diff --git a/.yamllint b/.yamllint
index f893d85a..3d75f8a4 100644
--- a/.yamllint
+++ b/.yamllint
@@ -2,3 +2,6 @@
 extends: default
 rules:
   line-length: {max: 1024}
+  new-lines:
+    type: platform
+  new-line-at-end-of-file: enable
diff --git a/NOTICE.txt b/NOTICE.txt
new file mode 100644
index 00000000..65d7df0f
--- /dev/null
+++ b/NOTICE.txt
@@ -0,0 +1,1806 @@
+OSPO_MAX78000_78002_Neural_Net_ML_ai8x-synthesis develop
+Copyright 2023 Analog Devices, Inc.
+
+The main license for this software is identified in the LICENSE file.
+
+This product includes third party IP identified below:
+
+Components:
+
+ CMSIS-NN cb192d7bac2386982c3ae6e9acc3e4a1bb8c9824 : Apache License 2.0
+OpenOCD 0.12.0 : (MIT License AND GPL-2.0-or-later WITH eCos-exception-2.0 AND BSD 2-clause "Simplified" License AND GNU General Public License v3.0 only AND BSD Source Code Attribution AND BSD 1-Clause License AND BSD 3-clause "New" or "Revised" License AND GNU General Public License v2.0 or later AND GNU Free Documentation License v1.2 or later)
+
+Licenses:
+
+--------------------------------------------------------------------------------
+ CMSIS-NN cb192d7bac2386982c3ae6e9acc3e4a1bb8c9824
+License: Apache License 2.0
+Origin: https://github.com/ARM-software/CMSIS-NN/tree/main
+
+
+
+License: Apache License 2.0
+SPDX-License-Identifier: Apache-2.0
+Apache License
+Version 2.0, January 2004
+=========================
+
+
+http://www.apache.org/licenses/
+
+TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+1. Definitions.
+
+"License" shall mean the terms and conditions for use, reproduction, and
+distribution as defined by Sections 1 through 9 of this document.
+
+"Licensor" shall mean the copyright owner or entity authorized by the copyright
+owner that is granting the License.
+
+"Legal Entity" shall mean the union of the acting entity and all other entities
+that control, are controlled by, or are under common control with that entity.
+For the purposes of this definition, "control" means (i) the power, direct or
+indirect, to cause the direction or management of such entity, whether by
+contract or otherwise, or (ii) ownership of fifty percent (50%) or more of the
+outstanding shares, or (iii) beneficial ownership of such entity.
+
+"You" (or "Your") shall mean an individual or Legal Entity exercising permissions
+granted by this License.
+
+"Source" form shall mean the preferred form for making modifications, including
+but not limited to software source code, documentation source, and configuration
+files.
+
+"Object" form shall mean any form resulting from mechanical transformation or
+translation of a Source form, including but not limited to compiled object code,
+generated documentation, and conversions to other media types.
+
+"Work" shall mean the work of authorship, whether in Source or Object form, made
+available under the License, as indicated by a copyright notice that is included
+in or attached to the work (an example is provided in the Appendix below).
+
+"Derivative Works" shall mean any work, whether in Source or Object form, that is
+based on (or derived from) the Work and for which the editorial revisions,
+annotations, elaborations, or other modifications represent, as a whole, an
+original work of authorship. For the purposes of this License, Derivative Works
+shall not include works that remain separable from, or merely link (or bind by
+name) to the interfaces of, the Work and Derivative Works thereof.
+
+"Contribution" shall mean any work of authorship, including the original version
+of the Work and any modifications or additions to that Work or Derivative Works
+thereof, that is intentionally submitted to Licensor for inclusion in the Work by
+the copyright owner or by an individual or Legal Entity authorized to submit on
+behalf of the copyright owner. For the purposes of this definition, "submitted"
+means any form of electronic, verbal, or written communication sent to the
+Licensor or its representatives, including but not limited to communication on
+electronic mailing lists, source code control systems, and issue tracking systems
+that are managed by, or on behalf of, the Licensor for the purpose of discussing
+and improving the Work, but excluding communication that is conspicuously marked
+or otherwise designated in writing by the copyright owner as "Not a
+Contribution."
+
+"Contributor" shall mean Licensor and any individual or Legal Entity on behalf of
+whom a Contribution has been received by Licensor and subsequently incorporated
+within the Work.
+
+2. Grant of Copyright License. Subject to the terms and conditions of this
+License, each Contributor hereby grants to You a perpetual, worldwide,
+non-exclusive, no-charge, royalty-free, irrevocable copyright license to
+reproduce, prepare Derivative Works of, publicly display, publicly perform,
+sublicense, and distribute the Work and such Derivative Works in Source or Object
+form.
+
+3. Grant of Patent License. Subject to the terms and conditions of this License,
+each Contributor hereby grants to You a perpetual, worldwide, non-exclusive,
+no-charge, royalty-free, irrevocable (except as stated in this section) patent
+license to make, have made, use, offer to sell, sell, import, and otherwise
+transfer the Work, where such license applies only to those patent claims
+licensable by such Contributor that are necessarily infringed by their
+Contribution(s) alone or by combination of their Contribution(s) with the Work to
+which such Contribution(s) was submitted. If You institute patent litigation
+against any entity (including a cross-claim or counterclaim in a lawsuit)
+alleging that the Work or a Contribution incorporated within the Work constitutes
+direct or contributory patent infringement, then any patent licenses granted to
+You under this License for that Work shall terminate as of the date such
+litigation is filed.
+
+4. Redistribution. You may reproduce and distribute copies of the Work or
+Derivative Works thereof in any medium, with or without modifications, and in
+Source or Object form, provided that You meet the following conditions:
+
+  a. You must give any other recipients of the Work or Derivative Works a copy of
+    this License; and
+
+  b. You must cause any modified files to carry prominent notices stating that
+    You changed the files; and
+
+  c. You must retain, in the Source form of any Derivative Works that You
+    distribute, all copyright, patent, trademark, and attribution notices from
+    the Source form of the Work, excluding those notices that do not pertain to
+    any part of the Derivative Works; and
+
+  d. If the Work includes a "NOTICE" text file as part of its distribution, then
+    any Derivative Works that You distribute must include a readable copy of the
+    attribution notices contained within such NOTICE file, excluding those
+    notices that do not pertain to any part of the Derivative Works, in at least
+    one of the following places: within a NOTICE text file distributed as part of
+    the Derivative Works; within the Source form or documentation, if provided
+    along with the Derivative Works; or, within a display generated by the
+    Derivative Works, if and wherever such third-party notices normally appear.
+    The contents of the NOTICE file are for informational purposes only and do
+    not modify the License. You may add Your own attribution notices within
+    Derivative Works that You distribute, alongside or as an addendum to the
+    NOTICE text from the Work, provided that such additional attribution notices
+    cannot be construed as modifying the License.
+
+You may add Your own copyright statement to Your modifications and may provide
+additional or different license terms and conditions for use, reproduction, or
+distribution of Your modifications, or for any such Derivative Works as a whole,
+provided Your use, reproduction, and distribution of the Work otherwise complies
+with the conditions stated in this License.
+
+5. Submission of Contributions. Unless You explicitly state otherwise, any
+Contribution intentionally submitted for inclusion in the Work by You to the
+Licensor shall be under the terms and conditions of this License, without any
+additional terms or conditions. Notwithstanding the above, nothing herein shall
+supersede or modify the terms of any separate license agreement you may have
+executed with Licensor regarding such Contributions.
+
+6. Trademarks. This License does not grant permission to use the trade names,
+trademarks, service marks, or product names of the Licensor, except as required
+for reasonable and customary use in describing the origin of the Work and
+reproducing the content of the NOTICE file.
+
+7. Disclaimer of Warranty. Unless required by applicable law or agreed to in
+writing, Licensor provides the Work (and each Contributor provides its
+Contributions) on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
+either express or implied, including, without limitation, any warranties or
+conditions of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+PARTICULAR PURPOSE. You are solely responsible for determining the
+appropriateness of using or redistributing the Work and assume any risks
+associated with Your exercise of permissions under this License.
+
+8. Limitation of Liability. In no event and under no legal theory, whether in
+tort (including negligence), contract, or otherwise, unless required by
+applicable law (such as deliberate and grossly negligent acts) or agreed to in
+writing, shall any Contributor be liable to You for damages, including any
+direct, indirect, special, incidental, or consequential damages of any character
+arising as a result of this License or out of the use or inability to use the
+Work (including but not limited to damages for loss of goodwill, work stoppage,
+computer failure or malfunction, or any and all other commercial damages or
+losses), even if such Contributor has been advised of the possibility of such
+damages.
+
+9. Accepting Warranty or Additional Liability. While redistributing the Work or
+Derivative Works thereof, You may choose to offer, and charge a fee for,
+acceptance of support, warranty, indemnity, or other liability obligations and/or
+rights consistent with this License. However, in accepting such obligations, You
+may act only on Your own behalf and on Your sole responsibility, not on behalf of
+any other Contributor, and only if You agree to indemnify, defend, and hold each
+Contributor harmless for any liability incurred by, or claims asserted against,
+such Contributor by reason of your accepting any such warranty or additional
+liability.
+
+END OF TERMS AND CONDITIONS
+
+APPENDIX: How to apply the Apache License to your work
+
+To apply the Apache License to your work, attach the following boilerplate
+notice, with the fields enclosed by brackets "[]" replaced with your own
+identifying information. (Don't include the brackets!) The text should be
+enclosed in the appropriate comment syntax for the file format. We also recommend
+that a file or class name and description of purpose be included on the same
+"printed page" as the copyright notice for easier identification within
+third-party archives.
+
+  Copyright [yyyy] [name of copyright owner] Licensed under the Apache License,
+  Version 2.0 (the "License"); you may not use this file except in compliance
+  with the License. You may obtain a copy of the License at
+  http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law
+  or agreed to in writing, software distributed under the License is
+  distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+  KIND, either express or implied. See the License for the specific language
+  governing permissions and limitations under the License.
+
+
+--------------------------------------------------------------------------------
+OpenOCD 0.12.0
+License: (MIT License AND GPL-2.0-or-later WITH eCos-exception-2.0 AND BSD 2-clause "Simplified" License AND GNU General Public License v3.0 only AND BSD Source Code Attribution AND BSD 1-Clause License AND BSD 3-clause "New" or "Revised" License AND GNU General Public License v2.0 or later AND GNU Free Documentation License v1.2 or later)
+Origin: https://packagehub.suse.com/packages/openocd-data
+
+
+
+License: MIT License
+SPDX-License-Identifier: MIT
+The MIT License
+===============
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of
+this software and associated documentation files (the "Software"), to deal in the
+Software without restriction, including without limitation the rights to use,
+copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the
+Software, and to permit persons to whom the Software is furnished to do so,
+subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS
+FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
+COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN
+AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION
+WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
+
+License: GPL-2.0-or-later WITH eCos-exception-2.0
+eCos exception 2.0
+================
+As a special exception, if other files instantiate templates or use macros or inline functions from this file, or you compile this file and link it with other works to produce a work based on this file, this file does not by itself cause the resulting work to be covered by the GNU General Public License. However the source code for this file must still be made available in accordance with section (3) of the GNU General Public License.
+
+This exception does not invalidate any other reasons why a work based on this file might be covered by the GNU General Public License.
+
+GNU GENERAL PUBLIC LICENSE
+Version 2, June 1991
+
+Copyright (C) 1989, 1991 Free Software Foundation, Inc.  
+51 Franklin Street, Fifth Floor, Boston, MA  02110-1301, USA
+
+Everyone is permitted to copy and distribute verbatim copies
+of this license document, but changing it is not allowed.
+Preamble
+The licenses for most software are designed to take away your freedom to share and change it. By contrast, the GNU General Public License is intended to guarantee your freedom to share and change free software--to make sure the software is free for all its users. This General Public License applies to most of the Free Software Foundation's software and to any other program whose authors commit to using it. (Some other Free Software Foundation software is covered by the GNU Lesser General Public License instead.) You can apply it to your programs, too.
+
+When we speak of free software, we are referring to freedom, not price. Our General Public Licenses are designed to make sure that you have the freedom to distribute copies of free software (and charge for this service if you wish), that you receive source code or can get it if you want it, that you can change the software or use pieces of it in new free programs; and that you know you can do these things.
+
+To protect your rights, we need to make restrictions that forbid anyone to deny you these rights or to ask you to surrender the rights. These restrictions translate to certain responsibilities for you if you distribute copies of the software, or if you modify it.
+
+For example, if you distribute copies of such a program, whether gratis or for a fee, you must give the recipients all the rights that you have. You must make sure that they, too, receive or can get the source code. And you must show them these terms so they know their rights.
+
+We protect your rights with two steps: (1) copyright the software, and (2) offer you this license which gives you legal permission to copy, distribute and/or modify the software.
+
+Also, for each author's protection and ours, we want to make certain that everyone understands that there is no warranty for this free software. If the software is modified by someone else and passed on, we want its recipients to know that what they have is not the original, so that any problems introduced by others will not reflect on the original authors' reputations.
+
+Finally, any free program is threatened constantly by software patents. We wish to avoid the danger that redistributors of a free program will individually obtain patent licenses, in effect making the program proprietary. To prevent this, we have made it clear that any patent must be licensed for everyone's free use or not licensed at all.
+
+The precise terms and conditions for copying, distribution and modification follow.
+
+TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
+0. This License applies to any program or other work which contains a notice placed by the copyright holder saying it may be distributed under the terms of this General Public License. The "Program", below, refers to any such program or work, and a "work based on the Program" means either the Program or any derivative work under copyright law: that is to say, a work containing the Program or a portion of it, either verbatim or with modifications and/or translated into another language. (Hereinafter, translation is included without limitation in the term "modification".) Each licensee is addressed as "you".
+
+Activities other than copying, distribution and modification are not covered by this License; they are outside its scope. The act of running the Program is not restricted, and the output from the Program is covered only if its contents constitute a work based on the Program (independent of having been made by running the Program). Whether that is true depends on what the Program does.
+
+1. You may copy and distribute verbatim copies of the Program's source code as you receive it, in any medium, provided that you conspicuously and appropriately publish on each copy an appropriate copyright notice and disclaimer of warranty; keep intact all the notices that refer to this License and to the absence of any warranty; and give any other recipients of the Program a copy of this License along with the Program.
+
+You may charge a fee for the physical act of transferring a copy, and you may at your option offer warranty protection in exchange for a fee.
+
+2. You may modify your copy or copies of the Program or any portion of it, thus forming a work based on the Program, and copy and distribute such modifications or work under the terms of Section 1 above, provided that you also meet all of these conditions:
+
+a) You must cause the modified files to carry prominent notices stating that you changed the files and the date of any change.
+b) You must cause any work that you distribute or publish, that in whole or in part contains or is derived from the Program or any part thereof, to be licensed as a whole at no charge to all third parties under the terms of this License.
+c) If the modified program normally reads commands interactively when run, you must cause it, when started running for such interactive use in the most ordinary way, to print or display an announcement including an appropriate copyright notice and a notice that there is no warranty (or else, saying that you provide a warranty) and that users may redistribute the program under these conditions, and telling the user how to view a copy of this License. (Exception: if the Program itself is interactive but does not normally print such an announcement, your work based on the Program is not required to print an announcement.)
+These requirements apply to the modified work as a whole. If identifiable sections of that work are not derived from the Program, and can be reasonably considered independent and separate works in themselves, then this License, and its terms, do not apply to those sections when you distribute them as separate works. But when you distribute the same sections as part of a whole which is a work based on the Program, the distribution of the whole must be on the terms of this License, whose permissions for other licensees extend to the entire whole, and thus to each and every part regardless of who wrote it.
+
+Thus, it is not the intent of this section to claim rights or contest your rights to work written entirely by you; rather, the intent is to exercise the right to control the distribution of derivative or collective works based on the Program.
+
+In addition, mere aggregation of another work not based on the Program with the Program (or with a work based on the Program) on a volume of a storage or distribution medium does not bring the other work under the scope of this License.
+
+3. You may copy and distribute the Program (or a work based on it, under Section 2) in object code or executable form under the terms of Sections 1 and 2 above provided that you also do one of the following:
+
+a) Accompany it with the complete corresponding machine-readable source code, which must be distributed under the terms of Sections 1 and 2 above on a medium customarily used for software interchange; or,
+b) Accompany it with a written offer, valid for at least three years, to give any third party, for a charge no more than your cost of physically performing source distribution, a complete machine-readable copy of the corresponding source code, to be distributed under the terms of Sections 1 and 2 above on a medium customarily used for software interchange; or,
+c) Accompany it with the information you received as to the offer to distribute corresponding source code. (This alternative is allowed only for noncommercial distribution and only if you received the program in object code or executable form with such an offer, in accord with Subsection b above.)
+The source code for a work means the preferred form of the work for making modifications to it. For an executable work, complete source code means all the source code for all modules it contains, plus any associated interface definition files, plus the scripts used to control compilation and installation of the executable. However, as a special exception, the source code distributed need not include anything that is normally distributed (in either source or binary form) with the major components (compiler, kernel, and so on) of the operating system on which the executable runs, unless that component itself accompanies the executable.
+
+If distribution of executable or object code is made by offering access to copy from a designated place, then offering equivalent access to copy the source code from the same place counts as distribution of the source code, even though third parties are not compelled to copy the source along with the object code.
+
+4. You may not copy, modify, sublicense, or distribute the Program except as expressly provided under this License. Any attempt otherwise to copy, modify, sublicense or distribute the Program is void, and will automatically terminate your rights under this License. However, parties who have received copies, or rights, from you under this License will not have their licenses terminated so long as such parties remain in full compliance.
+
+5. You are not required to accept this License, since you have not signed it. However, nothing else grants you permission to modify or distribute the Program or its derivative works. These actions are prohibited by law if you do not accept this License. Therefore, by modifying or distributing the Program (or any work based on the Program), you indicate your acceptance of this License to do so, and all its terms and conditions for copying, distributing or modifying the Program or works based on it.
+
+6. Each time you redistribute the Program (or any work based on the Program), the recipient automatically receives a license from the original licensor to copy, distribute or modify the Program subject to these terms and conditions. You may not impose any further restrictions on the recipients' exercise of the rights granted herein. You are not responsible for enforcing compliance by third parties to this License.
+
+7. If, as a consequence of a court judgment or allegation of patent infringement or for any other reason (not limited to patent issues), conditions are imposed on you (whether by court order, agreement or otherwise) that contradict the conditions of this License, they do not excuse you from the conditions of this License. If you cannot distribute so as to satisfy simultaneously your obligations under this License and any other pertinent obligations, then as a consequence you may not distribute the Program at all. For example, if a patent license would not permit royalty-free redistribution of the Program by all those who receive copies directly or indirectly through you, then the only way you could satisfy both it and this License would be to refrain entirely from distribution of the Program.
+
+If any portion of this section is held invalid or unenforceable under any particular circumstance, the balance of the section is intended to apply and the section as a whole is intended to apply in other circumstances.
+
+It is not the purpose of this section to induce you to infringe any patents or other property right claims or to contest validity of any such claims; this section has the sole purpose of protecting the integrity of the free software distribution system, which is implemented by public license practices. Many people have made generous contributions to the wide range of software distributed through that system in reliance on consistent application of that system; it is up to the author/donor to decide if he or she is willing to distribute software through any other system and a licensee cannot impose that choice.
+
+This section is intended to make thoroughly clear what is believed to be a consequence of the rest of this License.
+
+8. If the distribution and/or use of the Program is restricted in certain countries either by patents or by copyrighted interfaces, the original copyright holder who places the Program under this License may add an explicit geographical distribution limitation excluding those countries, so that distribution is permitted only in or among countries not thus excluded. In such case, this License incorporates the limitation as if written in the body of this License.
+
+9. The Free Software Foundation may publish revised and/or new versions of the General Public License from time to time. Such new versions will be similar in spirit to the present version, but may differ in detail to address new problems or concerns.
+
+Each version is given a distinguishing version number. If the Program specifies a version number of this License which applies to it and "any later version", you have the option of following the terms and conditions either of that version or of any later version published by the Free Software Foundation. If the Program does not specify a version number of this License, you may choose any version ever published by the Free Software Foundation.
+
+10. If you wish to incorporate parts of the Program into other free programs whose distribution conditions are different, write to the author to ask for permission. For software which is copyrighted by the Free Software Foundation, write to the Free Software Foundation; we sometimes make exceptions for this. Our decision will be guided by the two goals of preserving the free status of all derivatives of our free software and of promoting the sharing and reuse of software generally.
+
+NO WARRANTY
+
+11. BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
+
+12. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
+
+END OF TERMS AND CONDITIONS
+How to Apply These Terms to Your New Programs
+If you develop a new program, and you want it to be of the greatest possible use to the public, the best way to achieve this is to make it free software which everyone can redistribute and change under these terms.
+
+To do so, attach the following notices to the program. It is safest to attach them to the start of each source file to most effectively convey the exclusion of warranty; and each file should have at least the "copyright" line and a pointer to where the full notice is found.
+
+one line to give the program's name and an idea of what it does.
+Copyright (C) yyyy  name of author
+
+This program is free software; you can redistribute it and/or
+modify it under the terms of the GNU General Public License
+as published by the Free Software Foundation; either version 2
+of the License, or (at your option) any later version.
+
+This program is distributed in the hope that it will be useful,
+but WITHOUT ANY WARRANTY; without even the implied warranty of
+MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+GNU General Public License for more details.
+
+You should have received a copy of the GNU General Public License
+along with this program; if not, write to the Free Software
+Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA  02110-1301, USA.
+Also add information on how to contact you by electronic and paper mail.
+
+If the program is interactive, make it output a short notice like this when it starts in an interactive mode:
+
+Gnomovision version 69, Copyright (C) year name of author
+Gnomovision comes with ABSOLUTELY NO WARRANTY; for details
+type `show w'.  This is free software, and you are welcome
+to redistribute it under certain conditions; type `show c' 
+for details.
+The hypothetical commands `show w' and `show c' should show the appropriate parts of the General Public License. Of course, the commands you use may be called something other than `show w' and `show c'; they could even be mouse-clicks or menu items--whatever suits your program.
+
+You should also get your employer (if you work as a programmer) or your school, if any, to sign a "copyright disclaimer" for the program, if necessary. Here is a sample; alter the names:
+
+Yoyodyne, Inc., hereby disclaims all copyright
+interest in the program `Gnomovision'
+(which makes passes at compilers) written 
+by James Hacker.
+
+signature of Ty Coon, 1 April 1989
+Ty Coon, President of Vice
+This General Public License does not permit incorporating your program into proprietary programs. If your program is a subroutine library, you may consider it more useful to permit linking proprietary applications with the library. If this is what you want to do, use the GNU Lesser General Public License instead of this License.
+
+License: BSD 2-clause "Simplified" License
+SPDX-License-Identifier: BSD-2-Clause
+BSD Two Clause License
+======================
+
+Redistribution and use in source and binary forms, with or without modification,
+are permitted provided that the following conditions are met:
+
+  1. Redistributions of source code must retain the above copyright notice, this
+    list of conditions and the following disclaimer.
+
+  2. Redistributions in binary form must reproduce the above copyright notice,
+    this list of conditions and the following disclaimer in the documentation
+    and/or other materials provided with the distribution.
+
+THIS SOFTWARE IS PROVIDED BY THE AUTHOR "AS IS" AND ANY EXPRESS OR IMPLIED
+WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
+MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT
+SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
+EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT
+OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
+INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
+STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
+OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
+DAMAGE.
+
+License: GNU General Public License v3.0 only
+SPDX-License-Identifier: GPL-3.0
+"This program is free software: you can redistribute it and/or modify it under
+the terms of version 3 of the GNU General Public License as published by the Free
+Software Foundation."
+
+
+
+GNU GENERAL PUBLIC LICENSE
+==========================
+
+Version 3, 29 June 2007
+
+Copyright (C) 2007 Free Software Foundation, Inc. <http://fsf.org/>
+
+Everyone is permitted to copy and distribute verbatim copies of this license
+document, but changing it is not allowed.
+
+
+Preamble
+
+The GNU General Public License is a free, copyleft license for software and other
+kinds of works.
+
+The licenses for most software and other practical works are designed to take
+away your freedom to share and change the works. By contrast, the GNU General
+Public License is intended to guarantee your freedom to share and change all
+versions of a program--to make sure it remains free software for all its users.
+We, the Free Software Foundation, use the GNU General Public License for most of
+our software; it applies also to any other work released this way by its authors.
+You can apply it to your programs, too.
+
+When we speak of free software, we are referring to freedom, not price. Our
+General Public Licenses are designed to make sure that you have the freedom to
+distribute copies of free software (and charge for them if you wish), that you
+receive source code or can get it if you want it, that you can change the
+software or use pieces of it in new free programs, and that you know you can do
+these things.
+
+To protect your rights, we need to prevent others from denying you these rights
+or asking you to surrender the rights. Therefore, you have certain
+responsibilities if you distribute copies of the software, or if you modify it:
+responsibilities to respect the freedom of others.
+
+For example, if you distribute copies of such a program, whether gratis or for a
+fee, you must pass on to the recipients the same freedoms that you received. You
+must make sure that they, too, receive or can get the source code. And you must
+show them these terms so they know their rights.
+
+Developers that use the GNU GPL protect your rights with two steps: (1) assert
+copyright on the software, and (2) offer you this License giving you legal
+permission to copy, distribute and/or modify it.
+
+For the developers' and authors' protection, the GPL clearly explains that there
+is no warranty for this free software. For both users' and authors' sake, the GPL
+requires that modified versions be marked as changed, so that their problems will
+not be attributed erroneously to authors of previous versions.
+
+Some devices are designed to deny users access to install or run modified
+versions of the software inside them, although the manufacturer can do so. This
+is fundamentally incompatible with the aim of protecting users' freedom to change
+the software. The systematic pattern of such abuse occurs in the area of products
+for individuals to use, which is precisely where it is most unacceptable.
+Therefore, we have designed this version of the GPL to prohibit the practice for
+those products. If such problems arise substantially in other domains, we stand
+ready to extend this provision to those domains in future versions of the GPL, as
+needed to protect the freedom of users.
+
+Finally, every program is threatened constantly by software patents. States
+should not allow patents to restrict development and use of software on
+general-purpose computers, but in those that do, we wish to avoid the special
+danger that patents applied to a free program could make it effectively
+proprietary. To prevent this, the GPL assures that patents cannot be used to
+render the program non-free.
+
+The precise terms and conditions for copying, distribution and modification
+follow.
+
+
+TERMS AND CONDITIONS
+
+0. Definitions.
+
+"This License" refers to version 3 of the GNU General Public License.
+
+"Copyright" also means copyright-like laws that apply to other kinds of works,
+such as semiconductor masks.
+
+"The Program" refers to any copyrightable work licensed under this License. Each
+licensee is addressed as "you". "Licensees" and "recipients" may be individuals
+or organizations.
+
+To "modify" a work means to copy from or adapt all or part of the work in a
+fashion requiring copyright permission, other than the making of an exact copy.
+The resulting work is called a "modified version" of the earlier work or a work
+"based on" the earlier work.
+
+A "covered work" means either the unmodified Program or a work based on the
+Program.
+
+To "propagate" a work means to do anything with it that, without permission,
+would make you directly or secondarily liable for infringement under applicable
+copyright law, except executing it on a computer or modifying a private copy.
+Propagation includes copying, distribution (with or without modification), making
+available to the public, and in some countries other activities as well.
+
+To "convey" a work means any kind of propagation that enables other parties to
+make or receive copies. Mere interaction with a user through a computer network,
+with no transfer of a copy, is not conveying.
+
+An interactive user interface displays "Appropriate Legal Notices" to the extent
+that it includes a convenient and prominently visible feature that (1) displays
+an appropriate copyright notice, and (2) tells the user that there is no warranty
+for the work (except to the extent that warranties are provided), that licensees
+may convey the work under this License, and how to view a copy of this License.
+If the interface presents a list of user commands or options, such as a menu, a
+prominent item in the list meets this criterion.
+
+1. Source Code.
+
+The "source code" for a work means the preferred form of the work for making
+modifications to it. "Object code" means any non-source form of a work.
+
+A "Standard Interface" means an interface that either is an official standard
+defined by a recognized standards body, or, in the case of interfaces specified
+for a particular programming language, one that is widely used among developers
+working in that language.
+
+The "System Libraries" of an executable work include anything, other than the
+work as a whole, that (a) is included in the normal form of packaging a Major
+Component, but which is not part of that Major Component, and (b) serves only to
+enable use of the work with that Major Component, or to implement a Standard
+Interface for which an implementation is available to the public in source code
+form. A "Major Component", in this context, means a major essential component
+(kernel, window system, and so on) of the specific operating system (if any) on
+which the executable work runs, or a compiler used to produce the work, or an
+object code interpreter used to run it.
+
+The "Corresponding Source" for a work in object code form means all the source
+code needed to generate, install, and (for an executable work) run the object
+code and to modify the work, including scripts to control those activities.
+However, it does not include the work's System Libraries, or general-purpose
+tools or generally available free programs which are used unmodified in
+performing those activities but which are not part of the work. For example,
+Corresponding Source includes interface definition files associated with source
+files for the work, and the source code for shared libraries and dynamically
+linked subprograms that the work is specifically designed to require, such as by
+intimate data communication or control flow between those subprograms and other
+parts of the work.
+
+The Corresponding Source need not include anything that users can regenerate
+automatically from other parts of the Corresponding Source.
+
+The Corresponding Source for a work in source code form is that same work.
+
+2. Basic Permissions.
+
+All rights granted under this License are granted for the term of copyright on
+the Program, and are irrevocable provided the stated conditions are met. This
+License explicitly affirms your unlimited permission to run the unmodified
+Program. The output from running a covered work is covered by this License only
+if the output, given its content, constitutes a covered work. This License
+acknowledges your rights of fair use or other equivalent, as provided by
+copyright law.
+
+You may make, run and propagate covered works that you do not convey, without
+conditions so long as your license otherwise remains in force. You may convey
+covered works to others for the sole purpose of having them make modifications
+exclusively for you, or provide you with facilities for running those works,
+provided that you comply with the terms of this License in conveying all material
+for which you do not control copyright. Those thus making or running the covered
+works for you must do so exclusively on your behalf, under your direction and
+control, on terms that prohibit them from making any copies of your copyrighted
+material outside their relationship with you.
+
+Conveying under any other circumstances is permitted solely under the conditions
+stated below. Sublicensing is not allowed; section 10 makes it unnecessary.
+
+3. Protecting Users' Legal Rights From Anti-Circumvention Law.
+
+No covered work shall be deemed part of an effective technological measure under
+any applicable law fulfilling obligations under article 11 of the WIPO copyright
+treaty adopted on 20 December 1996, or similar laws prohibiting or restricting
+circumvention of such measures.
+
+When you convey a covered work, you waive any legal power to forbid circumvention
+of technological measures to the extent such circumvention is effected by
+exercising rights under this License with respect to the covered work, and you
+disclaim any intention to limit operation or modification of the work as a means
+of enforcing, against the work's users, your or third parties' legal rights to
+forbid circumvention of technological measures.
+
+4. Conveying Verbatim Copies.
+
+You may convey verbatim copies of the Program's source code as you receive it, in
+any medium, provided that you conspicuously and appropriately publish on each
+copy an appropriate copyright notice; keep intact all notices stating that this
+License and any non-permissive terms added in accord with section 7 apply to the
+code; keep intact all notices of the absence of any warranty; and give all
+recipients a copy of this License along with the Program.
+
+You may charge any price or no price for each copy that you convey, and you may
+offer support or warranty protection for a fee.
+
+5. Conveying Modified Source Versions.
+
+You may convey a work based on the Program, or the modifications to produce it
+from the Program, in the form of source code under the terms of section 4,
+provided that you also meet all of these conditions:
+
+  * a) The work must carry prominent notices stating that you modified it, and
+    giving a relevant date.
+
+  * b) The work must carry prominent notices stating that it is released under
+    this License and any conditions added under section 7. This requirement
+    modifies the requirement in section 4 to "keep intact all notices".
+
+  * c) You must license the entire work, as a whole, under this License to anyone
+    who comes into possession of a copy. This License will therefore apply, along
+    with any applicable section 7 additional terms, to the whole of the work, and
+    all its parts, regardless of how they are packaged. This License gives no
+    permission to license the work in any other way, but it does not invalidate
+    such permission if you have separately received it.
+
+  * d) If the work has interactive user interfaces, each must display Appropriate
+    Legal Notices; however, if the Program has interactive interfaces that do not
+    display Appropriate Legal Notices, your work need not make them do so.
+
+A compilation of a covered work with other separate and independent works, which
+are not by their nature extensions of the covered work, and which are not
+combined with it such as to form a larger program, in or on a volume of a storage
+or distribution medium, is called an "aggregate" if the compilation and its
+resulting copyright are not used to limit the access or legal rights of the
+compilation's users beyond what the individual works permit. Inclusion of a
+covered work in an aggregate does not cause this License to apply to the other
+parts of the aggregate.
+
+6. Conveying Non-Source Forms.
+
+You may convey a covered work in object code form under the terms of sections 4
+and 5, provided that you also convey the machine-readable Corresponding Source
+under the terms of this License, in one of these ways:
+
+  * a) Convey the object code in, or embodied in, a physical product (including a
+    physical distribution medium), accompanied by the Corresponding Source fixed
+    on a durable physical medium customarily used for software interchange.
+
+  * b) Convey the object code in, or embodied in, a physical product (including a
+    physical distribution medium), accompanied by a written offer, valid for at
+    least three years and valid for as long as you offer spare parts or customer
+    support for that product model, to give anyone who possesses the object code
+    either (1) a copy of the Corresponding Source for all the software in the
+    product that is covered by this License, on a durable physical medium
+    customarily used for software interchange, for a price no more than your
+    reasonable cost of physically performing this conveying of source, or (2)
+    access to copy the Corresponding Source from a network server at no charge.
+
+  * c) Convey individual copies of the object code with a copy of the written
+    offer to provide the Corresponding Source. This alternative is allowed only
+    occasionally and noncommercially, and only if you received the object code
+    with such an offer, in accord with subsection 6b.
+
+  * d) Convey the object code by offering access from a designated place (gratis
+    or for a charge), and offer equivalent access to the Corresponding Source in
+    the same way through the same place at no further charge. You need not
+    require recipients to copy the Corresponding Source along with the object
+    code. If the place to copy the object code is a network server, the
+    Corresponding Source may be on a different server (operated by you or a third
+    party) that supports equivalent copying facilities, provided you maintain
+    clear directions next to the object code saying where to find the
+    Corresponding Source. Regardless of what server hosts the Corresponding
+    Source, you remain obligated to ensure that it is available for as long as
+    needed to satisfy these requirements.
+
+  * e) Convey the object code using peer-to-peer transmission, provided you
+    inform other peers where the object code and Corresponding Source of the work
+    are being offered to the general public at no charge under subsection 6d.
+
+A separable portion of the object code, whose source code is excluded from the
+Corresponding Source as a System Library, need not be included in conveying the
+object code work.
+
+A "User Product" is either (1) a "consumer product", which means any tangible
+personal property which is normally used for personal, family, or household
+purposes, or (2) anything designed or sold for incorporation into a dwelling. In
+determining whether a product is a consumer product, doubtful cases shall be
+resolved in favor of coverage. For a particular product received by a particular
+user, "normally used" refers to a typical or common use of that class of product,
+regardless of the status of the particular user or of the way in which the
+particular user actually uses, or expects or is expected to use, the product. A
+product is a consumer product regardless of whether the product has substantial
+commercial, industrial or non-consumer uses, unless such uses represent the only
+significant mode of use of the product.
+
+"Installation Information" for a User Product means any methods, procedures,
+authorization keys, or other information required to install and execute modified
+versions of a covered work in that User Product from a modified version of its
+Corresponding Source. The information must suffice to ensure that the continued
+functioning of the modified object code is in no case prevented or interfered
+with solely because modification has been made.
+
+If you convey an object code work under this section in, or with, or specifically
+for use in, a User Product, and the conveying occurs as part of a transaction in
+which the right of possession and use of the User Product is transferred to the
+recipient in perpetuity or for a fixed term (regardless of how the transaction is
+characterized), the Corresponding Source conveyed under this section must be
+accompanied by the Installation Information. But this requirement does not apply
+if neither you nor any third party retains the ability to install modified object
+code on the User Product (for example, the work has been installed in ROM).
+
+The requirement to provide Installation Information does not include a
+requirement to continue to provide support service, warranty, or updates for a
+work that has been modified or installed by the recipient, or for the User
+Product in which it has been modified or installed. Access to a network may be
+denied when the modification itself materially and adversely affects the
+operation of the network or violates the rules and protocols for communication
+across the network.
+
+Corresponding Source conveyed, and Installation Information provided, in accord
+with this section must be in a format that is publicly documented (and with an
+implementation available to the public in source code form), and must require no
+special password or key for unpacking, reading or copying.
+
+7. Additional Terms.
+
+"Additional permissions" are terms that supplement the terms of this License by
+making exceptions from one or more of its conditions. Additional permissions that
+are applicable to the entire Program shall be treated as though they were
+included in this License, to the extent that they are valid under applicable law.
+If additional permissions apply only to part of the Program, that part may be
+used separately under those permissions, but the entire Program remains governed
+by this License without regard to the additional permissions.
+
+When you convey a copy of a covered work, you may at your option remove any
+additional permissions from that copy, or from any part of it. (Additional
+permissions may be written to require their own removal in certain cases when you
+modify the work.) You may place additional permissions on material, added by you
+to a covered work, for which you have or can give appropriate copyright
+permission.
+
+Notwithstanding any other provision of this License, for material you add to a
+covered work, you may (if authorized by the copyright holders of that material)
+supplement the terms of this License with terms:
+
+  * a) Disclaiming warranty or limiting liability differently from the terms of
+    sections 15 and 16 of this License; or
+
+  * b) Requiring preservation of specified reasonable legal notices or author
+    attributions in that material or in the Appropriate Legal Notices displayed
+    by works containing it; or
+
+  * c) Prohibiting misrepresentation of the origin of that material, or requiring
+    that modified versions of such material be marked in reasonable ways as
+    different from the original version; or
+
+  * d) Limiting the use for publicity purposes of names of licensors or authors
+    of the material; or
+
+  * e) Declining to grant rights under trademark law for use of some trade names,
+    trademarks, or service marks; or
+
+  * f) Requiring indemnification of licensors and authors of that material by
+    anyone who conveys the material (or modified versions of it) with contractual
+    assumptions of liability to the recipient, for any liability that these
+    contractual assumptions directly impose on those licensors and authors.
+
+All other non-permissive additional terms are considered "further restrictions"
+within the meaning of section 10. If the Program as you received it, or any part
+of it, contains a notice stating that it is governed by this License along with a
+term that is a further restriction, you may remove that term. If a license
+document contains a further restriction but permits relicensing or conveying
+under this License, you may add to a covered work material governed by the terms
+of that license document, provided that the further restriction does not survive
+such relicensing or conveying.
+
+If you add terms to a covered work in accord with this section, you must place,
+in the relevant source files, a statement of the additional terms that apply to
+those files, or a notice indicating where to find the applicable terms.
+
+Additional terms, permissive or non-permissive, may be stated in the form of a
+separately written license, or stated as exceptions; the above requirements apply
+either way.
+
+8. Termination.
+
+You may not propagate or modify a covered work except as expressly provided under
+this License. Any attempt otherwise to propagate or modify it is void, and will
+automatically terminate your rights under this License (including any patent
+licenses granted under the third paragraph of section 11).
+
+However, if you cease all violation of this License, then your license from a
+particular copyright holder is reinstated (a) provisionally, unless and until the
+copyright holder explicitly and finally terminates your license, and (b)
+permanently, if the copyright holder fails to notify you of the violation by some
+reasonable means prior to 60 days after the cessation.
+
+Moreover, your license from a particular copyright holder is reinstated
+permanently if the copyright holder notifies you of the violation by some
+reasonable means, this is the first time you have received notice of violation of
+this License (for any work) from that copyright holder, and you cure the
+violation prior to 30 days after your receipt of the notice.
+
+Termination of your rights under this section does not terminate the licenses of
+parties who have received copies or rights from you under this License. If your
+rights have been terminated and not permanently reinstated, you do not qualify to
+receive new licenses for the same material under section 10.
+
+9. Acceptance Not Required for Having Copies.
+
+You are not required to accept this License in order to receive or run a copy of
+the Program. Ancillary propagation of a covered work occurring solely as a
+consequence of using peer-to-peer transmission to receive a copy likewise does
+not require acceptance. However, nothing other than this License grants you
+permission to propagate or modify any covered work. These actions infringe
+copyright if you do not accept this License. Therefore, by modifying or
+propagating a covered work, you indicate your acceptance of this License to do
+so.
+
+10. Automatic Licensing of Downstream Recipients.
+
+Each time you convey a covered work, the recipient automatically receives a
+license from the original licensors, to run, modify and propagate that work,
+subject to this License. You are not responsible for enforcing compliance by
+third parties with this License.
+
+An "entity transaction" is a transaction transferring control of an organization,
+or substantially all assets of one, or subdividing an organization, or merging
+organizations. If propagation of a covered work results from an entity
+transaction, each party to that transaction who receives a copy of the work also
+receives whatever licenses to the work the party's predecessor in interest had or
+could give under the previous paragraph, plus a right to possession of the
+Corresponding Source of the work from the predecessor in interest, if the
+predecessor has it or can get it with reasonable efforts.
+
+You may not impose any further restrictions on the exercise of the rights granted
+or affirmed under this License. For example, you may not impose a license fee,
+royalty, or other charge for exercise of rights granted under this License, and
+you may not initiate litigation (including a cross-claim or counterclaim in a
+lawsuit) alleging that any patent claim is infringed by making, using, selling,
+offering for sale, or importing the Program or any portion of it.
+
+11. Patents.
+
+A "contributor" is a copyright holder who authorizes use under this License of
+the Program or a work on which the Program is based. The work thus licensed is
+called the contributor's "contributor version".
+
+A contributor's "essential patent claims" are all patent claims owned or
+controlled by the contributor, whether already acquired or hereafter acquired,
+that would be infringed by some manner, permitted by this License, of making,
+using, or selling its contributor version, but do not include claims that would
+be infringed only as a consequence of further modification of the contributor
+version. For purposes of this definition, "control" includes the right to grant
+patent sublicenses in a manner consistent with the requirements of this License.
+
+Each contributor grants you a non-exclusive, worldwide, royalty-free patent
+license under the contributor's essential patent claims, to make, use, sell,
+offer for sale, import and otherwise run, modify and propagate the contents of
+its contributor version.
+
+In the following three paragraphs, a "patent license" is any express agreement or
+commitment, however denominated, not to enforce a patent (such as an express
+permission to practice a patent or covenant not to sue for patent infringement).
+To "grant" such a patent license to a party means to make such an agreement or
+commitment not to enforce a patent against the party.
+
+If you convey a covered work, knowingly relying on a patent license, and the
+Corresponding Source of the work is not available for anyone to copy, free of
+charge and under the terms of this License, through a publicly available network
+server or other readily accessible means, then you must either (1) cause the
+Corresponding Source to be so available, or (2) arrange to deprive yourself of
+the benefit of the patent license for this particular work, or (3) arrange, in a
+manner consistent with the requirements of this License, to extend the patent
+license to downstream recipients. "Knowingly relying" means you have actual
+knowledge that, but for the patent license, your conveying the covered work in a
+country, or your recipient's use of the covered work in a country, would infringe
+one or more identifiable patents in that country that you have reason to believe
+are valid.
+
+If, pursuant to or in connection with a single transaction or arrangement, you
+convey, or propagate by procuring conveyance of, a covered work, and grant a
+patent license to some of the parties receiving the covered work authorizing them
+to use, propagate, modify or convey a specific copy of the covered work, then the
+patent license you grant is automatically extended to all recipients of the
+covered work and works based on it.
+
+A patent license is "discriminatory" if it does not include within the scope of
+its coverage, prohibits the exercise of, or is conditioned on the non-exercise of
+one or more of the rights that are specifically granted under this License. You
+may not convey a covered work if you are a party to an arrangement with a third
+party that is in the business of distributing software, under which you make
+payment to the third party based on the extent of your activity of conveying the
+work, and under which the third party grants, to any of the parties who would
+receive the covered work from you, a discriminatory patent license (a) in
+connection with copies of the covered work conveyed by you (or copies made from
+those copies), or (b) primarily for and in connection with specific products or
+compilations that contain the covered work, unless you entered into that
+arrangement, or that patent license was granted, prior to 28 March 2007.
+
+Nothing in this License shall be construed as excluding or limiting any implied
+license or other defenses to infringement that may otherwise be available to you
+under applicable patent law.
+
+12. No Surrender of Others' Freedom.
+
+If conditions are imposed on you (whether by court order, agreement or otherwise)
+that contradict the conditions of this License, they do not excuse you from the
+conditions of this License. If you cannot convey a covered work so as to satisfy
+simultaneously your obligations under this License and any other pertinent
+obligations, then as a consequence you may not convey it at all. For example, if
+you agree to terms that obligate you to collect a royalty for further conveying
+from those to whom you convey the Program, the only way you could satisfy both
+those terms and this License would be to refrain entirely from conveying the
+Program.
+
+13. Use with the GNU Affero General Public License.
+
+Notwithstanding any other provision of this License, you have permission to link
+or combine any covered work with a work licensed under version 3 of the GNU
+Affero General Public License into a single combined work, and to convey the
+resulting work. The terms of this License will continue to apply to the part
+which is the covered work, but the special requirements of the GNU Affero General
+Public License, section 13, concerning interaction through a network will apply
+to the combination as such.
+
+14. Revised Versions of this License.
+
+The Free Software Foundation may publish revised and/or new versions of the GNU
+General Public License from time to time. Such new versions will be similar in
+spirit to the present version, but may differ in detail to address new problems
+or concerns.
+
+Each version is given a distinguishing version number. If the Program specifies
+that a certain numbered version of the GNU General Public License "or any later
+version" applies to it, you have the option of following the terms and conditions
+either of that numbered version or of any later version published by the Free
+Software Foundation. If the Program does not specify a version number of the GNU
+General Public License, you may choose any version ever published by the Free
+Software Foundation.
+
+If the Program specifies that a proxy can decide which future versions of the GNU
+General Public License can be used, that proxy's public statement of acceptance
+of a version permanently authorizes you to choose that version for the Program.
+
+Later license versions may give you additional or different permissions. However,
+no additional obligations are imposed on any author or copyright holder as a
+result of your choosing to follow a later version.
+
+15. Disclaimer of Warranty.
+
+THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW.
+EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER
+PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER
+EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
+MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE
+QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE
+DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
+
+16. Limitation of Liability.
+
+IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY
+COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS THE PROGRAM AS
+PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL,
+INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE
+THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED
+INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE
+PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY
+HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
+
+17. Interpretation of Sections 15 and 16.
+
+If the disclaimer of warranty and limitation of liability provided above cannot
+be given local legal effect according to their terms, reviewing courts shall
+apply local law that most closely approximates an absolute waiver of all civil
+liability in connection with the Program, unless a warranty or assumption of
+liability accompanies a copy of the Program in return for a fee.
+
+END OF TERMS AND CONDITIONS
+
+
+How to Apply These Terms to Your New Programs
+
+If you develop a new program, and you want it to be of the greatest possible use
+to the public, the best way to achieve this is to make it free software which
+everyone can redistribute and change under these terms.
+
+To do so, attach the following notices to the program. It is safest to attach
+them to the start of each source file to most effectively state the exclusion of
+warranty; and each file should have at least the "copyright" line and a pointer
+to where the full notice is found.
+
+    <one line to give the program's name and a brief idea of what it
+does.>
+    Copyright (C) <year>  <name of author>
+
+    This program is free software: you can redistribute it and/or modify
+    it under the terms of the GNU General Public License as published by
+    the Free Software Foundation, either version 3 of the License, or
+    (at your option) any later version.
+
+    This program is distributed in the hope that it will be useful,
+    but WITHOUT ANY WARRANTY; without even the implied warranty of
+    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+    GNU General Public License for more details.
+
+    You should have received a copy of the GNU General Public License
+    along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+Also add information on how to contact you by electronic and paper mail.
+
+If the program does terminal interaction, make it output a short notice like this
+when it starts in an interactive mode:
+
+    <program>  Copyright (C) <year>  <name of author>
+
+    This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
+    This is free software, and you are welcome to redistribute it
+    under certain conditions; type `show c' for details.
+
+The hypothetical commands `show w' and `show c' should show the appropriate parts
+of the General Public License. Of course, your program's commands might be
+different; for a GUI interface, you would use an "about box".
+
+You should also get your employer (if you work as a programmer) or school, if
+any, to sign a "copyright disclaimer" for the program, if necessary. For more
+information on this, and how to apply and follow the GNU GPL, see
+<http://www.gnu.org/licenses/>.
+
+The GNU General Public License does not permit incorporating your program into
+proprietary programs. If your program is a subroutine library, you may consider
+it more useful to permit linking proprietary applications with the library. If
+this is what you want to do, use the GNU Lesser General Public License instead of
+this License. But first, please read
+<http://www.gnu.org/philosophy/why-not-lgpl.html>.
+
+License: BSD Source Code Attribution
+SPDX-License-Identifier: BSD-Source-Code
+BSD Source Code Attribution
+===========================
+
+Redistribution and use of this software in source and binary forms, with or
+without modification, are permitted provided that the following conditions are
+met:
+
+  * Redistributions of source code must retain the above copyright notice, this
+    list of conditions and the following disclaimer.
+
+  * Neither the name of Deusty nor the names of its contributors may be used to
+    endorse or promote products derived from this software without specific prior
+    written permission of Deusty, LLC.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR
+ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS
+OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN
+IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+License: BSD 1-Clause License
+SPDX-License-Identifier: BSD-1-Clause
+BSD 1-Clause License
+====================
+
+Redistribution and use in source and binary forms, with or without modification,
+are permitted provided that the following conditions are met:
+
+  * Redistributions of source code must retain the above copyright notice, this
+list of conditions and the following disclaimer.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR
+ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS
+OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN
+IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+License: BSD 3-clause "New" or "Revised" License
+SPDX-License-Identifier: BSD-3-Clause
+
+Redistribution and use in source and binary forms, with or without modification,
+are permitted provided that the following conditions are met:
+
+  * Redistributions of source code must retain the above copyright notice, this
+    list of conditions and the following disclaimer.
+
+  * Redistributions in binary form must reproduce the above copyright notice,
+    this list of conditions and the following disclaimer in the documentation
+    and/or other materials provided with the distribution.
+
+  * Neither the name of the <ORGANIZATION> nor the names of its contributors may
+    be used to endorse or promote products derived from this software without
+    specific prior written permission.
+
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND
+ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
+WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR
+ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS
+OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
+NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN
+IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+License: GNU General Public License v2.0 or later
+SPDX-License-Identifier: GPL-2.0+
+The GNU General Public License (GPL)
+====================================
+
+
+Version 2, June 1991
+--------------------
+
+Copyright (C) 1989, 1991 Free Software Foundation, Inc.
+59 Temple Place, Suite 330, Boston, MA 02111-1307 USAEveryone is permitted to copy and distribute verbatim copies
+of this license document, but changing it is not allowed.
+
+Preamble
+
+The licenses for most software are designed to take away your freedom to share
+and change it. By contrast, the GNU General Public License is intended to
+guarantee your freedom to share and change free software--to make sure the
+software is free for all its users. This General Public License applies to most
+of the Free Software Foundation's software and to any other program whose authors
+commit to using it. (Some other Free Software Foundation software is covered by
+the GNU Library General Public License instead.) You can apply it to your
+programs, too.
+
+When we speak of free software, we are referring to freedom, not price. Our
+General Public Licenses are designed to make sure that you have the freedom to
+distribute copies of free software (and charge for this service if you wish),
+that you receive source code or can get it if you want it, that you can change
+the software or use pieces of it in new free programs; and that you know you can
+do these things.
+
+To protect your rights, we need to make restrictions that forbid anyone to deny
+you these rights or to ask you to surrender the rights. These restrictions
+translate to certain responsibilities for you if you distribute copies of the
+software, or if you modify it.
+
+For example, if you distribute copies of such a program, whether gratis or for a
+fee, you must give the recipients all the rights that you have. You must make
+sure that they, too, receive or can get the source code. And you must show them
+these terms so they know their rights.
+
+We protect your rights with two steps: (1) copyright the software, and (2) offer
+you this license which gives you legal permission to copy, distribute and/or
+modify the software.
+
+Also, for each author's protection and ours, we want to make certain that
+everyone understands that there is no warranty for this free software. If the
+software is modified by someone else and passed on, we want its recipients to
+know that what they have is not the original, so that any problems introduced by
+others will not reflect on the original authors' reputations.
+
+Finally, any free program is threatened constantly by software patents. We wish
+to avoid the danger that redistributors of a free program will individually
+obtain patent licenses, in effect making the program proprietary. To prevent
+this, we have made it clear that any patent must be licensed for everyone's free
+use or not licensed at all.
+
+The precise terms and conditions for copying, distribution and modification
+follow.
+
+TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
+
+  1.  This License applies to any program or other work which contains a notice
+    placed by the copyright holder saying it may be distributed under the terms
+    of this General Public License. The "Program", below, refers to any such
+    program or work, and a "work based on the Program" means either the Program
+    or any derivative work under copyright law: that is to say, a work containing
+    the Program or a portion of it, either verbatim or with modifications and/or
+    translated into another language. (Hereinafter, translation is included
+    without limitation in the term "modification".) Each licensee is addressed as
+    "you".
+
+    Activities other than copying, distribution and modification are not covered
+    by this License; they are outside its scope. The act of running the Program
+    is not restricted, and the output from the Program is covered only if its
+    contents constitute a work based on the Program (independent of having been
+    made by running the Program). Whether that is true depends on what the
+    Program does.
+
+  2. You may copy and distribute verbatim copies of the Program's source code as
+    you receive it, in any medium, provided that you conspicuously and
+    appropriately publish on each copy an appropriate copyright notice and
+    disclaimer of warranty; keep intact all the notices that refer to this
+    License and to the absence of any warranty; and give any other recipients of
+    the Program a copy of this License along with the Program.
+
+    You may charge a fee for the physical act of transferring a copy, and you may
+    at your option offer warranty protection in exchange for a fee.
+
+  3. You may modify your copy or copies of the Program or any portion of it, thus
+    forming a work based on the Program, and copy and distribute such
+    modifications or work under the terms of Section 1 above, provided that you
+    also meet all of these conditions:
+
+      a. You must cause the modified files to carry prominent notices stating
+        that you changed the files and the date of any change.
+
+      b. You must cause any work that you distribute or publish, that in whole or
+        in part contains or is derived from the Program or any part thereof, to
+        be licensed as a whole at no charge to all third parties under the terms
+        of this License.
+
+      c. If the modified program normally reads commands interactively when run,
+        you must cause it, when started running for such interactive use in the
+        most ordinary way, to print or display an announcement including an
+        appropriate copyright notice and a notice that there is no warranty (or
+        else, saying that you provide a warranty) and that users may redistribute
+        the program under these conditions, and telling the user how to view a
+        copy of this License. (Exception: if the Program itself is interactive
+        but does not normally print such an announcement, your work based on the
+        Program is not required to print an announcement.)
+
+    These requirements apply to the modified work as a whole. If identifiable
+    sections of that work are not derived from the Program, and can be reasonably
+    considered independent and separate works in themselves, then this License,
+    and its terms, do not apply to those sections when you distribute them as
+    separate works. But when you distribute the same sections as part of a whole
+    which is a work based on the Program, the distribution of the whole must be
+    on the terms of this License, whose permissions for other licensees extend to
+    the entire whole, and thus to each and every part regardless of who wrote it.
+
+    Thus, it is not the intent of this section to claim rights or contest your
+    rights to work written entirely by you; rather, the intent is to exercise the
+    right to control the distribution of derivative or collective works based on
+    the Program.
+
+    In addition, mere aggregation of another work not based on the Program with
+    the Program (or with a work based on the Program) on a volume of a storage or
+    distribution medium does not bring the other work under the scope of this
+    License.
+
+  4. You may copy and distribute the Program (or a work based on it, under
+    Section 2) in object code or executable form under the terms of Sections 1
+    and 2 above provided that you also do one of the following:
+
+      a. Accompany it with the complete corresponding machine-readable source
+        code, which must be distributed under the terms of Sections 1 and 2 above
+        on a medium customarily used for software interchange; or,
+
+      b. Accompany it with a written offer, valid for at least three years, to
+        give any third party, for a charge no more than your cost of physically
+        performing source distribution, a complete machine-readable copy of the
+        corresponding source code, to be distributed under the terms of Sections
+        1 and 2 above on a medium customarily used for software interchange; or,
+
+      c. Accompany it with the information you received as to the offer to
+        distribute corresponding source code. (This alternative is allowed only
+        for noncommercial distribution and only if you received the program in
+        object code or executable form with such an offer, in accord with
+        Subsection b above.)
+
+    The source code for a work means the preferred form of the work for making
+    modifications to it. For an executable work, complete source code means all
+    the source code for all modules it contains, plus any associated interface
+    definition files, plus the scripts used to control compilation and
+    installation of the executable. However, as a special exception, the source
+    code distributed need not include anything that is normally distributed (in
+    either source or binary form) with the major components (compiler, kernel,
+    and so on) of the operating system on which the executable runs, unless that
+    component itself accompanies the executable.
+
+    If distribution of executable or object code is made by offering access to
+    copy from a designated place, then offering equivalent access to copy the
+    source code from the same place counts as distribution of the source code,
+    even though third parties are not compelled to copy the source along with the
+    object code.
+
+  5. You may not copy, modify, sublicense, or distribute the Program except as
+    expressly provided under this License. Any attempt otherwise to copy, modify,
+    sublicense or distribute the Program is void, and will automatically
+    terminate your rights under this License. However, parties who have received
+    copies, or rights, from you under this License will not have their licenses
+    terminated so long as such parties remain in full compliance.
+
+  6. You are not required to accept this License, since you have not signed it.
+    However, nothing else grants you permission to modify or distribute the
+    Program or its derivative works. These actions are prohibited by law if you
+    do not accept this License. Therefore, by modifying or distributing the
+    Program (or any work based on the Program), you indicate your acceptance of
+    this License to do so, and all its terms and conditions for copying,
+    distributing or modifying the Program or works based on it.
+
+  7. Each time you redistribute the Program (or any work based on the Program),
+    the recipient automatically receives a license from the original licensor to
+    copy, distribute or modify the Program subject to these terms and conditions.
+    You may not impose any further restrictions on the recipients' exercise of
+    the rights granted herein. You are not responsible for enforcing compliance
+    by third parties to this License.
+
+  8. If, as a consequence of a court judgment or allegation of patent
+    infringement or for any other reason (not limited to patent issues),
+    conditions are imposed on you (whether by court order, agreement or
+    otherwise) that contradict the conditions of this License, they do not excuse
+    you from the conditions of this License. If you cannot distribute so as to
+    satisfy simultaneously your obligations under this License and any other
+    pertinent obligations, then as a consequence you may not distribute the
+    Program at all. For example, if a patent license would not permit
+    royalty-free redistribution of the Program by all those who receive copies
+    directly or indirectly through you, then the only way you could satisfy both
+    it and this License would be to refrain entirely from distribution of the
+    Program.
+
+    If any portion of this section is held invalid or unenforceable under any
+    particular circumstance, the balance of the section is intended to apply and
+    the section as a whole is intended to apply in other circumstances.
+
+    It is not the purpose of this section to induce you to infringe any patents
+    or other property right claims or to contest validity of any such claims;
+    this section has the sole purpose of protecting the integrity of the free
+    software distribution system, which is implemented by public license
+    practices. Many people have made generous contributions to the wide range of
+    software distributed through that system in reliance on consistent
+    application of that system; it is up to the author/donor to decide if he or
+    she is willing to distribute software through any other system and a licensee
+    cannot impose that choice.
+
+    This section is intended to make thoroughly clear what is believed to be a
+    consequence of the rest of this License.
+
+  9. If the distribution and/or use of the Program is restricted in certain
+    countries either by patents or by copyrighted interfaces, the original
+    copyright holder who places the Program under this License may add an
+    explicit geographical distribution limitation excluding those countries, so
+    that distribution is permitted only in or among countries not thus excluded.
+    In such case, this License incorporates the limitation as if written in the
+    body of this License.
+
+  10. The Free Software Foundation may publish revised and/or new versions of the
+    General Public License from time to time. Such new versions will be similar
+    in spirit to the present version, but may differ in detail to address new
+    problems or concerns.
+
+    Each version is given a distinguishing version number. If the Program
+    specifies a version number of this License which applies to it and "any later
+    version", you have the option of following the terms and conditions either of
+    that version or of any later version published by the Free Software
+    Foundation. If the Program does not specify a version number of this License,
+    you may choose any version ever published by the Free Software Foundation.
+
+  11. If you wish to incorporate parts of the Program into other free programs
+    whose distribution conditions are different, write to the author to ask for
+    permission. For software which is copyrighted by the Free Software
+    Foundation, write to the Free Software Foundation; we sometimes make
+    exceptions for this. Our decision will be guided by the two goals of
+    preserving the free status of all derivatives of our free software and of
+    promoting the sharing and reuse of software generally.
+
+    NO WARRANTY
+
+  12. BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR
+    THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE
+    STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE
+    PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED,
+    INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND
+    FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND
+    PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE,
+    YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
+
+  13. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL
+    ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE
+    THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
+    GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE
+    OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR
+    DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR
+    A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), EVEN IF SUCH
+    HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
+
+    END OF TERMS AND CONDITIONS
+
+How to Apply These Terms to Your New Programs
+
+If you develop a new program, and you want it to be of the greatest possible use
+to the public, the best way to achieve this is to make it free software which
+everyone can redistribute and change under these terms.
+
+To do so, attach the following notices to the program. It is safest to attach
+them to the start of each source file to most effectively convey the exclusion of
+warranty; and each file should have at least the "copyright" line and a pointer
+to where the full notice is found.
+
+one line to give the program's name and a brief idea of what it does.Copyright (C)
+
+This program is free software; you can redistribute it and/or
+modify it under the terms of the GNU General Public License
+as published by the Free Software Foundation; either version 2
+of the License, or (at your option) any later version.
+
+This program is distributed in the hope that it will be useful,
+but WITHOUT ANY WARRANTY; without even the implied warranty of
+MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+GNU General Public License for more details.
+
+You should have received a copy of the GNU General Public License
+along with this program; if not, write to the Free Software
+Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA
+
+Also add information on how to contact you by electronic and paper mail.
+
+If the program is interactive, make it output a short notice like this when it
+starts in an interactive mode:
+
+Gnomovision version 69, Copyright (C) year name of author
+Gnomovision comes with ABSOLUTELY NO WARRANTY; for details
+type `show w'. This is free software, and you are welcome
+to redistribute it under certain conditions; type `show c'
+for details.
+
+The hypothetical commands `show w' and `show c' should show the appropriate parts
+of the General Public License. Of course, the commands you use may be called
+something other than `show w' and `show c'; they could even be mouse-clicks or
+menu items--whatever suits your program.
+
+You should also get your employer (if you work as a programmer) or your school,
+if any, to sign a "copyright disclaimer" for the program, if necessary. Here is a
+sample; alter the names:
+
+Yoyodyne, Inc., hereby disclaims all copyright
+interest in the program `Gnomovision'
+(which makes passes at compilers) written
+by James Hacker.
+
+signature of Ty Coon, 1 April 1989
+Ty Coon, President of Vice
+
+This General Public License does not permit incorporating your program into
+proprietary programs. If your program is a subroutine library, you may consider
+it more useful to permit linking proprietary applications with the library. If
+this is what you want to do, use the GNU Library General Public License instead
+of this License.
+
+License: GNU Free Documentation License v1.2 or later
+SPDX-License-Identifier: GFDL-1.2-or-later
+GNU Free Documentation License
+==============================
+
+Version 1.2, November 2002
+
+  Copyright (C) 2000,2001,2002  Free Software Foundation, Inc.
+  51 Franklin St, Fifth Floor, Boston, MA  02110-1301  USA
+  Everyone is permitted to copy and distribute verbatim copies
+  of this license document, but changing it is not allowed.
+
+
+0. PREAMBLE
+
+The purpose of this License is to make a manual, textbook, or other functional
+and useful document "free" in the sense of freedom: to assure everyone the
+effective freedom to copy and redistribute it, with or without modifying it,
+either commercially or noncommercially. Secondarily, this License preserves for
+the author and publisher a way to get credit for their work, while not being
+considered responsible for modifications made by others.
+
+This License is a kind of "copyleft", which means that derivative works of the
+document must themselves be free in the same sense. It complements the GNU
+General Public License, which is a copyleft license designed for free software.
+
+We have designed this License in order to use it for manuals for free software,
+because free software needs free documentation: a free program should come with
+manuals providing the same freedoms that the software does. But this License is
+not limited to software manuals; it can be used for any textual work, regardless
+of subject matter or whether it is published as a printed book. We recommend this
+License principally for works whose purpose is instruction or reference.
+
+1. APPLICABILITY AND DEFINITIONS
+
+This License applies to any manual or other work, in any medium, that contains a
+notice placed by the copyright holder saying it can be distributed under the
+terms of this License. Such a notice grants a world-wide, royalty-free license,
+unlimited in duration, to use that work under the conditions stated herein. The
+"Document", below, refers to any such manual or work. Any member of the public is
+a licensee, and is addressed as "you". You accept the license if you copy, modify
+or distribute the work in a way requiring permission under copyright law.
+
+A "Modified Version" of the Document means any work containing the Document or a
+portion of it, either copied verbatim, or with modifications and/or translated
+into another language.
+
+A "Secondary Section" is a named appendix or a front-matter section of the
+Document that deals exclusively with the relationship of the publishers or
+authors of the Document to the Document's overall subject (or to related matters)
+and contains nothing that could fall directly within that overall subject. (Thus,
+if the Document is in part a textbook of mathematics, a Secondary Section may not
+explain any mathematics.) The relationship could be a matter of historical
+connection with the subject or with related matters, or of legal, commercial,
+philosophical, ethical or political position regarding them.
+
+The "Invariant Sections" are certain Secondary Sections whose titles are
+designated, as being those of Invariant Sections, in the notice that says that
+the Document is released under this License. If a section does not fit the above
+definition of Secondary then it is not allowed to be designated as Invariant. The
+Document may contain zero Invariant Sections. If the Document does not identify
+any Invariant Sections then there are none.
+
+The "Cover Texts" are certain short passages of text that are listed, as
+Front-Cover Texts or Back-Cover Texts, in the notice that says that the Document
+is released under this License. A Front-Cover Text may be at most 5 words, and a
+Back-Cover Text may be at most 25 words.
+
+A "Transparent" copy of the Document means a machine-readable copy, represented
+in a format whose specification is available to the general public, that is
+suitable for revising the document straightforwardly with generic text editors or
+(for images composed of pixels) generic paint programs or (for drawings) some
+widely available drawing editor, and that is suitable for input to text
+formatters or for automatic translation to a variety of formats suitable for
+input to text formatters. A copy made in an otherwise Transparent file format
+whose markup, or absence of markup, has been arranged to thwart or discourage
+subsequent modification by readers is not Transparent. An image format is not
+Transparent if used for any substantial amount of text. A copy that is not
+"Transparent" is called "Opaque".
+
+Examples of suitable formats for Transparent copies include plain ASCII without
+markup, Texinfo input format, LaTeX input format, SGML or XML using a publicly
+available DTD, and standard-conforming simple HTML, PostScript or PDF designed
+for human modification. Examples of transparent image formats include PNG, XCF
+and JPG. Opaque formats include proprietary formats that can be read and edited
+only by proprietary word processors, SGML or XML for which the DTD and/or
+processing tools are not generally available, and the machine-generated HTML,
+PostScript or PDF produced by some word processors for output purposes only.
+
+The "Title Page" means, for a printed book, the title page itself, plus such
+following pages as are needed to hold, legibly, the material this License
+requires to appear in the title page. For works in formats which do not have any
+title page as such, "Title Page" means the text near the most prominent
+appearance of the work's title, preceding the beginning of the body of the text.
+
+A section "Entitled XYZ" means a named subunit of the Document whose title either
+is precisely XYZ or contains XYZ in parentheses following text that translates
+XYZ in another language. (Here XYZ stands for a specific section name mentioned
+below, such as "Acknowledgements", "Dedications", "Endorsements", or "History".)
+To "Preserve the Title" of such a section when you modify the Document means that
+it remains a section "Entitled XYZ" according to this definition.
+
+The Document may include Warranty Disclaimers next to the notice which states
+that this License applies to the Document. These Warranty Disclaimers are
+considered to be included by reference in this License, but only as regards
+disclaiming warranties: any other implication that these Warranty Disclaimers may
+have is void and has no effect on the meaning of this License.
+
+2. VERBATIM COPYING
+
+You may copy and distribute the Document in any medium, either commercially or
+noncommercially, provided that this License, the copyright notices, and the
+license notice saying this License applies to the Document are reproduced in all
+copies, and that you add no other conditions whatsoever to those of this License.
+You may not use technical measures to obstruct or control the reading or further
+copying of the copies you make or distribute. However, you may accept
+compensation in exchange for copies. If you distribute a large enough number of
+copies you must also follow the conditions in section 3.
+
+You may also lend copies, under the same conditions stated above, and you may
+publicly display copies.
+
+3. COPYING IN QUANTITY
+
+If you publish printed copies (or copies in media that commonly have printed
+covers) of the Document, numbering more than 100, and the Document's license
+notice requires Cover Texts, you must enclose the copies in covers that carry,
+clearly and legibly, all these Cover Texts: Front-Cover Texts on the front cover,
+and Back-Cover Texts on the back cover. Both covers must also clearly and legibly
+identify you as the publisher of these copies. The front cover must present the
+full title with all words of the title equally prominent and visible. You may add
+other material on the covers in addition. Copying with changes limited to the
+covers, as long as they preserve the title of the Document and satisfy these
+conditions, can be treated as verbatim copying in other respects.
+
+If the required texts for either cover are too voluminous to fit legibly, you
+should put the first ones listed (as many as fit reasonably) on the actual cover,
+and continue the rest onto adjacent pages.
+
+If you publish or distribute Opaque copies of the Document numbering more than
+100, you must either include a machine-readable Transparent copy along with each
+Opaque copy, or state in or with each Opaque copy a computer-network location
+from which the general network-using public has access to download using
+public-standard network protocols a complete Transparent copy of the Document,
+free of added material. If you use the latter option, you must take reasonably
+prudent steps, when you begin distribution of Opaque copies in quantity, to
+ensure that this Transparent copy will remain thus accessible at the stated
+location until at least one year after the last time you distribute an Opaque
+copy (directly or through your agents or retailers) of that edition to the
+public.
+
+It is requested, but not required, that you contact the authors of the Document
+well before redistributing any large number of copies, to give them a chance to
+provide you with an updated version of the Document.
+
+4. MODIFICATIONS
+
+You may copy and distribute a Modified Version of the Document under the
+conditions of sections 2 and 3 above, provided that you release the Modified
+Version under precisely this License, with the Modified Version filling the role
+of the Document, thus licensing distribution and modification of the Modified
+Version to whoever possesses a copy of it. In addition, you must do these things
+in the Modified Version:
+
+  * A. Use in the Title Page (and on the covers, if any) a title distinct from
+    that of the Document, and from those of previous versions (which should, if
+    there were any, be listed in the History section of the Document). You may
+    use the same title as a previous version if the original publisher of that
+    version gives permission.
+
+  * B. List on the Title Page, as authors, one or more persons or entities
+    responsible for authorship of the modifications in the Modified Version,
+    together with at least five of the principal authors of the Document (all of
+    its principal authors, if it has fewer than five), unless they release you
+    from this requirement.
+
+  * C. State on the Title page the name of the publisher of the Modified Version,
+    as the publisher.
+
+  * D. Preserve all the copyright notices of the Document.
+
+  * E. Add an appropriate copyright notice for your modifications adjacent to the
+    other copyright notices.
+
+  * F. Include, immediately after the copyright notices, a license notice giving
+    the public permission to use the Modified Version under the terms of this
+    License, in the form shown in the Addendum below.
+
+  * G. Preserve in that license notice the full lists of Invariant Sections and
+    required Cover Texts given in the Document's license notice.
+
+  * H. Include an unaltered copy of this License.
+
+  * I. Preserve the section Entitled "History", Preserve its Title, and add to it
+    an item stating at least the title, year, new authors, and publisher of the
+    Modified Version as given on the Title Page. If there is no section Entitled
+    "History" in the Document, create one stating the title, year, authors, and
+    publisher of the Document as given on its Title Page, then add an item
+    describing the Modified Version as stated in the previous sentence.
+
+  * J. Preserve the network location, if any, given in the Document for public
+    access to a Transparent copy of the Document, and likewise the network
+    locations given in the Document for previous versions it was based on. These
+    may be placed in the "History" section. You may omit a network location for a
+    work that was published at least four years before the Document itself, or if
+    the original publisher of the version it refers to gives permission.
+
+  * K. For any section Entitled "Acknowledgements" or "Dedications", Preserve the
+    Title of the section, and preserve in the section all the substance and tone
+    of each of the contributor acknowledgements and/or dedications given therein.
+
+  * L. Preserve all the Invariant Sections of the Document, unaltered in their
+    text and in their titles. Section numbers or the equivalent are not
+    considered part of the section titles.
+
+  * M. Delete any section Entitled "Endorsements". Such a section may not be
+    included in the Modified Version.
+
+  * N. Do not retitle any existing section to be Entitled "Endorsements" or to
+    conflict in title with any Invariant Section.
+
+  * O. Preserve any Warranty Disclaimers.
+
+If the Modified Version includes new front-matter sections or appendices that
+qualify as Secondary Sections and contain no material copied from the Document,
+you may at your option designate some or all of these sections as invariant. To
+do this, add their titles to the list of Invariant Sections in the Modified
+Version's license notice. These titles must be distinct from any other section
+titles.
+
+You may add a section Entitled "Endorsements", provided it contains nothing but
+endorsements of your Modified Version by various parties--for example, statements
+of peer review or that the text has been approved by an organization as the
+authoritative definition of a standard.
+
+You may add a passage of up to five words as a Front-Cover Text, and a passage of
+up to 25 words as a Back-Cover Text, to the end of the list of Cover Texts in the
+Modified Version. Only one passage of Front-Cover Text and one of Back-Cover Text
+may be added by (or through arrangements made by) any one entity. If the Document
+already includes a cover text for the same cover, previously added by you or by
+arrangement made by the same entity you are acting on behalf of, you may not add
+another; but you may replace the old one, on explicit permission from the
+previous publisher that added the old one.
+
+The author(s) and publisher(s) of the Document do not by this License give
+permission to use their names for publicity for or to assert or imply endorsement
+of any Modified Version.
+
+5. COMBINING DOCUMENTS
+
+You may combine the Document with other documents released under this License,
+under the terms defined in section 4 above for modified versions, provided that
+you include in the combination all of the Invariant Sections of all of the
+original documents, unmodified, and list them all as Invariant Sections of your
+combined work in its license notice, and that you preserve all their Warranty
+Disclaimers.
+
+The combined work need only contain one copy of this License, and multiple
+identical Invariant Sections may be replaced with a single copy. If there are
+multiple Invariant Sections with the same name but different contents, make the
+title of each such section unique by adding at the end of it, in parentheses, the
+name of the original author or publisher of that section if known, or else a
+unique number. Make the same adjustment to the section titles in the list of
+Invariant Sections in the license notice of the combined work.
+
+In the combination, you must combine any sections Entitled "History" in the
+various original documents, forming one section Entitled "History"; likewise
+combine any sections Entitled "Acknowledgements", and any sections Entitled
+"Dedications". You must delete all sections Entitled "Endorsements."
+
+6. COLLECTIONS OF DOCUMENTS
+
+You may make a collection consisting of the Document and other documents released
+under this License, and replace the individual copies of this License in the
+various documents with a single copy that is included in the collection, provided
+that you follow the rules of this License for verbatim copying of each of the
+documents in all other respects.
+
+You may extract a single document from such a collection, and distribute it
+individually under this License, provided you insert a copy of this License into
+the extracted document, and follow this License in all other respects regarding
+verbatim copying of that document.
+
+7. AGGREGATION WITH INDEPENDENT WORKS
+
+A compilation of the Document or its derivatives with other separate and
+independent documents or works, in or on a volume of a storage or distribution
+medium, is called an "aggregate" if the copyright resulting from the compilation
+is not used to limit the legal rights of the compilation's users beyond what the
+individual works permit. When the Document is included in an aggregate, this
+License does not apply to the other works in the aggregate which are not
+themselves derivative works of the Document.
+
+If the Cover Text requirement of section 3 is applicable to these copies of the
+Document, then if the Document is less than one half of the entire aggregate, the
+Document's Cover Texts may be placed on covers that bracket the Document within
+the aggregate, or the electronic equivalent of covers if the Document is in
+electronic form. Otherwise they must appear on printed covers that bracket the
+whole aggregate.
+
+8. TRANSLATION
+
+Translation is considered a kind of modification, so you may distribute
+translations of the Document under the terms of section 4. Replacing Invariant
+Sections with translations requires special permission from their copyright
+holders, but you may include translations of some or all Invariant Sections in
+addition to the original versions of these Invariant Sections. You may include a
+translation of this License, and all the license notices in the Document, and any
+Warranty Disclaimers, provided that you also include the original English version
+of this License and the original versions of those notices and disclaimers. In
+case of a disagreement between the translation and the original version of this
+License or a notice or disclaimer, the original version will prevail.
+
+If a section in the Document is Entitled "Acknowledgements", "Dedications", or
+"History", the requirement (section 4) to Preserve its Title (section 1) will
+typically require changing the actual title.
+
+9. TERMINATION
+
+You may not copy, modify, sublicense, or distribute the Document except as
+expressly provided for under this License. Any other attempt to copy, modify,
+sublicense or distribute the Document is void, and will automatically terminate
+your rights under this License. However, parties who have received copies, or
+rights, from you under this License will not have their licenses terminated so
+long as such parties remain in full compliance.
+
+10. FUTURE REVISIONS OF THIS LICENSE
+
+The Free Software Foundation may publish new, revised versions of the GNU Free
+Documentation License from time to time. Such new versions will be similar in
+spirit to the present version, but may differ in detail to address new problems
+or concerns. See http://www.gnu.org/copyleft/.
+
+Each version of the License is given a distinguishing version number. If the
+Document specifies that a particular numbered version of this License "or any
+later version" applies to it, you have the option of following the terms and
+conditions either of that specified version or of any later version that has been
+published (not as a draft) by the Free Software Foundation. If the Document does
+not specify a version number of this License, you may choose any version ever
+published (not as a draft) by the Free Software Foundation.
+
+
+How to use this License for your documents
+
+To use this License in a document you have written, include a copy of the License
+in the document and put the following copyright and license notices just after
+the title page:
+
+  Copyright (c)  YEAR  YOUR NAME.
+  Permission is granted to copy, distribute and/or modify this document
+  under the terms of the GNU Free Documentation License, Version 1.2
+  or any later version published by the Free Software Foundation;
+  with no Invariant Sections, no Front-Cover Texts, and no Back-Cover
+  Texts.  A copy of the license is included in the section entitled "GNU
+  Free Documentation License".
+
+If you have Invariant Sections, Front-Cover Texts and Back-Cover Texts, replace
+the "with...Texts." line with this:
+
+  with the Invariant Sections being LIST THEIR TITLES, with the
+  Front-Cover Texts being LIST, and with the Back-Cover Texts being LIST.
+
+If you have Invariant Sections without Cover Texts, or some other combination of
+the three, merge those two alternatives to suit the situation.
+
+If your document contains nontrivial examples of program code, we recommend
+releasing these examples in parallel under your choice of free software license,
+such as the GNU General Public License, to permit their use in free software.
+
diff --git a/README.md b/README.md
index 8dbe7cf2..8a3161e6 100644
--- a/README.md
+++ b/README.md
@@ -1,6 +1,6 @@
 # ADI MAX78000/MAX78002 Model Training and Synthesis
 
-November 13, 2023
+January 10, 2024
 
 ADI’s MAX78000/MAX78002 project is comprised of five repositories:
 
@@ -1534,6 +1534,11 @@ The following table describes the most important command line arguments for `tra
 | `--nas`                    | Enable network architecture search                           |                                 |
 | `--nas-policy`             | Define NAS policy in YAML file                               | `--nas-policy nas/nas_policy.yaml` |
 | `--regression` | Select regression instead of classification (changes Loss function, and log output) |  |
+| `--dr` | Set target embedding dimensionality for dimensionality reduction                |`--dr 64`                        |
+| `--scaf-lr` | Initial learning rate for sub-center ArcFace loss optimizer |  |
+| `--scaf-scale` |Scale hyperparameter for sub-center ArcFace loss |  |
+| `--scaf-margin` |Margin hyperparameter for sub-center ArcFace loss |  |
+| `--backbone-checkpoint` |Path to checkpoint from which to load backbone weights |  |
 | *Display and statistics*   |                                                              |                                 |
 | `--enable-tensorboard`     | Enable logging to TensorBoard (default: disabled)            |                                 |
 | `--confusion`              | Display the confusion matrix                                 |                                 |
@@ -1552,6 +1557,7 @@ The following table describes the most important command line arguments for `tra
 | `--summary onnx_simplified` | Export trained model to simplified [ONNX](https://onnx.ai/) file (default name: model.onnx) |                     |
 | `--summary-filename`       | Change the file name for the exported model                  | `--summary-filename mnist.onnx` |
 | `--save-sample`            | Save data[index] from the test set to a NumPy pickle for use as sample data | `--save-sample 10` |
+| `--slice-sample`  | For models that require RGB input, when the sample from the dataset has additional channels, slice the sample into 3 channels                                      |                                 |
 
 #### ONNX Model Export
 
@@ -3340,6 +3346,8 @@ Additional information about the evaluation kits, and the software development k
 
 [AHB Addresses for MAX78000 and MAX78002](docs/AHBAddresses.md)
 
+[Facial Recognition System](https://github.com/MaximIntegratedAI/ai8x-training/blob/develop/docs/FacialRecognitionSystem.md)
+
 
 ---
 
diff --git a/README.pdf b/README.pdf
index 944c6fe8..fbea4318 100644
Binary files a/README.pdf and b/README.pdf differ
diff --git a/izer/add_fake_passthrough.py b/izer/add_fake_passthrough.py
index f0e58692..139a2331 100644
--- a/izer/add_fake_passthrough.py
+++ b/izer/add_fake_passthrough.py
@@ -28,17 +28,22 @@ def parse_arguments():
                         help='depth of the passthrough layer')
     parser.add_argument('--layer-name-after-pt', metavar='S', required=True,
                         help='name of the layer just after the passthrough layer is added')
+    parser.add_argument('--low-memory-footprint', action='store_true', default=False,
+                        help='enables 2-bit quantization for weights')
 
     args = parser.parse_args()
     return args
 
 
-def passthrough_faker(n_channels):
+def passthrough_faker(n_channels, low_memory_footprint=False):
     """Creates passthrough layer"""
     a = nn.Conv2d(in_channels=n_channels, out_channels=n_channels, kernel_size=1, bias=False)
     a.weight.data = torch.zeros_like(a.weight.data)
     for i in range(a.weight.data.shape[0]):
-        a.weight.data[i, i, :, :] = 64
+        if low_memory_footprint:
+            a.weight.data[i, i, :, :] = 1
+        else:
+            a.weight.data[i, i, :, :] = 64
     return a
 
 
@@ -48,7 +53,7 @@ def main():
     device = torch.device('cpu')
 
     checkpoint = torch.load(args.input_checkpoint_path)
-    passthrough_kernel = passthrough_faker(args.layer_depth)
+    passthrough_kernel = passthrough_faker(args.layer_depth, args.low_memory_footprint)
 
     new_checkpoint = copy.deepcopy(checkpoint)
 
@@ -61,7 +66,10 @@ def main():
         new_state_dict[name] = v
 
     new_state_dict[f'{args.layer_name}.output_shift'] = torch.Tensor([1.]).to(device)
-    new_state_dict[f'{args.layer_name}.weight_bits'] = torch.Tensor([8.]).to(device)
+    if args.low_memory_footprint:
+        new_state_dict[f'{args.layer_name}.weight_bits'] = torch.Tensor([2.]).to(device)
+    else:
+        new_state_dict[f'{args.layer_name}.weight_bits'] = torch.Tensor([8.]).to(device)
     new_state_dict[f'{args.layer_name}.bias_bits'] = torch.Tensor([8.]).to(device)
     new_state_dict[f'{args.layer_name}.quantize_activation'] = torch.Tensor([1.]).to(device)
     new_state_dict[f'{args.layer_name}.adjust_output_shift'] = torch.Tensor([0.]).to(device)
diff --git a/networks/ai85-dotprod.yaml b/networks/ai85-dotprod.yaml
new file mode 100644
index 00000000..daec2625
--- /dev/null
+++ b/networks/ai85-dotprod.yaml
@@ -0,0 +1,11 @@
+---
+arch: AI85DotProd
+dataset: dotprod_test
+
+layers:
+  # layer0: mlp
+  - op: mlp
+    activate: none
+    out_offset: 0x4000
+    processors: 0xffff.ffff.ffff.ffff
+    data_format: HWC
diff --git a/networks/ai85-faceid_112.yaml b/networks/ai85-faceid_112.yaml
new file mode 100644
index 00000000..fb785504
--- /dev/null
+++ b/networks/ai85-faceid_112.yaml
@@ -0,0 +1,159 @@
+---
+# Faceid_112 for face recognition. Compatible with MAX78000.
+
+arch: ai85faceidnet_112
+dataset: vggface2_faceid
+
+layers:
+  # Layer 0: pre_stage. in 3ch, out 32 ch
+  - processors: 0x0000000000000007
+    in_offset: 0x0000
+    out_offset: 0x2000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    streaming: true
+  # Layer 1: pre_stage_2. in 32ch, out 32 ch
+  - processors: 0xffffffff00000000
+    output_processors: 0x00000000ffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+    streaming: true
+  # Layer 2: Bottleneck-0, n=0, conv1. in 32ch, out 64 ch
+  - processors: 0x00000000ffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 3: Bottleneck-0, n=0, conv2. in 64ch, out 48 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0x0000ffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: None
+    max_pool: 2
+    pool_stride: 2
+  # Layer 4: Bottleneck-1, n=0, conv1. in 48ch, out 192 ch
+  - processors: 0x0000ffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 5: Bottleneck-1, n=0, conv2. in 192 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: None
+    max_pool: 2
+    pool_stride: 2
+  # Layer 6: Bottleneck-2, n=0, conv1. in 64ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x2000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 7: Bottleneck-2, n=0, conv2. in 128 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 3x3
+    write_gap: 1
+    pad: 1
+    activate: None
+  # Layer 8: Bottleneck-2, n=0, Reform input layer
+  - in_offset: 0x4000
+    out_offset: 0x0004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [5]
+  # Layer 9: Bottleneck-2, n=0, Residual add
+  - in_offset: 0x0000
+    out_offset: 0x2000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [7, 8]
+  # Layer 10: Bottleneck-3, n=0, conv1. in 64, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 11: Bottleneck-3, n=0, conv2. in 256 ch, out 96 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffff0000
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: None
+    max_pool: 2
+    pool_stride: 2
+  # Layer 12: Bottleneck-4, n=0, conv1. in 96 ch, out 192 ch
+  - processors: 0xffffffffffff0000
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 13: Bottleneck-4, n=0, conv2. in 192 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: None
+  # Layer 14: post_stage in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 15: pre_avg in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: None
+  # Layer 16: Fake Fused Avg Pool
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: None
+    avg_pool: [7, 7]
+    pool_stride: 1
+  # Layer 17: output layer in 128 features, out 64 features
+  - out_offset: 0x2000
+    processors: 0xffffffffffffffff
+    operation: MLP
+    activate: None
diff --git a/networks/ai87-dotprod.yaml b/networks/ai87-dotprod.yaml
new file mode 100644
index 00000000..924411b4
--- /dev/null
+++ b/networks/ai87-dotprod.yaml
@@ -0,0 +1,524 @@
+---
+arch: AI87DotProd
+dataset: dotprod_test
+# Dotproduct Model with 73 passthrough layers
+# Define layer parameters in order of the layer sequence
+layers:
+  # Layer 0: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    data_format: HWC
+    processors: 0xffff.ffff.ffff.ffff
+    operation: passthrough
+    activate: None
+
+  # Layer 1: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 2: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 3: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 4: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 5: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 6: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 7: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 8: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 9: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 10: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 11: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 12: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 13: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 14: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 15: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 16: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 17: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 18: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 19: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 20: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 21: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 22: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 23: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 24: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 25: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 26: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 27: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 28: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 29: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 30: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 31: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 32: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 33: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 34: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 35: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 36: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 37: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 38: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 39: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 40: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 41: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 42: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 43: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 44: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 45: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 46: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 47: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 48: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 49: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 50: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 51: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 52: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 53: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 54: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 55: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 56: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 57: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 58: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 59: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 60: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 61: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 62: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 63: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 64: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 65: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 66: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 67: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 68: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 69: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 70: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 71: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer 72: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0xffff.ffff.ffff.ffff
+    operation: None
+    activate: None
+
+  # Layer73:mlp
+  - op: mlp
+    activate: none
+    out_offset: 0x4000
+    processors: 0xffff.ffff.ffff.ffff
+    data_format: HWC
diff --git a/networks/ai87-face-tinierssd-startat74.yaml b/networks/ai87-face-tinierssd-startat74.yaml
new file mode 100644
index 00000000..007bdb31
--- /dev/null
+++ b/networks/ai87-face-tinierssd-startat74.yaml
@@ -0,0 +1,710 @@
+---
+# For AI87
+# CHW configuration for FaceDetection
+# Parallel Model with 74 passthrough layers
+
+arch: ai85tinierssdface
+dataset: VGGFace2_FaceDetection
+
+layers:
+  # Layer 0: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    data_format: CHW
+    processors: 0x0000000100010001
+    operation: passthrough
+    activate: None
+
+  # Layer 1: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 2: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 3: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 4: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 5: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 6: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 7: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 8: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 9: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 10: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 11: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 12: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 13: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 14: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 15: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 16: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 17: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 18: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 19: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 20: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 21: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 22: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 23: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 24: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 25: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 26: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 27: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 28: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 29: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 30: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 31: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 32: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 33: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 34: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 35: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 36: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 37: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 38: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 39: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 40: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 41: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 42: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 43: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 44: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 45: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 46: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 47: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 48: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 49: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 50: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 51: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 52: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 53: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 54: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 55: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 56: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 57: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 58: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 59: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 60: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 61: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 62: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 63: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 64: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 65: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 66: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 67: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 68: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 69: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 70: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 71: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 72: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 73: Passthrough
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    processors: 0x0000000100010001
+    operation: None
+    activate: None
+
+  # Layer 74: backbone_conv1
+  - out_offset: 0x9300
+    in_offset: 0x0000
+    data_format: CHW
+    processors: 0x0000000100010001
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+
+  # Layer 75: backbone_conv2
+  - out_offset: 0x0000
+    in_offset: 0x9300
+    processors: 0x00000000ffff0000
+    output_processors: 0xffffffff00000000
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+
+  # Layer 76: backbone_conv3
+  - out_offset: 0x3000
+    in_offset: 0x0000
+    processors: 0xffffffff00000000
+    output_processors: 0xffffffffffffffff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 77: backbone_conv4
+  - out_offset: 0x0000  # 1600
+    in_offset: 0x3000
+    processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 78: backbone_conv5
+  - out_offset: 0x3000  # 1600+600 = 1C00
+    in_offset: 0x0000
+    processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 79: backbone_conv6
+  - out_offset: 0x0000  # 1600
+    in_offset: 0x3000
+    processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 80: backbone_conv7
+  - out_offset: 0x3000  # 1600
+    in_offset: 0x0000
+    processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 81: backbone_conv8
+  - name: backbone_conv8
+    out_offset: 0x0000  # 1C00
+    in_offset: 0x3000
+    processors: 0xffffffffffffffff
+    output_processors: 0x00000000ffffffff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 82: backbone_conv9
+  - name: backbone_conv9
+    out_offset: 0x3000
+    in_offset: 0x0000
+    processors: 0x00000000ffffffff
+    output_processors: 0xffffffff00000000
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+
+  # Layer 83: backbone_conv10
+  - name: backbone_conv10
+    out_offset: 0x1E70  # 1F00
+    in_offset: 0x3000
+    processors: 0xffffffff00000000
+    output_processors: 0xffffffff00000000
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+
+  # Layer 84: conv12_1
+  - name: conv12_1
+    out_offset: 0x0080
+    in_offset: 0x1E70
+    processors: 0xffffffff00000000
+    output_processors: 0xffff000000000000
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+
+  # Layer 85: conv12_2
+  - name: conv12_2
+    out_offset: 0x2080
+    in_offset: 0x0080
+    processors: 0xffff000000000000
+    output_processors: 0x0000ffff00000000
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+
+  # Layer 86: loc_conv9
+  - out_offset: 0x0000  # 0000+0930 = 0930
+    in_offset: 0x3000
+    processors: 0xffffffff00000000
+    output_processors: 0x00000000000000ff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    in_sequences: backbone_conv9
+    output: true
+    activate: None
+
+  # Layer 87: loc_conv12_2
+  - out_offset: 0x0930
+    in_offset: 0x2080
+    processors: 0x0000ffff00000000
+    output_processors: 0x00000000000000ff
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    in_sequences: conv12_2
+    output: true
+    activate: None
+
+  # Layer 88: cl_conv9
+  - out_offset: 0x0000  # 0000+0930 = 0930
+    in_offset: 0x3000
+    processors: 0xffffffff00000000
+    output_processors: 0x0000000000000f00
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    in_sequences: backbone_conv9
+    output: true
+    activate: None
+
+  # Layer 89: cl_conv12_2
+  - out_offset: 0x0930
+    in_offset: 0x2080
+    processors: 0x0000ffff00000000
+    output_processors: 0x0000000000000f00
+    operation: conv2d
+    kernel_size: 3x3
+    pad: 1
+    in_sequences: conv12_2
+    output: true
+    activate: None
diff --git a/networks/ai87-mobilefacenet-112.yaml b/networks/ai87-mobilefacenet-112.yaml
new file mode 100644
index 00000000..fad3be4c
--- /dev/null
+++ b/networks/ai87-mobilefacenet-112.yaml
@@ -0,0 +1,607 @@
+---
+# MobileFaceNet_112 for face recognition. Compatible with MAX78002.
+
+arch: ai87netmobilefacenet_112
+dataset: vggface2_faceid
+
+layers:
+  # Layer 0: pre_stage. in 3ch, out 64 ch
+  - processors: 0x0000000000000007
+    in_offset: 0x0000
+    out_offset: 0x8000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    activate: ReLU
+    streaming: true
+  # Layer 1: Dwise. in 64ch, out 64ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 64
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+    streaming: true
+  # Layer 2: Bottleneck-0, n=0, conv1. in 64ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 3: Bottleneck-1, n=0, conv2. in 128ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 128
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+  # Layer 4: Bottleneck-1, n=0, conv3. in 128 ch, out 64 ch.
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: None
+  # Layer 5: Bottleneck-1, n=1, conv1. in 64ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 6: Bottleneck-1, n=1, conv2. in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 128
+    activate: ReLU
+  # Layer 7: Bottleneck-1, n=1, conv3. in 128 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    write_gap: 1
+    activate: None
+  # Layer 8: Bottleneck-1, n=1, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [4]
+  # Layer 9: Bottleneck-1, n=1, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x4000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [7, 8]
+  # Layer 10: Bottleneck-1, n=2, conv1. in 64ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 11: Bottleneck-1, n=2, conv2. in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 128
+    activate: ReLU
+  # Layer 12: Bottleneck-1, n=2, conv3. in 128 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    write_gap: 1
+    activate: None
+  # Layer 13: Bottleneck-1, n=2, Reform input layer
+  - in_offset: 0x4000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [9]
+  # Layer 14: Bottleneck-1, n=2, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x0000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [12, 13]
+  # Layer 15: Bottleneck-1, n=3, conv1. in 64ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 16: Bottleneck-1, n=3, conv2. in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 128
+    activate: ReLU
+  # Layer 17: Bottleneck-1, n=3, conv3. in 128 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 18: Bottleneck-1, n=3, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [14]
+  # Layer 19: Bottleneck-1, n=3, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x0000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [17, 18]
+  # Layer 20: Bottleneck-1, n=4, conv1. in 64ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 21: Bottleneck-1, n=4, conv2. in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 128
+    activate: ReLU
+  # Layer 22: Bottleneck-1, n=4, conv3. in 128 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 23: Bottleneck-1, n=4, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [19]
+  # Layer 24: Bottleneck-1, n=4, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x6000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [22, 23]
+  # Layer 25: Bottleneck-2, n=0, conv1. in 64ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 26: Bottleneck-2, n=0, conv2. in 256ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+  # Layer 27: Bottleneck-2, n=0, conv3. in 256 ch, out 128 ch.
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: None
+  # Layer 28: Bottleneck-3, n=0, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 29: Bottleneck-3, n=0, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 30: Bottleneck-3, n=0, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 31: Bottleneck-3, n=0, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [27]
+  # Layer 32: Bottleneck-3, n=0, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x4000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [30, 31]
+  # Layer 33: Bottleneck-3, n=1, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 34: Bottleneck-3, n=1, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 35: Bottleneck-3, n=1, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 36: Bottleneck-3, n=1, Reform input layer
+  - in_offset: 0x4000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [32]
+  # Layer 37: Bottleneck-3, n=1, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x4000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [35, 36]
+  # Layer 38: Bottleneck-3, n=2, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 39: Bottleneck-3, n=2, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 40: Bottleneck-3, n=2, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 41: Bottleneck-3, n=2, Reform input layer
+  - in_offset: 0x4000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [37]
+  # Layer 42: Bottleneck-3, n=2, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x0000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [40, 41]
+  # Layer 43: Bottleneck-3, n=3, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 44: Bottleneck-3, n=3, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 45: Bottleneck-3, n=3, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 46: Bottleneck-3, n=3, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [42]
+  # Layer 47: Bottleneck-3, n=3, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x4000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [45, 46]
+  # Layer 48: Bottleneck-3, n=4, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 49: Bottleneck-3, n=4, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 50: Bottleneck-3, n=4, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 51: Bottleneck-3, n=4, Reform input layer
+  - in_offset: 0x4000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [47]
+  # Layer 52: Bottleneck-1, n=4, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x0000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [50, 51]
+  # Layer 53: Bottleneck-3, n=5, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 54: Bottleneck-3, n=5, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 55: Bottleneck-3, n=5, conv3. in 256 ch, out 128ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 56: Bottleneck-3, n=5, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [52]
+  # Layer 57: Bottleneck-3, n=5, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x4000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [55, 56]
+  # Layer 58: Bottleneck-4, n=0, conv1. in 128ch, out 512 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 59: Bottleneck-4, n=0, conv2. in 512ch, out 512 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 512
+    activate: ReLU
+    max_pool: 2
+    pool_stride: 2
+  # Layer 60: Bottleneck-4, n=0, conv3. in 512 ch, out 128 ch.
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: None
+  # Layer 61: Bottleneck-5, n=0, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x4000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 62: Bottleneck-5, n=0, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x8000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 63: Bottleneck-5, n=0, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 64: Bottleneck-5, n=1, Reform input layer
+  - in_offset: 0x0000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [60]
+  # Layer 65: Bottleneck-5, n=0, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x4000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [63, 64]
+  # Layer 66: Bottleneck-5, n=1, conv1. in 128ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 67: Bottleneck-5, n=1, conv2. in 256 ch, out 256 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x0000
+    operation: Conv2d
+    kernel_size: 3x3
+    pad: 1
+    groups: 256
+    activate: ReLU
+  # Layer 68: Bottleneck-5, n=1, conv3. in 256 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    write_gap: 1
+    pad: 0
+    activate: None
+  # Layer 69: Bottleneck-5, n=1, Reform input layer
+  - in_offset: 0x4000
+    out_offset: 0xa004
+    processors: 0xffffffffffffffff
+    operation: passthrough
+    write_gap: 1
+    in_sequences: [65]
+  # Layer 70: Bottleneck-5, n=1, Residual add
+  - in_offset: 0xa000
+    out_offset: 0x0000
+    processors: 0xffffffffffffffff
+    operation: none
+    eltwise: add
+    in_sequences: [68, 69]
+  # Layer 71: post-stage in 128 ch, out 128 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0x2000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: ReLU
+  # Layer 72: output layer in 128 ch, out 64 ch
+  - processors: 0xffffffffffffffff
+    output_processors: 0xffffffffffffffff
+    out_offset: 0xa000
+    operation: Conv2d
+    kernel_size: 1x1
+    pad: 0
+    activate: None
+    avg_pool: [7, 7]
+    pool_stride: 1
diff --git a/scripts/gen-facialrecognition_demo_networks-max78000.sh b/scripts/gen-facialrecognition_demo_networks-max78000.sh
new file mode 100755
index 00000000..6afc9e8c
--- /dev/null
+++ b/scripts/gen-facialrecognition_demo_networks-max78000.sh
@@ -0,0 +1,9 @@
+#!/bin/sh
+DEVICE="MAX78000"
+TARGET="sdk/Examples/$DEVICE/CNN"
+COMMON_ARGS="--device $DEVICE --timer 0 --display-checkpoint --verbose"
+
+python izer/add_fake_passthrough.py --input-checkpoint-path trained/ai85-faceid_112-qat-q.pth.tar --output-checkpoint-path trained/ai85-fakepass-faceid_112-qat-q.pth.tar --layer-name fakepass --layer-depth 128 --layer-name-after-pt linear --low-memory-footprint "$@"
+python ai8xize.py --test-dir $TARGET --prefix faceid_112 --checkpoint-file trained/ai85-fakepass-faceid_112-qat-q.pth.tar --config-file networks/ai85-faceid_112.yaml --fifo $COMMON_ARGS "$@"
+python ai8xize.py --test-dir $TARGET --prefix dotprod_demo --checkpoint-file trained/ai85-dot_emb_112_checkpoint-q.pth.tar --config-file networks/ai85-dotprod.yaml $COMMON_ARGS "$@"
+python ai8xize.py --test-dir $TARGET --prefix facedet_tinierssd --checkpoint-file trained/ai85-facedet-tinierssd-qat8-q.pth.tar --config-file networks/ai85-facedet-tinierssd.yaml --fifo  $COMMON_ARGS "$@"
diff --git a/scripts/gen-facialrecognition_demo_networks-max78002.sh b/scripts/gen-facialrecognition_demo_networks-max78002.sh
new file mode 100755
index 00000000..f96235ba
--- /dev/null
+++ b/scripts/gen-facialrecognition_demo_networks-max78002.sh
@@ -0,0 +1,8 @@
+#!/bin/sh
+DEVICE="MAX78002"
+TARGET="sdk/Examples/$DEVICE/CNN"
+COMMON_ARGS="--device $DEVICE --timer 0 --display-checkpoint --verbose"
+
+python ai8xize.py --test-dir $TARGET --prefix mobilefacenet_demo --checkpoint-file trained/ai87-mobilefacenet-112-qat-q.pth.tar --config-file networks/ai87-mobilefacenet-112.yaml --fifo $COMMON_ARGS "$@"
+python ai8xize.py --test-dir $TARGET --prefix dotprod_demo --checkpoint-file trained/ai87-dot_emb_112_checkpoint-q.pth.tar --config-file networks/ai87-dotprod.yaml --start-layer 73 --weight-start 2000 $COMMON_ARGS "$@"
+python ai8xize.py --test-dir $TARGET --prefix facedetection_demo --checkpoint-file trained/ai87-facedet-tinierssd-qat8-q.pth.tar --config-file networks/ai87-face-tinierssd-startat74.yaml --start-layer 74 --weight-start 2500 $COMMON_ARGS "$@"
diff --git a/scripts/gen_faceid_112_max78000.sh b/scripts/gen_faceid_112_max78000.sh
new file mode 100755
index 00000000..60b6bef1
--- /dev/null
+++ b/scripts/gen_faceid_112_max78000.sh
@@ -0,0 +1,7 @@
+#!/bin/sh
+DEVICE="MAX78000"
+TARGET="sdk/Examples/$DEVICE/CNN"
+COMMON_ARGS="--device $DEVICE --timer 0 --display-checkpoint --verbose"
+
+python izer/add_fake_passthrough.py --input-checkpoint-path trained/ai85-faceid_112-qat-q.pth.tar --output-checkpoint-path trained/ai85-fakepass-faceid_112-qat-q.pth.tar --layer-name fakepass --layer-depth 128 --layer-name-after-pt linear --low-memory-footprint "$@"
+python ai8xize.py --test-dir $TARGET --prefix faceid_112 --checkpoint-file trained/ai85-fakepass-faceid_112-qat-q.pth.tar --config-file networks/ai85-faceid_112.yaml --fifo $COMMON_ARGS "$@"
diff --git a/scripts/gen_mobilefacenet_112_max78002.sh b/scripts/gen_mobilefacenet_112_max78002.sh
new file mode 100755
index 00000000..76635ca8
--- /dev/null
+++ b/scripts/gen_mobilefacenet_112_max78002.sh
@@ -0,0 +1,6 @@
+#!/bin/sh
+DEVICE="MAX78002"
+TARGET="sdk/Examples/$DEVICE/CNN"
+COMMON_ARGS="--device $DEVICE --timer 0 --display-checkpoint --verbose"
+
+python ai8xize.py --test-dir $TARGET --prefix mobilefacenet-112 --checkpoint-file trained/ai87-mobilefacenet-112-qat-q.pth.tar --config-file networks/ai87-mobilefacenet-112.yaml --fifo $COMMON_ARGS "$@"
diff --git a/scripts/quantize_faceid_112.sh b/scripts/quantize_faceid_112.sh
new file mode 100755
index 00000000..6d8e7dbb
--- /dev/null
+++ b/scripts/quantize_faceid_112.sh
@@ -0,0 +1,2 @@
+#!/bin/sh
+python quantize.py trained/ai85-faceid_112-qat.pth.tar trained/ai85-faceid_112-qat-q.pth.tar --device MAX78000 -v "$@"
diff --git a/scripts/quantize_mobilefacenet_112.sh b/scripts/quantize_mobilefacenet_112.sh
new file mode 100755
index 00000000..5bd9e350
--- /dev/null
+++ b/scripts/quantize_mobilefacenet_112.sh
@@ -0,0 +1,2 @@
+#!/bin/sh
+python quantize.py trained/ai87-mobilefacenet-112-qat.pth.tar trained/ai87-mobilefacenet-112-qat-q.pth.tar --device MAX78002 -v "$@"
diff --git a/tests/sample_dotprod_test.npy b/tests/sample_dotprod_test.npy
new file mode 100644
index 00000000..4d5b6c4d
Binary files /dev/null and b/tests/sample_dotprod_test.npy differ
diff --git a/tests/sample_vggface2_faceid.npy b/tests/sample_vggface2_faceid.npy
new file mode 100644
index 00000000..8c642e48
Binary files /dev/null and b/tests/sample_vggface2_faceid.npy differ
diff --git a/trained/ai85-dot_emb_112_checkpoint-q.pth.tar b/trained/ai85-dot_emb_112_checkpoint-q.pth.tar
new file mode 100644
index 00000000..6a7cbb20
Binary files /dev/null and b/trained/ai85-dot_emb_112_checkpoint-q.pth.tar differ
diff --git a/trained/ai85-faceid-qat8-q.pth.tar b/trained/ai85-faceid-qat8-q.pth.tar
deleted file mode 100644
index a2a50ef0..00000000
Binary files a/trained/ai85-faceid-qat8-q.pth.tar and /dev/null differ
diff --git a/trained/ai85-faceid-qat8.log b/trained/ai85-faceid-qat8.log
deleted file mode 100644
index 3e7efc91..00000000
--- a/trained/ai85-faceid-qat8.log
+++ /dev/null
@@ -1,4658 +0,0 @@
-2020-12-09 15:31:01,076 - Log file for this run: /home/gorkemulkar/Workspace/Python/AI8X_GitHub/ai8x-training/logs/2020.12.09-153101/2020.12.09-153101.log
-2020-12-09 15:31:01,076 - Number of CPUs: 24
-2020-12-09 15:31:01,094 - Number of GPUs: 1
-2020-12-09 15:31:01,095 - CUDA version: 10.2
-2020-12-09 15:31:01,095 - CUDNN version: 7605
-2020-12-09 15:31:01,095 - Kernel: 5.4.0-45-generic
-2020-12-09 15:31:01,095 - Python: 3.8.3 (default, May 19 2020, 18:47:26) 
-[GCC 7.3.0]
-2020-12-09 15:31:01,095 - pip freeze: {'absl-py': '0.9.0', 'astroid': '2.4.2', 'atomicwrites': '1.4.0', 'attrs': '19.3.0', 'audioread': '2.1.8', 'backcall': '0.1.0', 'bleach': '3.1.5', 'blinker': '1.4', 'bqplot': '0.11.5', 'cachetools': '3.1.1', 'certifi': '2020.6.20', 'cffi': '1.14.0', 'chardet': '3.0.4', 'click': '7.1.2', 'cloudpickle': '1.4.1', 'colorama': '0.4.4', 'cryptography': '2.9.2', 'cycler': '0.10.0', 'cython': '0.29.17', 'cytoolz': '0.10.1', 'dask': '2.17.2', 'dataclasses': '0.6', 'decorator': '4.4.2', 'defusedxml': '0.6.0', 'distiller': '0.4.0rc0', 'entrypoints': '0.3', 'future': '0.18.2', 'gitdb': '4.0.5', 'gitpython': '3.1.0', 'google-auth': '1.14.1', 'google-auth-oauthlib': '0.4.1', 'graphviz': '0.10.1', 'grpcio': '1.27.2', 'gym': '0.12.5', 'idna': '2.9', 'imagecodecs-lite': '2019.12.3', 'imageio': '2.8.0', 'ipykernel': '5.3.0', 'ipython': '7.15.0', 'ipython-genutils': '0.2.0', 'ipywidgets': '7.4.2', 'isort': '4.3.21', 'jedi': '0.17.0', 'jinja2': '2.11.2', 'joblib': '0.15.1', 'jsonpatch': '1.25', 'jsonpointer': '2.0', 'jsonschema': '3.2.0', 'jupyter': '1.0.0', 'jupyter-client': '6.1.3', 'jupyter-console': '6.1.0', 'jupyter-core': '4.6.3', 'kiwisolver': '1.2.0', 'lazy-object-proxy': '1.4.3', 'librosa': '0.7.2', 'llvmlite': '0.32.1', 'markdown': '3.1.1', 'markupsafe': '1.1.1', 'matplotlib': '3.1.3', 'mccabe': '0.6.1', 'mistune': '0.8.4', 'mkl-fft': '1.0.15', 'mkl-random': '1.1.1', 'mkl-service': '2.3.0', 'more-itertools': '8.3.0', 'munch': '2.5.0', 'nbconvert': '5.6.1', 'nbformat': '5.0.6', 'networkx': '2.4', 'notebook': '6.0.3', 'numba': '0.49.1', 'numpy': '1.19.4', 'oauthlib': '3.1.0', 'olefile': '0.46', 'onnx': '1.7.0', 'opencv-python': '4.4.0.44', 'packaging': '20.4', 'pandas': '1.0.4', 'pandocfilters': '1.4.2', 'parso': '0.7.0', 'pexpect': '4.8.0', 'pickleshare': '0.7.5', 'pillow': '7.1.2', 'pip': '20.0.2', 'pluggy': '0.13.1', 'pretrainedmodels': '0.7.4', 'prometheus-client': '0.8.0', 'prompt-toolkit': '3.0.5', 'protobuf': '3.11.4', 'ptyprocess': '0.6.0', 'py': '1.8.1', 'pyasn1': '0.4.8', 'pyasn1-modules': '0.2.7', 'pycparser': '2.20', 'pydot': '1.4.1', 'pyglet': '1.5.5', 'pygments': '2.6.1', 'pyjwt': '1.7.1', 'pylint': '2.5.3', 'pyopenssl': '19.1.0', 'pyparsing': '2.4.7', 'pyrsistent': '0.16.0', 'pysocks': '1.7.1', 'pytest': '4.6.10', 'python-dateutil': '2.8.1', 'pytz': '2020.1', 'pywavelets': '1.1.1', 'pyyaml': '5.3.1', 'pyzmq': '19.0.1', 'qgrid': '1.1.1', 'qtconsole': '4.7.4', 'qtpy': '1.9.0', 'requests': '2.23.0', 'requests-oauthlib': '1.3.0', 'resampy': '0.2.2', 'rsa': '4.0', 'scikit-image': '0.17.2', 'scikit-learn': '0.23.2', 'scipy': '1.4.1', 'send2trash': '1.5.0', 'setuptools': '46.4.0.post20200518', 'shap': '0.35.0', 'six': '1.14.0', 'smmap': '3.0.4', 'soundfile': '0.10.2', 'tabulate': '0.8.3', 'tensorboard': '2.2.1', 'tensorboard-plugin-wit': '1.6.0', 'terminado': '0.8.3', 'testpath': '0.4.4', 'threadpoolctl': '2.1.0', 'tifffile': '2020.5.30', 'toml': '0.10.1', 'toolz': '0.10.0', 'torch': '1.7.0', 'torchfile': '0.1.0', 'torchnet': '0.0.4', 'torchvision': '0.8.1', 'tornado': '6.0.4', 'tqdm': '4.33.0', 'traitlets': '4.3.3', 'traittypes': '0.2.1', 'typing-extensions': '3.7.4.2', 'urllib3': '1.25.8', 'visdom': '0.1.8.9', 'wcwidth': '0.2.3', 'webencodings': '0.5.1', 'websocket-client': '0.57.0', 'werkzeug': '1.0.1', 'wheel': '0.34.2', 'widgetsnbextension': '3.4.2', 'wrapt': '1.11.2', 'xlsxwriter': '1.2.9'}
-2020-12-09 15:31:01,112 - Active Git branch: None, Git is in 'detached HEAD' state
-2020-12-09 15:31:01,118 - Git commit: 433ebc13209d4da4fc708d71e027d3caae226013
-2020-12-09 15:31:01,118 - Command line: ./train.py --epochs 100 --optimizer Adam --lr 0.001 --deterministic --compress schedule-faceid.yaml --model ai85faceidnet --dataset FaceID --batch-size 100 --device MAX78000 --regression --print-freq 250 --data /data_fast
-2020-12-09 15:31:02,807 - Optimizer Type: <class 'torch.optim.adam.Adam'>
-2020-12-09 15:31:02,808 - Optimizer Args: {'lr': 0.001, 'betas': (0.9, 0.999), 'eps': 1e-08, 'weight_decay': 0, 'amsgrad': False}
-2020-12-09 15:33:54,273 - Dataset sizes:
-	training=449775
-	validation=49975
-	test=165412
-2020-12-09 15:33:54,276 - Reading compression schedule from: schedule-faceid.yaml
-2020-12-09 15:33:54,277 - Schedule contents:
-{
-  "lr_schedulers": {
-    "training_lr": {
-      "class": "MultiStepLR",
-      "milestones": [
-        10,
-        20,
-        40,
-        60,
-        80
-      ],
-      "gamma": 0.5
-    }
-  },
-  "policies": [
-    {
-      "lr_scheduler": {
-        "instance_name": "training_lr"
-      },
-      "starting_epoch": 0,
-      "ending_epoch": 150,
-      "frequency": 1
-    }
-  ]
-}
-2020-12-09 15:33:54,293 - 
-
-2020-12-09 15:33:54,293 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:34:03,955 - Epoch: [0][  250/ 4498]    Overall Loss 0.053835    Objective Loss 0.053835    MSE 0.053835    LR 0.001000    Time 0.038577    
-2020-12-09 15:34:10,433 - Epoch: [0][  500/ 4498]    Overall Loss 0.053128    Objective Loss 0.053128    MSE 0.053128    LR 0.001000    Time 0.032212    
-2020-12-09 15:34:16,907 - Epoch: [0][  750/ 4498]    Overall Loss 0.052515    Objective Loss 0.052515    MSE 0.052515    LR 0.001000    Time 0.030085    
-2020-12-09 15:34:23,383 - Epoch: [0][ 1000/ 4498]    Overall Loss 0.052094    Objective Loss 0.052094    MSE 0.052093    LR 0.001000    Time 0.029024    
-2020-12-09 15:34:29,881 - Epoch: [0][ 1250/ 4498]    Overall Loss 0.051719    Objective Loss 0.051719    MSE 0.051718    LR 0.001000    Time 0.028404    
-2020-12-09 15:34:36,373 - Epoch: [0][ 1500/ 4498]    Overall Loss 0.051205    Objective Loss 0.051205    MSE 0.051205    LR 0.001000    Time 0.027986    
-2020-12-09 15:34:42,874 - Epoch: [0][ 1750/ 4498]    Overall Loss 0.050591    Objective Loss 0.050591    MSE 0.050591    LR 0.001000    Time 0.027694    
-2020-12-09 15:34:49,374 - Epoch: [0][ 2000/ 4498]    Overall Loss 0.049947    Objective Loss 0.049947    MSE 0.049947    LR 0.001000    Time 0.027474    
-2020-12-09 15:34:55,874 - Epoch: [0][ 2250/ 4498]    Overall Loss 0.049323    Objective Loss 0.049323    MSE 0.049323    LR 0.001000    Time 0.027303    
-2020-12-09 15:35:02,399 - Epoch: [0][ 2500/ 4498]    Overall Loss 0.048711    Objective Loss 0.048711    MSE 0.048711    LR 0.001000    Time 0.027176    
-2020-12-09 15:35:08,913 - Epoch: [0][ 2750/ 4498]    Overall Loss 0.048120    Objective Loss 0.048120    MSE 0.048120    LR 0.001000    Time 0.027068    
-2020-12-09 15:35:15,428 - Epoch: [0][ 3000/ 4498]    Overall Loss 0.047542    Objective Loss 0.047542    MSE 0.047542    LR 0.001000    Time 0.026979    
-2020-12-09 15:35:21,941 - Epoch: [0][ 3250/ 4498]    Overall Loss 0.046988    Objective Loss 0.046988    MSE 0.046988    LR 0.001000    Time 0.026902    
-2020-12-09 15:35:28,461 - Epoch: [0][ 3500/ 4498]    Overall Loss 0.046432    Objective Loss 0.046432    MSE 0.046432    LR 0.001000    Time 0.026839    
-2020-12-09 15:35:34,986 - Epoch: [0][ 3750/ 4498]    Overall Loss 0.045912    Objective Loss 0.045912    MSE 0.045912    LR 0.001000    Time 0.026785    
-2020-12-09 15:35:41,506 - Epoch: [0][ 4000/ 4498]    Overall Loss 0.045409    Objective Loss 0.045409    MSE 0.045409    LR 0.001000    Time 0.026737    
-2020-12-09 15:35:48,028 - Epoch: [0][ 4250/ 4498]    Overall Loss 0.044922    Objective Loss 0.044922    MSE 0.044922    LR 0.001000    Time 0.026695    
-2020-12-09 15:35:54,558 - Epoch: [0][ 4498/ 4498]    Overall Loss 0.044467    Objective Loss 0.044467    MSE 0.044467    LR 0.001000    Time 0.026672    
-2020-12-09 15:35:55,372 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14010 |  0.00107 |    0.11637 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08635 | -0.01309 |    0.06763 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.07335 | -0.00724 |    0.05633 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.07032 | -0.01592 |    0.05510 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.06259 | -0.01093 |    0.04614 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.06763 | -0.00869 |    0.04788 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.07640 | -0.00882 |    0.05433 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11309 | -0.00002 |    0.08830 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:35:55,372 - Total sparsity: 0.00
-
-2020-12-09 15:35:55,375 - --- validate (epoch=0)-----------
-2020-12-09 15:35:55,375 - 49975 samples (100 per mini-batch)
-2020-12-09 15:36:00,013 - Epoch: [0][  250/  500]    Loss 0.036358    MSE 0.036358    
-2020-12-09 15:36:02,395 - Epoch: [0][  500/  500]    Loss 0.036385    MSE 0.036384    
-2020-12-09 15:36:03,041 - ==> MSE: 0.03638    Loss: 0.036
-
-2020-12-09 15:36:03,043 - ==> Best [MSE: 0.03638   Sparsity:0.00   Params: 176048 on epoch: 0]
-2020-12-09 15:36:03,043 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:36:03,048 - 
-
-2020-12-09 15:36:03,048 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:36:12,583 - Epoch: [1][  250/ 4498]    Overall Loss 0.036136    Objective Loss 0.036136    MSE 0.036136    LR 0.001000    Time 0.038066    
-2020-12-09 15:36:19,138 - Epoch: [1][  500/ 4498]    Overall Loss 0.035882    Objective Loss 0.035882    MSE 0.035882    LR 0.001000    Time 0.032108    
-2020-12-09 15:36:25,678 - Epoch: [1][  750/ 4498]    Overall Loss 0.035705    Objective Loss 0.035705    MSE 0.035705    LR 0.001000    Time 0.030102    
-2020-12-09 15:36:32,222 - Epoch: [1][ 1000/ 4498]    Overall Loss 0.035514    Objective Loss 0.035514    MSE 0.035514    LR 0.001000    Time 0.029104    
-2020-12-09 15:36:38,766 - Epoch: [1][ 1250/ 4498]    Overall Loss 0.035306    Objective Loss 0.035306    MSE 0.035306    LR 0.001000    Time 0.028504    
-2020-12-09 15:36:45,332 - Epoch: [1][ 1500/ 4498]    Overall Loss 0.035143    Objective Loss 0.035143    MSE 0.035143    LR 0.001000    Time 0.028119    
-2020-12-09 15:36:51,918 - Epoch: [1][ 1750/ 4498]    Overall Loss 0.034964    Objective Loss 0.034964    MSE 0.034964    LR 0.001000    Time 0.027855    
-2020-12-09 15:36:58,498 - Epoch: [1][ 2000/ 4498]    Overall Loss 0.034800    Objective Loss 0.034800    MSE 0.034800    LR 0.001000    Time 0.027654    
-2020-12-09 15:37:05,072 - Epoch: [1][ 2250/ 4498]    Overall Loss 0.034641    Objective Loss 0.034641    MSE 0.034641    LR 0.001000    Time 0.027496    
-2020-12-09 15:37:11,639 - Epoch: [1][ 2500/ 4498]    Overall Loss 0.034495    Objective Loss 0.034495    MSE 0.034495    LR 0.001000    Time 0.027366    
-2020-12-09 15:37:18,206 - Epoch: [1][ 2750/ 4498]    Overall Loss 0.034346    Objective Loss 0.034346    MSE 0.034346    LR 0.001000    Time 0.027260    
-2020-12-09 15:37:24,770 - Epoch: [1][ 3000/ 4498]    Overall Loss 0.034198    Objective Loss 0.034198    MSE 0.034198    LR 0.001000    Time 0.027171    
-2020-12-09 15:37:31,335 - Epoch: [1][ 3250/ 4498]    Overall Loss 0.034058    Objective Loss 0.034058    MSE 0.034059    LR 0.001000    Time 0.027095    
-2020-12-09 15:37:37,905 - Epoch: [1][ 3500/ 4498]    Overall Loss 0.033927    Objective Loss 0.033927    MSE 0.033927    LR 0.001000    Time 0.027032    
-2020-12-09 15:37:44,470 - Epoch: [1][ 3750/ 4498]    Overall Loss 0.033790    Objective Loss 0.033790    MSE 0.033790    LR 0.001000    Time 0.026976    
-2020-12-09 15:37:51,043 - Epoch: [1][ 4000/ 4498]    Overall Loss 0.033663    Objective Loss 0.033663    MSE 0.033663    LR 0.001000    Time 0.026929    
-2020-12-09 15:37:57,615 - Epoch: [1][ 4250/ 4498]    Overall Loss 0.033540    Objective Loss 0.033540    MSE 0.033540    LR 0.001000    Time 0.026887    
-2020-12-09 15:38:04,175 - Epoch: [1][ 4498/ 4498]    Overall Loss 0.033427    Objective Loss 0.033427    MSE 0.033427    LR 0.001000    Time 0.026860    
-2020-12-09 15:38:05,013 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15014 |  0.00182 |    0.12130 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10132 | -0.01594 |    0.07732 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08413 | -0.00787 |    0.06464 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08072 | -0.01807 |    0.06290 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.07398 | -0.01352 |    0.05503 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08400 | -0.01184 |    0.06133 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09904 | -0.01123 |    0.07255 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14444 | -0.00018 |    0.11230 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:38:05,013 - Total sparsity: 0.00
-
-2020-12-09 15:38:05,016 - --- validate (epoch=1)-----------
-2020-12-09 15:38:05,016 - 49975 samples (100 per mini-batch)
-2020-12-09 15:38:09,573 - Epoch: [1][  250/  500]    Loss 0.031557    MSE 0.031557    
-2020-12-09 15:38:11,986 - Epoch: [1][  500/  500]    Loss 0.031618    MSE 0.031618    
-2020-12-09 15:38:12,727 - ==> MSE: 0.03162    Loss: 0.032
-
-2020-12-09 15:38:12,729 - ==> Best [MSE: 0.03162   Sparsity:0.00   Params: 176048 on epoch: 1]
-2020-12-09 15:38:12,729 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:38:12,741 - 
-
-2020-12-09 15:38:12,741 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:38:22,316 - Epoch: [2][  250/ 4498]    Overall Loss 0.031125    Objective Loss 0.031125    MSE 0.031125    LR 0.001000    Time 0.038233    
-2020-12-09 15:38:28,835 - Epoch: [2][  500/ 4498]    Overall Loss 0.031018    Objective Loss 0.031018    MSE 0.031018    LR 0.001000    Time 0.032119    
-2020-12-09 15:38:35,355 - Epoch: [2][  750/ 4498]    Overall Loss 0.030943    Objective Loss 0.030943    MSE 0.030943    LR 0.001000    Time 0.030083    
-2020-12-09 15:38:41,879 - Epoch: [2][ 1000/ 4498]    Overall Loss 0.030910    Objective Loss 0.030910    MSE 0.030910    LR 0.001000    Time 0.029069    
-2020-12-09 15:38:48,412 - Epoch: [2][ 1250/ 4498]    Overall Loss 0.030878    Objective Loss 0.030878    MSE 0.030878    LR 0.001000    Time 0.028469    
-2020-12-09 15:38:54,973 - Epoch: [2][ 1500/ 4498]    Overall Loss 0.030843    Objective Loss 0.030843    MSE 0.030843    LR 0.001000    Time 0.028086    
-2020-12-09 15:39:01,534 - Epoch: [2][ 1750/ 4498]    Overall Loss 0.030793    Objective Loss 0.030793    MSE 0.030793    LR 0.001000    Time 0.027813    
-2020-12-09 15:39:08,104 - Epoch: [2][ 2000/ 4498]    Overall Loss 0.030760    Objective Loss 0.030760    MSE 0.030760    LR 0.001000    Time 0.027612    
-2020-12-09 15:39:14,678 - Epoch: [2][ 2250/ 4498]    Overall Loss 0.030713    Objective Loss 0.030713    MSE 0.030713    LR 0.001000    Time 0.027459    
-2020-12-09 15:39:21,249 - Epoch: [2][ 2500/ 4498]    Overall Loss 0.030652    Objective Loss 0.030652    MSE 0.030652    LR 0.001000    Time 0.027334    
-2020-12-09 15:39:27,834 - Epoch: [2][ 2750/ 4498]    Overall Loss 0.030601    Objective Loss 0.030601    MSE 0.030601    LR 0.001000    Time 0.027238    
-2020-12-09 15:39:34,411 - Epoch: [2][ 3000/ 4498]    Overall Loss 0.030554    Objective Loss 0.030554    MSE 0.030554    LR 0.001000    Time 0.027155    
-2020-12-09 15:39:40,993 - Epoch: [2][ 3250/ 4498]    Overall Loss 0.030504    Objective Loss 0.030504    MSE 0.030504    LR 0.001000    Time 0.027086    
-2020-12-09 15:39:47,574 - Epoch: [2][ 3500/ 4498]    Overall Loss 0.030462    Objective Loss 0.030462    MSE 0.030462    LR 0.001000    Time 0.027027    
-2020-12-09 15:39:54,179 - Epoch: [2][ 3750/ 4498]    Overall Loss 0.030424    Objective Loss 0.030424    MSE 0.030424    LR 0.001000    Time 0.026981    
-2020-12-09 15:40:00,742 - Epoch: [2][ 4000/ 4498]    Overall Loss 0.030374    Objective Loss 0.030374    MSE 0.030374    LR 0.001000    Time 0.026932    
-2020-12-09 15:40:07,309 - Epoch: [2][ 4250/ 4498]    Overall Loss 0.030332    Objective Loss 0.030332    MSE 0.030332    LR 0.001000    Time 0.026888    
-2020-12-09 15:40:13,875 - Epoch: [2][ 4498/ 4498]    Overall Loss 0.030289    Objective Loss 0.030289    MSE 0.030289    LR 0.001000    Time 0.026862    
-2020-12-09 15:40:14,695 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15641 |  0.00154 |    0.12379 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10791 | -0.01668 |    0.08192 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08954 | -0.00846 |    0.06843 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08566 | -0.01868 |    0.06618 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08414 | -0.01472 |    0.06284 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09721 | -0.01449 |    0.07236 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11035 | -0.01340 |    0.08118 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16208 | -0.00028 |    0.12587 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:40:14,695 - Total sparsity: 0.00
-
-2020-12-09 15:40:14,698 - --- validate (epoch=2)-----------
-2020-12-09 15:40:14,699 - 49975 samples (100 per mini-batch)
-2020-12-09 15:40:19,383 - Epoch: [2][  250/  500]    Loss 0.029646    MSE 0.029646    
-2020-12-09 15:40:21,762 - Epoch: [2][  500/  500]    Loss 0.029615    MSE 0.029615    
-2020-12-09 15:40:22,509 - ==> MSE: 0.02961    Loss: 0.030
-
-2020-12-09 15:40:22,511 - ==> Best [MSE: 0.02961   Sparsity:0.00   Params: 176048 on epoch: 2]
-2020-12-09 15:40:22,511 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:40:22,523 - 
-
-2020-12-09 15:40:22,524 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:40:32,061 - Epoch: [3][  250/ 4498]    Overall Loss 0.029330    Objective Loss 0.029330    MSE 0.029330    LR 0.001000    Time 0.038085    
-2020-12-09 15:40:38,605 - Epoch: [3][  500/ 4498]    Overall Loss 0.029290    Objective Loss 0.029290    MSE 0.029290    LR 0.001000    Time 0.032094    
-2020-12-09 15:40:45,143 - Epoch: [3][  750/ 4498]    Overall Loss 0.029231    Objective Loss 0.029231    MSE 0.029231    LR 0.001000    Time 0.030090    
-2020-12-09 15:40:51,683 - Epoch: [3][ 1000/ 4498]    Overall Loss 0.029183    Objective Loss 0.029183    MSE 0.029183    LR 0.001000    Time 0.029090    
-2020-12-09 15:40:58,237 - Epoch: [3][ 1250/ 4498]    Overall Loss 0.029168    Objective Loss 0.029168    MSE 0.029168    LR 0.001000    Time 0.028502    
-2020-12-09 15:41:04,799 - Epoch: [3][ 1500/ 4498]    Overall Loss 0.029139    Objective Loss 0.029139    MSE 0.029139    LR 0.001000    Time 0.028115    
-2020-12-09 15:41:11,351 - Epoch: [3][ 1750/ 4498]    Overall Loss 0.029124    Objective Loss 0.029124    MSE 0.029124    LR 0.001000    Time 0.027832    
-2020-12-09 15:41:17,905 - Epoch: [3][ 2000/ 4498]    Overall Loss 0.029125    Objective Loss 0.029125    MSE 0.029125    LR 0.001000    Time 0.027622    
-2020-12-09 15:41:24,455 - Epoch: [3][ 2250/ 4498]    Overall Loss 0.029109    Objective Loss 0.029109    MSE 0.029109    LR 0.001000    Time 0.027457    
-2020-12-09 15:41:31,007 - Epoch: [3][ 2500/ 4498]    Overall Loss 0.029095    Objective Loss 0.029095    MSE 0.029095    LR 0.001000    Time 0.027325    
-2020-12-09 15:41:37,560 - Epoch: [3][ 2750/ 4498]    Overall Loss 0.029070    Objective Loss 0.029070    MSE 0.029070    LR 0.001000    Time 0.027218    
-2020-12-09 15:41:44,119 - Epoch: [3][ 3000/ 4498]    Overall Loss 0.029053    Objective Loss 0.029053    MSE 0.029053    LR 0.001000    Time 0.027131    
-2020-12-09 15:41:50,682 - Epoch: [3][ 3250/ 4498]    Overall Loss 0.029032    Objective Loss 0.029032    MSE 0.029032    LR 0.001000    Time 0.027058    
-2020-12-09 15:41:57,260 - Epoch: [3][ 3500/ 4498]    Overall Loss 0.029008    Objective Loss 0.029008    MSE 0.029008    LR 0.001000    Time 0.027000    
-2020-12-09 15:42:03,824 - Epoch: [3][ 3750/ 4498]    Overall Loss 0.028984    Objective Loss 0.028984    MSE 0.028984    LR 0.001000    Time 0.026946    
-2020-12-09 15:42:10,392 - Epoch: [3][ 4000/ 4498]    Overall Loss 0.028953    Objective Loss 0.028953    MSE 0.028953    LR 0.001000    Time 0.026900    
-2020-12-09 15:42:16,961 - Epoch: [3][ 4250/ 4498]    Overall Loss 0.028935    Objective Loss 0.028935    MSE 0.028935    LR 0.001000    Time 0.026859    
-2020-12-09 15:42:23,517 - Epoch: [3][ 4498/ 4498]    Overall Loss 0.028908    Objective Loss 0.028908    MSE 0.028908    LR 0.001000    Time 0.026832    
-2020-12-09 15:42:24,357 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15987 |  0.00184 |    0.12457 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11242 | -0.01687 |    0.08494 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09233 | -0.00939 |    0.07020 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08897 | -0.01922 |    0.06845 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09018 | -0.01462 |    0.06685 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10532 | -0.01628 |    0.07839 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11866 | -0.01472 |    0.08751 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17480 | -0.00023 |    0.13614 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:42:24,358 - Total sparsity: 0.00
-
-2020-12-09 15:42:24,360 - --- validate (epoch=3)-----------
-2020-12-09 15:42:24,361 - 49975 samples (100 per mini-batch)
-2020-12-09 15:42:28,950 - Epoch: [3][  250/  500]    Loss 0.028671    MSE 0.028671    
-2020-12-09 15:42:31,328 - Epoch: [3][  500/  500]    Loss 0.028616    MSE 0.028617    
-2020-12-09 15:42:32,032 - ==> MSE: 0.02862    Loss: 0.029
-
-2020-12-09 15:42:32,034 - ==> Best [MSE: 0.02862   Sparsity:0.00   Params: 176048 on epoch: 3]
-2020-12-09 15:42:32,034 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:42:32,046 - 
-
-2020-12-09 15:42:32,047 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:42:41,593 - Epoch: [4][  250/ 4498]    Overall Loss 0.028264    Objective Loss 0.028264    MSE 0.028264    LR 0.001000    Time 0.038114    
-2020-12-09 15:42:48,139 - Epoch: [4][  500/ 4498]    Overall Loss 0.028284    Objective Loss 0.028284    MSE 0.028284    LR 0.001000    Time 0.032117    
-2020-12-09 15:42:54,684 - Epoch: [4][  750/ 4498]    Overall Loss 0.028269    Objective Loss 0.028269    MSE 0.028269    LR 0.001000    Time 0.030114    
-2020-12-09 15:43:01,223 - Epoch: [4][ 1000/ 4498]    Overall Loss 0.028176    Objective Loss 0.028176    MSE 0.028176    LR 0.001000    Time 0.029108    
-2020-12-09 15:43:07,770 - Epoch: [4][ 1250/ 4498]    Overall Loss 0.028180    Objective Loss 0.028180    MSE 0.028180    LR 0.001000    Time 0.028509    
-2020-12-09 15:43:14,312 - Epoch: [4][ 1500/ 4498]    Overall Loss 0.028202    Objective Loss 0.028202    MSE 0.028202    LR 0.001000    Time 0.028108    
-2020-12-09 15:43:20,859 - Epoch: [4][ 1750/ 4498]    Overall Loss 0.028186    Objective Loss 0.028186    MSE 0.028186    LR 0.001000    Time 0.027824    
-2020-12-09 15:43:27,404 - Epoch: [4][ 2000/ 4498]    Overall Loss 0.028190    Objective Loss 0.028190    MSE 0.028190    LR 0.001000    Time 0.027610    
-2020-12-09 15:43:33,952 - Epoch: [4][ 2250/ 4498]    Overall Loss 0.028184    Objective Loss 0.028184    MSE 0.028184    LR 0.001000    Time 0.027445    
-2020-12-09 15:43:40,503 - Epoch: [4][ 2500/ 4498]    Overall Loss 0.028180    Objective Loss 0.028180    MSE 0.028180    LR 0.001000    Time 0.027314    
-2020-12-09 15:43:47,058 - Epoch: [4][ 2750/ 4498]    Overall Loss 0.028173    Objective Loss 0.028173    MSE 0.028173    LR 0.001000    Time 0.027209    
-2020-12-09 15:43:53,616 - Epoch: [4][ 3000/ 4498]    Overall Loss 0.028162    Objective Loss 0.028162    MSE 0.028162    LR 0.001000    Time 0.027122    
-2020-12-09 15:44:00,179 - Epoch: [4][ 3250/ 4498]    Overall Loss 0.028159    Objective Loss 0.028159    MSE 0.028159    LR 0.001000    Time 0.027049    
-2020-12-09 15:44:06,749 - Epoch: [4][ 3500/ 4498]    Overall Loss 0.028148    Objective Loss 0.028148    MSE 0.028148    LR 0.001000    Time 0.026990    
-2020-12-09 15:44:13,313 - Epoch: [4][ 3750/ 4498]    Overall Loss 0.028142    Objective Loss 0.028142    MSE 0.028142    LR 0.001000    Time 0.026936    
-2020-12-09 15:44:19,884 - Epoch: [4][ 4000/ 4498]    Overall Loss 0.028130    Objective Loss 0.028130    MSE 0.028130    LR 0.001000    Time 0.026891    
-2020-12-09 15:44:26,454 - Epoch: [4][ 4250/ 4498]    Overall Loss 0.028123    Objective Loss 0.028123    MSE 0.028123    LR 0.001000    Time 0.026851    
-2020-12-09 15:44:33,007 - Epoch: [4][ 4498/ 4498]    Overall Loss 0.028116    Objective Loss 0.028116    MSE 0.028116    LR 0.001000    Time 0.026824    
-2020-12-09 15:44:33,839 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16133 |  0.00187 |    0.12459 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11609 | -0.01743 |    0.08751 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09448 | -0.00987 |    0.07132 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09133 | -0.01982 |    0.07009 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09596 | -0.01453 |    0.07091 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11173 | -0.01760 |    0.08403 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12550 | -0.01658 |    0.09293 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18349 | -0.00021 |    0.14310 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:44:33,839 - Total sparsity: 0.00
-
-2020-12-09 15:44:33,842 - --- validate (epoch=4)-----------
-2020-12-09 15:44:33,842 - 49975 samples (100 per mini-batch)
-2020-12-09 15:44:38,405 - Epoch: [4][  250/  500]    Loss 0.027984    MSE 0.027984    
-2020-12-09 15:44:40,836 - Epoch: [4][  500/  500]    Loss 0.028038    MSE 0.028038    
-2020-12-09 15:44:41,556 - ==> MSE: 0.02804    Loss: 0.028
-
-2020-12-09 15:44:41,558 - ==> Best [MSE: 0.02804   Sparsity:0.00   Params: 176048 on epoch: 4]
-2020-12-09 15:44:41,558 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:44:41,570 - 
-
-2020-12-09 15:44:41,570 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:44:51,205 - Epoch: [5][  250/ 4498]    Overall Loss 0.027476    Objective Loss 0.027476    MSE 0.027476    LR 0.001000    Time 0.038465    
-2020-12-09 15:44:57,754 - Epoch: [5][  500/ 4498]    Overall Loss 0.027548    Objective Loss 0.027548    MSE 0.027548    LR 0.001000    Time 0.032297    
-2020-12-09 15:45:04,302 - Epoch: [5][  750/ 4498]    Overall Loss 0.027573    Objective Loss 0.027573    MSE 0.027573    LR 0.001000    Time 0.030237    
-2020-12-09 15:45:10,855 - Epoch: [5][ 1000/ 4498]    Overall Loss 0.027593    Objective Loss 0.027593    MSE 0.027593    LR 0.001000    Time 0.029214    
-2020-12-09 15:45:17,408 - Epoch: [5][ 1250/ 4498]    Overall Loss 0.027606    Objective Loss 0.027606    MSE 0.027606    LR 0.001000    Time 0.028600    
-2020-12-09 15:45:23,960 - Epoch: [5][ 1500/ 4498]    Overall Loss 0.027615    Objective Loss 0.027615    MSE 0.027615    LR 0.001000    Time 0.028191    
-2020-12-09 15:45:30,512 - Epoch: [5][ 1750/ 4498]    Overall Loss 0.027610    Objective Loss 0.027610    MSE 0.027610    LR 0.001000    Time 0.027898    
-2020-12-09 15:45:37,066 - Epoch: [5][ 2000/ 4498]    Overall Loss 0.027610    Objective Loss 0.027610    MSE 0.027610    LR 0.001000    Time 0.027679    
-2020-12-09 15:45:43,623 - Epoch: [5][ 2250/ 4498]    Overall Loss 0.027604    Objective Loss 0.027604    MSE 0.027604    LR 0.001000    Time 0.027509    
-2020-12-09 15:45:50,181 - Epoch: [5][ 2500/ 4498]    Overall Loss 0.027597    Objective Loss 0.027597    MSE 0.027597    LR 0.001000    Time 0.027375    
-2020-12-09 15:45:56,736 - Epoch: [5][ 2750/ 4498]    Overall Loss 0.027583    Objective Loss 0.027583    MSE 0.027583    LR 0.001000    Time 0.027264    
-2020-12-09 15:46:03,294 - Epoch: [5][ 3000/ 4498]    Overall Loss 0.027582    Objective Loss 0.027582    MSE 0.027582    LR 0.001000    Time 0.027172    
-2020-12-09 15:46:09,846 - Epoch: [5][ 3250/ 4498]    Overall Loss 0.027571    Objective Loss 0.027571    MSE 0.027571    LR 0.001000    Time 0.027093    
-2020-12-09 15:46:16,403 - Epoch: [5][ 3500/ 4498]    Overall Loss 0.027566    Objective Loss 0.027566    MSE 0.027566    LR 0.001000    Time 0.027026    
-2020-12-09 15:46:22,968 - Epoch: [5][ 3750/ 4498]    Overall Loss 0.027562    Objective Loss 0.027562    MSE 0.027562    LR 0.001000    Time 0.026971    
-2020-12-09 15:46:29,536 - Epoch: [5][ 4000/ 4498]    Overall Loss 0.027559    Objective Loss 0.027559    MSE 0.027559    LR 0.001000    Time 0.026923    
-2020-12-09 15:46:36,112 - Epoch: [5][ 4250/ 4498]    Overall Loss 0.027557    Objective Loss 0.027557    MSE 0.027557    LR 0.001000    Time 0.026882    
-2020-12-09 15:46:42,700 - Epoch: [5][ 4498/ 4498]    Overall Loss 0.027545    Objective Loss 0.027545    MSE 0.027545    LR 0.001000    Time 0.026861    
-2020-12-09 15:46:43,509 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16402 |  0.00188 |    0.12554 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12083 | -0.01711 |    0.09029 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09638 | -0.01041 |    0.07228 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09315 | -0.02003 |    0.07125 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09950 | -0.01429 |    0.07293 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11591 | -0.01894 |    0.08721 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.13161 | -0.01767 |    0.09732 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.19056 | -0.00021 |    0.14904 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:46:43,510 - Total sparsity: 0.00
-
-2020-12-09 15:46:43,513 - --- validate (epoch=5)-----------
-2020-12-09 15:46:43,513 - 49975 samples (100 per mini-batch)
-2020-12-09 15:46:48,175 - Epoch: [5][  250/  500]    Loss 0.027288    MSE 0.027288    
-2020-12-09 15:46:50,593 - Epoch: [5][  500/  500]    Loss 0.027304    MSE 0.027304    
-2020-12-09 15:46:51,340 - ==> MSE: 0.02730    Loss: 0.027
-
-2020-12-09 15:46:51,343 - ==> Best [MSE: 0.02730   Sparsity:0.00   Params: 176048 on epoch: 5]
-2020-12-09 15:46:51,343 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:46:51,355 - 
-
-2020-12-09 15:46:51,355 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:47:01,004 - Epoch: [6][  250/ 4498]    Overall Loss 0.027118    Objective Loss 0.027118    MSE 0.027118    LR 0.001000    Time 0.038522    
-2020-12-09 15:47:07,503 - Epoch: [6][  500/ 4498]    Overall Loss 0.027061    Objective Loss 0.027061    MSE 0.027061    LR 0.001000    Time 0.032226    
-2020-12-09 15:47:14,005 - Epoch: [6][  750/ 4498]    Overall Loss 0.027123    Objective Loss 0.027123    MSE 0.027123    LR 0.001000    Time 0.030127    
-2020-12-09 15:47:20,508 - Epoch: [6][ 1000/ 4498]    Overall Loss 0.027166    Objective Loss 0.027166    MSE 0.027166    LR 0.001000    Time 0.029082    
-2020-12-09 15:47:27,035 - Epoch: [6][ 1250/ 4498]    Overall Loss 0.027171    Objective Loss 0.027171    MSE 0.027171    LR 0.001000    Time 0.028472    
-2020-12-09 15:47:33,558 - Epoch: [6][ 1500/ 4498]    Overall Loss 0.027167    Objective Loss 0.027167    MSE 0.027167    LR 0.001000    Time 0.028063    
-2020-12-09 15:47:40,079 - Epoch: [6][ 1750/ 4498]    Overall Loss 0.027169    Objective Loss 0.027169    MSE 0.027169    LR 0.001000    Time 0.027770    
-2020-12-09 15:47:46,601 - Epoch: [6][ 2000/ 4498]    Overall Loss 0.027174    Objective Loss 0.027174    MSE 0.027174    LR 0.001000    Time 0.027550    
-2020-12-09 15:47:53,125 - Epoch: [6][ 2250/ 4498]    Overall Loss 0.027182    Objective Loss 0.027182    MSE 0.027182    LR 0.001000    Time 0.027381    
-2020-12-09 15:47:59,669 - Epoch: [6][ 2500/ 4498]    Overall Loss 0.027182    Objective Loss 0.027182    MSE 0.027182    LR 0.001000    Time 0.027254    
-2020-12-09 15:48:06,222 - Epoch: [6][ 2750/ 4498]    Overall Loss 0.027175    Objective Loss 0.027175    MSE 0.027175    LR 0.001000    Time 0.027153    
-2020-12-09 15:48:12,773 - Epoch: [6][ 3000/ 4498]    Overall Loss 0.027170    Objective Loss 0.027170    MSE 0.027170    LR 0.001000    Time 0.027068    
-2020-12-09 15:48:19,365 - Epoch: [6][ 3250/ 4498]    Overall Loss 0.027172    Objective Loss 0.027172    MSE 0.027172    LR 0.001000    Time 0.027009    
-2020-12-09 15:48:25,963 - Epoch: [6][ 3500/ 4498]    Overall Loss 0.027176    Objective Loss 0.027176    MSE 0.027176    LR 0.001000    Time 0.026960    
-2020-12-09 15:48:32,521 - Epoch: [6][ 3750/ 4498]    Overall Loss 0.027179    Objective Loss 0.027179    MSE 0.027179    LR 0.001000    Time 0.026907    
-2020-12-09 15:48:39,084 - Epoch: [6][ 4000/ 4498]    Overall Loss 0.027177    Objective Loss 0.027177    MSE 0.027177    LR 0.001000    Time 0.026862    
-2020-12-09 15:48:45,688 - Epoch: [6][ 4250/ 4498]    Overall Loss 0.027169    Objective Loss 0.027169    MSE 0.027169    LR 0.001000    Time 0.026831    
-2020-12-09 15:48:52,277 - Epoch: [6][ 4498/ 4498]    Overall Loss 0.027167    Objective Loss 0.027167    MSE 0.027167    LR 0.001000    Time 0.026814    
-2020-12-09 15:48:53,050 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16565 |  0.00197 |    0.12543 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12446 | -0.01708 |    0.09217 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09715 | -0.01067 |    0.07263 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09495 | -0.02015 |    0.07240 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10277 | -0.01450 |    0.07510 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11936 | -0.02015 |    0.08987 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.13639 | -0.01899 |    0.10054 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.19534 | -0.00020 |    0.15286 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:48:53,050 - Total sparsity: 0.00
-
-2020-12-09 15:48:53,053 - --- validate (epoch=6)-----------
-2020-12-09 15:48:53,053 - 49975 samples (100 per mini-batch)
-2020-12-09 15:48:57,622 - Epoch: [6][  250/  500]    Loss 0.027574    MSE 0.027574    
-2020-12-09 15:49:00,042 - Epoch: [6][  500/  500]    Loss 0.027533    MSE 0.027533    
-2020-12-09 15:49:00,716 - ==> MSE: 0.02753    Loss: 0.028
-
-2020-12-09 15:49:00,719 - ==> Best [MSE: 0.02730   Sparsity:0.00   Params: 176048 on epoch: 5]
-2020-12-09 15:49:00,719 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:49:00,724 - 
-
-2020-12-09 15:49:00,724 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:49:10,376 - Epoch: [7][  250/ 4498]    Overall Loss 0.026772    Objective Loss 0.026772    MSE 0.026772    LR 0.001000    Time 0.038542    
-2020-12-09 15:49:16,912 - Epoch: [7][  500/ 4498]    Overall Loss 0.026818    Objective Loss 0.026818    MSE 0.026818    LR 0.001000    Time 0.032307    
-2020-12-09 15:49:23,453 - Epoch: [7][  750/ 4498]    Overall Loss 0.026829    Objective Loss 0.026829    MSE 0.026829    LR 0.001000    Time 0.030236    
-2020-12-09 15:49:30,012 - Epoch: [7][ 1000/ 4498]    Overall Loss 0.026842    Objective Loss 0.026842    MSE 0.026842    LR 0.001000    Time 0.029218    
-2020-12-09 15:49:36,565 - Epoch: [7][ 1250/ 4498]    Overall Loss 0.026881    Objective Loss 0.026881    MSE 0.026881    LR 0.001000    Time 0.028603    
-2020-12-09 15:49:43,115 - Epoch: [7][ 1500/ 4498]    Overall Loss 0.026878    Objective Loss 0.026878    MSE 0.026878    LR 0.001000    Time 0.028192    
-2020-12-09 15:49:49,660 - Epoch: [7][ 1750/ 4498]    Overall Loss 0.026881    Objective Loss 0.026881    MSE 0.026881    LR 0.001000    Time 0.027895    
-2020-12-09 15:49:56,204 - Epoch: [7][ 2000/ 4498]    Overall Loss 0.026888    Objective Loss 0.026888    MSE 0.026888    LR 0.001000    Time 0.027671    
-2020-12-09 15:50:02,754 - Epoch: [7][ 2250/ 4498]    Overall Loss 0.026898    Objective Loss 0.026898    MSE 0.026898    LR 0.001000    Time 0.027500    
-2020-12-09 15:50:09,324 - Epoch: [7][ 2500/ 4498]    Overall Loss 0.026897    Objective Loss 0.026897    MSE 0.026897    LR 0.001000    Time 0.027371    
-2020-12-09 15:50:15,844 - Epoch: [7][ 2750/ 4498]    Overall Loss 0.026890    Objective Loss 0.026890    MSE 0.026890    LR 0.001000    Time 0.027248    
-2020-12-09 15:50:22,358 - Epoch: [7][ 3000/ 4498]    Overall Loss 0.026889    Objective Loss 0.026889    MSE 0.026889    LR 0.001000    Time 0.027143    
-2020-12-09 15:50:28,868 - Epoch: [7][ 3250/ 4498]    Overall Loss 0.026888    Objective Loss 0.026888    MSE 0.026888    LR 0.001000    Time 0.027053    
-2020-12-09 15:50:35,389 - Epoch: [7][ 3500/ 4498]    Overall Loss 0.026895    Objective Loss 0.026895    MSE 0.026895    LR 0.001000    Time 0.026979    
-2020-12-09 15:50:41,912 - Epoch: [7][ 3750/ 4498]    Overall Loss 0.026900    Objective Loss 0.026900    MSE 0.026900    LR 0.001000    Time 0.026915    
-2020-12-09 15:50:48,430 - Epoch: [7][ 4000/ 4498]    Overall Loss 0.026893    Objective Loss 0.026893    MSE 0.026893    LR 0.001000    Time 0.026859    
-2020-12-09 15:50:54,953 - Epoch: [7][ 4250/ 4498]    Overall Loss 0.026884    Objective Loss 0.026884    MSE 0.026884    LR 0.001000    Time 0.026810    
-2020-12-09 15:51:01,455 - Epoch: [7][ 4498/ 4498]    Overall Loss 0.026880    Objective Loss 0.026880    MSE 0.026879    LR 0.001000    Time 0.026774    
-2020-12-09 15:51:02,228 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16504 |  0.00185 |    0.12521 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12914 | -0.01680 |    0.09430 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09843 | -0.01119 |    0.07312 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09648 | -0.02094 |    0.07347 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10535 | -0.01429 |    0.07661 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12221 | -0.02031 |    0.09164 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14119 | -0.02030 |    0.10403 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.20009 | -0.00010 |    0.15681 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:51:02,228 - Total sparsity: 0.00
-
-2020-12-09 15:51:02,231 - --- validate (epoch=7)-----------
-2020-12-09 15:51:02,231 - 49975 samples (100 per mini-batch)
-2020-12-09 15:51:06,782 - Epoch: [7][  250/  500]    Loss 0.027069    MSE 0.027069    
-2020-12-09 15:51:09,175 - Epoch: [7][  500/  500]    Loss 0.027105    MSE 0.027106    
-2020-12-09 15:51:09,906 - ==> MSE: 0.02711    Loss: 0.027
-
-2020-12-09 15:51:09,909 - ==> Best [MSE: 0.02711   Sparsity:0.00   Params: 176048 on epoch: 7]
-2020-12-09 15:51:09,909 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:51:09,921 - 
-
-2020-12-09 15:51:09,921 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:51:19,550 - Epoch: [8][  250/ 4498]    Overall Loss 0.026583    Objective Loss 0.026583    MSE 0.026583    LR 0.001000    Time 0.038448    
-2020-12-09 15:51:26,086 - Epoch: [8][  500/ 4498]    Overall Loss 0.026593    Objective Loss 0.026593    MSE 0.026593    LR 0.001000    Time 0.032262    
-2020-12-09 15:51:32,632 - Epoch: [8][  750/ 4498]    Overall Loss 0.026624    Objective Loss 0.026624    MSE 0.026624    LR 0.001000    Time 0.030214    
-2020-12-09 15:51:39,158 - Epoch: [8][ 1000/ 4498]    Overall Loss 0.026633    Objective Loss 0.026633    MSE 0.026633    LR 0.001000    Time 0.029169    
-2020-12-09 15:51:45,664 - Epoch: [8][ 1250/ 4498]    Overall Loss 0.026657    Objective Loss 0.026657    MSE 0.026657    LR 0.001000    Time 0.028524    
-2020-12-09 15:51:52,158 - Epoch: [8][ 1500/ 4498]    Overall Loss 0.026657    Objective Loss 0.026657    MSE 0.026657    LR 0.001000    Time 0.028088    
-2020-12-09 15:51:58,653 - Epoch: [8][ 1750/ 4498]    Overall Loss 0.026657    Objective Loss 0.026657    MSE 0.026657    LR 0.001000    Time 0.027777    
-2020-12-09 15:52:05,153 - Epoch: [8][ 2000/ 4498]    Overall Loss 0.026661    Objective Loss 0.026661    MSE 0.026661    LR 0.001000    Time 0.027546    
-2020-12-09 15:52:11,661 - Epoch: [8][ 2250/ 4498]    Overall Loss 0.026666    Objective Loss 0.026666    MSE 0.026666    LR 0.001000    Time 0.027370    
-2020-12-09 15:52:18,188 - Epoch: [8][ 2500/ 4498]    Overall Loss 0.026662    Objective Loss 0.026662    MSE 0.026662    LR 0.001000    Time 0.027237    
-2020-12-09 15:52:24,731 - Epoch: [8][ 2750/ 4498]    Overall Loss 0.026657    Objective Loss 0.026657    MSE 0.026657    LR 0.001000    Time 0.027133    
-2020-12-09 15:52:31,277 - Epoch: [8][ 3000/ 4498]    Overall Loss 0.026648    Objective Loss 0.026648    MSE 0.026648    LR 0.001000    Time 0.027049    
-2020-12-09 15:52:37,825 - Epoch: [8][ 3250/ 4498]    Overall Loss 0.026644    Objective Loss 0.026644    MSE 0.026644    LR 0.001000    Time 0.026978    
-2020-12-09 15:52:44,379 - Epoch: [8][ 3500/ 4498]    Overall Loss 0.026637    Objective Loss 0.026637    MSE 0.026637    LR 0.001000    Time 0.026918    
-2020-12-09 15:52:50,936 - Epoch: [8][ 3750/ 4498]    Overall Loss 0.026645    Objective Loss 0.026645    MSE 0.026645    LR 0.001000    Time 0.026868    
-2020-12-09 15:52:57,497 - Epoch: [8][ 4000/ 4498]    Overall Loss 0.026649    Objective Loss 0.026649    MSE 0.026649    LR 0.001000    Time 0.026824    
-2020-12-09 15:53:04,054 - Epoch: [8][ 4250/ 4498]    Overall Loss 0.026652    Objective Loss 0.026652    MSE 0.026652    LR 0.001000    Time 0.026785    
-2020-12-09 15:53:10,599 - Epoch: [8][ 4498/ 4498]    Overall Loss 0.026656    Objective Loss 0.026656    MSE 0.026656    LR 0.001000    Time 0.026760    
-2020-12-09 15:53:11,417 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16703 |  0.00296 |    0.12562 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.13369 | -0.01668 |    0.09616 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09950 | -0.01169 |    0.07327 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09789 | -0.02103 |    0.07435 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10780 | -0.01465 |    0.07815 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12448 | -0.02091 |    0.09316 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14506 | -0.02095 |    0.10636 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.20323 | -0.00017 |    0.15922 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:53:11,417 - Total sparsity: 0.00
-
-2020-12-09 15:53:11,420 - --- validate (epoch=8)-----------
-2020-12-09 15:53:11,420 - 49975 samples (100 per mini-batch)
-2020-12-09 15:53:16,161 - Epoch: [8][  250/  500]    Loss 0.027163    MSE 0.027163    
-2020-12-09 15:53:18,579 - Epoch: [8][  500/  500]    Loss 0.027171    MSE 0.027172    
-2020-12-09 15:53:19,315 - ==> MSE: 0.02717    Loss: 0.027
-
-2020-12-09 15:53:19,317 - ==> Best [MSE: 0.02711   Sparsity:0.00   Params: 176048 on epoch: 7]
-2020-12-09 15:53:19,317 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:53:19,322 - 
-
-2020-12-09 15:53:19,322 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:53:28,975 - Epoch: [9][  250/ 4498]    Overall Loss 0.026290    Objective Loss 0.026290    MSE 0.026290    LR 0.001000    Time 0.038544    
-2020-12-09 15:53:35,497 - Epoch: [9][  500/ 4498]    Overall Loss 0.026334    Objective Loss 0.026334    MSE 0.026334    LR 0.001000    Time 0.032279    
-2020-12-09 15:53:42,017 - Epoch: [9][  750/ 4498]    Overall Loss 0.026377    Objective Loss 0.026377    MSE 0.026377    LR 0.001000    Time 0.030187    
-2020-12-09 15:53:48,555 - Epoch: [9][ 1000/ 4498]    Overall Loss 0.026415    Objective Loss 0.026415    MSE 0.026415    LR 0.001000    Time 0.029160    
-2020-12-09 15:53:55,104 - Epoch: [9][ 1250/ 4498]    Overall Loss 0.026398    Objective Loss 0.026398    MSE 0.026398    LR 0.001000    Time 0.028552    
-2020-12-09 15:54:01,654 - Epoch: [9][ 1500/ 4498]    Overall Loss 0.026425    Objective Loss 0.026425    MSE 0.026425    LR 0.001000    Time 0.028149    
-2020-12-09 15:54:08,179 - Epoch: [9][ 1750/ 4498]    Overall Loss 0.026432    Objective Loss 0.026432    MSE 0.026432    LR 0.001000    Time 0.027846    
-2020-12-09 15:54:14,694 - Epoch: [9][ 2000/ 4498]    Overall Loss 0.026435    Objective Loss 0.026435    MSE 0.026435    LR 0.001000    Time 0.027614    
-2020-12-09 15:54:21,216 - Epoch: [9][ 2250/ 4498]    Overall Loss 0.026450    Objective Loss 0.026450    MSE 0.026450    LR 0.001000    Time 0.027438    
-2020-12-09 15:54:27,763 - Epoch: [9][ 2500/ 4498]    Overall Loss 0.026457    Objective Loss 0.026457    MSE 0.026457    LR 0.001000    Time 0.027305    
-2020-12-09 15:54:34,307 - Epoch: [9][ 2750/ 4498]    Overall Loss 0.026456    Objective Loss 0.026456    MSE 0.026456    LR 0.001000    Time 0.027196    
-2020-12-09 15:54:40,857 - Epoch: [9][ 3000/ 4498]    Overall Loss 0.026462    Objective Loss 0.026462    MSE 0.026462    LR 0.001000    Time 0.027108    
-2020-12-09 15:54:47,418 - Epoch: [9][ 3250/ 4498]    Overall Loss 0.026467    Objective Loss 0.026467    MSE 0.026467    LR 0.001000    Time 0.027035    
-2020-12-09 15:54:53,986 - Epoch: [9][ 3500/ 4498]    Overall Loss 0.026472    Objective Loss 0.026472    MSE 0.026472    LR 0.001000    Time 0.026976    
-2020-12-09 15:55:00,549 - Epoch: [9][ 3750/ 4498]    Overall Loss 0.026481    Objective Loss 0.026481    MSE 0.026481    LR 0.001000    Time 0.026922    
-2020-12-09 15:55:07,114 - Epoch: [9][ 4000/ 4498]    Overall Loss 0.026482    Objective Loss 0.026482    MSE 0.026482    LR 0.001000    Time 0.026877    
-2020-12-09 15:55:13,670 - Epoch: [9][ 4250/ 4498]    Overall Loss 0.026496    Objective Loss 0.026496    MSE 0.026496    LR 0.001000    Time 0.026834    
-2020-12-09 15:55:20,203 - Epoch: [9][ 4498/ 4498]    Overall Loss 0.026492    Objective Loss 0.026492    MSE 0.026492    LR 0.001000    Time 0.026804    
-2020-12-09 15:55:20,979 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16787 |  0.00136 |    0.12634 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.13816 | -0.01702 |    0.09833 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10024 | -0.01157 |    0.07346 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09927 | -0.02155 |    0.07508 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.11019 | -0.01473 |    0.07990 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12684 | -0.02147 |    0.09507 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14849 | -0.02180 |    0.10848 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.20590 | -0.00019 |    0.16129 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:55:20,979 - Total sparsity: 0.00
-
-2020-12-09 15:55:20,982 - --- validate (epoch=9)-----------
-2020-12-09 15:55:20,983 - 49975 samples (100 per mini-batch)
-2020-12-09 15:55:25,604 - Epoch: [9][  250/  500]    Loss 0.026891    MSE 0.026891    
-2020-12-09 15:55:28,005 - Epoch: [9][  500/  500]    Loss 0.026872    MSE 0.026872    
-2020-12-09 15:55:28,745 - ==> MSE: 0.02687    Loss: 0.027
-
-2020-12-09 15:55:28,748 - ==> Best [MSE: 0.02687   Sparsity:0.00   Params: 176048 on epoch: 9]
-2020-12-09 15:55:28,748 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:55:28,774 - 
-
-2020-12-09 15:55:28,775 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:55:39,949 - Epoch: [10][  250/ 4498]    Overall Loss 0.025715    Objective Loss 0.025715    MSE 0.025715    LR 0.000500    Time 0.044631    
-2020-12-09 15:55:48,034 - Epoch: [10][  500/ 4498]    Overall Loss 0.025675    Objective Loss 0.025675    MSE 0.025675    LR 0.000500    Time 0.038450    
-2020-12-09 15:55:56,106 - Epoch: [10][  750/ 4498]    Overall Loss 0.025678    Objective Loss 0.025678    MSE 0.025678    LR 0.000500    Time 0.036374    
-2020-12-09 15:56:04,177 - Epoch: [10][ 1000/ 4498]    Overall Loss 0.025653    Objective Loss 0.025653    MSE 0.025653    LR 0.000500    Time 0.035334    
-2020-12-09 15:56:12,245 - Epoch: [10][ 1250/ 4498]    Overall Loss 0.025677    Objective Loss 0.025677    MSE 0.025677    LR 0.000500    Time 0.034708    
-2020-12-09 15:56:20,320 - Epoch: [10][ 1500/ 4498]    Overall Loss 0.025670    Objective Loss 0.025670    MSE 0.025670    LR 0.000500    Time 0.034295    
-2020-12-09 15:56:28,421 - Epoch: [10][ 1750/ 4498]    Overall Loss 0.025650    Objective Loss 0.025650    MSE 0.025650    LR 0.000500    Time 0.034015    
-2020-12-09 15:56:36,556 - Epoch: [10][ 2000/ 4498]    Overall Loss 0.025648    Objective Loss 0.025648    MSE 0.025648    LR 0.000500    Time 0.033822    
-2020-12-09 15:56:44,718 - Epoch: [10][ 2250/ 4498]    Overall Loss 0.025638    Objective Loss 0.025638    MSE 0.025638    LR 0.000500    Time 0.033684    
-2020-12-09 15:56:52,813 - Epoch: [10][ 2500/ 4498]    Overall Loss 0.025643    Objective Loss 0.025643    MSE 0.025643    LR 0.000500    Time 0.033547    
-2020-12-09 15:57:00,885 - Epoch: [10][ 2750/ 4498]    Overall Loss 0.025649    Objective Loss 0.025649    MSE 0.025649    LR 0.000500    Time 0.033426    
-2020-12-09 15:57:08,967 - Epoch: [10][ 3000/ 4498]    Overall Loss 0.025639    Objective Loss 0.025639    MSE 0.025639    LR 0.000500    Time 0.033329    
-2020-12-09 15:57:17,051 - Epoch: [10][ 3250/ 4498]    Overall Loss 0.025642    Objective Loss 0.025642    MSE 0.025642    LR 0.000500    Time 0.033247    
-2020-12-09 15:57:25,135 - Epoch: [10][ 3500/ 4498]    Overall Loss 0.025640    Objective Loss 0.025640    MSE 0.025640    LR 0.000500    Time 0.033177    
-2020-12-09 15:57:33,212 - Epoch: [10][ 3750/ 4498]    Overall Loss 0.025643    Objective Loss 0.025643    MSE 0.025643    LR 0.000500    Time 0.033115    
-2020-12-09 15:57:41,290 - Epoch: [10][ 4000/ 4498]    Overall Loss 0.025648    Objective Loss 0.025648    MSE 0.025648    LR 0.000500    Time 0.033060    
-2020-12-09 15:57:49,372 - Epoch: [10][ 4250/ 4498]    Overall Loss 0.025646    Objective Loss 0.025646    MSE 0.025646    LR 0.000500    Time 0.033013    
-2020-12-09 15:57:57,420 - Epoch: [10][ 4498/ 4498]    Overall Loss 0.025645    Objective Loss 0.025645    MSE 0.025645    LR 0.000500    Time 0.032979    
-2020-12-09 15:57:58,234 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16656 |  0.00289 |    0.12480 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.13817 | -0.01582 |    0.09797 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09812 | -0.01111 |    0.07153 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09787 | -0.02060 |    0.07379 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10918 | -0.01365 |    0.07906 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12586 | -0.02019 |    0.09427 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14870 | -0.02092 |    0.10881 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.21057 |  0.00016 |    0.16533 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 15:57:58,234 - Total sparsity: 0.00
-
-2020-12-09 15:57:58,237 - --- validate (epoch=10)-----------
-2020-12-09 15:57:58,237 - 49975 samples (100 per mini-batch)
-2020-12-09 15:58:03,717 - Epoch: [10][  250/  500]    Loss 0.026095    MSE 0.026095    
-2020-12-09 15:58:07,153 - Epoch: [10][  500/  500]    Loss 0.026146    MSE 0.026146    
-2020-12-09 15:58:07,822 - ==> MSE: 0.02615    Loss: 0.026
-
-2020-12-09 15:58:07,825 - ==> Best [MSE: 0.02615   Sparsity:0.00   Params: 176048 on epoch: 10]
-2020-12-09 15:58:07,825 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 15:58:07,837 - 
-
-2020-12-09 15:58:07,837 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 15:58:18,940 - Epoch: [11][  250/ 4498]    Overall Loss 0.025387    Objective Loss 0.025387    MSE 0.025387    LR 0.000500    Time 0.044343    
-2020-12-09 15:58:27,036 - Epoch: [11][  500/ 4498]    Overall Loss 0.025415    Objective Loss 0.025415    MSE 0.025415    LR 0.000500    Time 0.038328    
-2020-12-09 15:58:35,129 - Epoch: [11][  750/ 4498]    Overall Loss 0.025409    Objective Loss 0.025409    MSE 0.025409    LR 0.000500    Time 0.036321    
-2020-12-09 15:58:43,222 - Epoch: [11][ 1000/ 4498]    Overall Loss 0.025403    Objective Loss 0.025403    MSE 0.025403    LR 0.000500    Time 0.035316    
-2020-12-09 15:58:51,277 - Epoch: [11][ 1250/ 4498]    Overall Loss 0.025417    Objective Loss 0.025417    MSE 0.025417    LR 0.000500    Time 0.034683    
-2020-12-09 15:58:59,351 - Epoch: [11][ 1500/ 4498]    Overall Loss 0.025413    Objective Loss 0.025413    MSE 0.025413    LR 0.000500    Time 0.034274    
-2020-12-09 15:59:07,348 - Epoch: [11][ 1750/ 4498]    Overall Loss 0.025422    Objective Loss 0.025422    MSE 0.025422    LR 0.000500    Time 0.033937    
-2020-12-09 15:59:15,338 - Epoch: [11][ 2000/ 4498]    Overall Loss 0.025425    Objective Loss 0.025425    MSE 0.025425    LR 0.000500    Time 0.033681    
-2020-12-09 15:59:23,329 - Epoch: [11][ 2250/ 4498]    Overall Loss 0.025429    Objective Loss 0.025429    MSE 0.025429    LR 0.000500    Time 0.033483    
-2020-12-09 15:59:31,315 - Epoch: [11][ 2500/ 4498]    Overall Loss 0.025446    Objective Loss 0.025446    MSE 0.025446    LR 0.000500    Time 0.033322    
-2020-12-09 15:59:39,312 - Epoch: [11][ 2750/ 4498]    Overall Loss 0.025443    Objective Loss 0.025443    MSE 0.025443    LR 0.000500    Time 0.033195    
-2020-12-09 15:59:47,304 - Epoch: [11][ 3000/ 4498]    Overall Loss 0.025440    Objective Loss 0.025440    MSE 0.025440    LR 0.000500    Time 0.033087    
-2020-12-09 15:59:55,290 - Epoch: [11][ 3250/ 4498]    Overall Loss 0.025457    Objective Loss 0.025457    MSE 0.025457    LR 0.000500    Time 0.032993    
-2020-12-09 16:00:03,266 - Epoch: [11][ 3500/ 4498]    Overall Loss 0.025464    Objective Loss 0.025464    MSE 0.025464    LR 0.000500    Time 0.032911    
-2020-12-09 16:00:11,260 - Epoch: [11][ 3750/ 4498]    Overall Loss 0.025466    Objective Loss 0.025466    MSE 0.025466    LR 0.000500    Time 0.032844    
-2020-12-09 16:00:19,256 - Epoch: [11][ 4000/ 4498]    Overall Loss 0.025464    Objective Loss 0.025464    MSE 0.025464    LR 0.000500    Time 0.032786    
-2020-12-09 16:00:27,246 - Epoch: [11][ 4250/ 4498]    Overall Loss 0.025469    Objective Loss 0.025469    MSE 0.025469    LR 0.000500    Time 0.032733    
-2020-12-09 16:00:35,189 - Epoch: [11][ 4498/ 4498]    Overall Loss 0.025469    Objective Loss 0.025469    MSE 0.025469    LR 0.000500    Time 0.032691    
-2020-12-09 16:00:36,022 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16695 |  0.00334 |    0.12518 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.13917 | -0.01560 |    0.09845 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09695 | -0.01065 |    0.07060 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09712 | -0.02038 |    0.07311 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10867 | -0.01338 |    0.07859 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12546 | -0.01995 |    0.09413 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14929 | -0.02073 |    0.10941 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.21478 |  0.00013 |    0.16885 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:00:36,022 - Total sparsity: 0.00
-
-2020-12-09 16:00:36,025 - --- validate (epoch=11)-----------
-2020-12-09 16:00:36,025 - 49975 samples (100 per mini-batch)
-2020-12-09 16:00:41,723 - Epoch: [11][  250/  500]    Loss 0.026181    MSE 0.026181    
-2020-12-09 16:00:45,183 - Epoch: [11][  500/  500]    Loss 0.026135    MSE 0.026134    
-2020-12-09 16:00:45,944 - ==> MSE: 0.02613    Loss: 0.026
-
-2020-12-09 16:00:45,947 - ==> Best [MSE: 0.02613   Sparsity:0.00   Params: 176048 on epoch: 11]
-2020-12-09 16:00:45,947 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:00:45,953 - 
-
-2020-12-09 16:00:45,953 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:00:56,925 - Epoch: [12][  250/ 4498]    Overall Loss 0.025264    Objective Loss 0.025264    MSE 0.025264    LR 0.000500    Time 0.043819    
-2020-12-09 16:01:04,975 - Epoch: [12][  500/ 4498]    Overall Loss 0.025263    Objective Loss 0.025263    MSE 0.025263    LR 0.000500    Time 0.037976    
-2020-12-09 16:01:13,000 - Epoch: [12][  750/ 4498]    Overall Loss 0.025268    Objective Loss 0.025268    MSE 0.025268    LR 0.000500    Time 0.035994    
-2020-12-09 16:01:21,006 - Epoch: [12][ 1000/ 4498]    Overall Loss 0.025286    Objective Loss 0.025286    MSE 0.025286    LR 0.000500    Time 0.034984    
-2020-12-09 16:01:29,083 - Epoch: [12][ 1250/ 4498]    Overall Loss 0.025330    Objective Loss 0.025330    MSE 0.025330    LR 0.000500    Time 0.034435    
-2020-12-09 16:01:37,150 - Epoch: [12][ 1500/ 4498]    Overall Loss 0.025335    Objective Loss 0.025335    MSE 0.025335    LR 0.000500    Time 0.034062    
-2020-12-09 16:01:45,203 - Epoch: [12][ 1750/ 4498]    Overall Loss 0.025334    Objective Loss 0.025334    MSE 0.025334    LR 0.000500    Time 0.033788    
-2020-12-09 16:01:53,263 - Epoch: [12][ 2000/ 4498]    Overall Loss 0.025353    Objective Loss 0.025353    MSE 0.025353    LR 0.000500    Time 0.033586    
-2020-12-09 16:02:01,318 - Epoch: [12][ 2250/ 4498]    Overall Loss 0.025353    Objective Loss 0.025353    MSE 0.025353    LR 0.000500    Time 0.033427    
-2020-12-09 16:02:09,369 - Epoch: [12][ 2500/ 4498]    Overall Loss 0.025348    Objective Loss 0.025348    MSE 0.025348    LR 0.000500    Time 0.033298    
-2020-12-09 16:02:17,403 - Epoch: [12][ 2750/ 4498]    Overall Loss 0.025345    Objective Loss 0.025345    MSE 0.025345    LR 0.000500    Time 0.033186    
-2020-12-09 16:02:25,439 - Epoch: [12][ 3000/ 4498]    Overall Loss 0.025339    Objective Loss 0.025339    MSE 0.025339    LR 0.000500    Time 0.033093    
-2020-12-09 16:02:33,466 - Epoch: [12][ 3250/ 4498]    Overall Loss 0.025346    Objective Loss 0.025346    MSE 0.025346    LR 0.000500    Time 0.033012    
-2020-12-09 16:02:41,482 - Epoch: [12][ 3500/ 4498]    Overall Loss 0.025354    Objective Loss 0.025354    MSE 0.025354    LR 0.000500    Time 0.032940    
-2020-12-09 16:02:49,495 - Epoch: [12][ 3750/ 4498]    Overall Loss 0.025353    Objective Loss 0.025353    MSE 0.025353    LR 0.000500    Time 0.032876    
-2020-12-09 16:02:57,556 - Epoch: [12][ 4000/ 4498]    Overall Loss 0.025359    Objective Loss 0.025359    MSE 0.025359    LR 0.000500    Time 0.032832    
-2020-12-09 16:03:05,619 - Epoch: [12][ 4250/ 4498]    Overall Loss 0.025364    Objective Loss 0.025364    MSE 0.025364    LR 0.000500    Time 0.032794    
-2020-12-09 16:03:13,638 - Epoch: [12][ 4498/ 4498]    Overall Loss 0.025364    Objective Loss 0.025364    MSE 0.025364    LR 0.000500    Time 0.032766    
-2020-12-09 16:03:14,421 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16751 |  0.00305 |    0.12576 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14003 | -0.01550 |    0.09885 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09590 | -0.01061 |    0.06970 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09654 | -0.01998 |    0.07263 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10834 | -0.01306 |    0.07825 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12529 | -0.01978 |    0.09408 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15007 | -0.02104 |    0.11017 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.21815 |  0.00015 |    0.17161 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:03:14,421 - Total sparsity: 0.00
-
-2020-12-09 16:03:14,424 - --- validate (epoch=12)-----------
-2020-12-09 16:03:14,424 - 49975 samples (100 per mini-batch)
-2020-12-09 16:03:19,841 - Epoch: [12][  250/  500]    Loss 0.025653    MSE 0.025653    
-2020-12-09 16:03:23,274 - Epoch: [12][  500/  500]    Loss 0.025740    MSE 0.025740    
-2020-12-09 16:03:24,025 - ==> MSE: 0.02574    Loss: 0.026
-
-2020-12-09 16:03:24,028 - ==> Best [MSE: 0.02574   Sparsity:0.00   Params: 176048 on epoch: 12]
-2020-12-09 16:03:24,028 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:03:24,040 - 
-
-2020-12-09 16:03:24,041 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:03:35,213 - Epoch: [13][  250/ 4498]    Overall Loss 0.025001    Objective Loss 0.025001    MSE 0.025001    LR 0.000500    Time 0.044620    
-2020-12-09 16:03:43,297 - Epoch: [13][  500/ 4498]    Overall Loss 0.025136    Objective Loss 0.025136    MSE 0.025136    LR 0.000500    Time 0.038443    
-2020-12-09 16:03:51,318 - Epoch: [13][  750/ 4498]    Overall Loss 0.025146    Objective Loss 0.025146    MSE 0.025146    LR 0.000500    Time 0.036301    
-2020-12-09 16:03:59,266 - Epoch: [13][ 1000/ 4498]    Overall Loss 0.025156    Objective Loss 0.025156    MSE 0.025156    LR 0.000500    Time 0.035156    
-2020-12-09 16:04:07,240 - Epoch: [13][ 1250/ 4498]    Overall Loss 0.025171    Objective Loss 0.025171    MSE 0.025171    LR 0.000500    Time 0.034490    
-2020-12-09 16:04:15,311 - Epoch: [13][ 1500/ 4498]    Overall Loss 0.025170    Objective Loss 0.025170    MSE 0.025170    LR 0.000500    Time 0.034111    
-2020-12-09 16:04:23,350 - Epoch: [13][ 1750/ 4498]    Overall Loss 0.025204    Objective Loss 0.025204    MSE 0.025204    LR 0.000500    Time 0.033822    
-2020-12-09 16:04:31,326 - Epoch: [13][ 2000/ 4498]    Overall Loss 0.025210    Objective Loss 0.025210    MSE 0.025210    LR 0.000500    Time 0.033574    
-2020-12-09 16:04:39,346 - Epoch: [13][ 2250/ 4498]    Overall Loss 0.025216    Objective Loss 0.025216    MSE 0.025216    LR 0.000500    Time 0.033400    
-2020-12-09 16:04:47,380 - Epoch: [13][ 2500/ 4498]    Overall Loss 0.025236    Objective Loss 0.025236    MSE 0.025236    LR 0.000500    Time 0.033267    
-2020-12-09 16:04:55,422 - Epoch: [13][ 2750/ 4498]    Overall Loss 0.025229    Objective Loss 0.025229    MSE 0.025229    LR 0.000500    Time 0.033161    
-2020-12-09 16:05:03,465 - Epoch: [13][ 3000/ 4498]    Overall Loss 0.025227    Objective Loss 0.025227    MSE 0.025227    LR 0.000500    Time 0.033073    
-2020-12-09 16:05:11,508 - Epoch: [13][ 3250/ 4498]    Overall Loss 0.025227    Objective Loss 0.025227    MSE 0.025227    LR 0.000500    Time 0.032998    
-2020-12-09 16:05:19,532 - Epoch: [13][ 3500/ 4498]    Overall Loss 0.025236    Objective Loss 0.025236    MSE 0.025236    LR 0.000500    Time 0.032929    
-2020-12-09 16:05:27,567 - Epoch: [13][ 3750/ 4498]    Overall Loss 0.025251    Objective Loss 0.025251    MSE 0.025251    LR 0.000500    Time 0.032872    
-2020-12-09 16:05:35,608 - Epoch: [13][ 4000/ 4498]    Overall Loss 0.025257    Objective Loss 0.025257    MSE 0.025257    LR 0.000500    Time 0.032823    
-2020-12-09 16:05:43,658 - Epoch: [13][ 4250/ 4498]    Overall Loss 0.025262    Objective Loss 0.025262    MSE 0.025262    LR 0.000500    Time 0.032782    
-2020-12-09 16:05:51,673 - Epoch: [13][ 4498/ 4498]    Overall Loss 0.025261    Objective Loss 0.025261    MSE 0.025261    LR 0.000500    Time 0.032754    
-2020-12-09 16:05:52,486 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16808 |  0.00289 |    0.12630 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14111 | -0.01568 |    0.09936 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09540 | -0.01056 |    0.06918 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09617 | -0.01978 |    0.07230 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10802 | -0.01297 |    0.07801 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12518 | -0.01945 |    0.09399 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15075 | -0.02113 |    0.11067 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.22122 |  0.00014 |    0.17409 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:05:52,486 - Total sparsity: 0.00
-
-2020-12-09 16:05:52,489 - --- validate (epoch=13)-----------
-2020-12-09 16:05:52,489 - 49975 samples (100 per mini-batch)
-2020-12-09 16:05:58,187 - Epoch: [13][  250/  500]    Loss 0.025782    MSE 0.025782    
-2020-12-09 16:06:01,635 - Epoch: [13][  500/  500]    Loss 0.025793    MSE 0.025793    
-2020-12-09 16:06:02,356 - ==> MSE: 0.02579    Loss: 0.026
-
-2020-12-09 16:06:02,359 - ==> Best [MSE: 0.02574   Sparsity:0.00   Params: 176048 on epoch: 12]
-2020-12-09 16:06:02,359 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:06:02,364 - 
-
-2020-12-09 16:06:02,364 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:06:13,412 - Epoch: [14][  250/ 4498]    Overall Loss 0.025124    Objective Loss 0.025124    MSE 0.025124    LR 0.000500    Time 0.044124    
-2020-12-09 16:06:21,480 - Epoch: [14][  500/ 4498]    Overall Loss 0.025106    Objective Loss 0.025106    MSE 0.025106    LR 0.000500    Time 0.038164    
-2020-12-09 16:06:29,582 - Epoch: [14][  750/ 4498]    Overall Loss 0.025160    Objective Loss 0.025160    MSE 0.025160    LR 0.000500    Time 0.036223    
-2020-12-09 16:06:37,667 - Epoch: [14][ 1000/ 4498]    Overall Loss 0.025143    Objective Loss 0.025143    MSE 0.025143    LR 0.000500    Time 0.035235    
-2020-12-09 16:06:45,753 - Epoch: [14][ 1250/ 4498]    Overall Loss 0.025155    Objective Loss 0.025155    MSE 0.025155    LR 0.000500    Time 0.034642    
-2020-12-09 16:06:53,843 - Epoch: [14][ 1500/ 4498]    Overall Loss 0.025152    Objective Loss 0.025152    MSE 0.025152    LR 0.000500    Time 0.034251    
-2020-12-09 16:07:01,937 - Epoch: [14][ 1750/ 4498]    Overall Loss 0.025154    Objective Loss 0.025154    MSE 0.025154    LR 0.000500    Time 0.033973    
-2020-12-09 16:07:10,033 - Epoch: [14][ 2000/ 4498]    Overall Loss 0.025158    Objective Loss 0.025158    MSE 0.025158    LR 0.000500    Time 0.033766    
-2020-12-09 16:07:18,132 - Epoch: [14][ 2250/ 4498]    Overall Loss 0.025161    Objective Loss 0.025161    MSE 0.025161    LR 0.000500    Time 0.033606    
-2020-12-09 16:07:26,233 - Epoch: [14][ 2500/ 4498]    Overall Loss 0.025160    Objective Loss 0.025160    MSE 0.025160    LR 0.000500    Time 0.033479    
-2020-12-09 16:07:34,331 - Epoch: [14][ 2750/ 4498]    Overall Loss 0.025168    Objective Loss 0.025168    MSE 0.025168    LR 0.000500    Time 0.033374    
-2020-12-09 16:07:42,432 - Epoch: [14][ 3000/ 4498]    Overall Loss 0.025177    Objective Loss 0.025177    MSE 0.025177    LR 0.000500    Time 0.033287    
-2020-12-09 16:07:50,540 - Epoch: [14][ 3250/ 4498]    Overall Loss 0.025174    Objective Loss 0.025174    MSE 0.025174    LR 0.000500    Time 0.033216    
-2020-12-09 16:07:58,643 - Epoch: [14][ 3500/ 4498]    Overall Loss 0.025179    Objective Loss 0.025179    MSE 0.025179    LR 0.000500    Time 0.033154    
-2020-12-09 16:08:06,737 - Epoch: [14][ 3750/ 4498]    Overall Loss 0.025177    Objective Loss 0.025177    MSE 0.025177    LR 0.000500    Time 0.033097    
-2020-12-09 16:08:14,799 - Epoch: [14][ 4000/ 4498]    Overall Loss 0.025184    Objective Loss 0.025184    MSE 0.025184    LR 0.000500    Time 0.033040    
-2020-12-09 16:08:22,856 - Epoch: [14][ 4250/ 4498]    Overall Loss 0.025184    Objective Loss 0.025184    MSE 0.025184    LR 0.000500    Time 0.032988    
-2020-12-09 16:08:30,872 - Epoch: [14][ 4498/ 4498]    Overall Loss 0.025182    Objective Loss 0.025182    MSE 0.025182    LR 0.000500    Time 0.032949    
-2020-12-09 16:08:31,705 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16893 |  0.00273 |    0.12698 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14240 | -0.01544 |    0.10000 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09489 | -0.01034 |    0.06863 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09581 | -0.01961 |    0.07195 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10786 | -0.01285 |    0.07777 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12499 | -0.01933 |    0.09387 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15135 | -0.02128 |    0.11101 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.22385 |  0.00011 |    0.17619 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:08:31,705 - Total sparsity: 0.00
-
-2020-12-09 16:08:31,708 - --- validate (epoch=14)-----------
-2020-12-09 16:08:31,708 - 49975 samples (100 per mini-batch)
-2020-12-09 16:08:37,211 - Epoch: [14][  250/  500]    Loss 0.025582    MSE 0.025582    
-2020-12-09 16:08:40,681 - Epoch: [14][  500/  500]    Loss 0.025590    MSE 0.025590    
-2020-12-09 16:08:41,412 - ==> MSE: 0.02559    Loss: 0.026
-
-2020-12-09 16:08:41,416 - ==> Best [MSE: 0.02559   Sparsity:0.00   Params: 176048 on epoch: 14]
-2020-12-09 16:08:41,416 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:08:41,428 - 
-
-2020-12-09 16:08:41,428 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:08:52,553 - Epoch: [15][  250/ 4498]    Overall Loss 0.024821    Objective Loss 0.024821    MSE 0.024821    LR 0.000500    Time 0.044429    
-2020-12-09 16:09:00,630 - Epoch: [15][  500/ 4498]    Overall Loss 0.024904    Objective Loss 0.024904    MSE 0.024904    LR 0.000500    Time 0.038336    
-2020-12-09 16:09:08,701 - Epoch: [15][  750/ 4498]    Overall Loss 0.024936    Objective Loss 0.024936    MSE 0.024936    LR 0.000500    Time 0.036295    
-2020-12-09 16:09:16,768 - Epoch: [15][ 1000/ 4498]    Overall Loss 0.024992    Objective Loss 0.024992    MSE 0.024993    LR 0.000500    Time 0.035271    
-2020-12-09 16:09:24,818 - Epoch: [15][ 1250/ 4498]    Overall Loss 0.025006    Objective Loss 0.025006    MSE 0.025006    LR 0.000500    Time 0.034643    
-2020-12-09 16:09:32,786 - Epoch: [15][ 1500/ 4498]    Overall Loss 0.025017    Objective Loss 0.025017    MSE 0.025017    LR 0.000500    Time 0.034169    
-2020-12-09 16:09:40,765 - Epoch: [15][ 1750/ 4498]    Overall Loss 0.025041    Objective Loss 0.025041    MSE 0.025041    LR 0.000500    Time 0.033838    
-2020-12-09 16:09:48,752 - Epoch: [15][ 2000/ 4498]    Overall Loss 0.025043    Objective Loss 0.025043    MSE 0.025043    LR 0.000500    Time 0.033593    
-2020-12-09 16:09:56,764 - Epoch: [15][ 2250/ 4498]    Overall Loss 0.025035    Objective Loss 0.025035    MSE 0.025035    LR 0.000500    Time 0.033414    
-2020-12-09 16:10:04,775 - Epoch: [15][ 2500/ 4498]    Overall Loss 0.025034    Objective Loss 0.025034    MSE 0.025034    LR 0.000500    Time 0.033270    
-2020-12-09 16:10:12,827 - Epoch: [15][ 2750/ 4498]    Overall Loss 0.025042    Objective Loss 0.025042    MSE 0.025042    LR 0.000500    Time 0.033167    
-2020-12-09 16:10:20,847 - Epoch: [15][ 3000/ 4498]    Overall Loss 0.025056    Objective Loss 0.025056    MSE 0.025056    LR 0.000500    Time 0.033071    
-2020-12-09 16:10:28,821 - Epoch: [15][ 3250/ 4498]    Overall Loss 0.025069    Objective Loss 0.025069    MSE 0.025069    LR 0.000500    Time 0.032975    
-2020-12-09 16:10:36,798 - Epoch: [15][ 3500/ 4498]    Overall Loss 0.025078    Objective Loss 0.025078    MSE 0.025078    LR 0.000500    Time 0.032894    
-2020-12-09 16:10:44,774 - Epoch: [15][ 3750/ 4498]    Overall Loss 0.025084    Objective Loss 0.025084    MSE 0.025084    LR 0.000500    Time 0.032823    
-2020-12-09 16:10:52,768 - Epoch: [15][ 4000/ 4498]    Overall Loss 0.025094    Objective Loss 0.025094    MSE 0.025094    LR 0.000500    Time 0.032766    
-2020-12-09 16:11:00,787 - Epoch: [15][ 4250/ 4498]    Overall Loss 0.025103    Objective Loss 0.025103    MSE 0.025103    LR 0.000500    Time 0.032721    
-2020-12-09 16:11:08,784 - Epoch: [15][ 4498/ 4498]    Overall Loss 0.025109    Objective Loss 0.025109    MSE 0.025109    LR 0.000500    Time 0.032692    
-2020-12-09 16:11:09,595 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16934 |  0.00337 |    0.12733 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14381 | -0.01546 |    0.10059 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09467 | -0.01031 |    0.06822 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09543 | -0.01943 |    0.07162 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10762 | -0.01277 |    0.07761 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12492 | -0.01935 |    0.09389 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15192 | -0.02150 |    0.11130 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.22618 |  0.00012 |    0.17805 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:11:09,595 - Total sparsity: 0.00
-
-2020-12-09 16:11:09,598 - --- validate (epoch=15)-----------
-2020-12-09 16:11:09,598 - 49975 samples (100 per mini-batch)
-2020-12-09 16:11:15,161 - Epoch: [15][  250/  500]    Loss 0.025671    MSE 0.025671    
-2020-12-09 16:11:18,621 - Epoch: [15][  500/  500]    Loss 0.025638    MSE 0.025638    
-2020-12-09 16:11:19,351 - ==> MSE: 0.02564    Loss: 0.026
-
-2020-12-09 16:11:19,354 - ==> Best [MSE: 0.02559   Sparsity:0.00   Params: 176048 on epoch: 14]
-2020-12-09 16:11:19,355 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:11:19,359 - 
-
-2020-12-09 16:11:19,359 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:11:30,403 - Epoch: [16][  250/ 4498]    Overall Loss 0.025020    Objective Loss 0.025020    MSE 0.025020    LR 0.000500    Time 0.044105    
-2020-12-09 16:11:38,537 - Epoch: [16][  500/ 4498]    Overall Loss 0.024975    Objective Loss 0.024975    MSE 0.024975    LR 0.000500    Time 0.038286    
-2020-12-09 16:11:46,591 - Epoch: [16][  750/ 4498]    Overall Loss 0.024946    Objective Loss 0.024946    MSE 0.024946    LR 0.000500    Time 0.036240    
-2020-12-09 16:11:54,600 - Epoch: [16][ 1000/ 4498]    Overall Loss 0.024939    Objective Loss 0.024939    MSE 0.024939    LR 0.000500    Time 0.035172    
-2020-12-09 16:12:02,606 - Epoch: [16][ 1250/ 4498]    Overall Loss 0.024938    Objective Loss 0.024938    MSE 0.024938    LR 0.000500    Time 0.034529    
-2020-12-09 16:12:10,613 - Epoch: [16][ 1500/ 4498]    Overall Loss 0.024971    Objective Loss 0.024971    MSE 0.024971    LR 0.000500    Time 0.034101    
-2020-12-09 16:12:18,617 - Epoch: [16][ 1750/ 4498]    Overall Loss 0.024959    Objective Loss 0.024959    MSE 0.024959    LR 0.000500    Time 0.033793    
-2020-12-09 16:12:26,620 - Epoch: [16][ 2000/ 4498]    Overall Loss 0.024966    Objective Loss 0.024966    MSE 0.024966    LR 0.000500    Time 0.033562    
-2020-12-09 16:12:34,622 - Epoch: [16][ 2250/ 4498]    Overall Loss 0.024991    Objective Loss 0.024991    MSE 0.024991    LR 0.000500    Time 0.033381    
-2020-12-09 16:12:42,650 - Epoch: [16][ 2500/ 4498]    Overall Loss 0.024999    Objective Loss 0.024999    MSE 0.024999    LR 0.000500    Time 0.033248    
-2020-12-09 16:12:50,678 - Epoch: [16][ 2750/ 4498]    Overall Loss 0.024999    Objective Loss 0.024999    MSE 0.024999    LR 0.000500    Time 0.033138    
-2020-12-09 16:12:58,709 - Epoch: [16][ 3000/ 4498]    Overall Loss 0.025009    Objective Loss 0.025009    MSE 0.025009    LR 0.000500    Time 0.033048    
-2020-12-09 16:13:06,743 - Epoch: [16][ 3250/ 4498]    Overall Loss 0.025016    Objective Loss 0.025016    MSE 0.025016    LR 0.000500    Time 0.032973    
-2020-12-09 16:13:14,774 - Epoch: [16][ 3500/ 4498]    Overall Loss 0.025022    Objective Loss 0.025022    MSE 0.025022    LR 0.000500    Time 0.032907    
-2020-12-09 16:13:22,803 - Epoch: [16][ 3750/ 4498]    Overall Loss 0.025022    Objective Loss 0.025022    MSE 0.025022    LR 0.000500    Time 0.032849    
-2020-12-09 16:13:30,844 - Epoch: [16][ 4000/ 4498]    Overall Loss 0.025027    Objective Loss 0.025027    MSE 0.025027    LR 0.000500    Time 0.032803    
-2020-12-09 16:13:38,855 - Epoch: [16][ 4250/ 4498]    Overall Loss 0.025037    Objective Loss 0.025037    MSE 0.025037    LR 0.000500    Time 0.032754    
-2020-12-09 16:13:46,836 - Epoch: [16][ 4498/ 4498]    Overall Loss 0.025034    Objective Loss 0.025034    MSE 0.025034    LR 0.000500    Time 0.032719    
-2020-12-09 16:13:47,670 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.16991 |  0.00286 |    0.12791 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14536 | -0.01564 |    0.10130 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09434 | -0.01017 |    0.06793 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09515 | -0.01934 |    0.07131 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10735 | -0.01254 |    0.07745 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12491 | -0.01933 |    0.09389 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15252 | -0.02156 |    0.11155 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.22831 |  0.00016 |    0.17973 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:13:47,670 - Total sparsity: 0.00
-
-2020-12-09 16:13:47,673 - --- validate (epoch=16)-----------
-2020-12-09 16:13:47,673 - 49975 samples (100 per mini-batch)
-2020-12-09 16:13:53,364 - Epoch: [16][  250/  500]    Loss 0.025666    MSE 0.025666    
-2020-12-09 16:13:56,818 - Epoch: [16][  500/  500]    Loss 0.025649    MSE 0.025650    
-2020-12-09 16:13:57,542 - ==> MSE: 0.02565    Loss: 0.026
-
-2020-12-09 16:13:57,546 - ==> Best [MSE: 0.02559   Sparsity:0.00   Params: 176048 on epoch: 14]
-2020-12-09 16:13:57,546 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:13:57,551 - 
-
-2020-12-09 16:13:57,551 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:14:08,691 - Epoch: [17][  250/ 4498]    Overall Loss 0.024892    Objective Loss 0.024892    MSE 0.024892    LR 0.000500    Time 0.044494    
-2020-12-09 16:14:16,664 - Epoch: [17][  500/ 4498]    Overall Loss 0.024955    Objective Loss 0.024955    MSE 0.024955    LR 0.000500    Time 0.038159    
-2020-12-09 16:14:24,638 - Epoch: [17][  750/ 4498]    Overall Loss 0.024935    Objective Loss 0.024935    MSE 0.024935    LR 0.000500    Time 0.036047    
-2020-12-09 16:14:32,606 - Epoch: [17][ 1000/ 4498]    Overall Loss 0.024900    Objective Loss 0.024900    MSE 0.024900    LR 0.000500    Time 0.034987    
-2020-12-09 16:14:40,574 - Epoch: [17][ 1250/ 4498]    Overall Loss 0.024911    Objective Loss 0.024911    MSE 0.024911    LR 0.000500    Time 0.034350    
-2020-12-09 16:14:48,541 - Epoch: [17][ 1500/ 4498]    Overall Loss 0.024895    Objective Loss 0.024895    MSE 0.024895    LR 0.000500    Time 0.033925    
-2020-12-09 16:14:56,510 - Epoch: [17][ 1750/ 4498]    Overall Loss 0.024920    Objective Loss 0.024920    MSE 0.024920    LR 0.000500    Time 0.033622    
-2020-12-09 16:15:04,479 - Epoch: [17][ 2000/ 4498]    Overall Loss 0.024924    Objective Loss 0.024924    MSE 0.024924    LR 0.000500    Time 0.033395    
-2020-12-09 16:15:12,450 - Epoch: [17][ 2250/ 4498]    Overall Loss 0.024941    Objective Loss 0.024941    MSE 0.024941    LR 0.000500    Time 0.033220    
-2020-12-09 16:15:20,416 - Epoch: [17][ 2500/ 4498]    Overall Loss 0.024947    Objective Loss 0.024947    MSE 0.024947    LR 0.000500    Time 0.033077    
-2020-12-09 16:15:28,404 - Epoch: [17][ 2750/ 4498]    Overall Loss 0.024954    Objective Loss 0.024954    MSE 0.024954    LR 0.000500    Time 0.032969    
-2020-12-09 16:15:36,444 - Epoch: [17][ 3000/ 4498]    Overall Loss 0.024957    Objective Loss 0.024957    MSE 0.024957    LR 0.000500    Time 0.032896    
-2020-12-09 16:15:44,487 - Epoch: [17][ 3250/ 4498]    Overall Loss 0.024962    Objective Loss 0.024962    MSE 0.024962    LR 0.000500    Time 0.032835    
-2020-12-09 16:15:52,517 - Epoch: [17][ 3500/ 4498]    Overall Loss 0.024966    Objective Loss 0.024966    MSE 0.024966    LR 0.000500    Time 0.032779    
-2020-12-09 16:16:00,558 - Epoch: [17][ 3750/ 4498]    Overall Loss 0.024967    Objective Loss 0.024967    MSE 0.024966    LR 0.000500    Time 0.032733    
-2020-12-09 16:16:08,595 - Epoch: [17][ 4000/ 4498]    Overall Loss 0.024971    Objective Loss 0.024971    MSE 0.024971    LR 0.000500    Time 0.032693    
-2020-12-09 16:16:16,631 - Epoch: [17][ 4250/ 4498]    Overall Loss 0.024976    Objective Loss 0.024976    MSE 0.024976    LR 0.000500    Time 0.032656    
-2020-12-09 16:16:24,630 - Epoch: [17][ 4498/ 4498]    Overall Loss 0.024975    Objective Loss 0.024975    MSE 0.024975    LR 0.000500    Time 0.032631    
-2020-12-09 16:16:25,395 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17012 |  0.00319 |    0.12797 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14640 | -0.01575 |    0.10181 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09399 | -0.01027 |    0.06745 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09507 | -0.01897 |    0.07118 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10736 | -0.01269 |    0.07749 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12485 | -0.01926 |    0.09381 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15306 | -0.02172 |    0.11183 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.23021 |  0.00010 |    0.18124 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:16:25,395 - Total sparsity: 0.00
-
-2020-12-09 16:16:25,398 - --- validate (epoch=17)-----------
-2020-12-09 16:16:25,398 - 49975 samples (100 per mini-batch)
-2020-12-09 16:16:30,985 - Epoch: [17][  250/  500]    Loss 0.025447    MSE 0.025447    
-2020-12-09 16:16:34,487 - Epoch: [17][  500/  500]    Loss 0.025462    MSE 0.025462    
-2020-12-09 16:16:35,211 - ==> MSE: 0.02546    Loss: 0.025
-
-2020-12-09 16:16:35,215 - ==> Best [MSE: 0.02546   Sparsity:0.00   Params: 176048 on epoch: 17]
-2020-12-09 16:16:35,215 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:16:35,221 - 
-
-2020-12-09 16:16:35,221 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:16:46,386 - Epoch: [18][  250/ 4498]    Overall Loss 0.024854    Objective Loss 0.024854    MSE 0.024854    LR 0.000500    Time 0.044590    
-2020-12-09 16:16:54,442 - Epoch: [18][  500/ 4498]    Overall Loss 0.024852    Objective Loss 0.024852    MSE 0.024852    LR 0.000500    Time 0.038373    
-2020-12-09 16:17:02,501 - Epoch: [18][  750/ 4498]    Overall Loss 0.024841    Objective Loss 0.024841    MSE 0.024841    LR 0.000500    Time 0.036304    
-2020-12-09 16:17:10,523 - Epoch: [18][ 1000/ 4498]    Overall Loss 0.024840    Objective Loss 0.024840    MSE 0.024840    LR 0.000500    Time 0.035233    
-2020-12-09 16:17:18,507 - Epoch: [18][ 1250/ 4498]    Overall Loss 0.024849    Objective Loss 0.024849    MSE 0.024849    LR 0.000500    Time 0.034560    
-2020-12-09 16:17:26,484 - Epoch: [18][ 1500/ 4498]    Overall Loss 0.024879    Objective Loss 0.024879    MSE 0.024879    LR 0.000500    Time 0.034107    
-2020-12-09 16:17:34,459 - Epoch: [18][ 1750/ 4498]    Overall Loss 0.024870    Objective Loss 0.024870    MSE 0.024870    LR 0.000500    Time 0.033781    
-2020-12-09 16:17:42,428 - Epoch: [18][ 2000/ 4498]    Overall Loss 0.024885    Objective Loss 0.024885    MSE 0.024885    LR 0.000500    Time 0.033535    
-2020-12-09 16:17:50,398 - Epoch: [18][ 2250/ 4498]    Overall Loss 0.024897    Objective Loss 0.024897    MSE 0.024897    LR 0.000500    Time 0.033343    
-2020-12-09 16:17:58,370 - Epoch: [18][ 2500/ 4498]    Overall Loss 0.024923    Objective Loss 0.024923    MSE 0.024923    LR 0.000500    Time 0.033191    
-2020-12-09 16:18:06,343 - Epoch: [18][ 2750/ 4498]    Overall Loss 0.024922    Objective Loss 0.024922    MSE 0.024922    LR 0.000500    Time 0.033067    
-2020-12-09 16:18:14,312 - Epoch: [18][ 3000/ 4498]    Overall Loss 0.024920    Objective Loss 0.024920    MSE 0.024920    LR 0.000500    Time 0.032962    
-2020-12-09 16:18:22,280 - Epoch: [18][ 3250/ 4498]    Overall Loss 0.024918    Objective Loss 0.024918    MSE 0.024918    LR 0.000500    Time 0.032873    
-2020-12-09 16:18:30,247 - Epoch: [18][ 3500/ 4498]    Overall Loss 0.024925    Objective Loss 0.024925    MSE 0.024925    LR 0.000500    Time 0.032796    
-2020-12-09 16:18:38,219 - Epoch: [18][ 3750/ 4498]    Overall Loss 0.024933    Objective Loss 0.024933    MSE 0.024933    LR 0.000500    Time 0.032731    
-2020-12-09 16:18:46,188 - Epoch: [18][ 4000/ 4498]    Overall Loss 0.024936    Objective Loss 0.024936    MSE 0.024936    LR 0.000500    Time 0.032673    
-2020-12-09 16:18:54,164 - Epoch: [18][ 4250/ 4498]    Overall Loss 0.024937    Objective Loss 0.024937    MSE 0.024937    LR 0.000500    Time 0.032624    
-2020-12-09 16:19:02,106 - Epoch: [18][ 4498/ 4498]    Overall Loss 0.024941    Objective Loss 0.024941    MSE 0.024941    LR 0.000500    Time 0.032588    
-2020-12-09 16:19:02,934 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17095 |  0.00278 |    0.12858 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14770 | -0.01591 |    0.10231 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09365 | -0.01015 |    0.06713 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09491 | -0.01891 |    0.07108 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10727 | -0.01260 |    0.07742 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12479 | -0.01928 |    0.09378 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15357 | -0.02178 |    0.11203 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.23192 |  0.00013 |    0.18254 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:19:02,934 - Total sparsity: 0.00
-
-2020-12-09 16:19:02,938 - --- validate (epoch=18)-----------
-2020-12-09 16:19:02,938 - 49975 samples (100 per mini-batch)
-2020-12-09 16:19:08,591 - Epoch: [18][  250/  500]    Loss 0.025509    MSE 0.025509    
-2020-12-09 16:19:12,019 - Epoch: [18][  500/  500]    Loss 0.025528    MSE 0.025528    
-2020-12-09 16:19:12,749 - ==> MSE: 0.02553    Loss: 0.026
-
-2020-12-09 16:19:12,753 - ==> Best [MSE: 0.02546   Sparsity:0.00   Params: 176048 on epoch: 17]
-2020-12-09 16:19:12,753 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:19:12,758 - 
-
-2020-12-09 16:19:12,758 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:19:23,907 - Epoch: [19][  250/ 4498]    Overall Loss 0.024767    Objective Loss 0.024767    MSE 0.024767    LR 0.000500    Time 0.044527    
-2020-12-09 16:19:31,984 - Epoch: [19][  500/ 4498]    Overall Loss 0.024791    Objective Loss 0.024791    MSE 0.024791    LR 0.000500    Time 0.038382    
-2020-12-09 16:19:40,061 - Epoch: [19][  750/ 4498]    Overall Loss 0.024800    Objective Loss 0.024800    MSE 0.024800    LR 0.000500    Time 0.036334    
-2020-12-09 16:19:48,131 - Epoch: [19][ 1000/ 4498]    Overall Loss 0.024809    Objective Loss 0.024809    MSE 0.024809    LR 0.000500    Time 0.035304    
-2020-12-09 16:19:56,200 - Epoch: [19][ 1250/ 4498]    Overall Loss 0.024802    Objective Loss 0.024802    MSE 0.024802    LR 0.000500    Time 0.034685    
-2020-12-09 16:20:04,269 - Epoch: [19][ 1500/ 4498]    Overall Loss 0.024791    Objective Loss 0.024791    MSE 0.024791    LR 0.000500    Time 0.034271    
-2020-12-09 16:20:12,340 - Epoch: [19][ 1750/ 4498]    Overall Loss 0.024818    Objective Loss 0.024818    MSE 0.024818    LR 0.000500    Time 0.033978    
-2020-12-09 16:20:20,409 - Epoch: [19][ 2000/ 4498]    Overall Loss 0.024835    Objective Loss 0.024835    MSE 0.024835    LR 0.000500    Time 0.033756    
-2020-12-09 16:20:28,477 - Epoch: [19][ 2250/ 4498]    Overall Loss 0.024842    Objective Loss 0.024842    MSE 0.024842    LR 0.000500    Time 0.033584    
-2020-12-09 16:20:36,556 - Epoch: [19][ 2500/ 4498]    Overall Loss 0.024846    Objective Loss 0.024846    MSE 0.024846    LR 0.000500    Time 0.033450    
-2020-12-09 16:20:44,657 - Epoch: [19][ 2750/ 4498]    Overall Loss 0.024850    Objective Loss 0.024850    MSE 0.024850    LR 0.000500    Time 0.033349    
-2020-12-09 16:20:52,757 - Epoch: [19][ 3000/ 4498]    Overall Loss 0.024855    Objective Loss 0.024855    MSE 0.024855    LR 0.000500    Time 0.033264    
-2020-12-09 16:21:00,856 - Epoch: [19][ 3250/ 4498]    Overall Loss 0.024857    Objective Loss 0.024857    MSE 0.024857    LR 0.000500    Time 0.033192    
-2020-12-09 16:21:08,953 - Epoch: [19][ 3500/ 4498]    Overall Loss 0.024866    Objective Loss 0.024866    MSE 0.024866    LR 0.000500    Time 0.033129    
-2020-12-09 16:21:17,040 - Epoch: [19][ 3750/ 4498]    Overall Loss 0.024869    Objective Loss 0.024869    MSE 0.024869    LR 0.000500    Time 0.033073    
-2020-12-09 16:21:25,132 - Epoch: [19][ 4000/ 4498]    Overall Loss 0.024878    Objective Loss 0.024878    MSE 0.024877    LR 0.000500    Time 0.033024    
-2020-12-09 16:21:33,220 - Epoch: [19][ 4250/ 4498]    Overall Loss 0.024877    Objective Loss 0.024877    MSE 0.024877    LR 0.000500    Time 0.032981    
-2020-12-09 16:21:41,269 - Epoch: [19][ 4498/ 4498]    Overall Loss 0.024879    Objective Loss 0.024879    MSE 0.024879    LR 0.000500    Time 0.032949    
-2020-12-09 16:21:42,103 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17139 |  0.00279 |    0.12883 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14875 | -0.01566 |    0.10280 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09353 | -0.01019 |    0.06683 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09469 | -0.01853 |    0.07078 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10720 | -0.01271 |    0.07733 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12475 | -0.01903 |    0.09371 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15397 | -0.02201 |    0.11226 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.23363 |  0.00013 |    0.18387 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:21:42,103 - Total sparsity: 0.00
-
-2020-12-09 16:21:42,106 - --- validate (epoch=19)-----------
-2020-12-09 16:21:42,106 - 49975 samples (100 per mini-batch)
-2020-12-09 16:21:47,855 - Epoch: [19][  250/  500]    Loss 0.025348    MSE 0.025348    
-2020-12-09 16:21:51,301 - Epoch: [19][  500/  500]    Loss 0.025394    MSE 0.025394    
-2020-12-09 16:21:52,022 - ==> MSE: 0.02539    Loss: 0.025
-
-2020-12-09 16:21:52,026 - ==> Best [MSE: 0.02539   Sparsity:0.00   Params: 176048 on epoch: 19]
-2020-12-09 16:21:52,026 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:21:52,038 - 
-
-2020-12-09 16:21:52,039 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:22:03,136 - Epoch: [20][  250/ 4498]    Overall Loss 0.024255    Objective Loss 0.024255    MSE 0.024255    LR 0.000250    Time 0.044321    
-2020-12-09 16:22:11,167 - Epoch: [20][  500/ 4498]    Overall Loss 0.024287    Objective Loss 0.024287    MSE 0.024287    LR 0.000250    Time 0.038187    
-2020-12-09 16:22:19,190 - Epoch: [20][  750/ 4498]    Overall Loss 0.024353    Objective Loss 0.024353    MSE 0.024353    LR 0.000250    Time 0.036133    
-2020-12-09 16:22:27,204 - Epoch: [20][ 1000/ 4498]    Overall Loss 0.024328    Objective Loss 0.024328    MSE 0.024328    LR 0.000250    Time 0.035096    
-2020-12-09 16:22:35,251 - Epoch: [20][ 1250/ 4498]    Overall Loss 0.024322    Objective Loss 0.024322    MSE 0.024322    LR 0.000250    Time 0.034501    
-2020-12-09 16:22:43,362 - Epoch: [20][ 1500/ 4498]    Overall Loss 0.024316    Objective Loss 0.024316    MSE 0.024316    LR 0.000250    Time 0.034147    
-2020-12-09 16:22:51,469 - Epoch: [20][ 1750/ 4498]    Overall Loss 0.024327    Objective Loss 0.024327    MSE 0.024327    LR 0.000250    Time 0.033892    
-2020-12-09 16:22:59,576 - Epoch: [20][ 2000/ 4498]    Overall Loss 0.024321    Objective Loss 0.024321    MSE 0.024321    LR 0.000250    Time 0.033700    
-2020-12-09 16:23:07,684 - Epoch: [20][ 2250/ 4498]    Overall Loss 0.024319    Objective Loss 0.024319    MSE 0.024319    LR 0.000250    Time 0.033551    
-2020-12-09 16:23:15,795 - Epoch: [20][ 2500/ 4498]    Overall Loss 0.024329    Objective Loss 0.024329    MSE 0.024329    LR 0.000250    Time 0.033434    
-2020-12-09 16:23:23,892 - Epoch: [20][ 2750/ 4498]    Overall Loss 0.024333    Objective Loss 0.024333    MSE 0.024333    LR 0.000250    Time 0.033333    
-2020-12-09 16:23:32,035 - Epoch: [20][ 3000/ 4498]    Overall Loss 0.024343    Objective Loss 0.024343    MSE 0.024343    LR 0.000250    Time 0.033263    
-2020-12-09 16:23:40,105 - Epoch: [20][ 3250/ 4498]    Overall Loss 0.024341    Objective Loss 0.024341    MSE 0.024341    LR 0.000250    Time 0.033182    
-2020-12-09 16:23:48,164 - Epoch: [20][ 3500/ 4498]    Overall Loss 0.024344    Objective Loss 0.024344    MSE 0.024344    LR 0.000250    Time 0.033110    
-2020-12-09 16:23:56,218 - Epoch: [20][ 3750/ 4498]    Overall Loss 0.024347    Objective Loss 0.024347    MSE 0.024347    LR 0.000250    Time 0.033046    
-2020-12-09 16:24:04,273 - Epoch: [20][ 4000/ 4498]    Overall Loss 0.024350    Objective Loss 0.024350    MSE 0.024350    LR 0.000250    Time 0.032990    
-2020-12-09 16:24:12,320 - Epoch: [20][ 4250/ 4498]    Overall Loss 0.024347    Objective Loss 0.024347    MSE 0.024347    LR 0.000250    Time 0.032939    
-2020-12-09 16:24:20,334 - Epoch: [20][ 4498/ 4498]    Overall Loss 0.024347    Objective Loss 0.024347    MSE 0.024347    LR 0.000250    Time 0.032901    
-2020-12-09 16:24:21,148 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17109 |  0.00334 |    0.12855 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14862 | -0.01522 |    0.10252 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09262 | -0.00970 |    0.06598 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09395 | -0.01786 |    0.07012 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10655 | -0.01208 |    0.07684 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12426 | -0.01850 |    0.09327 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15382 | -0.02143 |    0.11206 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.23555 |  0.00011 |    0.18537 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:24:21,148 - Total sparsity: 0.00
-
-2020-12-09 16:24:21,151 - --- validate (epoch=20)-----------
-2020-12-09 16:24:21,152 - 49975 samples (100 per mini-batch)
-2020-12-09 16:24:26,691 - Epoch: [20][  250/  500]    Loss 0.024965    MSE 0.024965    
-2020-12-09 16:24:29,771 - Epoch: [20][  500/  500]    Loss 0.025029    MSE 0.025029    
-2020-12-09 16:24:30,460 - ==> MSE: 0.02503    Loss: 0.025
-
-2020-12-09 16:24:30,464 - ==> Best [MSE: 0.02503   Sparsity:0.00   Params: 176048 on epoch: 20]
-2020-12-09 16:24:30,464 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:24:30,476 - 
-
-2020-12-09 16:24:30,476 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:24:41,642 - Epoch: [21][  250/ 4498]    Overall Loss 0.024169    Objective Loss 0.024169    MSE 0.024169    LR 0.000250    Time 0.044594    
-2020-12-09 16:24:49,721 - Epoch: [21][  500/ 4498]    Overall Loss 0.024185    Objective Loss 0.024185    MSE 0.024185    LR 0.000250    Time 0.038420    
-2020-12-09 16:24:57,792 - Epoch: [21][  750/ 4498]    Overall Loss 0.024255    Objective Loss 0.024255    MSE 0.024255    LR 0.000250    Time 0.036352    
-2020-12-09 16:25:05,859 - Epoch: [21][ 1000/ 4498]    Overall Loss 0.024263    Objective Loss 0.024263    MSE 0.024263    LR 0.000250    Time 0.035313    
-2020-12-09 16:25:13,923 - Epoch: [21][ 1250/ 4498]    Overall Loss 0.024269    Objective Loss 0.024269    MSE 0.024269    LR 0.000250    Time 0.034688    
-2020-12-09 16:25:21,991 - Epoch: [21][ 1500/ 4498]    Overall Loss 0.024271    Objective Loss 0.024271    MSE 0.024271    LR 0.000250    Time 0.034274    
-2020-12-09 16:25:30,057 - Epoch: [21][ 1750/ 4498]    Overall Loss 0.024274    Objective Loss 0.024274    MSE 0.024274    LR 0.000250    Time 0.033977    
-2020-12-09 16:25:38,123 - Epoch: [21][ 2000/ 4498]    Overall Loss 0.024277    Objective Loss 0.024277    MSE 0.024277    LR 0.000250    Time 0.033755    
-2020-12-09 16:25:46,188 - Epoch: [21][ 2250/ 4498]    Overall Loss 0.024273    Objective Loss 0.024273    MSE 0.024273    LR 0.000250    Time 0.033581    
-2020-12-09 16:25:54,259 - Epoch: [21][ 2500/ 4498]    Overall Loss 0.024260    Objective Loss 0.024260    MSE 0.024260    LR 0.000250    Time 0.033444    
-2020-12-09 16:26:02,324 - Epoch: [21][ 2750/ 4498]    Overall Loss 0.024265    Objective Loss 0.024265    MSE 0.024265    LR 0.000250    Time 0.033330    
-2020-12-09 16:26:10,390 - Epoch: [21][ 3000/ 4498]    Overall Loss 0.024268    Objective Loss 0.024268    MSE 0.024268    LR 0.000250    Time 0.033236    
-2020-12-09 16:26:18,458 - Epoch: [21][ 3250/ 4498]    Overall Loss 0.024272    Objective Loss 0.024272    MSE 0.024272    LR 0.000250    Time 0.033156    
-2020-12-09 16:26:26,527 - Epoch: [21][ 3500/ 4498]    Overall Loss 0.024276    Objective Loss 0.024276    MSE 0.024276    LR 0.000250    Time 0.033089    
-2020-12-09 16:26:34,592 - Epoch: [21][ 3750/ 4498]    Overall Loss 0.024271    Objective Loss 0.024271    MSE 0.024271    LR 0.000250    Time 0.033029    
-2020-12-09 16:26:42,658 - Epoch: [21][ 4000/ 4498]    Overall Loss 0.024281    Objective Loss 0.024281    MSE 0.024281    LR 0.000250    Time 0.032977    
-2020-12-09 16:26:50,720 - Epoch: [21][ 4250/ 4498]    Overall Loss 0.024284    Objective Loss 0.024284    MSE 0.024284    LR 0.000250    Time 0.032930    
-2020-12-09 16:26:58,759 - Epoch: [21][ 4498/ 4498]    Overall Loss 0.024286    Objective Loss 0.024286    MSE 0.024286    LR 0.000250    Time 0.032899    
-2020-12-09 16:26:59,564 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17149 |  0.00286 |    0.12883 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14886 | -0.01520 |    0.10255 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09214 | -0.00950 |    0.06543 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09344 | -0.01761 |    0.06971 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10616 | -0.01190 |    0.07656 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12395 | -0.01827 |    0.09301 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15382 | -0.02127 |    0.11199 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.23746 |  0.00009 |    0.18687 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:26:59,565 - Total sparsity: 0.00
-
-2020-12-09 16:26:59,567 - --- validate (epoch=21)-----------
-2020-12-09 16:26:59,568 - 49975 samples (100 per mini-batch)
-2020-12-09 16:27:04,914 - Epoch: [21][  250/  500]    Loss 0.024929    MSE 0.024929    
-2020-12-09 16:27:08,029 - Epoch: [21][  500/  500]    Loss 0.024909    MSE 0.024909    
-2020-12-09 16:27:08,749 - ==> MSE: 0.02491    Loss: 0.025
-
-2020-12-09 16:27:08,753 - ==> Best [MSE: 0.02491   Sparsity:0.00   Params: 176048 on epoch: 21]
-2020-12-09 16:27:08,753 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:27:08,765 - 
-
-2020-12-09 16:27:08,766 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:27:19,848 - Epoch: [22][  250/ 4498]    Overall Loss 0.024332    Objective Loss 0.024332    MSE 0.024332    LR 0.000250    Time 0.044260    
-2020-12-09 16:27:27,914 - Epoch: [22][  500/ 4498]    Overall Loss 0.024264    Objective Loss 0.024264    MSE 0.024264    LR 0.000250    Time 0.038227    
-2020-12-09 16:27:35,972 - Epoch: [22][  750/ 4498]    Overall Loss 0.024270    Objective Loss 0.024270    MSE 0.024270    LR 0.000250    Time 0.036206    
-2020-12-09 16:27:44,017 - Epoch: [22][ 1000/ 4498]    Overall Loss 0.024248    Objective Loss 0.024248    MSE 0.024248    LR 0.000250    Time 0.035183    
-2020-12-09 16:27:52,102 - Epoch: [22][ 1250/ 4498]    Overall Loss 0.024222    Objective Loss 0.024222    MSE 0.024222    LR 0.000250    Time 0.034601    
-2020-12-09 16:28:00,191 - Epoch: [22][ 1500/ 4498]    Overall Loss 0.024209    Objective Loss 0.024209    MSE 0.024209    LR 0.000250    Time 0.034215    
-2020-12-09 16:28:08,295 - Epoch: [22][ 1750/ 4498]    Overall Loss 0.024208    Objective Loss 0.024208    MSE 0.024208    LR 0.000250    Time 0.033948    
-2020-12-09 16:28:16,397 - Epoch: [22][ 2000/ 4498]    Overall Loss 0.024217    Objective Loss 0.024217    MSE 0.024217    LR 0.000250    Time 0.033747    
-2020-12-09 16:28:24,492 - Epoch: [22][ 2250/ 4498]    Overall Loss 0.024213    Objective Loss 0.024213    MSE 0.024213    LR 0.000250    Time 0.033587    
-2020-12-09 16:28:32,584 - Epoch: [22][ 2500/ 4498]    Overall Loss 0.024215    Objective Loss 0.024215    MSE 0.024215    LR 0.000250    Time 0.033459    
-2020-12-09 16:28:40,678 - Epoch: [22][ 2750/ 4498]    Overall Loss 0.024218    Objective Loss 0.024218    MSE 0.024218    LR 0.000250    Time 0.033354    
-2020-12-09 16:28:48,774 - Epoch: [22][ 3000/ 4498]    Overall Loss 0.024217    Objective Loss 0.024217    MSE 0.024217    LR 0.000250    Time 0.033267    
-2020-12-09 16:28:56,867 - Epoch: [22][ 3250/ 4498]    Overall Loss 0.024224    Objective Loss 0.024224    MSE 0.024224    LR 0.000250    Time 0.033193    
-2020-12-09 16:29:04,954 - Epoch: [22][ 3500/ 4498]    Overall Loss 0.024227    Objective Loss 0.024227    MSE 0.024227    LR 0.000250    Time 0.033128    
-2020-12-09 16:29:13,044 - Epoch: [22][ 3750/ 4498]    Overall Loss 0.024226    Objective Loss 0.024226    MSE 0.024226    LR 0.000250    Time 0.033072    
-2020-12-09 16:29:21,137 - Epoch: [22][ 4000/ 4498]    Overall Loss 0.024230    Objective Loss 0.024230    MSE 0.024230    LR 0.000250    Time 0.033024    
-2020-12-09 16:29:29,215 - Epoch: [22][ 4250/ 4498]    Overall Loss 0.024234    Objective Loss 0.024234    MSE 0.024234    LR 0.000250    Time 0.032978    
-2020-12-09 16:29:37,254 - Epoch: [22][ 4498/ 4498]    Overall Loss 0.024238    Objective Loss 0.024238    MSE 0.024238    LR 0.000250    Time 0.032944    
-2020-12-09 16:29:38,014 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17168 |  0.00308 |    0.12901 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14909 | -0.01518 |    0.10264 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09162 | -0.00948 |    0.06505 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09302 | -0.01746 |    0.06937 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10578 | -0.01173 |    0.07632 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12363 | -0.01805 |    0.09273 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15389 | -0.02117 |    0.11197 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.23921 |  0.00009 |    0.18824 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:29:38,014 - Total sparsity: 0.00
-
-2020-12-09 16:29:38,017 - --- validate (epoch=22)-----------
-2020-12-09 16:29:38,017 - 49975 samples (100 per mini-batch)
-2020-12-09 16:29:43,722 - Epoch: [22][  250/  500]    Loss 0.024962    MSE 0.024962    
-2020-12-09 16:29:47,096 - Epoch: [22][  500/  500]    Loss 0.024913    MSE 0.024913    
-2020-12-09 16:29:47,828 - ==> MSE: 0.02491    Loss: 0.025
-
-2020-12-09 16:29:47,833 - ==> Best [MSE: 0.02491   Sparsity:0.00   Params: 176048 on epoch: 21]
-2020-12-09 16:29:47,833 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:29:47,838 - 
-
-2020-12-09 16:29:47,838 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:29:58,842 - Epoch: [23][  250/ 4498]    Overall Loss 0.024111    Objective Loss 0.024111    MSE 0.024111    LR 0.000250    Time 0.043948    
-2020-12-09 16:30:06,837 - Epoch: [23][  500/ 4498]    Overall Loss 0.024117    Objective Loss 0.024117    MSE 0.024117    LR 0.000250    Time 0.037929    
-2020-12-09 16:30:14,812 - Epoch: [23][  750/ 4498]    Overall Loss 0.024136    Objective Loss 0.024136    MSE 0.024136    LR 0.000250    Time 0.035897    
-2020-12-09 16:30:22,777 - Epoch: [23][ 1000/ 4498]    Overall Loss 0.024118    Objective Loss 0.024118    MSE 0.024118    LR 0.000250    Time 0.034870    
-2020-12-09 16:30:30,742 - Epoch: [23][ 1250/ 4498]    Overall Loss 0.024139    Objective Loss 0.024139    MSE 0.024139    LR 0.000250    Time 0.034254    
-2020-12-09 16:30:38,706 - Epoch: [23][ 1500/ 4498]    Overall Loss 0.024151    Objective Loss 0.024151    MSE 0.024151    LR 0.000250    Time 0.033843    
-2020-12-09 16:30:46,667 - Epoch: [23][ 1750/ 4498]    Overall Loss 0.024156    Objective Loss 0.024156    MSE 0.024156    LR 0.000250    Time 0.033548    
-2020-12-09 16:30:54,626 - Epoch: [23][ 2000/ 4498]    Overall Loss 0.024167    Objective Loss 0.024167    MSE 0.024167    LR 0.000250    Time 0.033325    
-2020-12-09 16:31:02,598 - Epoch: [23][ 2250/ 4498]    Overall Loss 0.024183    Objective Loss 0.024183    MSE 0.024183    LR 0.000250    Time 0.033158    
-2020-12-09 16:31:10,574 - Epoch: [23][ 2500/ 4498]    Overall Loss 0.024198    Objective Loss 0.024198    MSE 0.024198    LR 0.000250    Time 0.033026    
-2020-12-09 16:31:18,551 - Epoch: [23][ 2750/ 4498]    Overall Loss 0.024207    Objective Loss 0.024207    MSE 0.024207    LR 0.000250    Time 0.032918    
-2020-12-09 16:31:26,525 - Epoch: [23][ 3000/ 4498]    Overall Loss 0.024201    Objective Loss 0.024201    MSE 0.024201    LR 0.000250    Time 0.032827    
-2020-12-09 16:31:34,537 - Epoch: [23][ 3250/ 4498]    Overall Loss 0.024198    Objective Loss 0.024198    MSE 0.024198    LR 0.000250    Time 0.032761    
-2020-12-09 16:31:42,550 - Epoch: [23][ 3500/ 4498]    Overall Loss 0.024199    Objective Loss 0.024199    MSE 0.024199    LR 0.000250    Time 0.032706    
-2020-12-09 16:31:50,557 - Epoch: [23][ 3750/ 4498]    Overall Loss 0.024203    Objective Loss 0.024203    MSE 0.024203    LR 0.000250    Time 0.032656    
-2020-12-09 16:31:58,559 - Epoch: [23][ 4000/ 4498]    Overall Loss 0.024206    Objective Loss 0.024206    MSE 0.024206    LR 0.000250    Time 0.032612    
-2020-12-09 16:32:06,558 - Epoch: [23][ 4250/ 4498]    Overall Loss 0.024214    Objective Loss 0.024214    MSE 0.024214    LR 0.000250    Time 0.032571    
-2020-12-09 16:32:14,524 - Epoch: [23][ 4498/ 4498]    Overall Loss 0.024216    Objective Loss 0.024216    MSE 0.024216    LR 0.000250    Time 0.032543    
-2020-12-09 16:32:15,362 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17204 |  0.00284 |    0.12930 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14943 | -0.01514 |    0.10274 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09120 | -0.00940 |    0.06464 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09269 | -0.01722 |    0.06906 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10551 | -0.01166 |    0.07610 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12338 | -0.01788 |    0.09253 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15397 | -0.02110 |    0.11197 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24081 |  0.00010 |    0.18949 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:32:15,362 - Total sparsity: 0.00
-
-2020-12-09 16:32:15,365 - --- validate (epoch=23)-----------
-2020-12-09 16:32:15,365 - 49975 samples (100 per mini-batch)
-2020-12-09 16:32:21,026 - Epoch: [23][  250/  500]    Loss 0.024857    MSE 0.024857    
-2020-12-09 16:32:24,343 - Epoch: [23][  500/  500]    Loss 0.024881    MSE 0.024881    
-2020-12-09 16:32:25,051 - ==> MSE: 0.02488    Loss: 0.025
-
-2020-12-09 16:32:25,056 - ==> Best [MSE: 0.02488   Sparsity:0.00   Params: 176048 on epoch: 23]
-2020-12-09 16:32:25,056 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:32:25,068 - 
-
-2020-12-09 16:32:25,068 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:32:36,244 - Epoch: [24][  250/ 4498]    Overall Loss 0.023970    Objective Loss 0.023970    MSE 0.023970    LR 0.000250    Time 0.044634    
-2020-12-09 16:32:44,336 - Epoch: [24][  500/ 4498]    Overall Loss 0.024043    Objective Loss 0.024043    MSE 0.024043    LR 0.000250    Time 0.038466    
-2020-12-09 16:32:52,430 - Epoch: [24][  750/ 4498]    Overall Loss 0.024127    Objective Loss 0.024127    MSE 0.024127    LR 0.000250    Time 0.036414    
-2020-12-09 16:33:00,535 - Epoch: [24][ 1000/ 4498]    Overall Loss 0.024120    Objective Loss 0.024120    MSE 0.024120    LR 0.000250    Time 0.035398    
-2020-12-09 16:33:08,645 - Epoch: [24][ 1250/ 4498]    Overall Loss 0.024109    Objective Loss 0.024109    MSE 0.024109    LR 0.000250    Time 0.034793    
-2020-12-09 16:33:16,759 - Epoch: [24][ 1500/ 4498]    Overall Loss 0.024100    Objective Loss 0.024100    MSE 0.024100    LR 0.000250    Time 0.034392    
-2020-12-09 16:33:24,810 - Epoch: [24][ 1750/ 4498]    Overall Loss 0.024115    Objective Loss 0.024115    MSE 0.024115    LR 0.000250    Time 0.034069    
-2020-12-09 16:33:32,753 - Epoch: [24][ 2000/ 4498]    Overall Loss 0.024125    Objective Loss 0.024125    MSE 0.024125    LR 0.000250    Time 0.033774    
-2020-12-09 16:33:40,708 - Epoch: [24][ 2250/ 4498]    Overall Loss 0.024133    Objective Loss 0.024133    MSE 0.024133    LR 0.000250    Time 0.033549    
-2020-12-09 16:33:48,655 - Epoch: [24][ 2500/ 4498]    Overall Loss 0.024135    Objective Loss 0.024135    MSE 0.024135    LR 0.000250    Time 0.033366    
-2020-12-09 16:33:56,599 - Epoch: [24][ 2750/ 4498]    Overall Loss 0.024154    Objective Loss 0.024154    MSE 0.024154    LR 0.000250    Time 0.033215    
-2020-12-09 16:34:04,546 - Epoch: [24][ 3000/ 4498]    Overall Loss 0.024156    Objective Loss 0.024156    MSE 0.024156    LR 0.000250    Time 0.033091    
-2020-12-09 16:34:12,497 - Epoch: [24][ 3250/ 4498]    Overall Loss 0.024162    Objective Loss 0.024162    MSE 0.024162    LR 0.000250    Time 0.032986    
-2020-12-09 16:34:20,443 - Epoch: [24][ 3500/ 4498]    Overall Loss 0.024169    Objective Loss 0.024169    MSE 0.024169    LR 0.000250    Time 0.032896    
-2020-12-09 16:34:28,389 - Epoch: [24][ 3750/ 4498]    Overall Loss 0.024183    Objective Loss 0.024183    MSE 0.024183    LR 0.000250    Time 0.032817    
-2020-12-09 16:34:36,349 - Epoch: [24][ 4000/ 4498]    Overall Loss 0.024186    Objective Loss 0.024186    MSE 0.024186    LR 0.000250    Time 0.032751    
-2020-12-09 16:34:44,327 - Epoch: [24][ 4250/ 4498]    Overall Loss 0.024185    Objective Loss 0.024185    MSE 0.024185    LR 0.000250    Time 0.032698    
-2020-12-09 16:34:52,271 - Epoch: [24][ 4498/ 4498]    Overall Loss 0.024186    Objective Loss 0.024186    MSE 0.024186    LR 0.000250    Time 0.032658    
-2020-12-09 16:34:53,077 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17219 |  0.00332 |    0.12933 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.14981 | -0.01530 |    0.10290 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09078 | -0.00929 |    0.06421 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09234 | -0.01723 |    0.06878 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10522 | -0.01155 |    0.07588 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12315 | -0.01775 |    0.09239 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15404 | -0.02112 |    0.11197 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24227 |  0.00013 |    0.19064 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:34:53,077 - Total sparsity: 0.00
-
-2020-12-09 16:34:53,081 - --- validate (epoch=24)-----------
-2020-12-09 16:34:53,081 - 49975 samples (100 per mini-batch)
-2020-12-09 16:34:58,668 - Epoch: [24][  250/  500]    Loss 0.024899    MSE 0.024899    
-2020-12-09 16:35:02,145 - Epoch: [24][  500/  500]    Loss 0.024886    MSE 0.024885    
-2020-12-09 16:35:02,859 - ==> MSE: 0.02488    Loss: 0.025
-
-2020-12-09 16:35:02,864 - ==> Best [MSE: 0.02488   Sparsity:0.00   Params: 176048 on epoch: 23]
-2020-12-09 16:35:02,864 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:35:02,869 - 
-
-2020-12-09 16:35:02,869 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:35:13,907 - Epoch: [25][  250/ 4498]    Overall Loss 0.024073    Objective Loss 0.024073    MSE 0.024073    LR 0.000250    Time 0.044081    
-2020-12-09 16:35:21,926 - Epoch: [25][  500/ 4498]    Overall Loss 0.024094    Objective Loss 0.024094    MSE 0.024094    LR 0.000250    Time 0.038046    
-2020-12-09 16:35:29,936 - Epoch: [25][  750/ 4498]    Overall Loss 0.024110    Objective Loss 0.024110    MSE 0.024110    LR 0.000250    Time 0.036020    
-2020-12-09 16:35:37,931 - Epoch: [25][ 1000/ 4498]    Overall Loss 0.024109    Objective Loss 0.024109    MSE 0.024109    LR 0.000250    Time 0.034992    
-2020-12-09 16:35:45,971 - Epoch: [25][ 1250/ 4498]    Overall Loss 0.024089    Objective Loss 0.024089    MSE 0.024089    LR 0.000250    Time 0.034412    
-2020-12-09 16:35:54,070 - Epoch: [25][ 1500/ 4498]    Overall Loss 0.024111    Objective Loss 0.024111    MSE 0.024111    LR 0.000250    Time 0.034065    
-2020-12-09 16:36:02,168 - Epoch: [25][ 1750/ 4498]    Overall Loss 0.024116    Objective Loss 0.024116    MSE 0.024116    LR 0.000250    Time 0.033816    
-2020-12-09 16:36:10,270 - Epoch: [25][ 2000/ 4498]    Overall Loss 0.024120    Objective Loss 0.024120    MSE 0.024120    LR 0.000250    Time 0.033632    
-2020-12-09 16:36:18,370 - Epoch: [25][ 2250/ 4498]    Overall Loss 0.024127    Objective Loss 0.024127    MSE 0.024127    LR 0.000250    Time 0.033487    
-2020-12-09 16:36:26,463 - Epoch: [25][ 2500/ 4498]    Overall Loss 0.024124    Objective Loss 0.024124    MSE 0.024124    LR 0.000250    Time 0.033369    
-2020-12-09 16:36:34,559 - Epoch: [25][ 2750/ 4498]    Overall Loss 0.024133    Objective Loss 0.024133    MSE 0.024133    LR 0.000250    Time 0.033273    
-2020-12-09 16:36:42,606 - Epoch: [25][ 3000/ 4498]    Overall Loss 0.024145    Objective Loss 0.024145    MSE 0.024145    LR 0.000250    Time 0.033177    
-2020-12-09 16:36:50,654 - Epoch: [25][ 3250/ 4498]    Overall Loss 0.024149    Objective Loss 0.024149    MSE 0.024149    LR 0.000250    Time 0.033094    
-2020-12-09 16:36:58,698 - Epoch: [25][ 3500/ 4498]    Overall Loss 0.024150    Objective Loss 0.024150    MSE 0.024150    LR 0.000250    Time 0.033023    
-2020-12-09 16:37:06,764 - Epoch: [25][ 3750/ 4498]    Overall Loss 0.024156    Objective Loss 0.024156    MSE 0.024156    LR 0.000250    Time 0.032968    
-2020-12-09 16:37:14,846 - Epoch: [25][ 4000/ 4498]    Overall Loss 0.024160    Objective Loss 0.024160    MSE 0.024160    LR 0.000250    Time 0.032924    
-2020-12-09 16:37:22,902 - Epoch: [25][ 4250/ 4498]    Overall Loss 0.024156    Objective Loss 0.024156    MSE 0.024156    LR 0.000250    Time 0.032879    
-2020-12-09 16:37:30,915 - Epoch: [25][ 4498/ 4498]    Overall Loss 0.024155    Objective Loss 0.024155    MSE 0.024155    LR 0.000250    Time 0.032844    
-2020-12-09 16:37:31,724 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17255 |  0.00306 |    0.12962 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15018 | -0.01511 |    0.10307 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09040 | -0.00920 |    0.06383 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09209 | -0.01708 |    0.06855 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10496 | -0.01150 |    0.07573 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12302 | -0.01747 |    0.09234 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15413 | -0.02106 |    0.11214 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24367 |  0.00011 |    0.19173 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:37:31,724 - Total sparsity: 0.00
-
-2020-12-09 16:37:31,727 - --- validate (epoch=25)-----------
-2020-12-09 16:37:31,727 - 49975 samples (100 per mini-batch)
-2020-12-09 16:37:37,233 - Epoch: [25][  250/  500]    Loss 0.024905    MSE 0.024905    
-2020-12-09 16:37:40,738 - Epoch: [25][  500/  500]    Loss 0.024862    MSE 0.024862    
-2020-12-09 16:37:41,461 - ==> MSE: 0.02486    Loss: 0.025
-
-2020-12-09 16:37:41,466 - ==> Best [MSE: 0.02486   Sparsity:0.00   Params: 176048 on epoch: 25]
-2020-12-09 16:37:41,466 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:37:41,472 - 
-
-2020-12-09 16:37:41,472 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:37:52,613 - Epoch: [26][  250/ 4498]    Overall Loss 0.024023    Objective Loss 0.024023    MSE 0.024023    LR 0.000250    Time 0.044493    
-2020-12-09 16:38:00,666 - Epoch: [26][  500/ 4498]    Overall Loss 0.024040    Objective Loss 0.024040    MSE 0.024040    LR 0.000250    Time 0.038319    
-2020-12-09 16:38:08,710 - Epoch: [26][  750/ 4498]    Overall Loss 0.024046    Objective Loss 0.024046    MSE 0.024046    LR 0.000250    Time 0.036249    
-2020-12-09 16:38:16,743 - Epoch: [26][ 1000/ 4498]    Overall Loss 0.024085    Objective Loss 0.024085    MSE 0.024085    LR 0.000250    Time 0.035202    
-2020-12-09 16:38:24,792 - Epoch: [26][ 1250/ 4498]    Overall Loss 0.024106    Objective Loss 0.024106    MSE 0.024106    LR 0.000250    Time 0.034587    
-2020-12-09 16:38:32,837 - Epoch: [26][ 1500/ 4498]    Overall Loss 0.024096    Objective Loss 0.024096    MSE 0.024096    LR 0.000250    Time 0.034174    
-2020-12-09 16:38:40,869 - Epoch: [26][ 1750/ 4498]    Overall Loss 0.024108    Objective Loss 0.024108    MSE 0.024108    LR 0.000250    Time 0.033872    
-2020-12-09 16:38:48,902 - Epoch: [26][ 2000/ 4498]    Overall Loss 0.024107    Objective Loss 0.024107    MSE 0.024107    LR 0.000250    Time 0.033646    
-2020-12-09 16:38:56,937 - Epoch: [26][ 2250/ 4498]    Overall Loss 0.024101    Objective Loss 0.024101    MSE 0.024101    LR 0.000250    Time 0.033471    
-2020-12-09 16:39:04,983 - Epoch: [26][ 2500/ 4498]    Overall Loss 0.024103    Objective Loss 0.024103    MSE 0.024103    LR 0.000250    Time 0.033335    
-2020-12-09 16:39:13,002 - Epoch: [26][ 2750/ 4498]    Overall Loss 0.024100    Objective Loss 0.024100    MSE 0.024100    LR 0.000250    Time 0.033215    
-2020-12-09 16:39:21,016 - Epoch: [26][ 3000/ 4498]    Overall Loss 0.024095    Objective Loss 0.024095    MSE 0.024095    LR 0.000250    Time 0.033112    
-2020-12-09 16:39:29,055 - Epoch: [26][ 3250/ 4498]    Overall Loss 0.024096    Objective Loss 0.024096    MSE 0.024096    LR 0.000250    Time 0.033033    
-2020-12-09 16:39:37,091 - Epoch: [26][ 3500/ 4498]    Overall Loss 0.024102    Objective Loss 0.024102    MSE 0.024102    LR 0.000250    Time 0.032965    
-2020-12-09 16:39:45,157 - Epoch: [26][ 3750/ 4498]    Overall Loss 0.024111    Objective Loss 0.024111    MSE 0.024111    LR 0.000250    Time 0.032913    
-2020-12-09 16:39:53,231 - Epoch: [26][ 4000/ 4498]    Overall Loss 0.024115    Objective Loss 0.024115    MSE 0.024115    LR 0.000250    Time 0.032871    
-2020-12-09 16:40:01,316 - Epoch: [26][ 4250/ 4498]    Overall Loss 0.024124    Objective Loss 0.024124    MSE 0.024124    LR 0.000250    Time 0.032835    
-2020-12-09 16:40:09,356 - Epoch: [26][ 4498/ 4498]    Overall Loss 0.024128    Objective Loss 0.024128    MSE 0.024128    LR 0.000250    Time 0.032809    
-2020-12-09 16:40:10,171 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17314 |  0.00301 |    0.13010 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15057 | -0.01527 |    0.10325 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09010 | -0.00915 |    0.06351 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09190 | -0.01695 |    0.06839 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10476 | -0.01141 |    0.07558 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12288 | -0.01739 |    0.09230 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15422 | -0.02104 |    0.11227 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24501 |  0.00015 |    0.19277 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:40:10,171 - Total sparsity: 0.00
-
-2020-12-09 16:40:10,174 - --- validate (epoch=26)-----------
-2020-12-09 16:40:10,175 - 49975 samples (100 per mini-batch)
-2020-12-09 16:40:15,748 - Epoch: [26][  250/  500]    Loss 0.025000    MSE 0.025000    
-2020-12-09 16:40:18,969 - Epoch: [26][  500/  500]    Loss 0.025017    MSE 0.025016    
-2020-12-09 16:40:19,683 - ==> MSE: 0.02502    Loss: 0.025
-
-2020-12-09 16:40:19,688 - ==> Best [MSE: 0.02486   Sparsity:0.00   Params: 176048 on epoch: 25]
-2020-12-09 16:40:19,689 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:40:19,693 - 
-
-2020-12-09 16:40:19,693 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:40:30,791 - Epoch: [27][  250/ 4498]    Overall Loss 0.024019    Objective Loss 0.024019    MSE 0.024019    LR 0.000250    Time 0.044319    
-2020-12-09 16:40:38,806 - Epoch: [27][  500/ 4498]    Overall Loss 0.024038    Objective Loss 0.024038    MSE 0.024038    LR 0.000250    Time 0.038156    
-2020-12-09 16:40:46,821 - Epoch: [27][  750/ 4498]    Overall Loss 0.024032    Objective Loss 0.024032    MSE 0.024032    LR 0.000250    Time 0.036101    
-2020-12-09 16:40:54,831 - Epoch: [27][ 1000/ 4498]    Overall Loss 0.024028    Objective Loss 0.024028    MSE 0.024028    LR 0.000250    Time 0.035068    
-2020-12-09 16:41:02,837 - Epoch: [27][ 1250/ 4498]    Overall Loss 0.024027    Objective Loss 0.024027    MSE 0.024027    LR 0.000250    Time 0.034445    
-2020-12-09 16:41:10,873 - Epoch: [27][ 1500/ 4498]    Overall Loss 0.024068    Objective Loss 0.024068    MSE 0.024068    LR 0.000250    Time 0.034050    
-2020-12-09 16:41:18,914 - Epoch: [27][ 1750/ 4498]    Overall Loss 0.024055    Objective Loss 0.024055    MSE 0.024055    LR 0.000250    Time 0.033771    
-2020-12-09 16:41:26,972 - Epoch: [27][ 2000/ 4498]    Overall Loss 0.024052    Objective Loss 0.024052    MSE 0.024052    LR 0.000250    Time 0.033570    
-2020-12-09 16:41:35,001 - Epoch: [27][ 2250/ 4498]    Overall Loss 0.024040    Objective Loss 0.024040    MSE 0.024040    LR 0.000250    Time 0.033401    
-2020-12-09 16:41:43,002 - Epoch: [27][ 2500/ 4498]    Overall Loss 0.024048    Objective Loss 0.024048    MSE 0.024048    LR 0.000250    Time 0.033254    
-2020-12-09 16:41:51,006 - Epoch: [27][ 2750/ 4498]    Overall Loss 0.024047    Objective Loss 0.024047    MSE 0.024047    LR 0.000250    Time 0.033136    
-2020-12-09 16:41:59,010 - Epoch: [27][ 3000/ 4498]    Overall Loss 0.024058    Objective Loss 0.024058    MSE 0.024058    LR 0.000250    Time 0.033036    
-2020-12-09 16:42:07,017 - Epoch: [27][ 3250/ 4498]    Overall Loss 0.024080    Objective Loss 0.024080    MSE 0.024080    LR 0.000250    Time 0.032954    
-2020-12-09 16:42:15,018 - Epoch: [27][ 3500/ 4498]    Overall Loss 0.024076    Objective Loss 0.024076    MSE 0.024076    LR 0.000250    Time 0.032881    
-2020-12-09 16:42:23,019 - Epoch: [27][ 3750/ 4498]    Overall Loss 0.024084    Objective Loss 0.024084    MSE 0.024084    LR 0.000250    Time 0.032818    
-2020-12-09 16:42:31,018 - Epoch: [27][ 4000/ 4498]    Overall Loss 0.024084    Objective Loss 0.024084    MSE 0.024084    LR 0.000250    Time 0.032762    
-2020-12-09 16:42:39,015 - Epoch: [27][ 4250/ 4498]    Overall Loss 0.024087    Objective Loss 0.024087    MSE 0.024087    LR 0.000250    Time 0.032713    
-2020-12-09 16:42:46,978 - Epoch: [27][ 4498/ 4498]    Overall Loss 0.024093    Objective Loss 0.024093    MSE 0.024093    LR 0.000250    Time 0.032676    
-2020-12-09 16:42:47,741 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17344 |  0.00292 |    0.13033 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15093 | -0.01523 |    0.10342 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08980 | -0.00908 |    0.06324 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09166 | -0.01685 |    0.06817 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10456 | -0.01128 |    0.07545 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12279 | -0.01740 |    0.09227 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15434 | -0.02106 |    0.11236 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24621 |  0.00009 |    0.19373 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:42:47,741 - Total sparsity: 0.00
-
-2020-12-09 16:42:47,745 - --- validate (epoch=27)-----------
-2020-12-09 16:42:47,745 - 49975 samples (100 per mini-batch)
-2020-12-09 16:42:53,095 - Epoch: [27][  250/  500]    Loss 0.024840    MSE 0.024840    
-2020-12-09 16:42:56,559 - Epoch: [27][  500/  500]    Loss 0.024871    MSE 0.024872    
-2020-12-09 16:42:57,303 - ==> MSE: 0.02487    Loss: 0.025
-
-2020-12-09 16:42:57,308 - ==> Best [MSE: 0.02486   Sparsity:0.00   Params: 176048 on epoch: 25]
-2020-12-09 16:42:57,309 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:42:57,313 - 
-
-2020-12-09 16:42:57,313 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:43:08,416 - Epoch: [28][  250/ 4498]    Overall Loss 0.023965    Objective Loss 0.023965    MSE 0.023965    LR 0.000250    Time 0.044344    
-2020-12-09 16:43:16,549 - Epoch: [28][  500/ 4498]    Overall Loss 0.023993    Objective Loss 0.023993    MSE 0.023993    LR 0.000250    Time 0.038402    
-2020-12-09 16:43:24,678 - Epoch: [28][  750/ 4498]    Overall Loss 0.023994    Objective Loss 0.023994    MSE 0.023994    LR 0.000250    Time 0.036417    
-2020-12-09 16:43:32,761 - Epoch: [28][ 1000/ 4498]    Overall Loss 0.024007    Objective Loss 0.024007    MSE 0.024007    LR 0.000250    Time 0.035379    
-2020-12-09 16:43:40,765 - Epoch: [28][ 1250/ 4498]    Overall Loss 0.024009    Objective Loss 0.024009    MSE 0.024009    LR 0.000250    Time 0.034692    
-2020-12-09 16:43:48,770 - Epoch: [28][ 1500/ 4498]    Overall Loss 0.024028    Objective Loss 0.024028    MSE 0.024028    LR 0.000250    Time 0.034236    
-2020-12-09 16:43:56,770 - Epoch: [28][ 1750/ 4498]    Overall Loss 0.024032    Objective Loss 0.024032    MSE 0.024032    LR 0.000250    Time 0.033906    
-2020-12-09 16:44:04,771 - Epoch: [28][ 2000/ 4498]    Overall Loss 0.024047    Objective Loss 0.024047    MSE 0.024047    LR 0.000250    Time 0.033660    
-2020-12-09 16:44:12,775 - Epoch: [28][ 2250/ 4498]    Overall Loss 0.024048    Objective Loss 0.024048    MSE 0.024048    LR 0.000250    Time 0.033470    
-2020-12-09 16:44:20,802 - Epoch: [28][ 2500/ 4498]    Overall Loss 0.024052    Objective Loss 0.024052    MSE 0.024052    LR 0.000250    Time 0.033327    
-2020-12-09 16:44:28,829 - Epoch: [28][ 2750/ 4498]    Overall Loss 0.024049    Objective Loss 0.024049    MSE 0.024049    LR 0.000250    Time 0.033209    
-2020-12-09 16:44:36,804 - Epoch: [28][ 3000/ 4498]    Overall Loss 0.024069    Objective Loss 0.024069    MSE 0.024069    LR 0.000250    Time 0.033095    
-2020-12-09 16:44:44,779 - Epoch: [28][ 3250/ 4498]    Overall Loss 0.024064    Objective Loss 0.024064    MSE 0.024064    LR 0.000250    Time 0.032997    
-2020-12-09 16:44:52,756 - Epoch: [28][ 3500/ 4498]    Overall Loss 0.024057    Objective Loss 0.024057    MSE 0.024057    LR 0.000250    Time 0.032915    
-2020-12-09 16:45:00,730 - Epoch: [28][ 3750/ 4498]    Overall Loss 0.024054    Objective Loss 0.024054    MSE 0.024054    LR 0.000250    Time 0.032842    
-2020-12-09 16:45:08,707 - Epoch: [28][ 4000/ 4498]    Overall Loss 0.024058    Objective Loss 0.024058    MSE 0.024058    LR 0.000250    Time 0.032779    
-2020-12-09 16:45:16,679 - Epoch: [28][ 4250/ 4498]    Overall Loss 0.024060    Objective Loss 0.024060    MSE 0.024060    LR 0.000250    Time 0.032723    
-2020-12-09 16:45:24,615 - Epoch: [28][ 4498/ 4498]    Overall Loss 0.024069    Objective Loss 0.024069    MSE 0.024069    LR 0.000250    Time 0.032680    
-2020-12-09 16:45:25,441 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17366 |  0.00300 |    0.13053 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15127 | -0.01511 |    0.10360 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08947 | -0.00908 |    0.06295 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09148 | -0.01680 |    0.06802 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10439 | -0.01125 |    0.07532 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12267 | -0.01727 |    0.09223 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15441 | -0.02092 |    0.11241 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24732 |  0.00008 |    0.19460 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:45:25,441 - Total sparsity: 0.00
-
-2020-12-09 16:45:25,444 - --- validate (epoch=28)-----------
-2020-12-09 16:45:25,444 - 49975 samples (100 per mini-batch)
-2020-12-09 16:45:30,949 - Epoch: [28][  250/  500]    Loss 0.024788    MSE 0.024788    
-2020-12-09 16:45:34,357 - Epoch: [28][  500/  500]    Loss 0.024715    MSE 0.024714    
-2020-12-09 16:45:35,101 - ==> MSE: 0.02471    Loss: 0.025
-
-2020-12-09 16:45:35,107 - ==> Best [MSE: 0.02471   Sparsity:0.00   Params: 176048 on epoch: 28]
-2020-12-09 16:45:35,107 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:45:35,113 - 
-
-2020-12-09 16:45:35,113 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:45:46,228 - Epoch: [29][  250/ 4498]    Overall Loss 0.023958    Objective Loss 0.023958    MSE 0.023958    LR 0.000250    Time 0.044391    
-2020-12-09 16:45:54,251 - Epoch: [29][  500/ 4498]    Overall Loss 0.024006    Objective Loss 0.024006    MSE 0.024006    LR 0.000250    Time 0.038206    
-2020-12-09 16:46:02,265 - Epoch: [29][  750/ 4498]    Overall Loss 0.023989    Objective Loss 0.023989    MSE 0.023989    LR 0.000250    Time 0.036134    
-2020-12-09 16:46:10,280 - Epoch: [29][ 1000/ 4498]    Overall Loss 0.023999    Objective Loss 0.023999    MSE 0.023999    LR 0.000250    Time 0.035098    
-2020-12-09 16:46:18,313 - Epoch: [29][ 1250/ 4498]    Overall Loss 0.023993    Objective Loss 0.023993    MSE 0.023993    LR 0.000250    Time 0.034491    
-2020-12-09 16:46:26,395 - Epoch: [29][ 1500/ 4498]    Overall Loss 0.023992    Objective Loss 0.023992    MSE 0.023992    LR 0.000250    Time 0.034119    
-2020-12-09 16:46:34,482 - Epoch: [29][ 1750/ 4498]    Overall Loss 0.023980    Objective Loss 0.023980    MSE 0.023980    LR 0.000250    Time 0.033856    
-2020-12-09 16:46:42,562 - Epoch: [29][ 2000/ 4498]    Overall Loss 0.023981    Objective Loss 0.023981    MSE 0.023981    LR 0.000250    Time 0.033655    
-2020-12-09 16:46:50,655 - Epoch: [29][ 2250/ 4498]    Overall Loss 0.023989    Objective Loss 0.023989    MSE 0.023989    LR 0.000250    Time 0.033505    
-2020-12-09 16:46:58,720 - Epoch: [29][ 2500/ 4498]    Overall Loss 0.024001    Objective Loss 0.024001    MSE 0.024001    LR 0.000250    Time 0.033373    
-2020-12-09 16:47:06,816 - Epoch: [29][ 2750/ 4498]    Overall Loss 0.024013    Objective Loss 0.024013    MSE 0.024013    LR 0.000250    Time 0.033277    
-2020-12-09 16:47:14,873 - Epoch: [29][ 3000/ 4498]    Overall Loss 0.024019    Objective Loss 0.024019    MSE 0.024019    LR 0.000250    Time 0.033184    
-2020-12-09 16:47:22,928 - Epoch: [29][ 3250/ 4498]    Overall Loss 0.024023    Objective Loss 0.024023    MSE 0.024023    LR 0.000250    Time 0.033105    
-2020-12-09 16:47:30,979 - Epoch: [29][ 3500/ 4498]    Overall Loss 0.024030    Objective Loss 0.024030    MSE 0.024030    LR 0.000250    Time 0.033036    
-2020-12-09 16:47:39,031 - Epoch: [29][ 3750/ 4498]    Overall Loss 0.024037    Objective Loss 0.024037    MSE 0.024037    LR 0.000250    Time 0.032976    
-2020-12-09 16:47:47,079 - Epoch: [29][ 4000/ 4498]    Overall Loss 0.024042    Objective Loss 0.024042    MSE 0.024042    LR 0.000250    Time 0.032922    
-2020-12-09 16:47:55,125 - Epoch: [29][ 4250/ 4498]    Overall Loss 0.024044    Objective Loss 0.024044    MSE 0.024044    LR 0.000250    Time 0.032875    
-2020-12-09 16:48:03,132 - Epoch: [29][ 4498/ 4498]    Overall Loss 0.024043    Objective Loss 0.024043    MSE 0.024043    LR 0.000250    Time 0.032840    
-2020-12-09 16:48:03,938 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17392 |  0.00296 |    0.13077 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15167 | -0.01517 |    0.10384 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08919 | -0.00891 |    0.06269 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09130 | -0.01669 |    0.06788 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10427 | -0.01127 |    0.07523 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12259 | -0.01719 |    0.09223 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15450 | -0.02089 |    0.11250 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24844 |  0.00010 |    0.19548 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:48:03,938 - Total sparsity: 0.00
-
-2020-12-09 16:48:03,941 - --- validate (epoch=29)-----------
-2020-12-09 16:48:03,942 - 49975 samples (100 per mini-batch)
-2020-12-09 16:48:09,472 - Epoch: [29][  250/  500]    Loss 0.024691    MSE 0.024691    
-2020-12-09 16:48:12,858 - Epoch: [29][  500/  500]    Loss 0.024695    MSE 0.024695    
-2020-12-09 16:48:13,596 - ==> MSE: 0.02470    Loss: 0.025
-
-2020-12-09 16:48:13,602 - ==> Best [MSE: 0.02470   Sparsity:0.00   Params: 176048 on epoch: 29]
-2020-12-09 16:48:13,602 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:48:13,614 - 
-
-2020-12-09 16:48:13,614 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:48:24,691 - Epoch: [30][  250/ 4498]    Overall Loss 0.024016    Objective Loss 0.024016    MSE 0.024016    LR 0.000250    Time 0.044239    
-2020-12-09 16:48:32,736 - Epoch: [30][  500/ 4498]    Overall Loss 0.023949    Objective Loss 0.023949    MSE 0.023949    LR 0.000250    Time 0.038174    
-2020-12-09 16:48:40,771 - Epoch: [30][  750/ 4498]    Overall Loss 0.023954    Objective Loss 0.023954    MSE 0.023954    LR 0.000250    Time 0.036140    
-2020-12-09 16:48:48,804 - Epoch: [30][ 1000/ 4498]    Overall Loss 0.023949    Objective Loss 0.023949    MSE 0.023949    LR 0.000250    Time 0.035121    
-2020-12-09 16:48:56,839 - Epoch: [30][ 1250/ 4498]    Overall Loss 0.023967    Objective Loss 0.023967    MSE 0.023967    LR 0.000250    Time 0.034511    
-2020-12-09 16:49:04,874 - Epoch: [30][ 1500/ 4498]    Overall Loss 0.023977    Objective Loss 0.023977    MSE 0.023977    LR 0.000250    Time 0.034105    
-2020-12-09 16:49:12,910 - Epoch: [30][ 1750/ 4498]    Overall Loss 0.023990    Objective Loss 0.023990    MSE 0.023990    LR 0.000250    Time 0.033815    
-2020-12-09 16:49:20,948 - Epoch: [30][ 2000/ 4498]    Overall Loss 0.023983    Objective Loss 0.023983    MSE 0.023983    LR 0.000250    Time 0.033598    
-2020-12-09 16:49:28,977 - Epoch: [30][ 2250/ 4498]    Overall Loss 0.023988    Objective Loss 0.023988    MSE 0.023988    LR 0.000250    Time 0.033426    
-2020-12-09 16:49:37,004 - Epoch: [30][ 2500/ 4498]    Overall Loss 0.023997    Objective Loss 0.023997    MSE 0.023997    LR 0.000250    Time 0.033287    
-2020-12-09 16:49:45,041 - Epoch: [30][ 2750/ 4498]    Overall Loss 0.023989    Objective Loss 0.023989    MSE 0.023989    LR 0.000250    Time 0.033178    
-2020-12-09 16:49:53,092 - Epoch: [30][ 3000/ 4498]    Overall Loss 0.024000    Objective Loss 0.024000    MSE 0.024000    LR 0.000250    Time 0.033091    
-2020-12-09 16:50:01,142 - Epoch: [30][ 3250/ 4498]    Overall Loss 0.024005    Objective Loss 0.024005    MSE 0.024005    LR 0.000250    Time 0.033017    
-2020-12-09 16:50:09,191 - Epoch: [30][ 3500/ 4498]    Overall Loss 0.024017    Objective Loss 0.024017    MSE 0.024017    LR 0.000250    Time 0.032953    
-2020-12-09 16:50:17,230 - Epoch: [30][ 3750/ 4498]    Overall Loss 0.024017    Objective Loss 0.024017    MSE 0.024017    LR 0.000250    Time 0.032896    
-2020-12-09 16:50:25,271 - Epoch: [30][ 4000/ 4498]    Overall Loss 0.024017    Objective Loss 0.024017    MSE 0.024017    LR 0.000250    Time 0.032846    
-2020-12-09 16:50:33,306 - Epoch: [30][ 4250/ 4498]    Overall Loss 0.024015    Objective Loss 0.024015    MSE 0.024015    LR 0.000250    Time 0.032800    
-2020-12-09 16:50:41,310 - Epoch: [30][ 4498/ 4498]    Overall Loss 0.024018    Objective Loss 0.024018    MSE 0.024018    LR 0.000250    Time 0.032768    
-2020-12-09 16:50:42,071 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17415 |  0.00303 |    0.13089 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15200 | -0.01511 |    0.10398 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08901 | -0.00894 |    0.06248 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09113 | -0.01660 |    0.06772 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10409 | -0.01106 |    0.07510 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12254 | -0.01709 |    0.09221 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15458 | -0.02094 |    0.11255 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.24944 |  0.00009 |    0.19628 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:50:42,071 - Total sparsity: 0.00
-
-2020-12-09 16:50:42,074 - --- validate (epoch=30)-----------
-2020-12-09 16:50:42,074 - 49975 samples (100 per mini-batch)
-2020-12-09 16:50:47,400 - Epoch: [30][  250/  500]    Loss 0.024754    MSE 0.024754    
-2020-12-09 16:50:50,778 - Epoch: [30][  500/  500]    Loss 0.024761    MSE 0.024762    
-2020-12-09 16:50:51,512 - ==> MSE: 0.02476    Loss: 0.025
-
-2020-12-09 16:50:51,518 - ==> Best [MSE: 0.02470   Sparsity:0.00   Params: 176048 on epoch: 29]
-2020-12-09 16:50:51,518 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:50:51,523 - 
-
-2020-12-09 16:50:51,523 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:51:02,641 - Epoch: [31][  250/ 4498]    Overall Loss 0.023861    Objective Loss 0.023861    MSE 0.023861    LR 0.000250    Time 0.044404    
-2020-12-09 16:51:10,725 - Epoch: [31][  500/ 4498]    Overall Loss 0.023906    Objective Loss 0.023906    MSE 0.023906    LR 0.000250    Time 0.038335    
-2020-12-09 16:51:18,788 - Epoch: [31][  750/ 4498]    Overall Loss 0.023885    Objective Loss 0.023885    MSE 0.023885    LR 0.000250    Time 0.036284    
-2020-12-09 16:51:26,825 - Epoch: [31][ 1000/ 4498]    Overall Loss 0.023881    Objective Loss 0.023881    MSE 0.023881    LR 0.000250    Time 0.035233    
-2020-12-09 16:51:34,864 - Epoch: [31][ 1250/ 4498]    Overall Loss 0.023882    Objective Loss 0.023882    MSE 0.023882    LR 0.000250    Time 0.034604    
-2020-12-09 16:51:42,901 - Epoch: [31][ 1500/ 4498]    Overall Loss 0.023892    Objective Loss 0.023892    MSE 0.023892    LR 0.000250    Time 0.034183    
-2020-12-09 16:51:50,954 - Epoch: [31][ 1750/ 4498]    Overall Loss 0.023906    Objective Loss 0.023906    MSE 0.023906    LR 0.000250    Time 0.033892    
-2020-12-09 16:51:59,019 - Epoch: [31][ 2000/ 4498]    Overall Loss 0.023927    Objective Loss 0.023927    MSE 0.023927    LR 0.000250    Time 0.033679    
-2020-12-09 16:52:07,084 - Epoch: [31][ 2250/ 4498]    Overall Loss 0.023928    Objective Loss 0.023928    MSE 0.023928    LR 0.000250    Time 0.033514    
-2020-12-09 16:52:15,148 - Epoch: [31][ 2500/ 4498]    Overall Loss 0.023941    Objective Loss 0.023941    MSE 0.023941    LR 0.000250    Time 0.033381    
-2020-12-09 16:52:23,213 - Epoch: [31][ 2750/ 4498]    Overall Loss 0.023946    Objective Loss 0.023946    MSE 0.023946    LR 0.000250    Time 0.033273    
-2020-12-09 16:52:31,275 - Epoch: [31][ 3000/ 4498]    Overall Loss 0.023953    Objective Loss 0.023953    MSE 0.023953    LR 0.000250    Time 0.033182    
-2020-12-09 16:52:39,339 - Epoch: [31][ 3250/ 4498]    Overall Loss 0.023962    Objective Loss 0.023962    MSE 0.023962    LR 0.000250    Time 0.033106    
-2020-12-09 16:52:47,402 - Epoch: [31][ 3500/ 4498]    Overall Loss 0.023968    Objective Loss 0.023968    MSE 0.023968    LR 0.000250    Time 0.033039    
-2020-12-09 16:52:55,461 - Epoch: [31][ 3750/ 4498]    Overall Loss 0.023987    Objective Loss 0.023987    MSE 0.023987    LR 0.000250    Time 0.032981    
-2020-12-09 16:53:03,517 - Epoch: [31][ 4000/ 4498]    Overall Loss 0.023990    Objective Loss 0.023990    MSE 0.023990    LR 0.000250    Time 0.032930    
-2020-12-09 16:53:11,569 - Epoch: [31][ 4250/ 4498]    Overall Loss 0.023983    Objective Loss 0.023983    MSE 0.023983    LR 0.000250    Time 0.032883    
-2020-12-09 16:53:19,593 - Epoch: [31][ 4498/ 4498]    Overall Loss 0.023991    Objective Loss 0.023991    MSE 0.023991    LR 0.000250    Time 0.032851    
-2020-12-09 16:53:20,384 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17439 |  0.00296 |    0.13108 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15224 | -0.01496 |    0.10419 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08887 | -0.00890 |    0.06236 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09097 | -0.01657 |    0.06756 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10400 | -0.01097 |    0.07509 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12253 | -0.01712 |    0.09230 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15466 | -0.02099 |    0.11259 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25049 |  0.00011 |    0.19710 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:53:20,384 - Total sparsity: 0.00
-
-2020-12-09 16:53:20,387 - --- validate (epoch=31)-----------
-2020-12-09 16:53:20,387 - 49975 samples (100 per mini-batch)
-2020-12-09 16:53:25,955 - Epoch: [31][  250/  500]    Loss 0.024752    MSE 0.024752    
-2020-12-09 16:53:29,344 - Epoch: [31][  500/  500]    Loss 0.024757    MSE 0.024756    
-2020-12-09 16:53:30,035 - ==> MSE: 0.02476    Loss: 0.025
-
-2020-12-09 16:53:30,042 - ==> Best [MSE: 0.02470   Sparsity:0.00   Params: 176048 on epoch: 29]
-2020-12-09 16:53:30,042 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:53:30,047 - 
-
-2020-12-09 16:53:30,047 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:53:41,128 - Epoch: [32][  250/ 4498]    Overall Loss 0.023984    Objective Loss 0.023984    MSE 0.023984    LR 0.000250    Time 0.044256    
-2020-12-09 16:53:49,200 - Epoch: [32][  500/ 4498]    Overall Loss 0.024025    Objective Loss 0.024025    MSE 0.024025    LR 0.000250    Time 0.038238    
-2020-12-09 16:53:57,266 - Epoch: [32][  750/ 4498]    Overall Loss 0.023954    Objective Loss 0.023954    MSE 0.023954    LR 0.000250    Time 0.036223    
-2020-12-09 16:54:05,325 - Epoch: [32][ 1000/ 4498]    Overall Loss 0.023973    Objective Loss 0.023973    MSE 0.023973    LR 0.000250    Time 0.035210    
-2020-12-09 16:54:13,381 - Epoch: [32][ 1250/ 4498]    Overall Loss 0.023959    Objective Loss 0.023959    MSE 0.023959    LR 0.000250    Time 0.034599    
-2020-12-09 16:54:21,439 - Epoch: [32][ 1500/ 4498]    Overall Loss 0.023954    Objective Loss 0.023954    MSE 0.023954    LR 0.000250    Time 0.034193    
-2020-12-09 16:54:29,496 - Epoch: [32][ 1750/ 4498]    Overall Loss 0.023954    Objective Loss 0.023954    MSE 0.023954    LR 0.000250    Time 0.033902    
-2020-12-09 16:54:37,552 - Epoch: [32][ 2000/ 4498]    Overall Loss 0.023954    Objective Loss 0.023954    MSE 0.023954    LR 0.000250    Time 0.033684    
-2020-12-09 16:54:45,608 - Epoch: [32][ 2250/ 4498]    Overall Loss 0.023957    Objective Loss 0.023957    MSE 0.023957    LR 0.000250    Time 0.033514    
-2020-12-09 16:54:53,666 - Epoch: [32][ 2500/ 4498]    Overall Loss 0.023970    Objective Loss 0.023970    MSE 0.023970    LR 0.000250    Time 0.033379    
-2020-12-09 16:55:01,729 - Epoch: [32][ 2750/ 4498]    Overall Loss 0.023965    Objective Loss 0.023965    MSE 0.023965    LR 0.000250    Time 0.033270    
-2020-12-09 16:55:09,785 - Epoch: [32][ 3000/ 4498]    Overall Loss 0.023972    Objective Loss 0.023972    MSE 0.023972    LR 0.000250    Time 0.033177    
-2020-12-09 16:55:17,844 - Epoch: [32][ 3250/ 4498]    Overall Loss 0.023963    Objective Loss 0.023963    MSE 0.023963    LR 0.000250    Time 0.033100    
-2020-12-09 16:55:25,906 - Epoch: [32][ 3500/ 4498]    Overall Loss 0.023962    Objective Loss 0.023962    MSE 0.023962    LR 0.000250    Time 0.033034    
-2020-12-09 16:55:33,961 - Epoch: [32][ 3750/ 4498]    Overall Loss 0.023971    Objective Loss 0.023971    MSE 0.023971    LR 0.000250    Time 0.032975    
-2020-12-09 16:55:42,014 - Epoch: [32][ 4000/ 4498]    Overall Loss 0.023970    Objective Loss 0.023970    MSE 0.023970    LR 0.000250    Time 0.032923    
-2020-12-09 16:55:50,069 - Epoch: [32][ 4250/ 4498]    Overall Loss 0.023975    Objective Loss 0.023975    MSE 0.023975    LR 0.000250    Time 0.032878    
-2020-12-09 16:55:58,094 - Epoch: [32][ 4498/ 4498]    Overall Loss 0.023981    Objective Loss 0.023981    MSE 0.023981    LR 0.000250    Time 0.032846    
-2020-12-09 16:55:58,906 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17492 |  0.00279 |    0.13152 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15258 | -0.01487 |    0.10437 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08865 | -0.00889 |    0.06210 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09084 | -0.01653 |    0.06747 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10393 | -0.01088 |    0.07508 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12253 | -0.01707 |    0.09238 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15473 | -0.02103 |    0.11264 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25147 |  0.00012 |    0.19788 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:55:58,906 - Total sparsity: 0.00
-
-2020-12-09 16:55:58,909 - --- validate (epoch=32)-----------
-2020-12-09 16:55:58,909 - 49975 samples (100 per mini-batch)
-2020-12-09 16:56:04,493 - Epoch: [32][  250/  500]    Loss 0.024765    MSE 0.024765    
-2020-12-09 16:56:07,829 - Epoch: [32][  500/  500]    Loss 0.024713    MSE 0.024712    
-2020-12-09 16:56:08,572 - ==> MSE: 0.02471    Loss: 0.025
-
-2020-12-09 16:56:08,578 - ==> Best [MSE: 0.02470   Sparsity:0.00   Params: 176048 on epoch: 29]
-2020-12-09 16:56:08,578 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:56:08,583 - 
-
-2020-12-09 16:56:08,583 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:56:19,592 - Epoch: [33][  250/ 4498]    Overall Loss 0.023851    Objective Loss 0.023851    MSE 0.023851    LR 0.000250    Time 0.043966    
-2020-12-09 16:56:27,629 - Epoch: [33][  500/ 4498]    Overall Loss 0.023829    Objective Loss 0.023829    MSE 0.023829    LR 0.000250    Time 0.038023    
-2020-12-09 16:56:35,652 - Epoch: [33][  750/ 4498]    Overall Loss 0.023856    Objective Loss 0.023856    MSE 0.023856    LR 0.000250    Time 0.036024    
-2020-12-09 16:56:43,663 - Epoch: [33][ 1000/ 4498]    Overall Loss 0.023862    Objective Loss 0.023862    MSE 0.023862    LR 0.000250    Time 0.035011    
-2020-12-09 16:56:51,669 - Epoch: [33][ 1250/ 4498]    Overall Loss 0.023865    Objective Loss 0.023865    MSE 0.023865    LR 0.000250    Time 0.034400    
-2020-12-09 16:56:59,675 - Epoch: [33][ 1500/ 4498]    Overall Loss 0.023861    Objective Loss 0.023861    MSE 0.023861    LR 0.000250    Time 0.033992    
-2020-12-09 16:57:07,681 - Epoch: [33][ 1750/ 4498]    Overall Loss 0.023872    Objective Loss 0.023872    MSE 0.023872    LR 0.000250    Time 0.033702    
-2020-12-09 16:57:15,687 - Epoch: [33][ 2000/ 4498]    Overall Loss 0.023894    Objective Loss 0.023894    MSE 0.023894    LR 0.000250    Time 0.033483    
-2020-12-09 16:57:23,691 - Epoch: [33][ 2250/ 4498]    Overall Loss 0.023907    Objective Loss 0.023907    MSE 0.023907    LR 0.000250    Time 0.033313    
-2020-12-09 16:57:31,700 - Epoch: [33][ 2500/ 4498]    Overall Loss 0.023911    Objective Loss 0.023911    MSE 0.023911    LR 0.000250    Time 0.033178    
-2020-12-09 16:57:39,750 - Epoch: [33][ 2750/ 4498]    Overall Loss 0.023917    Objective Loss 0.023917    MSE 0.023917    LR 0.000250    Time 0.033083    
-2020-12-09 16:57:47,804 - Epoch: [33][ 3000/ 4498]    Overall Loss 0.023922    Objective Loss 0.023922    MSE 0.023922    LR 0.000250    Time 0.033005    
-2020-12-09 16:57:55,836 - Epoch: [33][ 3250/ 4498]    Overall Loss 0.023935    Objective Loss 0.023935    MSE 0.023935    LR 0.000250    Time 0.032932    
-2020-12-09 16:58:03,824 - Epoch: [33][ 3500/ 4498]    Overall Loss 0.023948    Objective Loss 0.023948    MSE 0.023948    LR 0.000250    Time 0.032857    
-2020-12-09 16:58:11,801 - Epoch: [33][ 3750/ 4498]    Overall Loss 0.023944    Objective Loss 0.023944    MSE 0.023944    LR 0.000250    Time 0.032789    
-2020-12-09 16:58:19,850 - Epoch: [33][ 4000/ 4498]    Overall Loss 0.023954    Objective Loss 0.023954    MSE 0.023954    LR 0.000250    Time 0.032748    
-2020-12-09 16:58:27,905 - Epoch: [33][ 4250/ 4498]    Overall Loss 0.023949    Objective Loss 0.023949    MSE 0.023949    LR 0.000250    Time 0.032713    
-2020-12-09 16:58:35,932 - Epoch: [33][ 4498/ 4498]    Overall Loss 0.023956    Objective Loss 0.023956    MSE 0.023956    LR 0.000250    Time 0.032691    
-2020-12-09 16:58:36,756 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17505 |  0.00296 |    0.13164 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15293 | -0.01508 |    0.10455 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08845 | -0.00882 |    0.06191 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09068 | -0.01644 |    0.06733 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10385 | -0.01082 |    0.07507 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12250 | -0.01708 |    0.09239 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15485 | -0.02103 |    0.11271 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25239 |  0.00012 |    0.19861 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 16:58:36,756 - Total sparsity: 0.00
-
-2020-12-09 16:58:36,759 - --- validate (epoch=33)-----------
-2020-12-09 16:58:36,759 - 49975 samples (100 per mini-batch)
-2020-12-09 16:58:42,403 - Epoch: [33][  250/  500]    Loss 0.024689    MSE 0.024689    
-2020-12-09 16:58:45,732 - Epoch: [33][  500/  500]    Loss 0.024654    MSE 0.024654    
-2020-12-09 16:58:46,472 - ==> MSE: 0.02465    Loss: 0.025
-
-2020-12-09 16:58:46,479 - ==> Best [MSE: 0.02465   Sparsity:0.00   Params: 176048 on epoch: 33]
-2020-12-09 16:58:46,479 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 16:58:46,491 - 
-
-2020-12-09 16:58:46,491 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 16:58:57,726 - Epoch: [34][  250/ 4498]    Overall Loss 0.023832    Objective Loss 0.023832    MSE 0.023832    LR 0.000250    Time 0.044870    
-2020-12-09 16:59:05,861 - Epoch: [34][  500/ 4498]    Overall Loss 0.023889    Objective Loss 0.023889    MSE 0.023889    LR 0.000250    Time 0.038671    
-2020-12-09 16:59:13,937 - Epoch: [34][  750/ 4498]    Overall Loss 0.023884    Objective Loss 0.023884    MSE 0.023884    LR 0.000250    Time 0.036526    
-2020-12-09 16:59:21,995 - Epoch: [34][ 1000/ 4498]    Overall Loss 0.023880    Objective Loss 0.023880    MSE 0.023880    LR 0.000250    Time 0.035435    
-2020-12-09 16:59:30,060 - Epoch: [34][ 1250/ 4498]    Overall Loss 0.023891    Objective Loss 0.023891    MSE 0.023891    LR 0.000250    Time 0.034787    
-2020-12-09 16:59:38,114 - Epoch: [34][ 1500/ 4498]    Overall Loss 0.023887    Objective Loss 0.023887    MSE 0.023887    LR 0.000250    Time 0.034347    
-2020-12-09 16:59:46,167 - Epoch: [34][ 1750/ 4498]    Overall Loss 0.023888    Objective Loss 0.023888    MSE 0.023888    LR 0.000250    Time 0.034032    
-2020-12-09 16:59:54,225 - Epoch: [34][ 2000/ 4498]    Overall Loss 0.023891    Objective Loss 0.023891    MSE 0.023891    LR 0.000250    Time 0.033798    
-2020-12-09 17:00:02,279 - Epoch: [34][ 2250/ 4498]    Overall Loss 0.023895    Objective Loss 0.023895    MSE 0.023895    LR 0.000250    Time 0.033615    
-2020-12-09 17:00:10,340 - Epoch: [34][ 2500/ 4498]    Overall Loss 0.023903    Objective Loss 0.023903    MSE 0.023903    LR 0.000250    Time 0.033471    
-2020-12-09 17:00:18,398 - Epoch: [34][ 2750/ 4498]    Overall Loss 0.023900    Objective Loss 0.023900    MSE 0.023900    LR 0.000250    Time 0.033352    
-2020-12-09 17:00:26,460 - Epoch: [34][ 3000/ 4498]    Overall Loss 0.023907    Objective Loss 0.023907    MSE 0.023907    LR 0.000250    Time 0.033254    
-2020-12-09 17:00:34,523 - Epoch: [34][ 3250/ 4498]    Overall Loss 0.023925    Objective Loss 0.023925    MSE 0.023924    LR 0.000250    Time 0.033172    
-2020-12-09 17:00:42,586 - Epoch: [34][ 3500/ 4498]    Overall Loss 0.023922    Objective Loss 0.023922    MSE 0.023922    LR 0.000250    Time 0.033101    
-2020-12-09 17:00:50,646 - Epoch: [34][ 3750/ 4498]    Overall Loss 0.023929    Objective Loss 0.023929    MSE 0.023928    LR 0.000250    Time 0.033039    
-2020-12-09 17:00:58,693 - Epoch: [34][ 4000/ 4498]    Overall Loss 0.023933    Objective Loss 0.023933    MSE 0.023933    LR 0.000250    Time 0.032982    
-2020-12-09 17:01:06,739 - Epoch: [34][ 4250/ 4498]    Overall Loss 0.023934    Objective Loss 0.023934    MSE 0.023934    LR 0.000250    Time 0.032931    
-2020-12-09 17:01:14,748 - Epoch: [34][ 4498/ 4498]    Overall Loss 0.023943    Objective Loss 0.023943    MSE 0.023943    LR 0.000250    Time 0.032893    
-2020-12-09 17:01:15,555 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17557 |  0.00308 |    0.13210 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15334 | -0.01501 |    0.10480 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08826 | -0.00873 |    0.06169 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09055 | -0.01636 |    0.06719 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10376 | -0.01082 |    0.07503 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12243 | -0.01716 |    0.09240 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15488 | -0.02095 |    0.11271 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25317 |  0.00013 |    0.19924 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:01:15,555 - Total sparsity: 0.00
-
-2020-12-09 17:01:15,558 - --- validate (epoch=34)-----------
-2020-12-09 17:01:15,559 - 49975 samples (100 per mini-batch)
-2020-12-09 17:01:21,272 - Epoch: [34][  250/  500]    Loss 0.024825    MSE 0.024825    
-2020-12-09 17:01:24,755 - Epoch: [34][  500/  500]    Loss 0.024893    MSE 0.024892    
-2020-12-09 17:01:25,491 - ==> MSE: 0.02489    Loss: 0.025
-
-2020-12-09 17:01:25,497 - ==> Best [MSE: 0.02465   Sparsity:0.00   Params: 176048 on epoch: 33]
-2020-12-09 17:01:25,497 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:01:25,502 - 
-
-2020-12-09 17:01:25,502 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:01:36,703 - Epoch: [35][  250/ 4498]    Overall Loss 0.023800    Objective Loss 0.023800    MSE 0.023800    LR 0.000250    Time 0.044735    
-2020-12-09 17:01:44,769 - Epoch: [35][  500/ 4498]    Overall Loss 0.023794    Objective Loss 0.023794    MSE 0.023794    LR 0.000250    Time 0.038464    
-2020-12-09 17:01:52,813 - Epoch: [35][  750/ 4498]    Overall Loss 0.023814    Objective Loss 0.023814    MSE 0.023814    LR 0.000250    Time 0.036346    
-2020-12-09 17:02:00,848 - Epoch: [35][ 1000/ 4498]    Overall Loss 0.023830    Objective Loss 0.023830    MSE 0.023830    LR 0.000250    Time 0.035277    
-2020-12-09 17:02:08,879 - Epoch: [35][ 1250/ 4498]    Overall Loss 0.023833    Objective Loss 0.023833    MSE 0.023833    LR 0.000250    Time 0.034633    
-2020-12-09 17:02:16,910 - Epoch: [35][ 1500/ 4498]    Overall Loss 0.023861    Objective Loss 0.023861    MSE 0.023861    LR 0.000250    Time 0.034203    
-2020-12-09 17:02:24,942 - Epoch: [35][ 1750/ 4498]    Overall Loss 0.023868    Objective Loss 0.023868    MSE 0.023868    LR 0.000250    Time 0.033897    
-2020-12-09 17:02:32,976 - Epoch: [35][ 2000/ 4498]    Overall Loss 0.023880    Objective Loss 0.023880    MSE 0.023880    LR 0.000250    Time 0.033668    
-2020-12-09 17:02:41,006 - Epoch: [35][ 2250/ 4498]    Overall Loss 0.023884    Objective Loss 0.023884    MSE 0.023884    LR 0.000250    Time 0.033488    
-2020-12-09 17:02:49,025 - Epoch: [35][ 2500/ 4498]    Overall Loss 0.023889    Objective Loss 0.023889    MSE 0.023889    LR 0.000250    Time 0.033340    
-2020-12-09 17:02:57,050 - Epoch: [35][ 2750/ 4498]    Overall Loss 0.023888    Objective Loss 0.023888    MSE 0.023888    LR 0.000250    Time 0.033221    
-2020-12-09 17:03:05,075 - Epoch: [35][ 3000/ 4498]    Overall Loss 0.023888    Objective Loss 0.023888    MSE 0.023888    LR 0.000250    Time 0.033122    
-2020-12-09 17:03:13,102 - Epoch: [35][ 3250/ 4498]    Overall Loss 0.023892    Objective Loss 0.023892    MSE 0.023892    LR 0.000250    Time 0.033039    
-2020-12-09 17:03:21,110 - Epoch: [35][ 3500/ 4498]    Overall Loss 0.023907    Objective Loss 0.023907    MSE 0.023907    LR 0.000250    Time 0.032962    
-2020-12-09 17:03:29,125 - Epoch: [35][ 3750/ 4498]    Overall Loss 0.023906    Objective Loss 0.023906    MSE 0.023906    LR 0.000250    Time 0.032897    
-2020-12-09 17:03:37,128 - Epoch: [35][ 4000/ 4498]    Overall Loss 0.023907    Objective Loss 0.023907    MSE 0.023907    LR 0.000250    Time 0.032838    
-2020-12-09 17:03:45,136 - Epoch: [35][ 4250/ 4498]    Overall Loss 0.023917    Objective Loss 0.023917    MSE 0.023917    LR 0.000250    Time 0.032786    
-2020-12-09 17:03:53,109 - Epoch: [35][ 4498/ 4498]    Overall Loss 0.023918    Objective Loss 0.023918    MSE 0.023918    LR 0.000250    Time 0.032748    
-2020-12-09 17:03:53,929 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17572 |  0.00294 |    0.13216 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15376 | -0.01514 |    0.10509 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08801 | -0.00859 |    0.06144 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09035 | -0.01625 |    0.06700 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10367 | -0.01075 |    0.07499 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12237 | -0.01712 |    0.09240 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15491 | -0.02097 |    0.11271 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25398 |  0.00006 |    0.19987 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:03:53,929 - Total sparsity: 0.00
-
-2020-12-09 17:03:53,932 - --- validate (epoch=35)-----------
-2020-12-09 17:03:53,932 - 49975 samples (100 per mini-batch)
-2020-12-09 17:03:59,239 - Epoch: [35][  250/  500]    Loss 0.024857    MSE 0.024857    
-2020-12-09 17:04:02,534 - Epoch: [35][  500/  500]    Loss 0.024891    MSE 0.024890    
-2020-12-09 17:04:03,272 - ==> MSE: 0.02489    Loss: 0.025
-
-2020-12-09 17:04:03,279 - ==> Best [MSE: 0.02465   Sparsity:0.00   Params: 176048 on epoch: 33]
-2020-12-09 17:04:03,279 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:04:03,284 - 
-
-2020-12-09 17:04:03,284 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:04:14,362 - Epoch: [36][  250/ 4498]    Overall Loss 0.023795    Objective Loss 0.023795    MSE 0.023795    LR 0.000250    Time 0.044243    
-2020-12-09 17:04:22,456 - Epoch: [36][  500/ 4498]    Overall Loss 0.023815    Objective Loss 0.023815    MSE 0.023815    LR 0.000250    Time 0.038274    
-2020-12-09 17:04:30,578 - Epoch: [36][  750/ 4498]    Overall Loss 0.023845    Objective Loss 0.023845    MSE 0.023845    LR 0.000250    Time 0.036323    
-2020-12-09 17:04:38,690 - Epoch: [36][ 1000/ 4498]    Overall Loss 0.023850    Objective Loss 0.023850    MSE 0.023850    LR 0.000250    Time 0.035337    
-2020-12-09 17:04:46,802 - Epoch: [36][ 1250/ 4498]    Overall Loss 0.023865    Objective Loss 0.023865    MSE 0.023865    LR 0.000250    Time 0.034746    
-2020-12-09 17:04:54,912 - Epoch: [36][ 1500/ 4498]    Overall Loss 0.023855    Objective Loss 0.023855    MSE 0.023855    LR 0.000250    Time 0.034350    
-2020-12-09 17:05:03,017 - Epoch: [36][ 1750/ 4498]    Overall Loss 0.023868    Objective Loss 0.023868    MSE 0.023868    LR 0.000250    Time 0.034064    
-2020-12-09 17:05:11,115 - Epoch: [36][ 2000/ 4498]    Overall Loss 0.023856    Objective Loss 0.023856    MSE 0.023856    LR 0.000250    Time 0.033847    
-2020-12-09 17:05:19,209 - Epoch: [36][ 2250/ 4498]    Overall Loss 0.023862    Objective Loss 0.023862    MSE 0.023862    LR 0.000250    Time 0.033676    
-2020-12-09 17:05:27,301 - Epoch: [36][ 2500/ 4498]    Overall Loss 0.023870    Objective Loss 0.023870    MSE 0.023870    LR 0.000250    Time 0.033538    
-2020-12-09 17:05:35,299 - Epoch: [36][ 2750/ 4498]    Overall Loss 0.023881    Objective Loss 0.023881    MSE 0.023881    LR 0.000250    Time 0.033391    
-2020-12-09 17:05:43,269 - Epoch: [36][ 3000/ 4498]    Overall Loss 0.023893    Objective Loss 0.023893    MSE 0.023893    LR 0.000250    Time 0.033259    
-2020-12-09 17:05:51,248 - Epoch: [36][ 3250/ 4498]    Overall Loss 0.023895    Objective Loss 0.023895    MSE 0.023895    LR 0.000250    Time 0.033151    
-2020-12-09 17:05:59,197 - Epoch: [36][ 3500/ 4498]    Overall Loss 0.023904    Objective Loss 0.023904    MSE 0.023904    LR 0.000250    Time 0.033049    
-2020-12-09 17:06:07,154 - Epoch: [36][ 3750/ 4498]    Overall Loss 0.023908    Objective Loss 0.023908    MSE 0.023908    LR 0.000250    Time 0.032963    
-2020-12-09 17:06:15,102 - Epoch: [36][ 4000/ 4498]    Overall Loss 0.023914    Objective Loss 0.023914    MSE 0.023914    LR 0.000250    Time 0.032886    
-2020-12-09 17:06:23,050 - Epoch: [36][ 4250/ 4498]    Overall Loss 0.023914    Objective Loss 0.023914    MSE 0.023914    LR 0.000250    Time 0.032817    
-2020-12-09 17:06:30,982 - Epoch: [36][ 4498/ 4498]    Overall Loss 0.023912    Objective Loss 0.023912    MSE 0.023912    LR 0.000250    Time 0.032768    
-2020-12-09 17:06:31,794 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17617 |  0.00267 |    0.13254 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15406 | -0.01520 |    0.10525 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08786 | -0.00863 |    0.06123 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09024 | -0.01624 |    0.06690 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10357 | -0.01070 |    0.07495 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12239 | -0.01705 |    0.09242 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15496 | -0.02101 |    0.11271 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25480 |  0.00010 |    0.20051 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:06:31,794 - Total sparsity: 0.00
-
-2020-12-09 17:06:31,797 - --- validate (epoch=36)-----------
-2020-12-09 17:06:31,797 - 49975 samples (100 per mini-batch)
-2020-12-09 17:06:37,439 - Epoch: [36][  250/  500]    Loss 0.024620    MSE 0.024620    
-2020-12-09 17:06:40,918 - Epoch: [36][  500/  500]    Loss 0.024658    MSE 0.024657    
-2020-12-09 17:06:41,651 - ==> MSE: 0.02466    Loss: 0.025
-
-2020-12-09 17:06:41,658 - ==> Best [MSE: 0.02465   Sparsity:0.00   Params: 176048 on epoch: 33]
-2020-12-09 17:06:41,658 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:06:41,663 - 
-
-2020-12-09 17:06:41,663 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:06:52,728 - Epoch: [37][  250/ 4498]    Overall Loss 0.023638    Objective Loss 0.023638    MSE 0.023638    LR 0.000250    Time 0.044189    
-2020-12-09 17:07:00,795 - Epoch: [37][  500/ 4498]    Overall Loss 0.023684    Objective Loss 0.023684    MSE 0.023684    LR 0.000250    Time 0.038195    
-2020-12-09 17:07:08,853 - Epoch: [37][  750/ 4498]    Overall Loss 0.023731    Objective Loss 0.023731    MSE 0.023731    LR 0.000250    Time 0.036184    
-2020-12-09 17:07:16,936 - Epoch: [37][ 1000/ 4498]    Overall Loss 0.023759    Objective Loss 0.023759    MSE 0.023759    LR 0.000250    Time 0.035204    
-2020-12-09 17:07:25,069 - Epoch: [37][ 1250/ 4498]    Overall Loss 0.023784    Objective Loss 0.023784    MSE 0.023784    LR 0.000250    Time 0.034656    
-2020-12-09 17:07:33,201 - Epoch: [37][ 1500/ 4498]    Overall Loss 0.023785    Objective Loss 0.023785    MSE 0.023785    LR 0.000250    Time 0.034290    
-2020-12-09 17:07:41,346 - Epoch: [37][ 1750/ 4498]    Overall Loss 0.023804    Objective Loss 0.023804    MSE 0.023804    LR 0.000250    Time 0.034036    
-2020-12-09 17:07:49,488 - Epoch: [37][ 2000/ 4498]    Overall Loss 0.023814    Objective Loss 0.023814    MSE 0.023814    LR 0.000250    Time 0.033844    
-2020-12-09 17:07:57,633 - Epoch: [37][ 2250/ 4498]    Overall Loss 0.023831    Objective Loss 0.023831    MSE 0.023831    LR 0.000250    Time 0.033695    
-2020-12-09 17:08:05,751 - Epoch: [37][ 2500/ 4498]    Overall Loss 0.023841    Objective Loss 0.023841    MSE 0.023841    LR 0.000250    Time 0.033566    
-2020-12-09 17:08:13,732 - Epoch: [37][ 2750/ 4498]    Overall Loss 0.023849    Objective Loss 0.023849    MSE 0.023849    LR 0.000250    Time 0.033411    
-2020-12-09 17:08:21,745 - Epoch: [37][ 3000/ 4498]    Overall Loss 0.023860    Objective Loss 0.023860    MSE 0.023860    LR 0.000250    Time 0.033292    
-2020-12-09 17:08:29,888 - Epoch: [37][ 3250/ 4498]    Overall Loss 0.023863    Objective Loss 0.023863    MSE 0.023863    LR 0.000250    Time 0.033231    
-2020-12-09 17:08:38,027 - Epoch: [37][ 3500/ 4498]    Overall Loss 0.023876    Objective Loss 0.023876    MSE 0.023876    LR 0.000250    Time 0.033178    
-2020-12-09 17:08:46,159 - Epoch: [37][ 3750/ 4498]    Overall Loss 0.023880    Objective Loss 0.023880    MSE 0.023880    LR 0.000250    Time 0.033130    
-2020-12-09 17:08:54,298 - Epoch: [37][ 4000/ 4498]    Overall Loss 0.023881    Objective Loss 0.023881    MSE 0.023881    LR 0.000250    Time 0.033090    
-2020-12-09 17:09:02,436 - Epoch: [37][ 4250/ 4498]    Overall Loss 0.023888    Objective Loss 0.023888    MSE 0.023888    LR 0.000250    Time 0.033054    
-2020-12-09 17:09:10,540 - Epoch: [37][ 4498/ 4498]    Overall Loss 0.023890    Objective Loss 0.023890    MSE 0.023890    LR 0.000250    Time 0.033030    
-2020-12-09 17:09:11,310 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17657 |  0.00284 |    0.13294 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15443 | -0.01502 |    0.10548 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08767 | -0.00861 |    0.06103 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.09009 | -0.01624 |    0.06676 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10348 | -0.01074 |    0.07489 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12235 | -0.01702 |    0.09242 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15496 | -0.02101 |    0.11266 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25554 |  0.00011 |    0.20109 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:09:11,310 - Total sparsity: 0.00
-
-2020-12-09 17:09:11,313 - --- validate (epoch=37)-----------
-2020-12-09 17:09:11,313 - 49975 samples (100 per mini-batch)
-2020-12-09 17:09:16,784 - Epoch: [37][  250/  500]    Loss 0.024546    MSE 0.024546    
-2020-12-09 17:09:20,214 - Epoch: [37][  500/  500]    Loss 0.024560    MSE 0.024560    
-2020-12-09 17:09:20,960 - ==> MSE: 0.02456    Loss: 0.025
-
-2020-12-09 17:09:20,967 - ==> Best [MSE: 0.02456   Sparsity:0.00   Params: 176048 on epoch: 37]
-2020-12-09 17:09:20,967 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:09:20,979 - 
-
-2020-12-09 17:09:20,979 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:09:32,130 - Epoch: [38][  250/ 4498]    Overall Loss 0.023741    Objective Loss 0.023741    MSE 0.023741    LR 0.000250    Time 0.044533    
-2020-12-09 17:09:40,158 - Epoch: [38][  500/ 4498]    Overall Loss 0.023710    Objective Loss 0.023710    MSE 0.023710    LR 0.000250    Time 0.038288    
-2020-12-09 17:09:48,166 - Epoch: [38][  750/ 4498]    Overall Loss 0.023731    Objective Loss 0.023731    MSE 0.023731    LR 0.000250    Time 0.036180    
-2020-12-09 17:09:56,165 - Epoch: [38][ 1000/ 4498]    Overall Loss 0.023758    Objective Loss 0.023758    MSE 0.023758    LR 0.000250    Time 0.035117    
-2020-12-09 17:10:04,160 - Epoch: [38][ 1250/ 4498]    Overall Loss 0.023768    Objective Loss 0.023768    MSE 0.023768    LR 0.000250    Time 0.034476    
-2020-12-09 17:10:12,157 - Epoch: [38][ 1500/ 4498]    Overall Loss 0.023783    Objective Loss 0.023783    MSE 0.023783    LR 0.000250    Time 0.034049    
-2020-12-09 17:10:20,148 - Epoch: [38][ 1750/ 4498]    Overall Loss 0.023806    Objective Loss 0.023806    MSE 0.023806    LR 0.000250    Time 0.033742    
-2020-12-09 17:10:28,136 - Epoch: [38][ 2000/ 4498]    Overall Loss 0.023824    Objective Loss 0.023824    MSE 0.023824    LR 0.000250    Time 0.033509    
-2020-12-09 17:10:36,122 - Epoch: [38][ 2250/ 4498]    Overall Loss 0.023831    Objective Loss 0.023831    MSE 0.023831    LR 0.000250    Time 0.033328    
-2020-12-09 17:10:44,104 - Epoch: [38][ 2500/ 4498]    Overall Loss 0.023823    Objective Loss 0.023823    MSE 0.023823    LR 0.000250    Time 0.033181    
-2020-12-09 17:10:52,083 - Epoch: [38][ 2750/ 4498]    Overall Loss 0.023837    Objective Loss 0.023837    MSE 0.023837    LR 0.000250    Time 0.033060    
-2020-12-09 17:11:00,066 - Epoch: [38][ 3000/ 4498]    Overall Loss 0.023840    Objective Loss 0.023840    MSE 0.023840    LR 0.000250    Time 0.032960    
-2020-12-09 17:11:08,043 - Epoch: [38][ 3250/ 4498]    Overall Loss 0.023850    Objective Loss 0.023850    MSE 0.023850    LR 0.000250    Time 0.032874    
-2020-12-09 17:11:16,019 - Epoch: [38][ 3500/ 4498]    Overall Loss 0.023850    Objective Loss 0.023850    MSE 0.023850    LR 0.000250    Time 0.032800    
-2020-12-09 17:11:23,988 - Epoch: [38][ 3750/ 4498]    Overall Loss 0.023866    Objective Loss 0.023866    MSE 0.023866    LR 0.000250    Time 0.032734    
-2020-12-09 17:11:31,967 - Epoch: [38][ 4000/ 4498]    Overall Loss 0.023871    Objective Loss 0.023871    MSE 0.023871    LR 0.000250    Time 0.032678    
-2020-12-09 17:11:39,945 - Epoch: [38][ 4250/ 4498]    Overall Loss 0.023864    Objective Loss 0.023864    MSE 0.023864    LR 0.000250    Time 0.032629    
-2020-12-09 17:11:47,888 - Epoch: [38][ 4498/ 4498]    Overall Loss 0.023866    Objective Loss 0.023866    MSE 0.023866    LR 0.000250    Time 0.032593    
-2020-12-09 17:11:48,642 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17678 |  0.00289 |    0.13310 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15469 | -0.01509 |    0.10574 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08747 | -0.00864 |    0.06078 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08999 | -0.01611 |    0.06667 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10340 | -0.01071 |    0.07486 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12233 | -0.01700 |    0.09240 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15502 | -0.02094 |    0.11265 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25633 |  0.00011 |    0.20171 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:11:48,642 - Total sparsity: 0.00
-
-2020-12-09 17:11:48,645 - --- validate (epoch=38)-----------
-2020-12-09 17:11:48,645 - 49975 samples (100 per mini-batch)
-2020-12-09 17:11:53,976 - Epoch: [38][  250/  500]    Loss 0.024595    MSE 0.024595    
-2020-12-09 17:11:57,439 - Epoch: [38][  500/  500]    Loss 0.024574    MSE 0.024573    
-2020-12-09 17:11:58,132 - ==> MSE: 0.02457    Loss: 0.025
-
-2020-12-09 17:11:58,139 - ==> Best [MSE: 0.02456   Sparsity:0.00   Params: 176048 on epoch: 37]
-2020-12-09 17:11:58,140 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:11:58,144 - 
-
-2020-12-09 17:11:58,144 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:12:09,223 - Epoch: [39][  250/ 4498]    Overall Loss 0.023733    Objective Loss 0.023733    MSE 0.023733    LR 0.000250    Time 0.044245    
-2020-12-09 17:12:17,289 - Epoch: [39][  500/ 4498]    Overall Loss 0.023738    Objective Loss 0.023738    MSE 0.023738    LR 0.000250    Time 0.038220    
-2020-12-09 17:12:25,335 - Epoch: [39][  750/ 4498]    Overall Loss 0.023741    Objective Loss 0.023741    MSE 0.023741    LR 0.000250    Time 0.036185    
-2020-12-09 17:12:33,360 - Epoch: [39][ 1000/ 4498]    Overall Loss 0.023753    Objective Loss 0.023753    MSE 0.023753    LR 0.000250    Time 0.035147    
-2020-12-09 17:12:41,384 - Epoch: [39][ 1250/ 4498]    Overall Loss 0.023773    Objective Loss 0.023773    MSE 0.023773    LR 0.000250    Time 0.034523    
-2020-12-09 17:12:49,408 - Epoch: [39][ 1500/ 4498]    Overall Loss 0.023784    Objective Loss 0.023784    MSE 0.023784    LR 0.000250    Time 0.034107    
-2020-12-09 17:12:57,428 - Epoch: [39][ 1750/ 4498]    Overall Loss 0.023810    Objective Loss 0.023810    MSE 0.023810    LR 0.000250    Time 0.033808    
-2020-12-09 17:13:05,447 - Epoch: [39][ 2000/ 4498]    Overall Loss 0.023806    Objective Loss 0.023806    MSE 0.023806    LR 0.000250    Time 0.033583    
-2020-12-09 17:13:13,470 - Epoch: [39][ 2250/ 4498]    Overall Loss 0.023822    Objective Loss 0.023822    MSE 0.023822    LR 0.000250    Time 0.033409    
-2020-12-09 17:13:21,488 - Epoch: [39][ 2500/ 4498]    Overall Loss 0.023839    Objective Loss 0.023839    MSE 0.023839    LR 0.000250    Time 0.033269    
-2020-12-09 17:13:29,510 - Epoch: [39][ 2750/ 4498]    Overall Loss 0.023839    Objective Loss 0.023839    MSE 0.023839    LR 0.000250    Time 0.033155    
-2020-12-09 17:13:37,532 - Epoch: [39][ 3000/ 4498]    Overall Loss 0.023841    Objective Loss 0.023841    MSE 0.023841    LR 0.000250    Time 0.033061    
-2020-12-09 17:13:45,548 - Epoch: [39][ 3250/ 4498]    Overall Loss 0.023850    Objective Loss 0.023850    MSE 0.023850    LR 0.000250    Time 0.032979    
-2020-12-09 17:13:53,560 - Epoch: [39][ 3500/ 4498]    Overall Loss 0.023845    Objective Loss 0.023845    MSE 0.023845    LR 0.000250    Time 0.032907    
-2020-12-09 17:14:01,565 - Epoch: [39][ 3750/ 4498]    Overall Loss 0.023848    Objective Loss 0.023848    MSE 0.023848    LR 0.000250    Time 0.032844    
-2020-12-09 17:14:09,560 - Epoch: [39][ 4000/ 4498]    Overall Loss 0.023852    Objective Loss 0.023852    MSE 0.023851    LR 0.000250    Time 0.032785    
-2020-12-09 17:14:17,547 - Epoch: [39][ 4250/ 4498]    Overall Loss 0.023852    Objective Loss 0.023852    MSE 0.023852    LR 0.000250    Time 0.032732    
-2020-12-09 17:14:25,505 - Epoch: [39][ 4498/ 4498]    Overall Loss 0.023852    Objective Loss 0.023852    MSE 0.023852    LR 0.000250    Time 0.032694    
-2020-12-09 17:14:26,317 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17705 |  0.00285 |    0.13329 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15490 | -0.01474 |    0.10584 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08740 | -0.00865 |    0.06067 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08986 | -0.01613 |    0.06657 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10337 | -0.01066 |    0.07482 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12232 | -0.01699 |    0.09242 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15510 | -0.02097 |    0.11267 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25704 |  0.00006 |    0.20227 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:14:26,317 - Total sparsity: 0.00
-
-2020-12-09 17:14:26,320 - --- validate (epoch=39)-----------
-2020-12-09 17:14:26,320 - 49975 samples (100 per mini-batch)
-2020-12-09 17:14:31,933 - Epoch: [39][  250/  500]    Loss 0.024677    MSE 0.024677    
-2020-12-09 17:14:35,395 - Epoch: [39][  500/  500]    Loss 0.024686    MSE 0.024686    
-2020-12-09 17:14:36,158 - ==> MSE: 0.02469    Loss: 0.025
-
-2020-12-09 17:14:36,165 - ==> Best [MSE: 0.02456   Sparsity:0.00   Params: 176048 on epoch: 37]
-2020-12-09 17:14:36,165 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:14:36,170 - 
-
-2020-12-09 17:14:36,170 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:14:47,256 - Epoch: [40][  250/ 4498]    Overall Loss 0.023472    Objective Loss 0.023472    MSE 0.023472    LR 0.000125    Time 0.044276    
-2020-12-09 17:14:55,315 - Epoch: [40][  500/ 4498]    Overall Loss 0.023446    Objective Loss 0.023446    MSE 0.023446    LR 0.000125    Time 0.038220    
-2020-12-09 17:15:03,366 - Epoch: [40][  750/ 4498]    Overall Loss 0.023456    Objective Loss 0.023456    MSE 0.023456    LR 0.000125    Time 0.036192    
-2020-12-09 17:15:11,401 - Epoch: [40][ 1000/ 4498]    Overall Loss 0.023486    Objective Loss 0.023486    MSE 0.023486    LR 0.000125    Time 0.035163    
-2020-12-09 17:15:19,436 - Epoch: [40][ 1250/ 4498]    Overall Loss 0.023482    Objective Loss 0.023482    MSE 0.023482    LR 0.000125    Time 0.034544    
-2020-12-09 17:15:27,468 - Epoch: [40][ 1500/ 4498]    Overall Loss 0.023495    Objective Loss 0.023495    MSE 0.023495    LR 0.000125    Time 0.034130    
-2020-12-09 17:15:35,507 - Epoch: [40][ 1750/ 4498]    Overall Loss 0.023517    Objective Loss 0.023517    MSE 0.023517    LR 0.000125    Time 0.033838    
-2020-12-09 17:15:43,546 - Epoch: [40][ 2000/ 4498]    Overall Loss 0.023522    Objective Loss 0.023522    MSE 0.023523    LR 0.000125    Time 0.033619    
-2020-12-09 17:15:51,586 - Epoch: [40][ 2250/ 4498]    Overall Loss 0.023522    Objective Loss 0.023522    MSE 0.023522    LR 0.000125    Time 0.033450    
-2020-12-09 17:15:59,626 - Epoch: [40][ 2500/ 4498]    Overall Loss 0.023523    Objective Loss 0.023523    MSE 0.023523    LR 0.000125    Time 0.033314    
-2020-12-09 17:16:07,666 - Epoch: [40][ 2750/ 4498]    Overall Loss 0.023547    Objective Loss 0.023547    MSE 0.023547    LR 0.000125    Time 0.033203    
-2020-12-09 17:16:15,704 - Epoch: [40][ 3000/ 4498]    Overall Loss 0.023541    Objective Loss 0.023541    MSE 0.023541    LR 0.000125    Time 0.033110    
-2020-12-09 17:16:23,749 - Epoch: [40][ 3250/ 4498]    Overall Loss 0.023538    Objective Loss 0.023538    MSE 0.023538    LR 0.000125    Time 0.033033    
-2020-12-09 17:16:31,776 - Epoch: [40][ 3500/ 4498]    Overall Loss 0.023544    Objective Loss 0.023544    MSE 0.023544    LR 0.000125    Time 0.032962    
-2020-12-09 17:16:39,802 - Epoch: [40][ 3750/ 4498]    Overall Loss 0.023548    Objective Loss 0.023548    MSE 0.023548    LR 0.000125    Time 0.032900    
-2020-12-09 17:16:47,830 - Epoch: [40][ 4000/ 4498]    Overall Loss 0.023550    Objective Loss 0.023550    MSE 0.023550    LR 0.000125    Time 0.032847    
-2020-12-09 17:16:55,861 - Epoch: [40][ 4250/ 4498]    Overall Loss 0.023554    Objective Loss 0.023554    MSE 0.023554    LR 0.000125    Time 0.032800    
-2020-12-09 17:17:03,862 - Epoch: [40][ 4498/ 4498]    Overall Loss 0.023556    Objective Loss 0.023556    MSE 0.023556    LR 0.000125    Time 0.032767    
-2020-12-09 17:17:04,700 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17700 |  0.00277 |    0.13324 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15484 | -0.01467 |    0.10573 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08711 | -0.00836 |    0.06039 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08964 | -0.01587 |    0.06635 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10316 | -0.01044 |    0.07467 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12216 | -0.01680 |    0.09228 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15503 | -0.02076 |    0.11259 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25775 |  0.00009 |    0.20282 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:17:04,700 - Total sparsity: 0.00
-
-2020-12-09 17:17:04,703 - --- validate (epoch=40)-----------
-2020-12-09 17:17:04,703 - 49975 samples (100 per mini-batch)
-2020-12-09 17:17:10,119 - Epoch: [40][  250/  500]    Loss 0.024329    MSE 0.024329    
-2020-12-09 17:17:13,568 - Epoch: [40][  500/  500]    Loss 0.024314    MSE 0.024315    
-2020-12-09 17:17:14,321 - ==> MSE: 0.02431    Loss: 0.024
-
-2020-12-09 17:17:14,329 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:17:14,329 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:17:14,341 - 
-
-2020-12-09 17:17:14,341 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:17:25,458 - Epoch: [41][  250/ 4498]    Overall Loss 0.023539    Objective Loss 0.023539    MSE 0.023539    LR 0.000125    Time 0.044398    
-2020-12-09 17:17:33,511 - Epoch: [41][  500/ 4498]    Overall Loss 0.023453    Objective Loss 0.023453    MSE 0.023453    LR 0.000125    Time 0.038271    
-2020-12-09 17:17:41,558 - Epoch: [41][  750/ 4498]    Overall Loss 0.023489    Objective Loss 0.023489    MSE 0.023489    LR 0.000125    Time 0.036221    
-2020-12-09 17:17:49,596 - Epoch: [41][ 1000/ 4498]    Overall Loss 0.023502    Objective Loss 0.023502    MSE 0.023502    LR 0.000125    Time 0.035186    
-2020-12-09 17:17:57,636 - Epoch: [41][ 1250/ 4498]    Overall Loss 0.023494    Objective Loss 0.023494    MSE 0.023494    LR 0.000125    Time 0.034568    
-2020-12-09 17:18:05,673 - Epoch: [41][ 1500/ 4498]    Overall Loss 0.023503    Objective Loss 0.023503    MSE 0.023503    LR 0.000125    Time 0.034153    
-2020-12-09 17:18:13,697 - Epoch: [41][ 1750/ 4498]    Overall Loss 0.023507    Objective Loss 0.023507    MSE 0.023507    LR 0.000125    Time 0.033849    
-2020-12-09 17:18:21,719 - Epoch: [41][ 2000/ 4498]    Overall Loss 0.023517    Objective Loss 0.023517    MSE 0.023517    LR 0.000125    Time 0.033621    
-2020-12-09 17:18:29,750 - Epoch: [41][ 2250/ 4498]    Overall Loss 0.023525    Objective Loss 0.023525    MSE 0.023525    LR 0.000125    Time 0.033446    
-2020-12-09 17:18:37,740 - Epoch: [41][ 2500/ 4498]    Overall Loss 0.023512    Objective Loss 0.023512    MSE 0.023512    LR 0.000125    Time 0.033291    
-2020-12-09 17:18:45,718 - Epoch: [41][ 2750/ 4498]    Overall Loss 0.023515    Objective Loss 0.023515    MSE 0.023515    LR 0.000125    Time 0.033159    
-2020-12-09 17:18:53,693 - Epoch: [41][ 3000/ 4498]    Overall Loss 0.023519    Objective Loss 0.023519    MSE 0.023519    LR 0.000125    Time 0.033049    
-2020-12-09 17:19:01,672 - Epoch: [41][ 3250/ 4498]    Overall Loss 0.023518    Objective Loss 0.023518    MSE 0.023518    LR 0.000125    Time 0.032956    
-2020-12-09 17:19:09,637 - Epoch: [41][ 3500/ 4498]    Overall Loss 0.023529    Objective Loss 0.023529    MSE 0.023529    LR 0.000125    Time 0.032873    
-2020-12-09 17:19:17,601 - Epoch: [41][ 3750/ 4498]    Overall Loss 0.023533    Objective Loss 0.023533    MSE 0.023533    LR 0.000125    Time 0.032801    
-2020-12-09 17:19:25,567 - Epoch: [41][ 4000/ 4498]    Overall Loss 0.023536    Objective Loss 0.023536    MSE 0.023536    LR 0.000125    Time 0.032738    
-2020-12-09 17:19:33,538 - Epoch: [41][ 4250/ 4498]    Overall Loss 0.023552    Objective Loss 0.023552    MSE 0.023552    LR 0.000125    Time 0.032683    
-2020-12-09 17:19:41,473 - Epoch: [41][ 4498/ 4498]    Overall Loss 0.023550    Objective Loss 0.023550    MSE 0.023550    LR 0.000125    Time 0.032643    
-2020-12-09 17:19:42,275 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17704 |  0.00290 |    0.13336 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15486 | -0.01428 |    0.10562 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08693 | -0.00834 |    0.06021 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08949 | -0.01580 |    0.06622 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10302 | -0.01038 |    0.07457 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12204 | -0.01669 |    0.09218 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15501 | -0.02074 |    0.11255 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25848 |  0.00009 |    0.20340 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:19:42,276 - Total sparsity: 0.00
-
-2020-12-09 17:19:42,279 - --- validate (epoch=41)-----------
-2020-12-09 17:19:42,279 - 49975 samples (100 per mini-batch)
-2020-12-09 17:19:47,731 - Epoch: [41][  250/  500]    Loss 0.024612    MSE 0.024612    
-2020-12-09 17:19:51,170 - Epoch: [41][  500/  500]    Loss 0.024480    MSE 0.024479    
-2020-12-09 17:19:51,905 - ==> MSE: 0.02448    Loss: 0.024
-
-2020-12-09 17:19:51,914 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:19:51,914 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:19:51,918 - 
-
-2020-12-09 17:19:51,919 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:20:02,970 - Epoch: [42][  250/ 4498]    Overall Loss 0.023511    Objective Loss 0.023511    MSE 0.023511    LR 0.000125    Time 0.044136    
-2020-12-09 17:20:11,017 - Epoch: [42][  500/ 4498]    Overall Loss 0.023501    Objective Loss 0.023501    MSE 0.023501    LR 0.000125    Time 0.038128    
-2020-12-09 17:20:19,057 - Epoch: [42][  750/ 4498]    Overall Loss 0.023490    Objective Loss 0.023490    MSE 0.023490    LR 0.000125    Time 0.036115    
-2020-12-09 17:20:27,085 - Epoch: [42][ 1000/ 4498]    Overall Loss 0.023510    Objective Loss 0.023510    MSE 0.023510    LR 0.000125    Time 0.035098    
-2020-12-09 17:20:35,115 - Epoch: [42][ 1250/ 4498]    Overall Loss 0.023507    Objective Loss 0.023507    MSE 0.023507    LR 0.000125    Time 0.034488    
-2020-12-09 17:20:43,139 - Epoch: [42][ 1500/ 4498]    Overall Loss 0.023511    Objective Loss 0.023511    MSE 0.023511    LR 0.000125    Time 0.034078    
-2020-12-09 17:20:51,166 - Epoch: [42][ 1750/ 4498]    Overall Loss 0.023515    Objective Loss 0.023515    MSE 0.023515    LR 0.000125    Time 0.033787    
-2020-12-09 17:20:59,189 - Epoch: [42][ 2000/ 4498]    Overall Loss 0.023519    Objective Loss 0.023519    MSE 0.023519    LR 0.000125    Time 0.033566    
-2020-12-09 17:21:07,213 - Epoch: [42][ 2250/ 4498]    Overall Loss 0.023522    Objective Loss 0.023522    MSE 0.023522    LR 0.000125    Time 0.033395    
-2020-12-09 17:21:15,236 - Epoch: [42][ 2500/ 4498]    Overall Loss 0.023519    Objective Loss 0.023519    MSE 0.023519    LR 0.000125    Time 0.033258    
-2020-12-09 17:21:23,261 - Epoch: [42][ 2750/ 4498]    Overall Loss 0.023513    Objective Loss 0.023513    MSE 0.023513    LR 0.000125    Time 0.033147    
-2020-12-09 17:21:31,284 - Epoch: [42][ 3000/ 4498]    Overall Loss 0.023517    Objective Loss 0.023517    MSE 0.023517    LR 0.000125    Time 0.033053    
-2020-12-09 17:21:39,311 - Epoch: [42][ 3250/ 4498]    Overall Loss 0.023529    Objective Loss 0.023529    MSE 0.023529    LR 0.000125    Time 0.032975    
-2020-12-09 17:21:47,329 - Epoch: [42][ 3500/ 4498]    Overall Loss 0.023532    Objective Loss 0.023532    MSE 0.023532    LR 0.000125    Time 0.032906    
-2020-12-09 17:21:55,355 - Epoch: [42][ 3750/ 4498]    Overall Loss 0.023537    Objective Loss 0.023537    MSE 0.023537    LR 0.000125    Time 0.032848    
-2020-12-09 17:22:03,376 - Epoch: [42][ 4000/ 4498]    Overall Loss 0.023535    Objective Loss 0.023535    MSE 0.023535    LR 0.000125    Time 0.032796    
-2020-12-09 17:22:11,401 - Epoch: [42][ 4250/ 4498]    Overall Loss 0.023538    Objective Loss 0.023538    MSE 0.023538    LR 0.000125    Time 0.032751    
-2020-12-09 17:22:19,394 - Epoch: [42][ 4498/ 4498]    Overall Loss 0.023538    Objective Loss 0.023538    MSE 0.023538    LR 0.000125    Time 0.032719    
-2020-12-09 17:22:20,211 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17730 |  0.00283 |    0.13354 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15492 | -0.01394 |    0.10554 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08673 | -0.00837 |    0.06007 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08934 | -0.01580 |    0.06610 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10289 | -0.01034 |    0.07447 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12196 | -0.01663 |    0.09210 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15499 | -0.02065 |    0.11252 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25919 |  0.00006 |    0.20396 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:22:20,211 - Total sparsity: 0.00
-
-2020-12-09 17:22:20,214 - --- validate (epoch=42)-----------
-2020-12-09 17:22:20,215 - 49975 samples (100 per mini-batch)
-2020-12-09 17:22:25,738 - Epoch: [42][  250/  500]    Loss 0.024497    MSE 0.024497    
-2020-12-09 17:22:29,225 - Epoch: [42][  500/  500]    Loss 0.024437    MSE 0.024438    
-2020-12-09 17:22:29,906 - ==> MSE: 0.02444    Loss: 0.024
-
-2020-12-09 17:22:29,914 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:22:29,914 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:22:29,919 - 
-
-2020-12-09 17:22:29,919 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:22:41,005 - Epoch: [43][  250/ 4498]    Overall Loss 0.023496    Objective Loss 0.023496    MSE 0.023496    LR 0.000125    Time 0.044276    
-2020-12-09 17:22:49,057 - Epoch: [43][  500/ 4498]    Overall Loss 0.023480    Objective Loss 0.023480    MSE 0.023480    LR 0.000125    Time 0.038208    
-2020-12-09 17:22:57,110 - Epoch: [43][  750/ 4498]    Overall Loss 0.023417    Objective Loss 0.023417    MSE 0.023417    LR 0.000125    Time 0.036186    
-2020-12-09 17:23:05,154 - Epoch: [43][ 1000/ 4498]    Overall Loss 0.023440    Objective Loss 0.023440    MSE 0.023440    LR 0.000125    Time 0.035166    
-2020-12-09 17:23:13,198 - Epoch: [43][ 1250/ 4498]    Overall Loss 0.023451    Objective Loss 0.023451    MSE 0.023451    LR 0.000125    Time 0.034555    
-2020-12-09 17:23:21,246 - Epoch: [43][ 1500/ 4498]    Overall Loss 0.023465    Objective Loss 0.023465    MSE 0.023465    LR 0.000125    Time 0.034150    
-2020-12-09 17:23:29,294 - Epoch: [43][ 1750/ 4498]    Overall Loss 0.023463    Objective Loss 0.023463    MSE 0.023463    LR 0.000125    Time 0.033860    
-2020-12-09 17:23:37,339 - Epoch: [43][ 2000/ 4498]    Overall Loss 0.023467    Objective Loss 0.023467    MSE 0.023467    LR 0.000125    Time 0.033642    
-2020-12-09 17:23:45,393 - Epoch: [43][ 2250/ 4498]    Overall Loss 0.023483    Objective Loss 0.023483    MSE 0.023483    LR 0.000125    Time 0.033476    
-2020-12-09 17:23:53,466 - Epoch: [43][ 2500/ 4498]    Overall Loss 0.023493    Objective Loss 0.023493    MSE 0.023494    LR 0.000125    Time 0.033350    
-2020-12-09 17:24:01,504 - Epoch: [43][ 2750/ 4498]    Overall Loss 0.023505    Objective Loss 0.023505    MSE 0.023505    LR 0.000125    Time 0.033235    
-2020-12-09 17:24:09,531 - Epoch: [43][ 3000/ 4498]    Overall Loss 0.023502    Objective Loss 0.023502    MSE 0.023502    LR 0.000125    Time 0.033136    
-2020-12-09 17:24:17,554 - Epoch: [43][ 3250/ 4498]    Overall Loss 0.023506    Objective Loss 0.023506    MSE 0.023506    LR 0.000125    Time 0.033050    
-2020-12-09 17:24:25,564 - Epoch: [43][ 3500/ 4498]    Overall Loss 0.023511    Objective Loss 0.023511    MSE 0.023511    LR 0.000125    Time 0.032973    
-2020-12-09 17:24:33,576 - Epoch: [43][ 3750/ 4498]    Overall Loss 0.023522    Objective Loss 0.023522    MSE 0.023522    LR 0.000125    Time 0.032907    
-2020-12-09 17:24:41,596 - Epoch: [43][ 4000/ 4498]    Overall Loss 0.023525    Objective Loss 0.023525    MSE 0.023525    LR 0.000125    Time 0.032851    
-2020-12-09 17:24:49,618 - Epoch: [43][ 4250/ 4498]    Overall Loss 0.023528    Objective Loss 0.023528    MSE 0.023528    LR 0.000125    Time 0.032802    
-2020-12-09 17:24:57,606 - Epoch: [43][ 4498/ 4498]    Overall Loss 0.023524    Objective Loss 0.023524    MSE 0.023524    LR 0.000125    Time 0.032766    
-2020-12-09 17:24:58,430 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17760 |  0.00274 |    0.13380 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15499 | -0.01367 |    0.10550 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08659 | -0.00848 |    0.05993 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08920 | -0.01572 |    0.06598 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10278 | -0.01033 |    0.07439 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12188 | -0.01657 |    0.09203 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15499 | -0.02068 |    0.11250 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.25985 |  0.00006 |    0.20447 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:24:58,430 - Total sparsity: 0.00
-
-2020-12-09 17:24:58,433 - --- validate (epoch=43)-----------
-2020-12-09 17:24:58,433 - 49975 samples (100 per mini-batch)
-2020-12-09 17:25:03,960 - Epoch: [43][  250/  500]    Loss 0.024480    MSE 0.024480    
-2020-12-09 17:25:07,296 - Epoch: [43][  500/  500]    Loss 0.024490    MSE 0.024491    
-2020-12-09 17:25:08,031 - ==> MSE: 0.02449    Loss: 0.024
-
-2020-12-09 17:25:08,040 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:25:08,040 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:25:08,045 - 
-
-2020-12-09 17:25:08,045 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:25:19,114 - Epoch: [44][  250/ 4498]    Overall Loss 0.023360    Objective Loss 0.023360    MSE 0.023360    LR 0.000125    Time 0.044210    
-2020-12-09 17:25:27,153 - Epoch: [44][  500/ 4498]    Overall Loss 0.023415    Objective Loss 0.023415    MSE 0.023415    LR 0.000125    Time 0.038147    
-2020-12-09 17:25:35,182 - Epoch: [44][  750/ 4498]    Overall Loss 0.023427    Objective Loss 0.023427    MSE 0.023427    LR 0.000125    Time 0.036114    
-2020-12-09 17:25:43,199 - Epoch: [44][ 1000/ 4498]    Overall Loss 0.023429    Objective Loss 0.023429    MSE 0.023429    LR 0.000125    Time 0.035086    
-2020-12-09 17:25:51,222 - Epoch: [44][ 1250/ 4498]    Overall Loss 0.023442    Objective Loss 0.023442    MSE 0.023442    LR 0.000125    Time 0.034473    
-2020-12-09 17:25:59,247 - Epoch: [44][ 1500/ 4498]    Overall Loss 0.023425    Objective Loss 0.023425    MSE 0.023425    LR 0.000125    Time 0.034066    
-2020-12-09 17:26:07,258 - Epoch: [44][ 1750/ 4498]    Overall Loss 0.023436    Objective Loss 0.023436    MSE 0.023436    LR 0.000125    Time 0.033768    
-2020-12-09 17:26:15,269 - Epoch: [44][ 2000/ 4498]    Overall Loss 0.023461    Objective Loss 0.023461    MSE 0.023461    LR 0.000125    Time 0.033544    
-2020-12-09 17:26:23,283 - Epoch: [44][ 2250/ 4498]    Overall Loss 0.023480    Objective Loss 0.023480    MSE 0.023480    LR 0.000125    Time 0.033370    
-2020-12-09 17:26:31,294 - Epoch: [44][ 2500/ 4498]    Overall Loss 0.023483    Objective Loss 0.023483    MSE 0.023483    LR 0.000125    Time 0.033231    
-2020-12-09 17:26:39,311 - Epoch: [44][ 2750/ 4498]    Overall Loss 0.023499    Objective Loss 0.023499    MSE 0.023499    LR 0.000125    Time 0.033119    
-2020-12-09 17:26:47,324 - Epoch: [44][ 3000/ 4498]    Overall Loss 0.023501    Objective Loss 0.023501    MSE 0.023501    LR 0.000125    Time 0.033025    
-2020-12-09 17:26:55,337 - Epoch: [44][ 3250/ 4498]    Overall Loss 0.023498    Objective Loss 0.023498    MSE 0.023498    LR 0.000125    Time 0.032944    
-2020-12-09 17:27:03,338 - Epoch: [44][ 3500/ 4498]    Overall Loss 0.023498    Objective Loss 0.023498    MSE 0.023498    LR 0.000125    Time 0.032872    
-2020-12-09 17:27:11,347 - Epoch: [44][ 3750/ 4498]    Overall Loss 0.023506    Objective Loss 0.023506    MSE 0.023506    LR 0.000125    Time 0.032812    
-2020-12-09 17:27:19,341 - Epoch: [44][ 4000/ 4498]    Overall Loss 0.023506    Objective Loss 0.023506    MSE 0.023506    LR 0.000125    Time 0.032755    
-2020-12-09 17:27:27,338 - Epoch: [44][ 4250/ 4498]    Overall Loss 0.023510    Objective Loss 0.023510    MSE 0.023510    LR 0.000125    Time 0.032706    
-2020-12-09 17:27:35,298 - Epoch: [44][ 4498/ 4498]    Overall Loss 0.023516    Objective Loss 0.023516    MSE 0.023516    LR 0.000125    Time 0.032670    
-2020-12-09 17:27:36,104 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17760 |  0.00286 |    0.13383 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15512 | -0.01356 |    0.10554 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08646 | -0.00844 |    0.05979 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08910 | -0.01567 |    0.06591 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10267 | -0.01022 |    0.07431 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12180 | -0.01652 |    0.09196 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15501 | -0.02062 |    0.11249 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26052 |  0.00006 |    0.20500 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:27:36,104 - Total sparsity: 0.00
-
-2020-12-09 17:27:36,107 - --- validate (epoch=44)-----------
-2020-12-09 17:27:36,107 - 49975 samples (100 per mini-batch)
-2020-12-09 17:27:41,682 - Epoch: [44][  250/  500]    Loss 0.024321    MSE 0.024321    
-2020-12-09 17:27:45,170 - Epoch: [44][  500/  500]    Loss 0.024348    MSE 0.024348    
-2020-12-09 17:27:45,928 - ==> MSE: 0.02435    Loss: 0.024
-
-2020-12-09 17:27:45,937 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:27:45,937 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:27:45,941 - 
-
-2020-12-09 17:27:45,942 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:27:56,996 - Epoch: [45][  250/ 4498]    Overall Loss 0.023365    Objective Loss 0.023365    MSE 0.023365    LR 0.000125    Time 0.044150    
-2020-12-09 17:28:05,054 - Epoch: [45][  500/ 4498]    Overall Loss 0.023448    Objective Loss 0.023448    MSE 0.023448    LR 0.000125    Time 0.038157    
-2020-12-09 17:28:13,106 - Epoch: [45][  750/ 4498]    Overall Loss 0.023445    Objective Loss 0.023445    MSE 0.023445    LR 0.000125    Time 0.036151    
-2020-12-09 17:28:21,145 - Epoch: [45][ 1000/ 4498]    Overall Loss 0.023435    Objective Loss 0.023435    MSE 0.023436    LR 0.000125    Time 0.035135    
-2020-12-09 17:28:29,182 - Epoch: [45][ 1250/ 4498]    Overall Loss 0.023437    Objective Loss 0.023437    MSE 0.023437    LR 0.000125    Time 0.034524    
-2020-12-09 17:28:37,218 - Epoch: [45][ 1500/ 4498]    Overall Loss 0.023435    Objective Loss 0.023435    MSE 0.023435    LR 0.000125    Time 0.034116    
-2020-12-09 17:28:45,255 - Epoch: [45][ 1750/ 4498]    Overall Loss 0.023429    Objective Loss 0.023429    MSE 0.023429    LR 0.000125    Time 0.033825    
-2020-12-09 17:28:53,290 - Epoch: [45][ 2000/ 4498]    Overall Loss 0.023454    Objective Loss 0.023454    MSE 0.023454    LR 0.000125    Time 0.033606    
-2020-12-09 17:29:01,318 - Epoch: [45][ 2250/ 4498]    Overall Loss 0.023453    Objective Loss 0.023453    MSE 0.023453    LR 0.000125    Time 0.033432    
-2020-12-09 17:29:09,349 - Epoch: [45][ 2500/ 4498]    Overall Loss 0.023470    Objective Loss 0.023470    MSE 0.023470    LR 0.000125    Time 0.033295    
-2020-12-09 17:29:17,381 - Epoch: [45][ 2750/ 4498]    Overall Loss 0.023475    Objective Loss 0.023475    MSE 0.023475    LR 0.000125    Time 0.033182    
-2020-12-09 17:29:25,411 - Epoch: [45][ 3000/ 4498]    Overall Loss 0.023477    Objective Loss 0.023477    MSE 0.023477    LR 0.000125    Time 0.033088    
-2020-12-09 17:29:33,441 - Epoch: [45][ 3250/ 4498]    Overall Loss 0.023487    Objective Loss 0.023487    MSE 0.023487    LR 0.000125    Time 0.033008    
-2020-12-09 17:29:41,457 - Epoch: [45][ 3500/ 4498]    Overall Loss 0.023488    Objective Loss 0.023488    MSE 0.023488    LR 0.000125    Time 0.032936    
-2020-12-09 17:29:49,483 - Epoch: [45][ 3750/ 4498]    Overall Loss 0.023485    Objective Loss 0.023485    MSE 0.023485    LR 0.000125    Time 0.032876    
-2020-12-09 17:29:57,508 - Epoch: [45][ 4000/ 4498]    Overall Loss 0.023487    Objective Loss 0.023487    MSE 0.023487    LR 0.000125    Time 0.032823    
-2020-12-09 17:30:05,494 - Epoch: [45][ 4250/ 4498]    Overall Loss 0.023497    Objective Loss 0.023497    MSE 0.023497    LR 0.000125    Time 0.032767    
-2020-12-09 17:30:13,421 - Epoch: [45][ 4498/ 4498]    Overall Loss 0.023498    Objective Loss 0.023498    MSE 0.023498    LR 0.000125    Time 0.032720    
-2020-12-09 17:30:14,237 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17773 |  0.00277 |    0.13394 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15515 | -0.01343 |    0.10552 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08630 | -0.00841 |    0.05965 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08900 | -0.01568 |    0.06582 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10257 | -0.01012 |    0.07424 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12175 | -0.01652 |    0.09194 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15502 | -0.02059 |    0.11249 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26119 |  0.00007 |    0.20552 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:30:14,237 - Total sparsity: 0.00
-
-2020-12-09 17:30:14,241 - --- validate (epoch=45)-----------
-2020-12-09 17:30:14,241 - 49975 samples (100 per mini-batch)
-2020-12-09 17:30:19,691 - Epoch: [45][  250/  500]    Loss 0.024402    MSE 0.024402    
-2020-12-09 17:30:22,937 - Epoch: [45][  500/  500]    Loss 0.024422    MSE 0.024421    
-2020-12-09 17:30:23,673 - ==> MSE: 0.02442    Loss: 0.024
-
-2020-12-09 17:30:23,682 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:30:23,682 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:30:23,687 - 
-
-2020-12-09 17:30:23,687 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:30:34,725 - Epoch: [46][  250/ 4498]    Overall Loss 0.023494    Objective Loss 0.023494    MSE 0.023494    LR 0.000125    Time 0.044085    
-2020-12-09 17:30:42,750 - Epoch: [46][  500/ 4498]    Overall Loss 0.023443    Objective Loss 0.023443    MSE 0.023443    LR 0.000125    Time 0.038056    
-2020-12-09 17:30:50,763 - Epoch: [46][  750/ 4498]    Overall Loss 0.023423    Objective Loss 0.023423    MSE 0.023423    LR 0.000125    Time 0.036032    
-2020-12-09 17:30:58,769 - Epoch: [46][ 1000/ 4498]    Overall Loss 0.023419    Objective Loss 0.023419    MSE 0.023419    LR 0.000125    Time 0.035013    
-2020-12-09 17:31:06,773 - Epoch: [46][ 1250/ 4498]    Overall Loss 0.023425    Objective Loss 0.023425    MSE 0.023425    LR 0.000125    Time 0.034399    
-2020-12-09 17:31:14,776 - Epoch: [46][ 1500/ 4498]    Overall Loss 0.023448    Objective Loss 0.023448    MSE 0.023448    LR 0.000125    Time 0.033990    
-2020-12-09 17:31:22,776 - Epoch: [46][ 1750/ 4498]    Overall Loss 0.023445    Objective Loss 0.023445    MSE 0.023445    LR 0.000125    Time 0.033696    
-2020-12-09 17:31:30,779 - Epoch: [46][ 2000/ 4498]    Overall Loss 0.023461    Objective Loss 0.023461    MSE 0.023461    LR 0.000125    Time 0.033477    
-2020-12-09 17:31:38,777 - Epoch: [46][ 2250/ 4498]    Overall Loss 0.023460    Objective Loss 0.023460    MSE 0.023460    LR 0.000125    Time 0.033304    
-2020-12-09 17:31:46,750 - Epoch: [46][ 2500/ 4498]    Overall Loss 0.023466    Objective Loss 0.023466    MSE 0.023466    LR 0.000125    Time 0.033156    
-2020-12-09 17:31:54,713 - Epoch: [46][ 2750/ 4498]    Overall Loss 0.023482    Objective Loss 0.023482    MSE 0.023482    LR 0.000125    Time 0.033031    
-2020-12-09 17:32:02,682 - Epoch: [46][ 3000/ 4498]    Overall Loss 0.023489    Objective Loss 0.023489    MSE 0.023489    LR 0.000125    Time 0.032929    
-2020-12-09 17:32:10,677 - Epoch: [46][ 3250/ 4498]    Overall Loss 0.023498    Objective Loss 0.023498    MSE 0.023498    LR 0.000125    Time 0.032851    
-2020-12-09 17:32:18,658 - Epoch: [46][ 3500/ 4498]    Overall Loss 0.023497    Objective Loss 0.023497    MSE 0.023497    LR 0.000125    Time 0.032780    
-2020-12-09 17:32:26,639 - Epoch: [46][ 3750/ 4498]    Overall Loss 0.023493    Objective Loss 0.023493    MSE 0.023493    LR 0.000125    Time 0.032718    
-2020-12-09 17:32:34,603 - Epoch: [46][ 4000/ 4498]    Overall Loss 0.023488    Objective Loss 0.023488    MSE 0.023488    LR 0.000125    Time 0.032660    
-2020-12-09 17:32:42,562 - Epoch: [46][ 4250/ 4498]    Overall Loss 0.023497    Objective Loss 0.023497    MSE 0.023497    LR 0.000125    Time 0.032607    
-2020-12-09 17:32:50,488 - Epoch: [46][ 4498/ 4498]    Overall Loss 0.023494    Objective Loss 0.023494    MSE 0.023494    LR 0.000125    Time 0.032569    
-2020-12-09 17:32:51,293 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17789 |  0.00270 |    0.13410 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15521 | -0.01340 |    0.10557 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08617 | -0.00844 |    0.05952 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08889 | -0.01560 |    0.06572 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10250 | -0.01014 |    0.07418 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12170 | -0.01648 |    0.09191 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15504 | -0.02056 |    0.11249 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26182 |  0.00008 |    0.20603 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:32:51,293 - Total sparsity: 0.00
-
-2020-12-09 17:32:51,296 - --- validate (epoch=46)-----------
-2020-12-09 17:32:51,296 - 49975 samples (100 per mini-batch)
-2020-12-09 17:32:56,669 - Epoch: [46][  250/  500]    Loss 0.024442    MSE 0.024442    
-2020-12-09 17:33:00,173 - Epoch: [46][  500/  500]    Loss 0.024341    MSE 0.024341    
-2020-12-09 17:33:00,886 - ==> MSE: 0.02434    Loss: 0.024
-
-2020-12-09 17:33:00,895 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:33:00,895 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:33:00,900 - 
-
-2020-12-09 17:33:00,900 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:33:11,973 - Epoch: [47][  250/ 4498]    Overall Loss 0.023299    Objective Loss 0.023299    MSE 0.023299    LR 0.000125    Time 0.044222    
-2020-12-09 17:33:20,003 - Epoch: [47][  500/ 4498]    Overall Loss 0.023329    Objective Loss 0.023329    MSE 0.023328    LR 0.000125    Time 0.038137    
-2020-12-09 17:33:28,070 - Epoch: [47][  750/ 4498]    Overall Loss 0.023388    Objective Loss 0.023388    MSE 0.023388    LR 0.000125    Time 0.036157    
-2020-12-09 17:33:36,125 - Epoch: [47][ 1000/ 4498]    Overall Loss 0.023410    Objective Loss 0.023410    MSE 0.023410    LR 0.000125    Time 0.035156    
-2020-12-09 17:33:44,177 - Epoch: [47][ 1250/ 4498]    Overall Loss 0.023402    Objective Loss 0.023402    MSE 0.023402    LR 0.000125    Time 0.034552    
-2020-12-09 17:33:52,230 - Epoch: [47][ 1500/ 4498]    Overall Loss 0.023410    Objective Loss 0.023410    MSE 0.023410    LR 0.000125    Time 0.034151    
-2020-12-09 17:34:00,285 - Epoch: [47][ 1750/ 4498]    Overall Loss 0.023421    Objective Loss 0.023421    MSE 0.023421    LR 0.000125    Time 0.033865    
-2020-12-09 17:34:08,339 - Epoch: [47][ 2000/ 4498]    Overall Loss 0.023447    Objective Loss 0.023447    MSE 0.023447    LR 0.000125    Time 0.033651    
-2020-12-09 17:34:16,396 - Epoch: [47][ 2250/ 4498]    Overall Loss 0.023448    Objective Loss 0.023448    MSE 0.023448    LR 0.000125    Time 0.033485    
-2020-12-09 17:34:24,466 - Epoch: [47][ 2500/ 4498]    Overall Loss 0.023456    Objective Loss 0.023456    MSE 0.023456    LR 0.000125    Time 0.033357    
-2020-12-09 17:34:32,533 - Epoch: [47][ 2750/ 4498]    Overall Loss 0.023449    Objective Loss 0.023449    MSE 0.023449    LR 0.000125    Time 0.033252    
-2020-12-09 17:34:40,607 - Epoch: [47][ 3000/ 4498]    Overall Loss 0.023455    Objective Loss 0.023455    MSE 0.023455    LR 0.000125    Time 0.033167    
-2020-12-09 17:34:48,682 - Epoch: [47][ 3250/ 4498]    Overall Loss 0.023466    Objective Loss 0.023466    MSE 0.023466    LR 0.000125    Time 0.033095    
-2020-12-09 17:34:56,749 - Epoch: [47][ 3500/ 4498]    Overall Loss 0.023480    Objective Loss 0.023480    MSE 0.023480    LR 0.000125    Time 0.033031    
-2020-12-09 17:35:04,813 - Epoch: [47][ 3750/ 4498]    Overall Loss 0.023486    Objective Loss 0.023486    MSE 0.023486    LR 0.000125    Time 0.032975    
-2020-12-09 17:35:12,892 - Epoch: [47][ 4000/ 4498]    Overall Loss 0.023492    Objective Loss 0.023492    MSE 0.023492    LR 0.000125    Time 0.032929    
-2020-12-09 17:35:20,967 - Epoch: [47][ 4250/ 4498]    Overall Loss 0.023497    Objective Loss 0.023497    MSE 0.023497    LR 0.000125    Time 0.032888    
-2020-12-09 17:35:29,016 - Epoch: [47][ 4498/ 4498]    Overall Loss 0.023490    Objective Loss 0.023490    MSE 0.023490    LR 0.000125    Time 0.032861    
-2020-12-09 17:35:29,822 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17812 |  0.00279 |    0.13429 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15531 | -0.01342 |    0.10563 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08610 | -0.00838 |    0.05943 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08881 | -0.01554 |    0.06564 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10245 | -0.00998 |    0.07416 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12166 | -0.01652 |    0.09193 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15505 | -0.02055 |    0.11248 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26240 |  0.00007 |    0.20648 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:35:29,822 - Total sparsity: 0.00
-
-2020-12-09 17:35:29,825 - --- validate (epoch=47)-----------
-2020-12-09 17:35:29,825 - 49975 samples (100 per mini-batch)
-2020-12-09 17:35:35,239 - Epoch: [47][  250/  500]    Loss 0.024272    MSE 0.024272    
-2020-12-09 17:35:38,786 - Epoch: [47][  500/  500]    Loss 0.024319    MSE 0.024319    
-2020-12-09 17:35:39,462 - ==> MSE: 0.02432    Loss: 0.024
-
-2020-12-09 17:35:39,471 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:35:39,471 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:35:39,476 - 
-
-2020-12-09 17:35:39,476 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:35:50,685 - Epoch: [48][  250/ 4498]    Overall Loss 0.023317    Objective Loss 0.023317    MSE 0.023317    LR 0.000125    Time 0.044767    
-2020-12-09 17:35:58,757 - Epoch: [48][  500/ 4498]    Overall Loss 0.023363    Objective Loss 0.023363    MSE 0.023363    LR 0.000125    Time 0.038493    
-2020-12-09 17:36:06,836 - Epoch: [48][  750/ 4498]    Overall Loss 0.023394    Objective Loss 0.023394    MSE 0.023394    LR 0.000125    Time 0.036411    
-2020-12-09 17:36:14,904 - Epoch: [48][ 1000/ 4498]    Overall Loss 0.023397    Objective Loss 0.023397    MSE 0.023397    LR 0.000125    Time 0.035359    
-2020-12-09 17:36:22,972 - Epoch: [48][ 1250/ 4498]    Overall Loss 0.023371    Objective Loss 0.023371    MSE 0.023371    LR 0.000125    Time 0.034728    
-2020-12-09 17:36:31,044 - Epoch: [48][ 1500/ 4498]    Overall Loss 0.023391    Objective Loss 0.023391    MSE 0.023391    LR 0.000125    Time 0.034310    
-2020-12-09 17:36:39,112 - Epoch: [48][ 1750/ 4498]    Overall Loss 0.023411    Objective Loss 0.023411    MSE 0.023411    LR 0.000125    Time 0.034009    
-2020-12-09 17:36:47,185 - Epoch: [48][ 2000/ 4498]    Overall Loss 0.023416    Objective Loss 0.023416    MSE 0.023416    LR 0.000125    Time 0.033786    
-2020-12-09 17:36:55,252 - Epoch: [48][ 2250/ 4498]    Overall Loss 0.023422    Objective Loss 0.023422    MSE 0.023422    LR 0.000125    Time 0.033609    
-2020-12-09 17:37:03,316 - Epoch: [48][ 2500/ 4498]    Overall Loss 0.023435    Objective Loss 0.023435    MSE 0.023435    LR 0.000125    Time 0.033467    
-2020-12-09 17:37:11,381 - Epoch: [48][ 2750/ 4498]    Overall Loss 0.023432    Objective Loss 0.023432    MSE 0.023432    LR 0.000125    Time 0.033351    
-2020-12-09 17:37:19,445 - Epoch: [48][ 3000/ 4498]    Overall Loss 0.023435    Objective Loss 0.023435    MSE 0.023435    LR 0.000125    Time 0.033255    
-2020-12-09 17:37:27,508 - Epoch: [48][ 3250/ 4498]    Overall Loss 0.023442    Objective Loss 0.023442    MSE 0.023442    LR 0.000125    Time 0.033172    
-2020-12-09 17:37:35,566 - Epoch: [48][ 3500/ 4498]    Overall Loss 0.023442    Objective Loss 0.023442    MSE 0.023442    LR 0.000125    Time 0.033100    
-2020-12-09 17:37:43,626 - Epoch: [48][ 3750/ 4498]    Overall Loss 0.023450    Objective Loss 0.023450    MSE 0.023450    LR 0.000125    Time 0.033038    
-2020-12-09 17:37:51,674 - Epoch: [48][ 4000/ 4498]    Overall Loss 0.023450    Objective Loss 0.023450    MSE 0.023450    LR 0.000125    Time 0.032981    
-2020-12-09 17:37:59,723 - Epoch: [48][ 4250/ 4498]    Overall Loss 0.023464    Objective Loss 0.023464    MSE 0.023464    LR 0.000125    Time 0.032931    
-2020-12-09 17:38:07,742 - Epoch: [48][ 4498/ 4498]    Overall Loss 0.023474    Objective Loss 0.023474    MSE 0.023474    LR 0.000125    Time 0.032895    
-2020-12-09 17:38:08,542 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17823 |  0.00290 |    0.13439 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15542 | -0.01331 |    0.10565 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08601 | -0.00844 |    0.05933 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08873 | -0.01550 |    0.06556 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10240 | -0.01001 |    0.07415 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12162 | -0.01646 |    0.09192 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15507 | -0.02054 |    0.11247 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26297 |  0.00006 |    0.20693 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:38:08,542 - Total sparsity: 0.00
-
-2020-12-09 17:38:08,545 - --- validate (epoch=48)-----------
-2020-12-09 17:38:08,545 - 49975 samples (100 per mini-batch)
-2020-12-09 17:38:14,227 - Epoch: [48][  250/  500]    Loss 0.024371    MSE 0.024371    
-2020-12-09 17:38:17,654 - Epoch: [48][  500/  500]    Loss 0.024365    MSE 0.024366    
-2020-12-09 17:38:18,362 - ==> MSE: 0.02437    Loss: 0.024
-
-2020-12-09 17:38:18,372 - ==> Best [MSE: 0.02431   Sparsity:0.00   Params: 176048 on epoch: 40]
-2020-12-09 17:38:18,372 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:38:18,377 - 
-
-2020-12-09 17:38:18,377 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:38:29,558 - Epoch: [49][  250/ 4498]    Overall Loss 0.023349    Objective Loss 0.023349    MSE 0.023349    LR 0.000125    Time 0.044656    
-2020-12-09 17:38:37,600 - Epoch: [49][  500/ 4498]    Overall Loss 0.023386    Objective Loss 0.023386    MSE 0.023386    LR 0.000125    Time 0.038378    
-2020-12-09 17:38:45,640 - Epoch: [49][  750/ 4498]    Overall Loss 0.023362    Objective Loss 0.023362    MSE 0.023362    LR 0.000125    Time 0.036282    
-2020-12-09 17:38:53,669 - Epoch: [49][ 1000/ 4498]    Overall Loss 0.023377    Objective Loss 0.023377    MSE 0.023377    LR 0.000125    Time 0.035223    
-2020-12-09 17:39:01,701 - Epoch: [49][ 1250/ 4498]    Overall Loss 0.023376    Objective Loss 0.023376    MSE 0.023376    LR 0.000125    Time 0.034590    
-2020-12-09 17:39:09,734 - Epoch: [49][ 1500/ 4498]    Overall Loss 0.023393    Objective Loss 0.023393    MSE 0.023393    LR 0.000125    Time 0.034170    
-2020-12-09 17:39:17,765 - Epoch: [49][ 1750/ 4498]    Overall Loss 0.023412    Objective Loss 0.023412    MSE 0.023412    LR 0.000125    Time 0.033868    
-2020-12-09 17:39:25,784 - Epoch: [49][ 2000/ 4498]    Overall Loss 0.023416    Objective Loss 0.023416    MSE 0.023416    LR 0.000125    Time 0.033635    
-2020-12-09 17:39:33,803 - Epoch: [49][ 2250/ 4498]    Overall Loss 0.023415    Objective Loss 0.023415    MSE 0.023415    LR 0.000125    Time 0.033454    
-2020-12-09 17:39:41,860 - Epoch: [49][ 2500/ 4498]    Overall Loss 0.023422    Objective Loss 0.023422    MSE 0.023422    LR 0.000125    Time 0.033324    
-2020-12-09 17:39:49,918 - Epoch: [49][ 2750/ 4498]    Overall Loss 0.023429    Objective Loss 0.023429    MSE 0.023429    LR 0.000125    Time 0.033219    
-2020-12-09 17:39:57,975 - Epoch: [49][ 3000/ 4498]    Overall Loss 0.023428    Objective Loss 0.023428    MSE 0.023428    LR 0.000125    Time 0.033131    
-2020-12-09 17:40:06,033 - Epoch: [49][ 3250/ 4498]    Overall Loss 0.023427    Objective Loss 0.023427    MSE 0.023427    LR 0.000125    Time 0.033056    
-2020-12-09 17:40:14,089 - Epoch: [49][ 3500/ 4498]    Overall Loss 0.023440    Objective Loss 0.023440    MSE 0.023440    LR 0.000125    Time 0.032992    
-2020-12-09 17:40:22,132 - Epoch: [49][ 3750/ 4498]    Overall Loss 0.023449    Objective Loss 0.023449    MSE 0.023449    LR 0.000125    Time 0.032933    
-2020-12-09 17:40:30,169 - Epoch: [49][ 4000/ 4498]    Overall Loss 0.023446    Objective Loss 0.023446    MSE 0.023446    LR 0.000125    Time 0.032879    
-2020-12-09 17:40:38,203 - Epoch: [49][ 4250/ 4498]    Overall Loss 0.023452    Objective Loss 0.023452    MSE 0.023452    LR 0.000125    Time 0.032832    
-2020-12-09 17:40:46,200 - Epoch: [49][ 4498/ 4498]    Overall Loss 0.023455    Objective Loss 0.023455    MSE 0.023454    LR 0.000125    Time 0.032796    
-2020-12-09 17:40:47,004 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17834 |  0.00292 |    0.13447 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15548 | -0.01331 |    0.10572 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08587 | -0.00843 |    0.05920 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08863 | -0.01543 |    0.06549 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10235 | -0.00997 |    0.07415 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12157 | -0.01642 |    0.09192 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15507 | -0.02054 |    0.11246 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26357 |  0.00006 |    0.20740 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:40:47,004 - Total sparsity: 0.00
-
-2020-12-09 17:40:47,007 - --- validate (epoch=49)-----------
-2020-12-09 17:40:47,007 - 49975 samples (100 per mini-batch)
-2020-12-09 17:40:52,511 - Epoch: [49][  250/  500]    Loss 0.024359    MSE 0.024359    
-2020-12-09 17:40:55,800 - Epoch: [49][  500/  500]    Loss 0.024303    MSE 0.024302    
-2020-12-09 17:40:56,533 - ==> MSE: 0.02430    Loss: 0.024
-
-2020-12-09 17:40:56,543 - ==> Best [MSE: 0.02430   Sparsity:0.00   Params: 176048 on epoch: 49]
-2020-12-09 17:40:56,543 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:40:56,555 - 
-
-2020-12-09 17:40:56,555 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:41:07,674 - Epoch: [50][  250/ 4498]    Overall Loss 0.023431    Objective Loss 0.023431    MSE 0.023431    LR 0.000125    Time 0.044407    
-2020-12-09 17:41:15,712 - Epoch: [50][  500/ 4498]    Overall Loss 0.023464    Objective Loss 0.023464    MSE 0.023464    LR 0.000125    Time 0.038244    
-2020-12-09 17:41:23,761 - Epoch: [50][  750/ 4498]    Overall Loss 0.023464    Objective Loss 0.023464    MSE 0.023464    LR 0.000125    Time 0.036205    
-2020-12-09 17:41:31,835 - Epoch: [50][ 1000/ 4498]    Overall Loss 0.023450    Objective Loss 0.023450    MSE 0.023450    LR 0.000125    Time 0.035211    
-2020-12-09 17:41:39,916 - Epoch: [50][ 1250/ 4498]    Overall Loss 0.023436    Objective Loss 0.023436    MSE 0.023436    LR 0.000125    Time 0.034620    
-2020-12-09 17:41:47,994 - Epoch: [50][ 1500/ 4498]    Overall Loss 0.023416    Objective Loss 0.023416    MSE 0.023416    LR 0.000125    Time 0.034223    
-2020-12-09 17:41:56,076 - Epoch: [50][ 1750/ 4498]    Overall Loss 0.023426    Objective Loss 0.023426    MSE 0.023426    LR 0.000125    Time 0.033943    
-2020-12-09 17:42:04,161 - Epoch: [50][ 2000/ 4498]    Overall Loss 0.023436    Objective Loss 0.023436    MSE 0.023436    LR 0.000125    Time 0.033734    
-2020-12-09 17:42:12,248 - Epoch: [50][ 2250/ 4498]    Overall Loss 0.023438    Objective Loss 0.023438    MSE 0.023438    LR 0.000125    Time 0.033572    
-2020-12-09 17:42:20,339 - Epoch: [50][ 2500/ 4498]    Overall Loss 0.023429    Objective Loss 0.023429    MSE 0.023429    LR 0.000125    Time 0.033445    
-2020-12-09 17:42:28,435 - Epoch: [50][ 2750/ 4498]    Overall Loss 0.023431    Objective Loss 0.023431    MSE 0.023431    LR 0.000125    Time 0.033342    
-2020-12-09 17:42:36,514 - Epoch: [50][ 3000/ 4498]    Overall Loss 0.023431    Objective Loss 0.023431    MSE 0.023431    LR 0.000125    Time 0.033251    
-2020-12-09 17:42:44,596 - Epoch: [50][ 3250/ 4498]    Overall Loss 0.023434    Objective Loss 0.023434    MSE 0.023434    LR 0.000125    Time 0.033174    
-2020-12-09 17:42:52,677 - Epoch: [50][ 3500/ 4498]    Overall Loss 0.023431    Objective Loss 0.023431    MSE 0.023431    LR 0.000125    Time 0.033109    
-2020-12-09 17:43:00,761 - Epoch: [50][ 3750/ 4498]    Overall Loss 0.023438    Objective Loss 0.023438    MSE 0.023439    LR 0.000125    Time 0.033053    
-2020-12-09 17:43:08,831 - Epoch: [50][ 4000/ 4498]    Overall Loss 0.023444    Objective Loss 0.023444    MSE 0.023444    LR 0.000125    Time 0.033000    
-2020-12-09 17:43:16,904 - Epoch: [50][ 4250/ 4498]    Overall Loss 0.023446    Objective Loss 0.023446    MSE 0.023446    LR 0.000125    Time 0.032954    
-2020-12-09 17:43:24,938 - Epoch: [50][ 4498/ 4498]    Overall Loss 0.023443    Objective Loss 0.023443    MSE 0.023443    LR 0.000125    Time 0.032921    
-2020-12-09 17:43:25,777 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17846 |  0.00290 |    0.13451 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15558 | -0.01322 |    0.10576 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08577 | -0.00845 |    0.05909 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08854 | -0.01548 |    0.06543 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10229 | -0.00996 |    0.07414 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12153 | -0.01643 |    0.09191 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15507 | -0.02056 |    0.11245 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26411 |  0.00007 |    0.20784 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:43:25,777 - Total sparsity: 0.00
-
-2020-12-09 17:43:25,780 - --- validate (epoch=50)-----------
-2020-12-09 17:43:25,780 - 49975 samples (100 per mini-batch)
-2020-12-09 17:43:31,130 - Epoch: [50][  250/  500]    Loss 0.024256    MSE 0.024256    
-2020-12-09 17:43:34,580 - Epoch: [50][  500/  500]    Loss 0.024293    MSE 0.024293    
-2020-12-09 17:43:35,315 - ==> MSE: 0.02429    Loss: 0.024
-
-2020-12-09 17:43:35,325 - ==> Best [MSE: 0.02429   Sparsity:0.00   Params: 176048 on epoch: 50]
-2020-12-09 17:43:35,325 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:43:35,337 - 
-
-2020-12-09 17:43:35,338 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:43:46,418 - Epoch: [51][  250/ 4498]    Overall Loss 0.023466    Objective Loss 0.023466    MSE 0.023466    LR 0.000125    Time 0.044254    
-2020-12-09 17:43:54,467 - Epoch: [51][  500/ 4498]    Overall Loss 0.023489    Objective Loss 0.023489    MSE 0.023489    LR 0.000125    Time 0.038191    
-2020-12-09 17:44:02,509 - Epoch: [51][  750/ 4498]    Overall Loss 0.023430    Objective Loss 0.023430    MSE 0.023430    LR 0.000125    Time 0.036159    
-2020-12-09 17:44:10,537 - Epoch: [51][ 1000/ 4498]    Overall Loss 0.023404    Objective Loss 0.023404    MSE 0.023404    LR 0.000125    Time 0.035130    
-2020-12-09 17:44:18,567 - Epoch: [51][ 1250/ 4498]    Overall Loss 0.023377    Objective Loss 0.023377    MSE 0.023377    LR 0.000125    Time 0.034515    
-2020-12-09 17:44:26,595 - Epoch: [51][ 1500/ 4498]    Overall Loss 0.023396    Objective Loss 0.023396    MSE 0.023396    LR 0.000125    Time 0.034103    
-2020-12-09 17:44:34,620 - Epoch: [51][ 1750/ 4498]    Overall Loss 0.023383    Objective Loss 0.023383    MSE 0.023383    LR 0.000125    Time 0.033807    
-2020-12-09 17:44:42,646 - Epoch: [51][ 2000/ 4498]    Overall Loss 0.023397    Objective Loss 0.023397    MSE 0.023397    LR 0.000125    Time 0.033585    
-2020-12-09 17:44:50,669 - Epoch: [51][ 2250/ 4498]    Overall Loss 0.023409    Objective Loss 0.023409    MSE 0.023409    LR 0.000125    Time 0.033412    
-2020-12-09 17:44:58,694 - Epoch: [51][ 2500/ 4498]    Overall Loss 0.023421    Objective Loss 0.023421    MSE 0.023421    LR 0.000125    Time 0.033274    
-2020-12-09 17:45:06,719 - Epoch: [51][ 2750/ 4498]    Overall Loss 0.023418    Objective Loss 0.023418    MSE 0.023418    LR 0.000125    Time 0.033161    
-2020-12-09 17:45:14,743 - Epoch: [51][ 3000/ 4498]    Overall Loss 0.023428    Objective Loss 0.023428    MSE 0.023428    LR 0.000125    Time 0.033067    
-2020-12-09 17:45:22,768 - Epoch: [51][ 3250/ 4498]    Overall Loss 0.023427    Objective Loss 0.023427    MSE 0.023427    LR 0.000125    Time 0.032987    
-2020-12-09 17:45:30,782 - Epoch: [51][ 3500/ 4498]    Overall Loss 0.023422    Objective Loss 0.023422    MSE 0.023422    LR 0.000125    Time 0.032916    
-2020-12-09 17:45:38,796 - Epoch: [51][ 3750/ 4498]    Overall Loss 0.023422    Objective Loss 0.023422    MSE 0.023422    LR 0.000125    Time 0.032854    
-2020-12-09 17:45:46,798 - Epoch: [51][ 4000/ 4498]    Overall Loss 0.023430    Objective Loss 0.023430    MSE 0.023430    LR 0.000125    Time 0.032797    
-2020-12-09 17:45:54,796 - Epoch: [51][ 4250/ 4498]    Overall Loss 0.023436    Objective Loss 0.023436    MSE 0.023436    LR 0.000125    Time 0.032745    
-2020-12-09 17:46:02,763 - Epoch: [51][ 4498/ 4498]    Overall Loss 0.023444    Objective Loss 0.023444    MSE 0.023444    LR 0.000125    Time 0.032708    
-2020-12-09 17:46:03,574 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17870 |  0.00293 |    0.13471 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15565 | -0.01319 |    0.10583 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08568 | -0.00843 |    0.05900 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08846 | -0.01542 |    0.06537 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10226 | -0.00996 |    0.07414 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12149 | -0.01643 |    0.09192 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15508 | -0.02052 |    0.11244 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26465 |  0.00005 |    0.20826 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:46:03,574 - Total sparsity: 0.00
-
-2020-12-09 17:46:03,577 - --- validate (epoch=51)-----------
-2020-12-09 17:46:03,577 - 49975 samples (100 per mini-batch)
-2020-12-09 17:46:09,195 - Epoch: [51][  250/  500]    Loss 0.024369    MSE 0.024369    
-2020-12-09 17:46:12,641 - Epoch: [51][  500/  500]    Loss 0.024405    MSE 0.024404    
-2020-12-09 17:46:13,368 - ==> MSE: 0.02440    Loss: 0.024
-
-2020-12-09 17:46:13,377 - ==> Best [MSE: 0.02429   Sparsity:0.00   Params: 176048 on epoch: 50]
-2020-12-09 17:46:13,378 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:46:13,382 - 
-
-2020-12-09 17:46:13,382 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:46:24,480 - Epoch: [52][  250/ 4498]    Overall Loss 0.023288    Objective Loss 0.023288    MSE 0.023288    LR 0.000125    Time 0.044324    
-2020-12-09 17:46:32,518 - Epoch: [52][  500/ 4498]    Overall Loss 0.023334    Objective Loss 0.023334    MSE 0.023334    LR 0.000125    Time 0.038203    
-2020-12-09 17:46:40,548 - Epoch: [52][  750/ 4498]    Overall Loss 0.023373    Objective Loss 0.023373    MSE 0.023373    LR 0.000125    Time 0.036153    
-2020-12-09 17:46:48,564 - Epoch: [52][ 1000/ 4498]    Overall Loss 0.023374    Objective Loss 0.023374    MSE 0.023374    LR 0.000125    Time 0.035113    
-2020-12-09 17:46:56,580 - Epoch: [52][ 1250/ 4498]    Overall Loss 0.023382    Objective Loss 0.023382    MSE 0.023382    LR 0.000125    Time 0.034489    
-2020-12-09 17:47:04,604 - Epoch: [52][ 1500/ 4498]    Overall Loss 0.023374    Objective Loss 0.023374    MSE 0.023374    LR 0.000125    Time 0.034079    
-2020-12-09 17:47:12,621 - Epoch: [52][ 1750/ 4498]    Overall Loss 0.023383    Objective Loss 0.023383    MSE 0.023383    LR 0.000125    Time 0.033782    
-2020-12-09 17:47:20,638 - Epoch: [52][ 2000/ 4498]    Overall Loss 0.023391    Objective Loss 0.023391    MSE 0.023391    LR 0.000125    Time 0.033559    
-2020-12-09 17:47:28,653 - Epoch: [52][ 2250/ 4498]    Overall Loss 0.023398    Objective Loss 0.023398    MSE 0.023398    LR 0.000125    Time 0.033385    
-2020-12-09 17:47:36,665 - Epoch: [52][ 2500/ 4498]    Overall Loss 0.023403    Objective Loss 0.023403    MSE 0.023403    LR 0.000125    Time 0.033245    
-2020-12-09 17:47:44,676 - Epoch: [52][ 2750/ 4498]    Overall Loss 0.023420    Objective Loss 0.023420    MSE 0.023420    LR 0.000125    Time 0.033129    
-2020-12-09 17:47:52,693 - Epoch: [52][ 3000/ 4498]    Overall Loss 0.023423    Objective Loss 0.023423    MSE 0.023423    LR 0.000125    Time 0.033035    
-2020-12-09 17:48:00,707 - Epoch: [52][ 3250/ 4498]    Overall Loss 0.023422    Objective Loss 0.023422    MSE 0.023422    LR 0.000125    Time 0.032954    
-2020-12-09 17:48:08,702 - Epoch: [52][ 3500/ 4498]    Overall Loss 0.023432    Objective Loss 0.023432    MSE 0.023433    LR 0.000125    Time 0.032880    
-2020-12-09 17:48:16,722 - Epoch: [52][ 3750/ 4498]    Overall Loss 0.023438    Objective Loss 0.023438    MSE 0.023438    LR 0.000125    Time 0.032822    
-2020-12-09 17:48:24,728 - Epoch: [52][ 4000/ 4498]    Overall Loss 0.023434    Objective Loss 0.023434    MSE 0.023434    LR 0.000125    Time 0.032768    
-2020-12-09 17:48:32,737 - Epoch: [52][ 4250/ 4498]    Overall Loss 0.023439    Objective Loss 0.023439    MSE 0.023439    LR 0.000125    Time 0.032721    
-2020-12-09 17:48:40,711 - Epoch: [52][ 4498/ 4498]    Overall Loss 0.023436    Objective Loss 0.023436    MSE 0.023436    LR 0.000125    Time 0.032687    
-2020-12-09 17:48:41,521 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17877 |  0.00290 |    0.13478 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15578 | -0.01314 |    0.10592 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08563 | -0.00839 |    0.05893 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08842 | -0.01542 |    0.06532 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10222 | -0.00997 |    0.07414 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12146 | -0.01639 |    0.09192 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15509 | -0.02054 |    0.11243 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26516 |  0.00007 |    0.20867 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:48:41,521 - Total sparsity: 0.00
-
-2020-12-09 17:48:41,524 - --- validate (epoch=52)-----------
-2020-12-09 17:48:41,524 - 49975 samples (100 per mini-batch)
-2020-12-09 17:48:46,906 - Epoch: [52][  250/  500]    Loss 0.024291    MSE 0.024291    
-2020-12-09 17:48:50,258 - Epoch: [52][  500/  500]    Loss 0.024347    MSE 0.024347    
-2020-12-09 17:48:51,004 - ==> MSE: 0.02435    Loss: 0.024
-
-2020-12-09 17:48:51,015 - ==> Best [MSE: 0.02429   Sparsity:0.00   Params: 176048 on epoch: 50]
-2020-12-09 17:48:51,015 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:48:51,019 - 
-
-2020-12-09 17:48:51,020 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:49:02,077 - Epoch: [53][  250/ 4498]    Overall Loss 0.023350    Objective Loss 0.023350    MSE 0.023350    LR 0.000125    Time 0.044160    
-2020-12-09 17:49:10,138 - Epoch: [53][  500/ 4498]    Overall Loss 0.023359    Objective Loss 0.023359    MSE 0.023359    LR 0.000125    Time 0.038168    
-2020-12-09 17:49:18,189 - Epoch: [53][  750/ 4498]    Overall Loss 0.023389    Objective Loss 0.023389    MSE 0.023389    LR 0.000125    Time 0.036157    
-2020-12-09 17:49:26,232 - Epoch: [53][ 1000/ 4498]    Overall Loss 0.023395    Objective Loss 0.023395    MSE 0.023395    LR 0.000125    Time 0.035144    
-2020-12-09 17:49:34,272 - Epoch: [53][ 1250/ 4498]    Overall Loss 0.023380    Objective Loss 0.023380    MSE 0.023380    LR 0.000125    Time 0.034533    
-2020-12-09 17:49:42,311 - Epoch: [53][ 1500/ 4498]    Overall Loss 0.023407    Objective Loss 0.023407    MSE 0.023407    LR 0.000125    Time 0.034126    
-2020-12-09 17:49:50,351 - Epoch: [53][ 1750/ 4498]    Overall Loss 0.023412    Objective Loss 0.023412    MSE 0.023412    LR 0.000125    Time 0.033835    
-2020-12-09 17:49:58,392 - Epoch: [53][ 2000/ 4498]    Overall Loss 0.023421    Objective Loss 0.023421    MSE 0.023421    LR 0.000125    Time 0.033618    
-2020-12-09 17:50:06,425 - Epoch: [53][ 2250/ 4498]    Overall Loss 0.023406    Objective Loss 0.023406    MSE 0.023406    LR 0.000125    Time 0.033445    
-2020-12-09 17:50:14,453 - Epoch: [53][ 2500/ 4498]    Overall Loss 0.023413    Objective Loss 0.023413    MSE 0.023413    LR 0.000125    Time 0.033305    
-2020-12-09 17:50:22,473 - Epoch: [53][ 2750/ 4498]    Overall Loss 0.023423    Objective Loss 0.023423    MSE 0.023423    LR 0.000125    Time 0.033187    
-2020-12-09 17:50:30,493 - Epoch: [53][ 3000/ 4498]    Overall Loss 0.023422    Objective Loss 0.023422    MSE 0.023422    LR 0.000125    Time 0.033090    
-2020-12-09 17:50:38,510 - Epoch: [53][ 3250/ 4498]    Overall Loss 0.023419    Objective Loss 0.023419    MSE 0.023419    LR 0.000125    Time 0.033006    
-2020-12-09 17:50:46,512 - Epoch: [53][ 3500/ 4498]    Overall Loss 0.023420    Objective Loss 0.023420    MSE 0.023420    LR 0.000125    Time 0.032929    
-2020-12-09 17:50:54,520 - Epoch: [53][ 3750/ 4498]    Overall Loss 0.023421    Objective Loss 0.023421    MSE 0.023421    LR 0.000125    Time 0.032865    
-2020-12-09 17:51:02,530 - Epoch: [53][ 4000/ 4498]    Overall Loss 0.023416    Objective Loss 0.023416    MSE 0.023416    LR 0.000125    Time 0.032809    
-2020-12-09 17:51:10,532 - Epoch: [53][ 4250/ 4498]    Overall Loss 0.023419    Objective Loss 0.023419    MSE 0.023419    LR 0.000125    Time 0.032758    
-2020-12-09 17:51:18,494 - Epoch: [53][ 4498/ 4498]    Overall Loss 0.023424    Objective Loss 0.023424    MSE 0.023424    LR 0.000125    Time 0.032719    
-2020-12-09 17:51:19,302 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17895 |  0.00275 |    0.13494 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15589 | -0.01321 |    0.10597 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08554 | -0.00841 |    0.05882 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08834 | -0.01539 |    0.06524 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10217 | -0.00992 |    0.07410 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12144 | -0.01639 |    0.09191 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15511 | -0.02056 |    0.11243 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26566 |  0.00005 |    0.20906 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:51:19,302 - Total sparsity: 0.00
-
-2020-12-09 17:51:19,305 - --- validate (epoch=53)-----------
-2020-12-09 17:51:19,305 - 49975 samples (100 per mini-batch)
-2020-12-09 17:51:24,700 - Epoch: [53][  250/  500]    Loss 0.024336    MSE 0.024336    
-2020-12-09 17:51:28,184 - Epoch: [53][  500/  500]    Loss 0.024408    MSE 0.024409    
-2020-12-09 17:51:28,928 - ==> MSE: 0.02441    Loss: 0.024
-
-2020-12-09 17:51:28,938 - ==> Best [MSE: 0.02429   Sparsity:0.00   Params: 176048 on epoch: 50]
-2020-12-09 17:51:28,938 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:51:28,943 - 
-
-2020-12-09 17:51:28,943 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:51:40,035 - Epoch: [54][  250/ 4498]    Overall Loss 0.023353    Objective Loss 0.023353    MSE 0.023353    LR 0.000125    Time 0.044299    
-2020-12-09 17:51:48,114 - Epoch: [54][  500/ 4498]    Overall Loss 0.023366    Objective Loss 0.023366    MSE 0.023366    LR 0.000125    Time 0.038272    
-2020-12-09 17:51:56,172 - Epoch: [54][  750/ 4498]    Overall Loss 0.023398    Objective Loss 0.023398    MSE 0.023398    LR 0.000125    Time 0.036237    
-2020-12-09 17:52:04,220 - Epoch: [54][ 1000/ 4498]    Overall Loss 0.023398    Objective Loss 0.023398    MSE 0.023398    LR 0.000125    Time 0.035208    
-2020-12-09 17:52:12,264 - Epoch: [54][ 1250/ 4498]    Overall Loss 0.023407    Objective Loss 0.023407    MSE 0.023407    LR 0.000125    Time 0.034588    
-2020-12-09 17:52:20,304 - Epoch: [54][ 1500/ 4498]    Overall Loss 0.023405    Objective Loss 0.023405    MSE 0.023405    LR 0.000125    Time 0.034172    
-2020-12-09 17:52:28,349 - Epoch: [54][ 1750/ 4498]    Overall Loss 0.023407    Objective Loss 0.023407    MSE 0.023407    LR 0.000125    Time 0.033877    
-2020-12-09 17:52:36,392 - Epoch: [54][ 2000/ 4498]    Overall Loss 0.023406    Objective Loss 0.023406    MSE 0.023406    LR 0.000125    Time 0.033656    
-2020-12-09 17:52:44,441 - Epoch: [54][ 2250/ 4498]    Overall Loss 0.023411    Objective Loss 0.023411    MSE 0.023411    LR 0.000125    Time 0.033486    
-2020-12-09 17:52:52,485 - Epoch: [54][ 2500/ 4498]    Overall Loss 0.023403    Objective Loss 0.023403    MSE 0.023403    LR 0.000125    Time 0.033348    
-2020-12-09 17:53:00,535 - Epoch: [54][ 2750/ 4498]    Overall Loss 0.023401    Objective Loss 0.023401    MSE 0.023401    LR 0.000125    Time 0.033238    
-2020-12-09 17:53:08,582 - Epoch: [54][ 3000/ 4498]    Overall Loss 0.023410    Objective Loss 0.023410    MSE 0.023410    LR 0.000125    Time 0.033144    
-2020-12-09 17:53:16,633 - Epoch: [54][ 3250/ 4498]    Overall Loss 0.023409    Objective Loss 0.023409    MSE 0.023409    LR 0.000125    Time 0.033067    
-2020-12-09 17:53:24,674 - Epoch: [54][ 3500/ 4498]    Overall Loss 0.023412    Objective Loss 0.023412    MSE 0.023412    LR 0.000125    Time 0.032997    
-2020-12-09 17:53:32,704 - Epoch: [54][ 3750/ 4498]    Overall Loss 0.023405    Objective Loss 0.023405    MSE 0.023405    LR 0.000125    Time 0.032934    
-2020-12-09 17:53:40,729 - Epoch: [54][ 4000/ 4498]    Overall Loss 0.023412    Objective Loss 0.023412    MSE 0.023412    LR 0.000125    Time 0.032878    
-2020-12-09 17:53:48,749 - Epoch: [54][ 4250/ 4498]    Overall Loss 0.023420    Objective Loss 0.023420    MSE 0.023420    LR 0.000125    Time 0.032827    
-2020-12-09 17:53:56,738 - Epoch: [54][ 4498/ 4498]    Overall Loss 0.023417    Objective Loss 0.023417    MSE 0.023417    LR 0.000125    Time 0.032790    
-2020-12-09 17:53:57,538 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17906 |  0.00279 |    0.13504 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15602 | -0.01314 |    0.10603 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08543 | -0.00837 |    0.05874 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08825 | -0.01539 |    0.06519 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10213 | -0.00992 |    0.07408 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12140 | -0.01635 |    0.09189 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15512 | -0.02057 |    0.11243 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26614 |  0.00006 |    0.20945 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:53:57,538 - Total sparsity: 0.00
-
-2020-12-09 17:53:57,542 - --- validate (epoch=54)-----------
-2020-12-09 17:53:57,542 - 49975 samples (100 per mini-batch)
-2020-12-09 17:54:03,084 - Epoch: [54][  250/  500]    Loss 0.024480    MSE 0.024480    
-2020-12-09 17:54:06,548 - Epoch: [54][  500/  500]    Loss 0.024352    MSE 0.024353    
-2020-12-09 17:54:07,285 - ==> MSE: 0.02435    Loss: 0.024
-
-2020-12-09 17:54:07,296 - ==> Best [MSE: 0.02429   Sparsity:0.00   Params: 176048 on epoch: 50]
-2020-12-09 17:54:07,296 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:54:07,301 - 
-
-2020-12-09 17:54:07,301 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:54:18,424 - Epoch: [55][  250/ 4498]    Overall Loss 0.023380    Objective Loss 0.023380    MSE 0.023380    LR 0.000125    Time 0.044424    
-2020-12-09 17:54:26,451 - Epoch: [55][  500/ 4498]    Overall Loss 0.023356    Objective Loss 0.023356    MSE 0.023356    LR 0.000125    Time 0.038231    
-2020-12-09 17:54:34,476 - Epoch: [55][  750/ 4498]    Overall Loss 0.023354    Objective Loss 0.023354    MSE 0.023354    LR 0.000125    Time 0.036165    
-2020-12-09 17:54:42,486 - Epoch: [55][ 1000/ 4498]    Overall Loss 0.023373    Objective Loss 0.023373    MSE 0.023373    LR 0.000125    Time 0.035117    
-2020-12-09 17:54:50,501 - Epoch: [55][ 1250/ 4498]    Overall Loss 0.023377    Objective Loss 0.023377    MSE 0.023377    LR 0.000125    Time 0.034491    
-2020-12-09 17:54:58,516 - Epoch: [55][ 1500/ 4498]    Overall Loss 0.023375    Objective Loss 0.023375    MSE 0.023375    LR 0.000125    Time 0.034074    
-2020-12-09 17:55:06,531 - Epoch: [55][ 1750/ 4498]    Overall Loss 0.023379    Objective Loss 0.023379    MSE 0.023379    LR 0.000125    Time 0.033777    
-2020-12-09 17:55:14,549 - Epoch: [55][ 2000/ 4498]    Overall Loss 0.023382    Objective Loss 0.023382    MSE 0.023382    LR 0.000125    Time 0.033555    
-2020-12-09 17:55:22,562 - Epoch: [55][ 2250/ 4498]    Overall Loss 0.023396    Objective Loss 0.023396    MSE 0.023396    LR 0.000125    Time 0.033381    
-2020-12-09 17:55:30,577 - Epoch: [55][ 2500/ 4498]    Overall Loss 0.023408    Objective Loss 0.023408    MSE 0.023408    LR 0.000125    Time 0.033242    
-2020-12-09 17:55:38,590 - Epoch: [55][ 2750/ 4498]    Overall Loss 0.023403    Objective Loss 0.023403    MSE 0.023403    LR 0.000125    Time 0.033128    
-2020-12-09 17:55:46,600 - Epoch: [55][ 3000/ 4498]    Overall Loss 0.023401    Objective Loss 0.023401    MSE 0.023401    LR 0.000125    Time 0.033031    
-2020-12-09 17:55:54,615 - Epoch: [55][ 3250/ 4498]    Overall Loss 0.023401    Objective Loss 0.023401    MSE 0.023401    LR 0.000125    Time 0.032951    
-2020-12-09 17:56:02,620 - Epoch: [55][ 3500/ 4498]    Overall Loss 0.023397    Objective Loss 0.023397    MSE 0.023397    LR 0.000125    Time 0.032880    
-2020-12-09 17:56:10,627 - Epoch: [55][ 3750/ 4498]    Overall Loss 0.023402    Objective Loss 0.023402    MSE 0.023402    LR 0.000125    Time 0.032818    
-2020-12-09 17:56:18,626 - Epoch: [55][ 4000/ 4498]    Overall Loss 0.023397    Objective Loss 0.023397    MSE 0.023397    LR 0.000125    Time 0.032762    
-2020-12-09 17:56:26,626 - Epoch: [55][ 4250/ 4498]    Overall Loss 0.023397    Objective Loss 0.023397    MSE 0.023397    LR 0.000125    Time 0.032714    
-2020-12-09 17:56:34,593 - Epoch: [55][ 4498/ 4498]    Overall Loss 0.023402    Objective Loss 0.023402    MSE 0.023402    LR 0.000125    Time 0.032678    
-2020-12-09 17:56:35,437 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17940 |  0.00270 |    0.13531 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15615 | -0.01310 |    0.10610 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08538 | -0.00840 |    0.05862 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08819 | -0.01531 |    0.06511 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10209 | -0.00992 |    0.07406 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12137 | -0.01640 |    0.09189 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15511 | -0.02050 |    0.11241 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26665 |  0.00008 |    0.20985 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:56:35,437 - Total sparsity: 0.00
-
-2020-12-09 17:56:35,440 - --- validate (epoch=55)-----------
-2020-12-09 17:56:35,441 - 49975 samples (100 per mini-batch)
-2020-12-09 17:56:41,028 - Epoch: [55][  250/  500]    Loss 0.024238    MSE 0.024238    
-2020-12-09 17:56:44,278 - Epoch: [55][  500/  500]    Loss 0.024231    MSE 0.024231    
-2020-12-09 17:56:45,006 - ==> MSE: 0.02423    Loss: 0.024
-
-2020-12-09 17:56:45,017 - ==> Best [MSE: 0.02423   Sparsity:0.00   Params: 176048 on epoch: 55]
-2020-12-09 17:56:45,017 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:56:45,030 - 
-
-2020-12-09 17:56:45,030 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:56:56,139 - Epoch: [56][  250/ 4498]    Overall Loss 0.023272    Objective Loss 0.023272    MSE 0.023272    LR 0.000125    Time 0.044368    
-2020-12-09 17:57:04,187 - Epoch: [56][  500/ 4498]    Overall Loss 0.023319    Objective Loss 0.023319    MSE 0.023319    LR 0.000125    Time 0.038246    
-2020-12-09 17:57:12,232 - Epoch: [56][  750/ 4498]    Overall Loss 0.023298    Objective Loss 0.023298    MSE 0.023298    LR 0.000125    Time 0.036200    
-2020-12-09 17:57:20,265 - Epoch: [56][ 1000/ 4498]    Overall Loss 0.023283    Objective Loss 0.023283    MSE 0.023283    LR 0.000125    Time 0.035167    
-2020-12-09 17:57:28,300 - Epoch: [56][ 1250/ 4498]    Overall Loss 0.023299    Objective Loss 0.023299    MSE 0.023299    LR 0.000125    Time 0.034548    
-2020-12-09 17:57:36,330 - Epoch: [56][ 1500/ 4498]    Overall Loss 0.023313    Objective Loss 0.023313    MSE 0.023313    LR 0.000125    Time 0.034131    
-2020-12-09 17:57:44,361 - Epoch: [56][ 1750/ 4498]    Overall Loss 0.023322    Objective Loss 0.023322    MSE 0.023322    LR 0.000125    Time 0.033835    
-2020-12-09 17:57:52,396 - Epoch: [56][ 2000/ 4498]    Overall Loss 0.023327    Objective Loss 0.023327    MSE 0.023327    LR 0.000125    Time 0.033615    
-2020-12-09 17:58:00,430 - Epoch: [56][ 2250/ 4498]    Overall Loss 0.023340    Objective Loss 0.023340    MSE 0.023340    LR 0.000125    Time 0.033442    
-2020-12-09 17:58:08,457 - Epoch: [56][ 2500/ 4498]    Overall Loss 0.023341    Objective Loss 0.023341    MSE 0.023341    LR 0.000125    Time 0.033302    
-2020-12-09 17:58:16,491 - Epoch: [56][ 2750/ 4498]    Overall Loss 0.023356    Objective Loss 0.023356    MSE 0.023356    LR 0.000125    Time 0.033190    
-2020-12-09 17:58:24,519 - Epoch: [56][ 3000/ 4498]    Overall Loss 0.023362    Objective Loss 0.023362    MSE 0.023362    LR 0.000125    Time 0.033094    
-2020-12-09 17:58:32,553 - Epoch: [56][ 3250/ 4498]    Overall Loss 0.023364    Objective Loss 0.023364    MSE 0.023364    LR 0.000125    Time 0.033015    
-2020-12-09 17:58:40,583 - Epoch: [56][ 3500/ 4498]    Overall Loss 0.023370    Objective Loss 0.023370    MSE 0.023370    LR 0.000125    Time 0.032947    
-2020-12-09 17:58:48,611 - Epoch: [56][ 3750/ 4498]    Overall Loss 0.023372    Objective Loss 0.023372    MSE 0.023372    LR 0.000125    Time 0.032886    
-2020-12-09 17:58:56,634 - Epoch: [56][ 4000/ 4498]    Overall Loss 0.023383    Objective Loss 0.023383    MSE 0.023383    LR 0.000125    Time 0.032833    
-2020-12-09 17:59:04,655 - Epoch: [56][ 4250/ 4498]    Overall Loss 0.023393    Objective Loss 0.023393    MSE 0.023393    LR 0.000125    Time 0.032784    
-2020-12-09 17:59:12,646 - Epoch: [56][ 4498/ 4498]    Overall Loss 0.023395    Objective Loss 0.023395    MSE 0.023395    LR 0.000125    Time 0.032750    
-2020-12-09 17:59:13,451 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17948 |  0.00274 |    0.13537 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15624 | -0.01307 |    0.10617 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08531 | -0.00836 |    0.05854 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08810 | -0.01531 |    0.06505 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10205 | -0.00982 |    0.07402 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12135 | -0.01638 |    0.09187 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15512 | -0.02053 |    0.11240 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26711 |  0.00006 |    0.21021 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 17:59:13,451 - Total sparsity: 0.00
-
-2020-12-09 17:59:13,454 - --- validate (epoch=56)-----------
-2020-12-09 17:59:13,454 - 49975 samples (100 per mini-batch)
-2020-12-09 17:59:19,155 - Epoch: [56][  250/  500]    Loss 0.024270    MSE 0.024270    
-2020-12-09 17:59:22,618 - Epoch: [56][  500/  500]    Loss 0.024271    MSE 0.024271    
-2020-12-09 17:59:23,379 - ==> MSE: 0.02427    Loss: 0.024
-
-2020-12-09 17:59:23,390 - ==> Best [MSE: 0.02423   Sparsity:0.00   Params: 176048 on epoch: 55]
-2020-12-09 17:59:23,390 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 17:59:23,395 - 
-
-2020-12-09 17:59:23,395 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 17:59:34,436 - Epoch: [57][  250/ 4498]    Overall Loss 0.023286    Objective Loss 0.023286    MSE 0.023286    LR 0.000125    Time 0.044094    
-2020-12-09 17:59:42,467 - Epoch: [57][  500/ 4498]    Overall Loss 0.023303    Objective Loss 0.023303    MSE 0.023303    LR 0.000125    Time 0.038075    
-2020-12-09 17:59:50,490 - Epoch: [57][  750/ 4498]    Overall Loss 0.023336    Objective Loss 0.023336    MSE 0.023336    LR 0.000125    Time 0.036058    
-2020-12-09 17:59:58,502 - Epoch: [57][ 1000/ 4498]    Overall Loss 0.023321    Objective Loss 0.023321    MSE 0.023321    LR 0.000125    Time 0.035038    
-2020-12-09 18:00:06,517 - Epoch: [57][ 1250/ 4498]    Overall Loss 0.023327    Objective Loss 0.023327    MSE 0.023327    LR 0.000125    Time 0.034428    
-2020-12-09 18:00:14,525 - Epoch: [57][ 1500/ 4498]    Overall Loss 0.023345    Objective Loss 0.023345    MSE 0.023345    LR 0.000125    Time 0.034017    
-2020-12-09 18:00:22,536 - Epoch: [57][ 1750/ 4498]    Overall Loss 0.023368    Objective Loss 0.023368    MSE 0.023368    LR 0.000125    Time 0.033726    
-2020-12-09 18:00:30,542 - Epoch: [57][ 2000/ 4498]    Overall Loss 0.023379    Objective Loss 0.023379    MSE 0.023379    LR 0.000125    Time 0.033504    
-2020-12-09 18:00:38,550 - Epoch: [57][ 2250/ 4498]    Overall Loss 0.023386    Objective Loss 0.023386    MSE 0.023386    LR 0.000125    Time 0.033333    
-2020-12-09 18:00:46,556 - Epoch: [57][ 2500/ 4498]    Overall Loss 0.023385    Objective Loss 0.023385    MSE 0.023385    LR 0.000125    Time 0.033195    
-2020-12-09 18:00:54,565 - Epoch: [57][ 2750/ 4498]    Overall Loss 0.023385    Objective Loss 0.023385    MSE 0.023385    LR 0.000125    Time 0.033084    
-2020-12-09 18:01:02,576 - Epoch: [57][ 3000/ 4498]    Overall Loss 0.023388    Objective Loss 0.023388    MSE 0.023388    LR 0.000125    Time 0.032991    
-2020-12-09 18:01:10,591 - Epoch: [57][ 3250/ 4498]    Overall Loss 0.023387    Objective Loss 0.023387    MSE 0.023387    LR 0.000125    Time 0.032914    
-2020-12-09 18:01:18,592 - Epoch: [57][ 3500/ 4498]    Overall Loss 0.023392    Objective Loss 0.023392    MSE 0.023392    LR 0.000125    Time 0.032844    
-2020-12-09 18:01:26,594 - Epoch: [57][ 3750/ 4498]    Overall Loss 0.023388    Objective Loss 0.023388    MSE 0.023388    LR 0.000125    Time 0.032784    
-2020-12-09 18:01:34,601 - Epoch: [57][ 4000/ 4498]    Overall Loss 0.023393    Objective Loss 0.023393    MSE 0.023393    LR 0.000125    Time 0.032732    
-2020-12-09 18:01:42,615 - Epoch: [57][ 4250/ 4498]    Overall Loss 0.023391    Objective Loss 0.023391    MSE 0.023391    LR 0.000125    Time 0.032688    
-2020-12-09 18:01:50,597 - Epoch: [57][ 4498/ 4498]    Overall Loss 0.023393    Objective Loss 0.023393    MSE 0.023393    LR 0.000125    Time 0.032658    
-2020-12-09 18:01:51,433 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17957 |  0.00284 |    0.13546 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15633 | -0.01310 |    0.10624 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08523 | -0.00844 |    0.05844 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08804 | -0.01527 |    0.06499 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10201 | -0.00985 |    0.07400 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12132 | -0.01636 |    0.09186 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02050 |    0.11240 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26757 |  0.00007 |    0.21058 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:01:51,433 - Total sparsity: 0.00
-
-2020-12-09 18:01:51,436 - --- validate (epoch=57)-----------
-2020-12-09 18:01:51,436 - 49975 samples (100 per mini-batch)
-2020-12-09 18:01:56,926 - Epoch: [57][  250/  500]    Loss 0.024227    MSE 0.024227    
-2020-12-09 18:02:00,308 - Epoch: [57][  500/  500]    Loss 0.024272    MSE 0.024273    
-2020-12-09 18:02:01,057 - ==> MSE: 0.02427    Loss: 0.024
-
-2020-12-09 18:02:01,069 - ==> Best [MSE: 0.02423   Sparsity:0.00   Params: 176048 on epoch: 55]
-2020-12-09 18:02:01,069 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:02:01,074 - 
-
-2020-12-09 18:02:01,074 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:02:12,272 - Epoch: [58][  250/ 4498]    Overall Loss 0.023398    Objective Loss 0.023398    MSE 0.023398    LR 0.000125    Time 0.044726    
-2020-12-09 18:02:20,365 - Epoch: [58][  500/ 4498]    Overall Loss 0.023405    Objective Loss 0.023405    MSE 0.023405    LR 0.000125    Time 0.038514    
-2020-12-09 18:02:28,449 - Epoch: [58][  750/ 4498]    Overall Loss 0.023372    Objective Loss 0.023372    MSE 0.023372    LR 0.000125    Time 0.036431    
-2020-12-09 18:02:36,516 - Epoch: [58][ 1000/ 4498]    Overall Loss 0.023333    Objective Loss 0.023333    MSE 0.023333    LR 0.000125    Time 0.035373    
-2020-12-09 18:02:44,583 - Epoch: [58][ 1250/ 4498]    Overall Loss 0.023315    Objective Loss 0.023315    MSE 0.023315    LR 0.000125    Time 0.034738    
-2020-12-09 18:02:52,651 - Epoch: [58][ 1500/ 4498]    Overall Loss 0.023328    Objective Loss 0.023328    MSE 0.023328    LR 0.000125    Time 0.034316    
-2020-12-09 18:03:00,718 - Epoch: [58][ 1750/ 4498]    Overall Loss 0.023342    Objective Loss 0.023342    MSE 0.023342    LR 0.000125    Time 0.034014    
-2020-12-09 18:03:08,791 - Epoch: [58][ 2000/ 4498]    Overall Loss 0.023349    Objective Loss 0.023349    MSE 0.023349    LR 0.000125    Time 0.033790    
-2020-12-09 18:03:16,863 - Epoch: [58][ 2250/ 4498]    Overall Loss 0.023352    Objective Loss 0.023352    MSE 0.023352    LR 0.000125    Time 0.033615    
-2020-12-09 18:03:24,933 - Epoch: [58][ 2500/ 4498]    Overall Loss 0.023342    Objective Loss 0.023342    MSE 0.023342    LR 0.000125    Time 0.033475    
-2020-12-09 18:03:33,003 - Epoch: [58][ 2750/ 4498]    Overall Loss 0.023353    Objective Loss 0.023353    MSE 0.023353    LR 0.000125    Time 0.033360    
-2020-12-09 18:03:41,075 - Epoch: [58][ 3000/ 4498]    Overall Loss 0.023365    Objective Loss 0.023365    MSE 0.023365    LR 0.000125    Time 0.033265    
-2020-12-09 18:03:49,146 - Epoch: [58][ 3250/ 4498]    Overall Loss 0.023365    Objective Loss 0.023365    MSE 0.023365    LR 0.000125    Time 0.033184    
-2020-12-09 18:03:57,216 - Epoch: [58][ 3500/ 4498]    Overall Loss 0.023363    Objective Loss 0.023363    MSE 0.023363    LR 0.000125    Time 0.033115    
-2020-12-09 18:04:05,283 - Epoch: [58][ 3750/ 4498]    Overall Loss 0.023370    Objective Loss 0.023370    MSE 0.023370    LR 0.000125    Time 0.033054    
-2020-12-09 18:04:13,349 - Epoch: [58][ 4000/ 4498]    Overall Loss 0.023380    Objective Loss 0.023380    MSE 0.023380    LR 0.000125    Time 0.033000    
-2020-12-09 18:04:21,417 - Epoch: [58][ 4250/ 4498]    Overall Loss 0.023380    Objective Loss 0.023380    MSE 0.023380    LR 0.000125    Time 0.032953    
-2020-12-09 18:04:29,449 - Epoch: [58][ 4498/ 4498]    Overall Loss 0.023381    Objective Loss 0.023381    MSE 0.023381    LR 0.000125    Time 0.032919    
-2020-12-09 18:04:30,288 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17972 |  0.00272 |    0.13554 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15641 | -0.01307 |    0.10629 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08513 | -0.00840 |    0.05838 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08797 | -0.01522 |    0.06493 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10196 | -0.00979 |    0.07398 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12128 | -0.01628 |    0.09183 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02050 |    0.11239 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26803 |  0.00004 |    0.21094 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:04:30,288 - Total sparsity: 0.00
-
-2020-12-09 18:04:30,291 - --- validate (epoch=58)-----------
-2020-12-09 18:04:30,291 - 49975 samples (100 per mini-batch)
-2020-12-09 18:04:35,700 - Epoch: [58][  250/  500]    Loss 0.024358    MSE 0.024358    
-2020-12-09 18:04:38,939 - Epoch: [58][  500/  500]    Loss 0.024354    MSE 0.024354    
-2020-12-09 18:04:39,679 - ==> MSE: 0.02435    Loss: 0.024
-
-2020-12-09 18:04:39,691 - ==> Best [MSE: 0.02423   Sparsity:0.00   Params: 176048 on epoch: 55]
-2020-12-09 18:04:39,691 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:04:39,696 - 
-
-2020-12-09 18:04:39,696 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:04:50,848 - Epoch: [59][  250/ 4498]    Overall Loss 0.023349    Objective Loss 0.023349    MSE 0.023349    LR 0.000125    Time 0.044539    
-2020-12-09 18:04:58,907 - Epoch: [59][  500/ 4498]    Overall Loss 0.023315    Objective Loss 0.023315    MSE 0.023315    LR 0.000125    Time 0.038352    
-2020-12-09 18:05:06,978 - Epoch: [59][  750/ 4498]    Overall Loss 0.023321    Objective Loss 0.023321    MSE 0.023321    LR 0.000125    Time 0.036307    
-2020-12-09 18:05:15,072 - Epoch: [59][ 1000/ 4498]    Overall Loss 0.023321    Objective Loss 0.023321    MSE 0.023321    LR 0.000125    Time 0.035307    
-2020-12-09 18:05:23,162 - Epoch: [59][ 1250/ 4498]    Overall Loss 0.023325    Objective Loss 0.023325    MSE 0.023325    LR 0.000125    Time 0.034704    
-2020-12-09 18:05:31,256 - Epoch: [59][ 1500/ 4498]    Overall Loss 0.023330    Objective Loss 0.023330    MSE 0.023330    LR 0.000125    Time 0.034304    
-2020-12-09 18:05:39,348 - Epoch: [59][ 1750/ 4498]    Overall Loss 0.023343    Objective Loss 0.023343    MSE 0.023343    LR 0.000125    Time 0.034018    
-2020-12-09 18:05:47,442 - Epoch: [59][ 2000/ 4498]    Overall Loss 0.023348    Objective Loss 0.023348    MSE 0.023348    LR 0.000125    Time 0.033804    
-2020-12-09 18:05:55,539 - Epoch: [59][ 2250/ 4498]    Overall Loss 0.023344    Objective Loss 0.023344    MSE 0.023344    LR 0.000125    Time 0.033639    
-2020-12-09 18:06:03,636 - Epoch: [59][ 2500/ 4498]    Overall Loss 0.023358    Objective Loss 0.023358    MSE 0.023358    LR 0.000125    Time 0.033507    
-2020-12-09 18:06:11,732 - Epoch: [59][ 2750/ 4498]    Overall Loss 0.023361    Objective Loss 0.023361    MSE 0.023361    LR 0.000125    Time 0.033399    
-2020-12-09 18:06:19,831 - Epoch: [59][ 3000/ 4498]    Overall Loss 0.023367    Objective Loss 0.023367    MSE 0.023367    LR 0.000125    Time 0.033310    
-2020-12-09 18:06:27,930 - Epoch: [59][ 3250/ 4498]    Overall Loss 0.023372    Objective Loss 0.023372    MSE 0.023372    LR 0.000125    Time 0.033234    
-2020-12-09 18:06:36,024 - Epoch: [59][ 3500/ 4498]    Overall Loss 0.023373    Objective Loss 0.023373    MSE 0.023373    LR 0.000125    Time 0.033168    
-2020-12-09 18:06:44,113 - Epoch: [59][ 3750/ 4498]    Overall Loss 0.023374    Objective Loss 0.023374    MSE 0.023374    LR 0.000125    Time 0.033109    
-2020-12-09 18:06:52,204 - Epoch: [59][ 4000/ 4498]    Overall Loss 0.023378    Objective Loss 0.023378    MSE 0.023378    LR 0.000125    Time 0.033058    
-2020-12-09 18:07:00,296 - Epoch: [59][ 4250/ 4498]    Overall Loss 0.023380    Objective Loss 0.023380    MSE 0.023380    LR 0.000125    Time 0.033014    
-2020-12-09 18:07:08,353 - Epoch: [59][ 4498/ 4498]    Overall Loss 0.023382    Objective Loss 0.023382    MSE 0.023382    LR 0.000125    Time 0.032982    
-2020-12-09 18:07:09,151 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17993 |  0.00275 |    0.13576 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15646 | -0.01311 |    0.10636 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08506 | -0.00830 |    0.05830 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08792 | -0.01524 |    0.06488 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10193 | -0.00982 |    0.07395 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12126 | -0.01627 |    0.09182 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02050 |    0.11240 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26846 |  0.00004 |    0.21128 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:07:09,151 - Total sparsity: 0.00
-
-2020-12-09 18:07:09,154 - --- validate (epoch=59)-----------
-2020-12-09 18:07:09,155 - 49975 samples (100 per mini-batch)
-2020-12-09 18:07:14,635 - Epoch: [59][  250/  500]    Loss 0.024359    MSE 0.024359    
-2020-12-09 18:07:17,999 - Epoch: [59][  500/  500]    Loss 0.024267    MSE 0.024267    
-2020-12-09 18:07:18,749 - ==> MSE: 0.02427    Loss: 0.024
-
-2020-12-09 18:07:18,761 - ==> Best [MSE: 0.02423   Sparsity:0.00   Params: 176048 on epoch: 55]
-2020-12-09 18:07:18,761 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:07:18,766 - 
-
-2020-12-09 18:07:18,766 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:07:29,840 - Epoch: [60][  250/ 4498]    Overall Loss 0.023160    Objective Loss 0.023160    MSE 0.023160    LR 0.000063    Time 0.044226    
-2020-12-09 18:07:37,877 - Epoch: [60][  500/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.038153    
-2020-12-09 18:07:45,908 - Epoch: [60][  750/ 4498]    Overall Loss 0.023205    Objective Loss 0.023205    MSE 0.023205    LR 0.000063    Time 0.036121    
-2020-12-09 18:07:53,926 - Epoch: [60][ 1000/ 4498]    Overall Loss 0.023164    Objective Loss 0.023164    MSE 0.023164    LR 0.000063    Time 0.035092    
-2020-12-09 18:08:01,938 - Epoch: [60][ 1250/ 4498]    Overall Loss 0.023172    Objective Loss 0.023172    MSE 0.023172    LR 0.000063    Time 0.034469    
-2020-12-09 18:08:09,949 - Epoch: [60][ 1500/ 4498]    Overall Loss 0.023163    Objective Loss 0.023163    MSE 0.023163    LR 0.000063    Time 0.034053    
-2020-12-09 18:08:17,962 - Epoch: [60][ 1750/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.033758    
-2020-12-09 18:08:25,971 - Epoch: [60][ 2000/ 4498]    Overall Loss 0.023170    Objective Loss 0.023170    MSE 0.023170    LR 0.000063    Time 0.033534    
-2020-12-09 18:08:33,984 - Epoch: [60][ 2250/ 4498]    Overall Loss 0.023179    Objective Loss 0.023179    MSE 0.023179    LR 0.000063    Time 0.033362    
-2020-12-09 18:08:41,997 - Epoch: [60][ 2500/ 4498]    Overall Loss 0.023177    Objective Loss 0.023177    MSE 0.023177    LR 0.000063    Time 0.033224    
-2020-12-09 18:08:50,011 - Epoch: [60][ 2750/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.033111    
-2020-12-09 18:08:58,021 - Epoch: [60][ 3000/ 4498]    Overall Loss 0.023175    Objective Loss 0.023175    MSE 0.023175    LR 0.000063    Time 0.033016    
-2020-12-09 18:09:06,030 - Epoch: [60][ 3250/ 4498]    Overall Loss 0.023188    Objective Loss 0.023188    MSE 0.023188    LR 0.000063    Time 0.032936    
-2020-12-09 18:09:14,028 - Epoch: [60][ 3500/ 4498]    Overall Loss 0.023191    Objective Loss 0.023191    MSE 0.023191    LR 0.000063    Time 0.032863    
-2020-12-09 18:09:22,029 - Epoch: [60][ 3750/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.032802    
-2020-12-09 18:09:30,022 - Epoch: [60][ 4000/ 4498]    Overall Loss 0.023191    Objective Loss 0.023191    MSE 0.023191    LR 0.000063    Time 0.032746    
-2020-12-09 18:09:38,008 - Epoch: [60][ 4250/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.032694    
-2020-12-09 18:09:45,966 - Epoch: [60][ 4498/ 4498]    Overall Loss 0.023194    Objective Loss 0.023194    MSE 0.023194    LR 0.000063    Time 0.032658    
-2020-12-09 18:09:46,779 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17995 |  0.00277 |    0.13577 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15648 | -0.01305 |    0.10635 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08497 | -0.00826 |    0.05819 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08784 | -0.01514 |    0.06480 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10186 | -0.00972 |    0.07391 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12121 | -0.01623 |    0.09178 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02041 |    0.11237 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26882 |  0.00004 |    0.21156 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:09:46,779 - Total sparsity: 0.00
-
-2020-12-09 18:09:46,782 - --- validate (epoch=60)-----------
-2020-12-09 18:09:46,782 - 49975 samples (100 per mini-batch)
-2020-12-09 18:09:52,166 - Epoch: [60][  250/  500]    Loss 0.024189    MSE 0.024189    
-2020-12-09 18:09:55,431 - Epoch: [60][  500/  500]    Loss 0.024101    MSE 0.024100    
-2020-12-09 18:09:56,099 - ==> MSE: 0.02410    Loss: 0.024
-
-2020-12-09 18:09:56,112 - ==> Best [MSE: 0.02410   Sparsity:0.00   Params: 176048 on epoch: 60]
-2020-12-09 18:09:56,112 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:09:56,124 - 
-
-2020-12-09 18:09:56,124 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:10:07,245 - Epoch: [61][  250/ 4498]    Overall Loss 0.023147    Objective Loss 0.023147    MSE 0.023147    LR 0.000063    Time 0.044412    
-2020-12-09 18:10:15,320 - Epoch: [61][  500/ 4498]    Overall Loss 0.023126    Objective Loss 0.023126    MSE 0.023126    LR 0.000063    Time 0.038321    
-2020-12-09 18:10:23,388 - Epoch: [61][  750/ 4498]    Overall Loss 0.023175    Objective Loss 0.023175    MSE 0.023175    LR 0.000063    Time 0.036283    
-2020-12-09 18:10:31,445 - Epoch: [61][ 1000/ 4498]    Overall Loss 0.023136    Objective Loss 0.023136    MSE 0.023136    LR 0.000063    Time 0.035252    
-2020-12-09 18:10:39,499 - Epoch: [61][ 1250/ 4498]    Overall Loss 0.023145    Objective Loss 0.023145    MSE 0.023145    LR 0.000063    Time 0.034631    
-2020-12-09 18:10:47,551 - Epoch: [61][ 1500/ 4498]    Overall Loss 0.023158    Objective Loss 0.023158    MSE 0.023158    LR 0.000063    Time 0.034215    
-2020-12-09 18:10:55,605 - Epoch: [61][ 1750/ 4498]    Overall Loss 0.023174    Objective Loss 0.023174    MSE 0.023174    LR 0.000063    Time 0.033920    
-2020-12-09 18:11:03,658 - Epoch: [61][ 2000/ 4498]    Overall Loss 0.023174    Objective Loss 0.023174    MSE 0.023174    LR 0.000063    Time 0.033698    
-2020-12-09 18:11:11,708 - Epoch: [61][ 2250/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.033524    
-2020-12-09 18:11:19,757 - Epoch: [61][ 2500/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.033384    
-2020-12-09 18:11:27,809 - Epoch: [61][ 2750/ 4498]    Overall Loss 0.023178    Objective Loss 0.023178    MSE 0.023178    LR 0.000063    Time 0.033271    
-2020-12-09 18:11:35,860 - Epoch: [61][ 3000/ 4498]    Overall Loss 0.023183    Objective Loss 0.023183    MSE 0.023183    LR 0.000063    Time 0.033176    
-2020-12-09 18:11:43,914 - Epoch: [61][ 3250/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.033097    
-2020-12-09 18:11:51,966 - Epoch: [61][ 3500/ 4498]    Overall Loss 0.023191    Objective Loss 0.023191    MSE 0.023191    LR 0.000063    Time 0.033029    
-2020-12-09 18:12:00,021 - Epoch: [61][ 3750/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.032970    
-2020-12-09 18:12:08,074 - Epoch: [61][ 4000/ 4498]    Overall Loss 0.023204    Objective Loss 0.023204    MSE 0.023204    LR 0.000063    Time 0.032919    
-2020-12-09 18:12:16,129 - Epoch: [61][ 4250/ 4498]    Overall Loss 0.023204    Objective Loss 0.023204    MSE 0.023204    LR 0.000063    Time 0.032873    
-2020-12-09 18:12:24,148 - Epoch: [61][ 4498/ 4498]    Overall Loss 0.023205    Objective Loss 0.023205    MSE 0.023205    LR 0.000063    Time 0.032841    
-2020-12-09 18:12:24,982 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.17996 |  0.00268 |    0.13577 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15650 | -0.01298 |    0.10635 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08487 | -0.00824 |    0.05810 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08777 | -0.01512 |    0.06475 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10181 | -0.00969 |    0.07388 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12116 | -0.01616 |    0.09174 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02038 |    0.11235 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26914 |  0.00005 |    0.21182 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:12:24,982 - Total sparsity: 0.00
-
-2020-12-09 18:12:24,985 - --- validate (epoch=61)-----------
-2020-12-09 18:12:24,985 - 49975 samples (100 per mini-batch)
-2020-12-09 18:12:30,570 - Epoch: [61][  250/  500]    Loss 0.024215    MSE 0.024215    
-2020-12-09 18:12:33,963 - Epoch: [61][  500/  500]    Loss 0.024164    MSE 0.024163    
-2020-12-09 18:12:34,674 - ==> MSE: 0.02416    Loss: 0.024
-
-2020-12-09 18:12:34,687 - ==> Best [MSE: 0.02410   Sparsity:0.00   Params: 176048 on epoch: 60]
-2020-12-09 18:12:34,687 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:12:34,692 - 
-
-2020-12-09 18:12:34,692 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:12:45,845 - Epoch: [62][  250/ 4498]    Overall Loss 0.023130    Objective Loss 0.023130    MSE 0.023130    LR 0.000063    Time 0.044544    
-2020-12-09 18:12:53,897 - Epoch: [62][  500/ 4498]    Overall Loss 0.023205    Objective Loss 0.023205    MSE 0.023205    LR 0.000063    Time 0.038341    
-2020-12-09 18:13:01,948 - Epoch: [62][  750/ 4498]    Overall Loss 0.023183    Objective Loss 0.023183    MSE 0.023183    LR 0.000063    Time 0.036273    
-2020-12-09 18:13:09,990 - Epoch: [62][ 1000/ 4498]    Overall Loss 0.023151    Objective Loss 0.023151    MSE 0.023151    LR 0.000063    Time 0.035229    
-2020-12-09 18:13:18,028 - Epoch: [62][ 1250/ 4498]    Overall Loss 0.023152    Objective Loss 0.023152    MSE 0.023152    LR 0.000063    Time 0.034600    
-2020-12-09 18:13:26,066 - Epoch: [62][ 1500/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.034180    
-2020-12-09 18:13:34,103 - Epoch: [62][ 1750/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033881    
-2020-12-09 18:13:42,145 - Epoch: [62][ 2000/ 4498]    Overall Loss 0.023173    Objective Loss 0.023173    MSE 0.023173    LR 0.000063    Time 0.033658    
-2020-12-09 18:13:50,189 - Epoch: [62][ 2250/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.033485    
-2020-12-09 18:13:58,232 - Epoch: [62][ 2500/ 4498]    Overall Loss 0.023175    Objective Loss 0.023175    MSE 0.023175    LR 0.000063    Time 0.033347    
-2020-12-09 18:14:06,274 - Epoch: [62][ 2750/ 4498]    Overall Loss 0.023188    Objective Loss 0.023188    MSE 0.023188    LR 0.000063    Time 0.033234    
-2020-12-09 18:14:14,314 - Epoch: [62][ 3000/ 4498]    Overall Loss 0.023188    Objective Loss 0.023188    MSE 0.023188    LR 0.000063    Time 0.033138    
-2020-12-09 18:14:22,354 - Epoch: [62][ 3250/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.033058    
-2020-12-09 18:14:30,394 - Epoch: [62][ 3500/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.032989    
-2020-12-09 18:14:38,431 - Epoch: [62][ 3750/ 4498]    Overall Loss 0.023203    Objective Loss 0.023203    MSE 0.023203    LR 0.000063    Time 0.032928    
-2020-12-09 18:14:46,469 - Epoch: [62][ 4000/ 4498]    Overall Loss 0.023212    Objective Loss 0.023212    MSE 0.023212    LR 0.000063    Time 0.032875    
-2020-12-09 18:14:54,509 - Epoch: [62][ 4250/ 4498]    Overall Loss 0.023207    Objective Loss 0.023207    MSE 0.023207    LR 0.000063    Time 0.032829    
-2020-12-09 18:15:02,519 - Epoch: [62][ 4498/ 4498]    Overall Loss 0.023209    Objective Loss 0.023209    MSE 0.023210    LR 0.000063    Time 0.032797    
-2020-12-09 18:15:03,336 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18002 |  0.00273 |    0.13584 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15651 | -0.01304 |    0.10638 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08481 | -0.00824 |    0.05804 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08772 | -0.01507 |    0.06471 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10177 | -0.00968 |    0.07384 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12113 | -0.01616 |    0.09171 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15515 | -0.02037 |    0.11234 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26946 |  0.00005 |    0.21207 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:15:03,337 - Total sparsity: 0.00
-
-2020-12-09 18:15:03,340 - --- validate (epoch=62)-----------
-2020-12-09 18:15:03,340 - 49975 samples (100 per mini-batch)
-2020-12-09 18:15:08,855 - Epoch: [62][  250/  500]    Loss 0.024131    MSE 0.024131    
-2020-12-09 18:15:12,306 - Epoch: [62][  500/  500]    Loss 0.024136    MSE 0.024137    
-2020-12-09 18:15:13,043 - ==> MSE: 0.02414    Loss: 0.024
-
-2020-12-09 18:15:13,055 - ==> Best [MSE: 0.02410   Sparsity:0.00   Params: 176048 on epoch: 60]
-2020-12-09 18:15:13,055 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:15:13,060 - 
-
-2020-12-09 18:15:13,060 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:15:24,223 - Epoch: [63][  250/ 4498]    Overall Loss 0.023141    Objective Loss 0.023141    MSE 0.023141    LR 0.000063    Time 0.044582    
-2020-12-09 18:15:32,319 - Epoch: [63][  500/ 4498]    Overall Loss 0.023131    Objective Loss 0.023131    MSE 0.023131    LR 0.000063    Time 0.038449    
-2020-12-09 18:15:40,411 - Epoch: [63][  750/ 4498]    Overall Loss 0.023129    Objective Loss 0.023129    MSE 0.023129    LR 0.000063    Time 0.036399    
-2020-12-09 18:15:48,495 - Epoch: [63][ 1000/ 4498]    Overall Loss 0.023152    Objective Loss 0.023152    MSE 0.023152    LR 0.000063    Time 0.035366    
-2020-12-09 18:15:56,576 - Epoch: [63][ 1250/ 4498]    Overall Loss 0.023162    Objective Loss 0.023162    MSE 0.023162    LR 0.000063    Time 0.034744    
-2020-12-09 18:16:04,660 - Epoch: [63][ 1500/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.034331    
-2020-12-09 18:16:12,735 - Epoch: [63][ 1750/ 4498]    Overall Loss 0.023186    Objective Loss 0.023186    MSE 0.023186    LR 0.000063    Time 0.034031    
-2020-12-09 18:16:20,804 - Epoch: [63][ 2000/ 4498]    Overall Loss 0.023180    Objective Loss 0.023180    MSE 0.023180    LR 0.000063    Time 0.033803    
-2020-12-09 18:16:28,878 - Epoch: [63][ 2250/ 4498]    Overall Loss 0.023188    Objective Loss 0.023188    MSE 0.023188    LR 0.000063    Time 0.033628    
-2020-12-09 18:16:36,954 - Epoch: [63][ 2500/ 4498]    Overall Loss 0.023194    Objective Loss 0.023194    MSE 0.023194    LR 0.000063    Time 0.033489    
-2020-12-09 18:16:45,033 - Epoch: [63][ 2750/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.033376    
-2020-12-09 18:16:53,109 - Epoch: [63][ 3000/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.033281    
-2020-12-09 18:17:01,201 - Epoch: [63][ 3250/ 4498]    Overall Loss 0.023200    Objective Loss 0.023200    MSE 0.023200    LR 0.000063    Time 0.033205    
-2020-12-09 18:17:09,278 - Epoch: [63][ 3500/ 4498]    Overall Loss 0.023209    Objective Loss 0.023209    MSE 0.023209    LR 0.000063    Time 0.033136    
-2020-12-09 18:17:17,354 - Epoch: [63][ 3750/ 4498]    Overall Loss 0.023208    Objective Loss 0.023208    MSE 0.023208    LR 0.000063    Time 0.033076    
-2020-12-09 18:17:25,427 - Epoch: [63][ 4000/ 4498]    Overall Loss 0.023213    Objective Loss 0.023213    MSE 0.023213    LR 0.000063    Time 0.033023    
-2020-12-09 18:17:33,504 - Epoch: [63][ 4250/ 4498]    Overall Loss 0.023210    Objective Loss 0.023210    MSE 0.023210    LR 0.000063    Time 0.032977    
-2020-12-09 18:17:41,549 - Epoch: [63][ 4498/ 4498]    Overall Loss 0.023201    Objective Loss 0.023201    MSE 0.023201    LR 0.000063    Time 0.032944    
-2020-12-09 18:17:42,384 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18014 |  0.00264 |    0.13592 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15654 | -0.01302 |    0.10639 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08473 | -0.00823 |    0.05796 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08766 | -0.01507 |    0.06466 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10172 | -0.00965 |    0.07381 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12109 | -0.01613 |    0.09168 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15515 | -0.02037 |    0.11233 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.26977 |  0.00005 |    0.21231 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:17:42,385 - Total sparsity: 0.00
-
-2020-12-09 18:17:42,388 - --- validate (epoch=63)-----------
-2020-12-09 18:17:42,388 - 49975 samples (100 per mini-batch)
-2020-12-09 18:17:47,779 - Epoch: [63][  250/  500]    Loss 0.024033    MSE 0.024033    
-2020-12-09 18:17:51,037 - Epoch: [63][  500/  500]    Loss 0.024064    MSE 0.024064    
-2020-12-09 18:17:51,785 - ==> MSE: 0.02406    Loss: 0.024
-
-2020-12-09 18:17:51,793 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:17:51,793 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:17:51,805 - 
-
-2020-12-09 18:17:51,805 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:18:02,907 - Epoch: [64][  250/ 4498]    Overall Loss 0.023233    Objective Loss 0.023233    MSE 0.023233    LR 0.000063    Time 0.044341    
-2020-12-09 18:18:10,941 - Epoch: [64][  500/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.038203    
-2020-12-09 18:18:18,969 - Epoch: [64][  750/ 4498]    Overall Loss 0.023166    Objective Loss 0.023166    MSE 0.023166    LR 0.000063    Time 0.036149    
-2020-12-09 18:18:26,986 - Epoch: [64][ 1000/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.035112    
-2020-12-09 18:18:34,999 - Epoch: [64][ 1250/ 4498]    Overall Loss 0.023139    Objective Loss 0.023139    MSE 0.023139    LR 0.000063    Time 0.034487    
-2020-12-09 18:18:43,019 - Epoch: [64][ 1500/ 4498]    Overall Loss 0.023136    Objective Loss 0.023136    MSE 0.023136    LR 0.000063    Time 0.034074    
-2020-12-09 18:18:51,048 - Epoch: [64][ 1750/ 4498]    Overall Loss 0.023150    Objective Loss 0.023150    MSE 0.023150    LR 0.000063    Time 0.033784    
-2020-12-09 18:18:59,076 - Epoch: [64][ 2000/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.033567    
-2020-12-09 18:19:07,105 - Epoch: [64][ 2250/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.033398    
-2020-12-09 18:19:15,133 - Epoch: [64][ 2500/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033263    
-2020-12-09 18:19:23,159 - Epoch: [64][ 2750/ 4498]    Overall Loss 0.023170    Objective Loss 0.023170    MSE 0.023170    LR 0.000063    Time 0.033151    
-2020-12-09 18:19:31,185 - Epoch: [64][ 3000/ 4498]    Overall Loss 0.023176    Objective Loss 0.023176    MSE 0.023176    LR 0.000063    Time 0.033058    
-2020-12-09 18:19:39,215 - Epoch: [64][ 3250/ 4498]    Overall Loss 0.023176    Objective Loss 0.023176    MSE 0.023176    LR 0.000063    Time 0.032981    
-2020-12-09 18:19:47,229 - Epoch: [64][ 3500/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.032910    
-2020-12-09 18:19:55,247 - Epoch: [64][ 3750/ 4498]    Overall Loss 0.023187    Objective Loss 0.023187    MSE 0.023187    LR 0.000063    Time 0.032849    
-2020-12-09 18:20:03,270 - Epoch: [64][ 4000/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.032798    
-2020-12-09 18:20:11,280 - Epoch: [64][ 4250/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.032749    
-2020-12-09 18:20:19,253 - Epoch: [64][ 4498/ 4498]    Overall Loss 0.023193    Objective Loss 0.023193    MSE 0.023193    LR 0.000063    Time 0.032713    
-2020-12-09 18:20:20,056 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18025 |  0.00269 |    0.13599 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15658 | -0.01291 |    0.10639 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08468 | -0.00823 |    0.05791 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08761 | -0.01507 |    0.06463 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10169 | -0.00963 |    0.07378 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12106 | -0.01612 |    0.09166 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02032 |    0.11231 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27009 |  0.00006 |    0.21256 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:20:20,057 - Total sparsity: 0.00
-
-2020-12-09 18:20:20,060 - --- validate (epoch=64)-----------
-2020-12-09 18:20:20,060 - 49975 samples (100 per mini-batch)
-2020-12-09 18:20:25,416 - Epoch: [64][  250/  500]    Loss 0.024282    MSE 0.024282    
-2020-12-09 18:20:28,852 - Epoch: [64][  500/  500]    Loss 0.024230    MSE 0.024230    
-2020-12-09 18:20:29,569 - ==> MSE: 0.02423    Loss: 0.024
-
-2020-12-09 18:20:29,577 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:20:29,577 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:20:29,582 - 
-
-2020-12-09 18:20:29,582 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:20:40,609 - Epoch: [65][  250/ 4498]    Overall Loss 0.023130    Objective Loss 0.023130    MSE 0.023130    LR 0.000063    Time 0.044038    
-2020-12-09 18:20:48,687 - Epoch: [65][  500/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.038141    
-2020-12-09 18:20:56,731 - Epoch: [65][  750/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.036130    
-2020-12-09 18:21:04,739 - Epoch: [65][ 1000/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.035088    
-2020-12-09 18:21:12,807 - Epoch: [65][ 1250/ 4498]    Overall Loss 0.023163    Objective Loss 0.023163    MSE 0.023163    LR 0.000063    Time 0.034511    
-2020-12-09 18:21:20,882 - Epoch: [65][ 1500/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.034131    
-2020-12-09 18:21:28,957 - Epoch: [65][ 1750/ 4498]    Overall Loss 0.023169    Objective Loss 0.023169    MSE 0.023169    LR 0.000063    Time 0.033860    
-2020-12-09 18:21:37,026 - Epoch: [65][ 2000/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.033654    
-2020-12-09 18:21:45,105 - Epoch: [65][ 2250/ 4498]    Overall Loss 0.023189    Objective Loss 0.023189    MSE 0.023189    LR 0.000063    Time 0.033497    
-2020-12-09 18:21:53,173 - Epoch: [65][ 2500/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.033368    
-2020-12-09 18:22:01,259 - Epoch: [65][ 2750/ 4498]    Overall Loss 0.023201    Objective Loss 0.023201    MSE 0.023201    LR 0.000063    Time 0.033269    
-2020-12-09 18:22:09,343 - Epoch: [65][ 3000/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.033185    
-2020-12-09 18:22:17,436 - Epoch: [65][ 3250/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.033117    
-2020-12-09 18:22:25,515 - Epoch: [65][ 3500/ 4498]    Overall Loss 0.023195    Objective Loss 0.023195    MSE 0.023195    LR 0.000063    Time 0.033055    
-2020-12-09 18:22:33,596 - Epoch: [65][ 3750/ 4498]    Overall Loss 0.023200    Objective Loss 0.023200    MSE 0.023200    LR 0.000063    Time 0.033002    
-2020-12-09 18:22:41,673 - Epoch: [65][ 4000/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.032954    
-2020-12-09 18:22:49,752 - Epoch: [65][ 4250/ 4498]    Overall Loss 0.023192    Objective Loss 0.023192    MSE 0.023192    LR 0.000063    Time 0.032913    
-2020-12-09 18:22:57,798 - Epoch: [65][ 4498/ 4498]    Overall Loss 0.023197    Objective Loss 0.023197    MSE 0.023197    LR 0.000063    Time 0.032884    
-2020-12-09 18:22:58,641 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18028 |  0.00278 |    0.13602 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15660 | -0.01293 |    0.10641 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08462 | -0.00821 |    0.05786 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08757 | -0.01503 |    0.06459 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10166 | -0.00960 |    0.07375 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12104 | -0.01610 |    0.09164 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15515 | -0.02031 |    0.11230 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27039 |  0.00006 |    0.21280 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:22:58,641 - Total sparsity: 0.00
-
-2020-12-09 18:22:58,644 - --- validate (epoch=65)-----------
-2020-12-09 18:22:58,644 - 49975 samples (100 per mini-batch)
-2020-12-09 18:23:04,220 - Epoch: [65][  250/  500]    Loss 0.024216    MSE 0.024216    
-2020-12-09 18:23:07,649 - Epoch: [65][  500/  500]    Loss 0.024148    MSE 0.024147    
-2020-12-09 18:23:08,347 - ==> MSE: 0.02415    Loss: 0.024
-
-2020-12-09 18:23:08,355 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:23:08,355 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:23:08,360 - 
-
-2020-12-09 18:23:08,360 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:23:19,577 - Epoch: [66][  250/ 4498]    Overall Loss 0.023204    Objective Loss 0.023204    MSE 0.023204    LR 0.000063    Time 0.044800    
-2020-12-09 18:23:27,656 - Epoch: [66][  500/ 4498]    Overall Loss 0.023198    Objective Loss 0.023198    MSE 0.023198    LR 0.000063    Time 0.038524    
-2020-12-09 18:23:35,729 - Epoch: [66][  750/ 4498]    Overall Loss 0.023187    Objective Loss 0.023187    MSE 0.023187    LR 0.000063    Time 0.036424    
-2020-12-09 18:23:43,795 - Epoch: [66][ 1000/ 4498]    Overall Loss 0.023194    Objective Loss 0.023194    MSE 0.023194    LR 0.000063    Time 0.035367    
-2020-12-09 18:23:51,857 - Epoch: [66][ 1250/ 4498]    Overall Loss 0.023186    Objective Loss 0.023186    MSE 0.023186    LR 0.000063    Time 0.034729    
-2020-12-09 18:23:59,923 - Epoch: [66][ 1500/ 4498]    Overall Loss 0.023186    Objective Loss 0.023186    MSE 0.023186    LR 0.000063    Time 0.034307    
-2020-12-09 18:24:07,998 - Epoch: [66][ 1750/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.034010    
-2020-12-09 18:24:16,073 - Epoch: [66][ 2000/ 4498]    Overall Loss 0.023186    Objective Loss 0.023186    MSE 0.023186    LR 0.000063    Time 0.033788    
-2020-12-09 18:24:24,149 - Epoch: [66][ 2250/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.033616    
-2020-12-09 18:24:32,219 - Epoch: [66][ 2500/ 4498]    Overall Loss 0.023177    Objective Loss 0.023177    MSE 0.023177    LR 0.000063    Time 0.033475    
-2020-12-09 18:24:40,289 - Epoch: [66][ 2750/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.033360    
-2020-12-09 18:24:48,364 - Epoch: [66][ 3000/ 4498]    Overall Loss 0.023188    Objective Loss 0.023188    MSE 0.023188    LR 0.000063    Time 0.033266    
-2020-12-09 18:24:56,440 - Epoch: [66][ 3250/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.033187    
-2020-12-09 18:25:04,518 - Epoch: [66][ 3500/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.033119    
-2020-12-09 18:25:12,594 - Epoch: [66][ 3750/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.033061    
-2020-12-09 18:25:20,669 - Epoch: [66][ 4000/ 4498]    Overall Loss 0.023196    Objective Loss 0.023196    MSE 0.023196    LR 0.000063    Time 0.033009    
-2020-12-09 18:25:28,740 - Epoch: [66][ 4250/ 4498]    Overall Loss 0.023200    Objective Loss 0.023200    MSE 0.023200    LR 0.000063    Time 0.032962    
-2020-12-09 18:25:36,777 - Epoch: [66][ 4498/ 4498]    Overall Loss 0.023196    Objective Loss 0.023196    MSE 0.023196    LR 0.000063    Time 0.032929    
-2020-12-09 18:25:37,607 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18033 |  0.00282 |    0.13607 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15663 | -0.01292 |    0.10643 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08456 | -0.00820 |    0.05779 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08754 | -0.01501 |    0.06456 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10163 | -0.00961 |    0.07373 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12101 | -0.01609 |    0.09162 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02031 |    0.11230 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27070 |  0.00006 |    0.21304 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:25:37,608 - Total sparsity: 0.00
-
-2020-12-09 18:25:37,611 - --- validate (epoch=66)-----------
-2020-12-09 18:25:37,611 - 49975 samples (100 per mini-batch)
-2020-12-09 18:25:43,136 - Epoch: [66][  250/  500]    Loss 0.024074    MSE 0.024074    
-2020-12-09 18:25:46,441 - Epoch: [66][  500/  500]    Loss 0.024098    MSE 0.024097    
-2020-12-09 18:25:47,170 - ==> MSE: 0.02410    Loss: 0.024
-
-2020-12-09 18:25:47,179 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:25:47,179 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:25:47,184 - 
-
-2020-12-09 18:25:47,184 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:25:58,397 - Epoch: [67][  250/ 4498]    Overall Loss 0.023220    Objective Loss 0.023220    MSE 0.023220    LR 0.000063    Time 0.044786    
-2020-12-09 18:26:06,472 - Epoch: [67][  500/ 4498]    Overall Loss 0.023187    Objective Loss 0.023187    MSE 0.023187    LR 0.000063    Time 0.038507    
-2020-12-09 18:26:14,512 - Epoch: [67][  750/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.036369    
-2020-12-09 18:26:22,535 - Epoch: [67][ 1000/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.035282    
-2020-12-09 18:26:30,554 - Epoch: [67][ 1250/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.034627    
-2020-12-09 18:26:38,580 - Epoch: [67][ 1500/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.034195    
-2020-12-09 18:26:46,609 - Epoch: [67][ 1750/ 4498]    Overall Loss 0.023164    Objective Loss 0.023164    MSE 0.023164    LR 0.000063    Time 0.033889    
-2020-12-09 18:26:54,636 - Epoch: [67][ 2000/ 4498]    Overall Loss 0.023152    Objective Loss 0.023152    MSE 0.023152    LR 0.000063    Time 0.033657    
-2020-12-09 18:27:02,665 - Epoch: [67][ 2250/ 4498]    Overall Loss 0.023152    Objective Loss 0.023152    MSE 0.023152    LR 0.000063    Time 0.033478    
-2020-12-09 18:27:10,691 - Epoch: [67][ 2500/ 4498]    Overall Loss 0.023155    Objective Loss 0.023155    MSE 0.023155    LR 0.000063    Time 0.033334    
-2020-12-09 18:27:18,725 - Epoch: [67][ 2750/ 4498]    Overall Loss 0.023160    Objective Loss 0.023160    MSE 0.023160    LR 0.000063    Time 0.033219    
-2020-12-09 18:27:26,761 - Epoch: [67][ 3000/ 4498]    Overall Loss 0.023159    Objective Loss 0.023159    MSE 0.023159    LR 0.000063    Time 0.033124    
-2020-12-09 18:27:34,798 - Epoch: [67][ 3250/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.033043    
-2020-12-09 18:27:42,826 - Epoch: [67][ 3500/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.032972    
-2020-12-09 18:27:50,861 - Epoch: [67][ 3750/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.032912    
-2020-12-09 18:27:58,884 - Epoch: [67][ 4000/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.032856    
-2020-12-09 18:28:06,908 - Epoch: [67][ 4250/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.032807    
-2020-12-09 18:28:14,899 - Epoch: [67][ 4498/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.032772    
-2020-12-09 18:28:15,734 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18040 |  0.00283 |    0.13612 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15665 | -0.01289 |    0.10644 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08449 | -0.00818 |    0.05772 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08750 | -0.01500 |    0.06453 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10158 | -0.00956 |    0.07369 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12098 | -0.01606 |    0.09159 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02031 |    0.11229 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27100 |  0.00005 |    0.21328 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:28:15,735 - Total sparsity: 0.00
-
-2020-12-09 18:28:15,738 - --- validate (epoch=67)-----------
-2020-12-09 18:28:15,738 - 49975 samples (100 per mini-batch)
-2020-12-09 18:28:21,176 - Epoch: [67][  250/  500]    Loss 0.024104    MSE 0.024104    
-2020-12-09 18:28:24,495 - Epoch: [67][  500/  500]    Loss 0.024070    MSE 0.024071    
-2020-12-09 18:28:25,236 - ==> MSE: 0.02407    Loss: 0.024
-
-2020-12-09 18:28:25,245 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:28:25,245 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:28:25,250 - 
-
-2020-12-09 18:28:25,250 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:28:36,489 - Epoch: [68][  250/ 4498]    Overall Loss 0.023133    Objective Loss 0.023133    MSE 0.023133    LR 0.000063    Time 0.044890    
-2020-12-09 18:28:44,580 - Epoch: [68][  500/ 4498]    Overall Loss 0.023120    Objective Loss 0.023120    MSE 0.023120    LR 0.000063    Time 0.038592    
-2020-12-09 18:28:52,668 - Epoch: [68][  750/ 4498]    Overall Loss 0.023113    Objective Loss 0.023113    MSE 0.023113    LR 0.000063    Time 0.036489    
-2020-12-09 18:29:00,745 - Epoch: [68][ 1000/ 4498]    Overall Loss 0.023114    Objective Loss 0.023114    MSE 0.023114    LR 0.000063    Time 0.035427    
-2020-12-09 18:29:08,827 - Epoch: [68][ 1250/ 4498]    Overall Loss 0.023138    Objective Loss 0.023138    MSE 0.023138    LR 0.000063    Time 0.034793    
-2020-12-09 18:29:16,898 - Epoch: [68][ 1500/ 4498]    Overall Loss 0.023159    Objective Loss 0.023159    MSE 0.023159    LR 0.000063    Time 0.034363    
-2020-12-09 18:29:24,969 - Epoch: [68][ 1750/ 4498]    Overall Loss 0.023177    Objective Loss 0.023177    MSE 0.023177    LR 0.000063    Time 0.034057    
-2020-12-09 18:29:33,039 - Epoch: [68][ 2000/ 4498]    Overall Loss 0.023189    Objective Loss 0.023189    MSE 0.023189    LR 0.000063    Time 0.033826    
-2020-12-09 18:29:41,109 - Epoch: [68][ 2250/ 4498]    Overall Loss 0.023187    Objective Loss 0.023187    MSE 0.023187    LR 0.000063    Time 0.033647    
-2020-12-09 18:29:49,183 - Epoch: [68][ 2500/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033505    
-2020-12-09 18:29:57,253 - Epoch: [68][ 2750/ 4498]    Overall Loss 0.023172    Objective Loss 0.023172    MSE 0.023172    LR 0.000063    Time 0.033387    
-2020-12-09 18:30:05,333 - Epoch: [68][ 3000/ 4498]    Overall Loss 0.023173    Objective Loss 0.023173    MSE 0.023173    LR 0.000063    Time 0.033292    
-2020-12-09 18:30:13,409 - Epoch: [68][ 3250/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.033211    
-2020-12-09 18:30:21,474 - Epoch: [68][ 3500/ 4498]    Overall Loss 0.023189    Objective Loss 0.023189    MSE 0.023189    LR 0.000063    Time 0.033138    
-2020-12-09 18:30:29,536 - Epoch: [68][ 3750/ 4498]    Overall Loss 0.023194    Objective Loss 0.023194    MSE 0.023194    LR 0.000063    Time 0.033074    
-2020-12-09 18:30:37,595 - Epoch: [68][ 4000/ 4498]    Overall Loss 0.023187    Objective Loss 0.023187    MSE 0.023187    LR 0.000063    Time 0.033018    
-2020-12-09 18:30:45,652 - Epoch: [68][ 4250/ 4498]    Overall Loss 0.023189    Objective Loss 0.023189    MSE 0.023189    LR 0.000063    Time 0.032967    
-2020-12-09 18:30:53,679 - Epoch: [68][ 4498/ 4498]    Overall Loss 0.023189    Objective Loss 0.023189    MSE 0.023189    LR 0.000063    Time 0.032931    
-2020-12-09 18:30:54,499 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18045 |  0.00281 |    0.13618 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15668 | -0.01284 |    0.10647 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08446 | -0.00821 |    0.05768 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08746 | -0.01498 |    0.06450 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10155 | -0.00957 |    0.07366 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12096 | -0.01606 |    0.09157 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02030 |    0.11228 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27130 |  0.00007 |    0.21351 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:30:54,499 - Total sparsity: 0.00
-
-2020-12-09 18:30:54,502 - --- validate (epoch=68)-----------
-2020-12-09 18:30:54,502 - 49975 samples (100 per mini-batch)
-2020-12-09 18:31:00,202 - Epoch: [68][  250/  500]    Loss 0.024123    MSE 0.024123    
-2020-12-09 18:31:03,478 - Epoch: [68][  500/  500]    Loss 0.024178    MSE 0.024178    
-2020-12-09 18:31:04,211 - ==> MSE: 0.02418    Loss: 0.024
-
-2020-12-09 18:31:04,220 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:31:04,220 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:31:04,225 - 
-
-2020-12-09 18:31:04,225 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:31:15,385 - Epoch: [69][  250/ 4498]    Overall Loss 0.023112    Objective Loss 0.023112    MSE 0.023112    LR 0.000063    Time 0.044572    
-2020-12-09 18:31:23,444 - Epoch: [69][  500/ 4498]    Overall Loss 0.023130    Objective Loss 0.023130    MSE 0.023130    LR 0.000063    Time 0.038368    
-2020-12-09 18:31:31,501 - Epoch: [69][  750/ 4498]    Overall Loss 0.023158    Objective Loss 0.023158    MSE 0.023158    LR 0.000063    Time 0.036298    
-2020-12-09 18:31:39,542 - Epoch: [69][ 1000/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.035248    
-2020-12-09 18:31:47,578 - Epoch: [69][ 1250/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.034613    
-2020-12-09 18:31:55,616 - Epoch: [69][ 1500/ 4498]    Overall Loss 0.023188    Objective Loss 0.023188    MSE 0.023188    LR 0.000063    Time 0.034192    
-2020-12-09 18:32:03,658 - Epoch: [69][ 1750/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.033893    
-2020-12-09 18:32:11,701 - Epoch: [69][ 2000/ 4498]    Overall Loss 0.023182    Objective Loss 0.023182    MSE 0.023182    LR 0.000063    Time 0.033669    
-2020-12-09 18:32:19,739 - Epoch: [69][ 2250/ 4498]    Overall Loss 0.023175    Objective Loss 0.023175    MSE 0.023175    LR 0.000063    Time 0.033493    
-2020-12-09 18:32:27,777 - Epoch: [69][ 2500/ 4498]    Overall Loss 0.023175    Objective Loss 0.023175    MSE 0.023175    LR 0.000063    Time 0.033352    
-2020-12-09 18:32:35,811 - Epoch: [69][ 2750/ 4498]    Overall Loss 0.023179    Objective Loss 0.023179    MSE 0.023179    LR 0.000063    Time 0.033235    
-2020-12-09 18:32:43,849 - Epoch: [69][ 3000/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.033139    
-2020-12-09 18:32:51,887 - Epoch: [69][ 3250/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.033058    
-2020-12-09 18:32:59,919 - Epoch: [69][ 3500/ 4498]    Overall Loss 0.023186    Objective Loss 0.023186    MSE 0.023186    LR 0.000063    Time 0.032987    
-2020-12-09 18:33:07,946 - Epoch: [69][ 3750/ 4498]    Overall Loss 0.023187    Objective Loss 0.023187    MSE 0.023187    LR 0.000063    Time 0.032923    
-2020-12-09 18:33:15,978 - Epoch: [69][ 4000/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.032869    
-2020-12-09 18:33:24,014 - Epoch: [69][ 4250/ 4498]    Overall Loss 0.023185    Objective Loss 0.023185    MSE 0.023185    LR 0.000063    Time 0.032823    
-2020-12-09 18:33:32,028 - Epoch: [69][ 4498/ 4498]    Overall Loss 0.023190    Objective Loss 0.023190    MSE 0.023190    LR 0.000063    Time 0.032792    
-2020-12-09 18:33:32,806 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18057 |  0.00270 |    0.13625 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15673 | -0.01291 |    0.10650 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08441 | -0.00819 |    0.05763 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08742 | -0.01496 |    0.06447 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10153 | -0.00957 |    0.07363 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12093 | -0.01602 |    0.09154 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02029 |    0.11227 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27157 |  0.00006 |    0.21373 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:33:32,806 - Total sparsity: 0.00
-
-2020-12-09 18:33:32,809 - --- validate (epoch=69)-----------
-2020-12-09 18:33:32,809 - 49975 samples (100 per mini-batch)
-2020-12-09 18:33:38,331 - Epoch: [69][  250/  500]    Loss 0.024043    MSE 0.024043    
-2020-12-09 18:33:41,580 - Epoch: [69][  500/  500]    Loss 0.024110    MSE 0.024110    
-2020-12-09 18:33:42,325 - ==> MSE: 0.02411    Loss: 0.024
-
-2020-12-09 18:33:42,334 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:33:42,334 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:33:42,339 - 
-
-2020-12-09 18:33:42,339 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:33:53,522 - Epoch: [70][  250/ 4498]    Overall Loss 0.023129    Objective Loss 0.023129    MSE 0.023129    LR 0.000063    Time 0.044665    
-2020-12-09 18:34:01,604 - Epoch: [70][  500/ 4498]    Overall Loss 0.023172    Objective Loss 0.023172    MSE 0.023172    LR 0.000063    Time 0.038461    
-2020-12-09 18:34:09,676 - Epoch: [70][  750/ 4498]    Overall Loss 0.023140    Objective Loss 0.023140    MSE 0.023140    LR 0.000063    Time 0.036381    
-2020-12-09 18:34:17,745 - Epoch: [70][ 1000/ 4498]    Overall Loss 0.023153    Objective Loss 0.023153    MSE 0.023153    LR 0.000063    Time 0.035337    
-2020-12-09 18:34:25,810 - Epoch: [70][ 1250/ 4498]    Overall Loss 0.023138    Objective Loss 0.023138    MSE 0.023138    LR 0.000063    Time 0.034708    
-2020-12-09 18:34:33,877 - Epoch: [70][ 1500/ 4498]    Overall Loss 0.023153    Objective Loss 0.023153    MSE 0.023153    LR 0.000063    Time 0.034290    
-2020-12-09 18:34:41,947 - Epoch: [70][ 1750/ 4498]    Overall Loss 0.023158    Objective Loss 0.023158    MSE 0.023158    LR 0.000063    Time 0.033993    
-2020-12-09 18:34:50,008 - Epoch: [70][ 2000/ 4498]    Overall Loss 0.023165    Objective Loss 0.023165    MSE 0.023165    LR 0.000063    Time 0.033766    
-2020-12-09 18:34:58,062 - Epoch: [70][ 2250/ 4498]    Overall Loss 0.023156    Objective Loss 0.023156    MSE 0.023156    LR 0.000063    Time 0.033586    
-2020-12-09 18:35:06,092 - Epoch: [70][ 2500/ 4498]    Overall Loss 0.023165    Objective Loss 0.023165    MSE 0.023165    LR 0.000063    Time 0.033433    
-2020-12-09 18:35:14,119 - Epoch: [70][ 2750/ 4498]    Overall Loss 0.023166    Objective Loss 0.023166    MSE 0.023166    LR 0.000063    Time 0.033306    
-2020-12-09 18:35:22,139 - Epoch: [70][ 3000/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033198    
-2020-12-09 18:35:30,166 - Epoch: [70][ 3250/ 4498]    Overall Loss 0.023173    Objective Loss 0.023173    MSE 0.023173    LR 0.000063    Time 0.033109    
-2020-12-09 18:35:38,182 - Epoch: [70][ 3500/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033029    
-2020-12-09 18:35:46,204 - Epoch: [70][ 3750/ 4498]    Overall Loss 0.023174    Objective Loss 0.023174    MSE 0.023173    LR 0.000063    Time 0.032962    
-2020-12-09 18:35:54,230 - Epoch: [70][ 4000/ 4498]    Overall Loss 0.023175    Objective Loss 0.023175    MSE 0.023174    LR 0.000063    Time 0.032904    
-2020-12-09 18:36:02,266 - Epoch: [70][ 4250/ 4498]    Overall Loss 0.023180    Objective Loss 0.023180    MSE 0.023180    LR 0.000063    Time 0.032855    
-2020-12-09 18:36:10,258 - Epoch: [70][ 4498/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.032818    
-2020-12-09 18:36:11,075 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18058 |  0.00277 |    0.13628 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15676 | -0.01294 |    0.10652 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08436 | -0.00817 |    0.05757 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08740 | -0.01494 |    0.06444 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10149 | -0.00957 |    0.07361 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12090 | -0.01600 |    0.09153 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02027 |    0.11227 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27185 |  0.00006 |    0.21395 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:36:11,075 - Total sparsity: 0.00
-
-2020-12-09 18:36:11,078 - --- validate (epoch=70)-----------
-2020-12-09 18:36:11,078 - 49975 samples (100 per mini-batch)
-2020-12-09 18:36:16,381 - Epoch: [70][  250/  500]    Loss 0.024072    MSE 0.024072    
-2020-12-09 18:36:19,708 - Epoch: [70][  500/  500]    Loss 0.024095    MSE 0.024096    
-2020-12-09 18:36:20,435 - ==> MSE: 0.02410    Loss: 0.024
-
-2020-12-09 18:36:20,444 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 63]
-2020-12-09 18:36:20,444 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:36:20,449 - 
-
-2020-12-09 18:36:20,449 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:36:31,554 - Epoch: [71][  250/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000063    Time 0.044352    
-2020-12-09 18:36:39,606 - Epoch: [71][  500/ 4498]    Overall Loss 0.023079    Objective Loss 0.023079    MSE 0.023079    LR 0.000063    Time 0.038246    
-2020-12-09 18:36:47,665 - Epoch: [71][  750/ 4498]    Overall Loss 0.023044    Objective Loss 0.023044    MSE 0.023044    LR 0.000063    Time 0.036219    
-2020-12-09 18:36:55,711 - Epoch: [71][ 1000/ 4498]    Overall Loss 0.023073    Objective Loss 0.023073    MSE 0.023073    LR 0.000063    Time 0.035194    
-2020-12-09 18:37:03,735 - Epoch: [71][ 1250/ 4498]    Overall Loss 0.023077    Objective Loss 0.023077    MSE 0.023077    LR 0.000063    Time 0.034560    
-2020-12-09 18:37:11,762 - Epoch: [71][ 1500/ 4498]    Overall Loss 0.023118    Objective Loss 0.023118    MSE 0.023118    LR 0.000063    Time 0.034140    
-2020-12-09 18:37:19,771 - Epoch: [71][ 1750/ 4498]    Overall Loss 0.023113    Objective Loss 0.023113    MSE 0.023113    LR 0.000063    Time 0.033830    
-2020-12-09 18:37:27,787 - Epoch: [71][ 2000/ 4498]    Overall Loss 0.023126    Objective Loss 0.023126    MSE 0.023126    LR 0.000063    Time 0.033600    
-2020-12-09 18:37:35,817 - Epoch: [71][ 2250/ 4498]    Overall Loss 0.023135    Objective Loss 0.023135    MSE 0.023135    LR 0.000063    Time 0.033428    
-2020-12-09 18:37:43,847 - Epoch: [71][ 2500/ 4498]    Overall Loss 0.023145    Objective Loss 0.023145    MSE 0.023145    LR 0.000063    Time 0.033291    
-2020-12-09 18:37:51,881 - Epoch: [71][ 2750/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.033179    
-2020-12-09 18:37:59,912 - Epoch: [71][ 3000/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.033086    
-2020-12-09 18:38:07,943 - Epoch: [71][ 3250/ 4498]    Overall Loss 0.023174    Objective Loss 0.023174    MSE 0.023174    LR 0.000063    Time 0.033007    
-2020-12-09 18:38:15,968 - Epoch: [71][ 3500/ 4498]    Overall Loss 0.023180    Objective Loss 0.023180    MSE 0.023180    LR 0.000063    Time 0.032937    
-2020-12-09 18:38:23,996 - Epoch: [71][ 3750/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.032877    
-2020-12-09 18:38:32,029 - Epoch: [71][ 4000/ 4498]    Overall Loss 0.023181    Objective Loss 0.023181    MSE 0.023181    LR 0.000063    Time 0.032826    
-2020-12-09 18:38:40,067 - Epoch: [71][ 4250/ 4498]    Overall Loss 0.023184    Objective Loss 0.023184    MSE 0.023184    LR 0.000063    Time 0.032783    
-2020-12-09 18:38:48,074 - Epoch: [71][ 4498/ 4498]    Overall Loss 0.023183    Objective Loss 0.023183    MSE 0.023183    LR 0.000063    Time 0.032753    
-2020-12-09 18:38:48,907 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18076 |  0.00267 |    0.13642 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15680 | -0.01290 |    0.10654 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08431 | -0.00818 |    0.05753 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08737 | -0.01492 |    0.06441 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10145 | -0.00955 |    0.07357 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12086 | -0.01600 |    0.09150 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02029 |    0.11225 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27213 |  0.00006 |    0.21417 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:38:48,907 - Total sparsity: 0.00
-
-2020-12-09 18:38:48,910 - --- validate (epoch=71)-----------
-2020-12-09 18:38:48,910 - 49975 samples (100 per mini-batch)
-2020-12-09 18:38:54,385 - Epoch: [71][  250/  500]    Loss 0.024105    MSE 0.024105    
-2020-12-09 18:38:57,695 - Epoch: [71][  500/  500]    Loss 0.024061    MSE 0.024060    
-2020-12-09 18:38:58,383 - ==> MSE: 0.02406    Loss: 0.024
-
-2020-12-09 18:38:58,391 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 71]
-2020-12-09 18:38:58,392 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:38:58,404 - 
-
-2020-12-09 18:38:58,404 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:39:09,453 - Epoch: [72][  250/ 4498]    Overall Loss 0.023001    Objective Loss 0.023001    MSE 0.023001    LR 0.000063    Time 0.044127    
-2020-12-09 18:39:17,471 - Epoch: [72][  500/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000063    Time 0.038065    
-2020-12-09 18:39:25,471 - Epoch: [72][  750/ 4498]    Overall Loss 0.023090    Objective Loss 0.023090    MSE 0.023090    LR 0.000063    Time 0.036020    
-2020-12-09 18:39:33,453 - Epoch: [72][ 1000/ 4498]    Overall Loss 0.023146    Objective Loss 0.023146    MSE 0.023147    LR 0.000063    Time 0.034980    
-2020-12-09 18:39:41,422 - Epoch: [72][ 1250/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.034345    
-2020-12-09 18:39:49,402 - Epoch: [72][ 1500/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.033929    
-2020-12-09 18:39:57,375 - Epoch: [72][ 1750/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033629    
-2020-12-09 18:40:05,348 - Epoch: [72][ 2000/ 4498]    Overall Loss 0.023149    Objective Loss 0.023149    MSE 0.023149    LR 0.000063    Time 0.033403    
-2020-12-09 18:40:13,316 - Epoch: [72][ 2250/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.033225    
-2020-12-09 18:40:21,287 - Epoch: [72][ 2500/ 4498]    Overall Loss 0.023162    Objective Loss 0.023162    MSE 0.023162    LR 0.000063    Time 0.033084    
-2020-12-09 18:40:29,263 - Epoch: [72][ 2750/ 4498]    Overall Loss 0.023160    Objective Loss 0.023160    MSE 0.023160    LR 0.000063    Time 0.032970    
-2020-12-09 18:40:37,228 - Epoch: [72][ 3000/ 4498]    Overall Loss 0.023155    Objective Loss 0.023155    MSE 0.023155    LR 0.000063    Time 0.032872    
-2020-12-09 18:40:45,226 - Epoch: [72][ 3250/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.032799    
-2020-12-09 18:40:53,230 - Epoch: [72][ 3500/ 4498]    Overall Loss 0.023155    Objective Loss 0.023155    MSE 0.023155    LR 0.000063    Time 0.032738    
-2020-12-09 18:41:01,231 - Epoch: [72][ 3750/ 4498]    Overall Loss 0.023164    Objective Loss 0.023164    MSE 0.023164    LR 0.000063    Time 0.032685    
-2020-12-09 18:41:09,225 - Epoch: [72][ 4000/ 4498]    Overall Loss 0.023170    Objective Loss 0.023170    MSE 0.023170    LR 0.000063    Time 0.032636    
-2020-12-09 18:41:17,210 - Epoch: [72][ 4250/ 4498]    Overall Loss 0.023172    Objective Loss 0.023172    MSE 0.023172    LR 0.000063    Time 0.032591    
-2020-12-09 18:41:25,164 - Epoch: [72][ 4498/ 4498]    Overall Loss 0.023176    Objective Loss 0.023176    MSE 0.023176    LR 0.000063    Time 0.032560    
-2020-12-09 18:41:25,989 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18076 |  0.00274 |    0.13642 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15683 | -0.01284 |    0.10655 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08425 | -0.00816 |    0.05747 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08735 | -0.01494 |    0.06440 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10141 | -0.00954 |    0.07355 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12083 | -0.01599 |    0.09147 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02027 |    0.11224 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27240 |  0.00008 |    0.21438 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:41:25,989 - Total sparsity: 0.00
-
-2020-12-09 18:41:25,992 - --- validate (epoch=72)-----------
-2020-12-09 18:41:25,992 - 49975 samples (100 per mini-batch)
-2020-12-09 18:41:31,387 - Epoch: [72][  250/  500]    Loss 0.024090    MSE 0.024090    
-2020-12-09 18:41:34,627 - Epoch: [72][  500/  500]    Loss 0.024185    MSE 0.024186    
-2020-12-09 18:41:35,328 - ==> MSE: 0.02419    Loss: 0.024
-
-2020-12-09 18:41:35,337 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 71]
-2020-12-09 18:41:35,337 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:41:35,342 - 
-
-2020-12-09 18:41:35,342 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:41:46,479 - Epoch: [73][  250/ 4498]    Overall Loss 0.023156    Objective Loss 0.023156    MSE 0.023156    LR 0.000063    Time 0.044480    
-2020-12-09 18:41:54,608 - Epoch: [73][  500/ 4498]    Overall Loss 0.023123    Objective Loss 0.023123    MSE 0.023123    LR 0.000063    Time 0.038463    
-2020-12-09 18:42:02,720 - Epoch: [73][  750/ 4498]    Overall Loss 0.023130    Objective Loss 0.023130    MSE 0.023130    LR 0.000063    Time 0.036435    
-2020-12-09 18:42:10,816 - Epoch: [73][ 1000/ 4498]    Overall Loss 0.023131    Objective Loss 0.023131    MSE 0.023131    LR 0.000063    Time 0.035405    
-2020-12-09 18:42:18,914 - Epoch: [73][ 1250/ 4498]    Overall Loss 0.023136    Objective Loss 0.023136    MSE 0.023136    LR 0.000063    Time 0.034789    
-2020-12-09 18:42:27,014 - Epoch: [73][ 1500/ 4498]    Overall Loss 0.023137    Objective Loss 0.023137    MSE 0.023137    LR 0.000063    Time 0.034379    
-2020-12-09 18:42:35,108 - Epoch: [73][ 1750/ 4498]    Overall Loss 0.023148    Objective Loss 0.023148    MSE 0.023148    LR 0.000063    Time 0.034083    
-2020-12-09 18:42:43,204 - Epoch: [73][ 2000/ 4498]    Overall Loss 0.023148    Objective Loss 0.023148    MSE 0.023148    LR 0.000063    Time 0.033862    
-2020-12-09 18:42:51,300 - Epoch: [73][ 2250/ 4498]    Overall Loss 0.023149    Objective Loss 0.023149    MSE 0.023149    LR 0.000063    Time 0.033690    
-2020-12-09 18:42:59,399 - Epoch: [73][ 2500/ 4498]    Overall Loss 0.023156    Objective Loss 0.023156    MSE 0.023156    LR 0.000063    Time 0.033554    
-2020-12-09 18:43:07,500 - Epoch: [73][ 2750/ 4498]    Overall Loss 0.023153    Objective Loss 0.023153    MSE 0.023153    LR 0.000063    Time 0.033443    
-2020-12-09 18:43:15,605 - Epoch: [73][ 3000/ 4498]    Overall Loss 0.023163    Objective Loss 0.023163    MSE 0.023163    LR 0.000063    Time 0.033352    
-2020-12-09 18:43:23,708 - Epoch: [73][ 3250/ 4498]    Overall Loss 0.023170    Objective Loss 0.023170    MSE 0.023170    LR 0.000063    Time 0.033275    
-2020-12-09 18:43:31,808 - Epoch: [73][ 3500/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.033207    
-2020-12-09 18:43:39,909 - Epoch: [73][ 3750/ 4498]    Overall Loss 0.023169    Objective Loss 0.023169    MSE 0.023169    LR 0.000063    Time 0.033149    
-2020-12-09 18:43:48,007 - Epoch: [73][ 4000/ 4498]    Overall Loss 0.023172    Objective Loss 0.023172    MSE 0.023172    LR 0.000063    Time 0.033098    
-2020-12-09 18:43:56,096 - Epoch: [73][ 4250/ 4498]    Overall Loss 0.023174    Objective Loss 0.023174    MSE 0.023174    LR 0.000063    Time 0.033050    
-2020-12-09 18:44:04,153 - Epoch: [73][ 4498/ 4498]    Overall Loss 0.023178    Objective Loss 0.023178    MSE 0.023178    LR 0.000063    Time 0.033016    
-2020-12-09 18:44:04,951 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18085 |  0.00259 |    0.13650 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15686 | -0.01285 |    0.10657 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08418 | -0.00813 |    0.05741 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08733 | -0.01490 |    0.06438 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10139 | -0.00949 |    0.07352 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12081 | -0.01599 |    0.09146 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02026 |    0.11223 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27266 |  0.00008 |    0.21459 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:44:04,951 - Total sparsity: 0.00
-
-2020-12-09 18:44:04,954 - --- validate (epoch=73)-----------
-2020-12-09 18:44:04,954 - 49975 samples (100 per mini-batch)
-2020-12-09 18:44:10,334 - Epoch: [73][  250/  500]    Loss 0.024017    MSE 0.024017    
-2020-12-09 18:44:13,626 - Epoch: [73][  500/  500]    Loss 0.024078    MSE 0.024077    
-2020-12-09 18:44:14,380 - ==> MSE: 0.02408    Loss: 0.024
-
-2020-12-09 18:44:14,389 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 71]
-2020-12-09 18:44:14,389 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:44:14,394 - 
-
-2020-12-09 18:44:14,394 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:44:25,611 - Epoch: [74][  250/ 4498]    Overall Loss 0.023209    Objective Loss 0.023209    MSE 0.023209    LR 0.000063    Time 0.044795    
-2020-12-09 18:44:33,632 - Epoch: [74][  500/ 4498]    Overall Loss 0.023163    Objective Loss 0.023163    MSE 0.023163    LR 0.000063    Time 0.038407    
-2020-12-09 18:44:41,709 - Epoch: [74][  750/ 4498]    Overall Loss 0.023152    Objective Loss 0.023152    MSE 0.023152    LR 0.000063    Time 0.036351    
-2020-12-09 18:44:49,779 - Epoch: [74][ 1000/ 4498]    Overall Loss 0.023156    Objective Loss 0.023156    MSE 0.023156    LR 0.000063    Time 0.035316    
-2020-12-09 18:44:57,846 - Epoch: [74][ 1250/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.034692    
-2020-12-09 18:45:05,917 - Epoch: [74][ 1500/ 4498]    Overall Loss 0.023172    Objective Loss 0.023172    MSE 0.023172    LR 0.000063    Time 0.034279    
-2020-12-09 18:45:13,986 - Epoch: [74][ 1750/ 4498]    Overall Loss 0.023186    Objective Loss 0.023186    MSE 0.023186    LR 0.000063    Time 0.033983    
-2020-12-09 18:45:22,055 - Epoch: [74][ 2000/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.033761    
-2020-12-09 18:45:30,121 - Epoch: [74][ 2250/ 4498]    Overall Loss 0.023167    Objective Loss 0.023167    MSE 0.023167    LR 0.000063    Time 0.033587    
-2020-12-09 18:45:38,189 - Epoch: [74][ 2500/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.033449    
-2020-12-09 18:45:46,256 - Epoch: [74][ 2750/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.033336    
-2020-12-09 18:45:54,322 - Epoch: [74][ 3000/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.033241    
-2020-12-09 18:46:02,390 - Epoch: [74][ 3250/ 4498]    Overall Loss 0.023165    Objective Loss 0.023165    MSE 0.023165    LR 0.000063    Time 0.033161    
-2020-12-09 18:46:10,454 - Epoch: [74][ 3500/ 4498]    Overall Loss 0.023173    Objective Loss 0.023173    MSE 0.023173    LR 0.000063    Time 0.033091    
-2020-12-09 18:46:18,519 - Epoch: [74][ 3750/ 4498]    Overall Loss 0.023179    Objective Loss 0.023179    MSE 0.023179    LR 0.000063    Time 0.033031    
-2020-12-09 18:46:26,577 - Epoch: [74][ 4000/ 4498]    Overall Loss 0.023176    Objective Loss 0.023176    MSE 0.023176    LR 0.000063    Time 0.032977    
-2020-12-09 18:46:34,630 - Epoch: [74][ 4250/ 4498]    Overall Loss 0.023174    Objective Loss 0.023174    MSE 0.023174    LR 0.000063    Time 0.032928    
-2020-12-09 18:46:42,654 - Epoch: [74][ 4498/ 4498]    Overall Loss 0.023177    Objective Loss 0.023177    MSE 0.023177    LR 0.000063    Time 0.032894    
-2020-12-09 18:46:43,475 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18085 |  0.00268 |    0.13651 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15688 | -0.01286 |    0.10660 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08413 | -0.00811 |    0.05736 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08730 | -0.01489 |    0.06436 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10136 | -0.00947 |    0.07350 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12079 | -0.01597 |    0.09143 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15516 | -0.02027 |    0.11223 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27292 |  0.00007 |    0.21479 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:46:43,475 - Total sparsity: 0.00
-
-2020-12-09 18:46:43,478 - --- validate (epoch=74)-----------
-2020-12-09 18:46:43,478 - 49975 samples (100 per mini-batch)
-2020-12-09 18:46:48,964 - Epoch: [74][  250/  500]    Loss 0.024217    MSE 0.024217    
-2020-12-09 18:46:52,252 - Epoch: [74][  500/  500]    Loss 0.024182    MSE 0.024182    
-2020-12-09 18:46:52,988 - ==> MSE: 0.02418    Loss: 0.024
-
-2020-12-09 18:46:52,998 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 71]
-2020-12-09 18:46:52,998 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:46:53,003 - 
-
-2020-12-09 18:46:53,003 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:47:04,210 - Epoch: [75][  250/ 4498]    Overall Loss 0.023101    Objective Loss 0.023101    MSE 0.023101    LR 0.000063    Time 0.044762    
-2020-12-09 18:47:12,296 - Epoch: [75][  500/ 4498]    Overall Loss 0.023155    Objective Loss 0.023155    MSE 0.023155    LR 0.000063    Time 0.038518    
-2020-12-09 18:47:20,382 - Epoch: [75][  750/ 4498]    Overall Loss 0.023156    Objective Loss 0.023156    MSE 0.023156    LR 0.000063    Time 0.036437    
-2020-12-09 18:47:28,453 - Epoch: [75][ 1000/ 4498]    Overall Loss 0.023150    Objective Loss 0.023150    MSE 0.023150    LR 0.000063    Time 0.035382    
-2020-12-09 18:47:36,535 - Epoch: [75][ 1250/ 4498]    Overall Loss 0.023146    Objective Loss 0.023146    MSE 0.023146    LR 0.000063    Time 0.034757    
-2020-12-09 18:47:44,620 - Epoch: [75][ 1500/ 4498]    Overall Loss 0.023151    Objective Loss 0.023151    MSE 0.023151    LR 0.000063    Time 0.034343    
-2020-12-09 18:47:52,697 - Epoch: [75][ 1750/ 4498]    Overall Loss 0.023149    Objective Loss 0.023149    MSE 0.023149    LR 0.000063    Time 0.034043    
-2020-12-09 18:48:00,767 - Epoch: [75][ 2000/ 4498]    Overall Loss 0.023141    Objective Loss 0.023141    MSE 0.023141    LR 0.000063    Time 0.033814    
-2020-12-09 18:48:08,829 - Epoch: [75][ 2250/ 4498]    Overall Loss 0.023142    Objective Loss 0.023142    MSE 0.023142    LR 0.000063    Time 0.033632    
-2020-12-09 18:48:16,876 - Epoch: [75][ 2500/ 4498]    Overall Loss 0.023144    Objective Loss 0.023144    MSE 0.023144    LR 0.000063    Time 0.033481    
-2020-12-09 18:48:24,923 - Epoch: [75][ 2750/ 4498]    Overall Loss 0.023145    Objective Loss 0.023145    MSE 0.023145    LR 0.000063    Time 0.033357    
-2020-12-09 18:48:32,985 - Epoch: [75][ 3000/ 4498]    Overall Loss 0.023138    Objective Loss 0.023138    MSE 0.023138    LR 0.000063    Time 0.033259    
-2020-12-09 18:48:41,050 - Epoch: [75][ 3250/ 4498]    Overall Loss 0.023147    Objective Loss 0.023147    MSE 0.023147    LR 0.000063    Time 0.033177    
-2020-12-09 18:48:49,094 - Epoch: [75][ 3500/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.033100    
-2020-12-09 18:48:57,134 - Epoch: [75][ 3750/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.033033    
-2020-12-09 18:49:05,177 - Epoch: [75][ 4000/ 4498]    Overall Loss 0.023158    Objective Loss 0.023158    MSE 0.023158    LR 0.000063    Time 0.032975    
-2020-12-09 18:49:13,220 - Epoch: [75][ 4250/ 4498]    Overall Loss 0.023164    Objective Loss 0.023164    MSE 0.023164    LR 0.000063    Time 0.032924    
-2020-12-09 18:49:21,232 - Epoch: [75][ 4498/ 4498]    Overall Loss 0.023171    Objective Loss 0.023171    MSE 0.023171    LR 0.000063    Time 0.032887    
-2020-12-09 18:49:22,046 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18106 |  0.00269 |    0.13670 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15692 | -0.01280 |    0.10662 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08409 | -0.00809 |    0.05731 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08728 | -0.01487 |    0.06434 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10134 | -0.00946 |    0.07348 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12077 | -0.01596 |    0.09142 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02027 |    0.11222 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27318 |  0.00009 |    0.21500 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:49:22,046 - Total sparsity: 0.00
-
-2020-12-09 18:49:22,049 - --- validate (epoch=75)-----------
-2020-12-09 18:49:22,049 - 49975 samples (100 per mini-batch)
-2020-12-09 18:49:27,514 - Epoch: [75][  250/  500]    Loss 0.024018    MSE 0.024018    
-2020-12-09 18:49:30,760 - Epoch: [75][  500/  500]    Loss 0.024119    MSE 0.024118    
-2020-12-09 18:49:31,481 - ==> MSE: 0.02412    Loss: 0.024
-
-2020-12-09 18:49:31,491 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 71]
-2020-12-09 18:49:31,491 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:49:31,496 - 
-
-2020-12-09 18:49:31,496 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:49:42,686 - Epoch: [76][  250/ 4498]    Overall Loss 0.023095    Objective Loss 0.023095    MSE 0.023095    LR 0.000063    Time 0.044691    
-2020-12-09 18:49:50,742 - Epoch: [76][  500/ 4498]    Overall Loss 0.023097    Objective Loss 0.023097    MSE 0.023097    LR 0.000063    Time 0.038423    
-2020-12-09 18:49:58,802 - Epoch: [76][  750/ 4498]    Overall Loss 0.023137    Objective Loss 0.023137    MSE 0.023137    LR 0.000063    Time 0.036339    
-2020-12-09 18:50:06,852 - Epoch: [76][ 1000/ 4498]    Overall Loss 0.023139    Objective Loss 0.023139    MSE 0.023139    LR 0.000063    Time 0.035287    
-2020-12-09 18:50:14,902 - Epoch: [76][ 1250/ 4498]    Overall Loss 0.023138    Objective Loss 0.023138    MSE 0.023138    LR 0.000063    Time 0.034656    
-2020-12-09 18:50:22,953 - Epoch: [76][ 1500/ 4498]    Overall Loss 0.023117    Objective Loss 0.023117    MSE 0.023117    LR 0.000063    Time 0.034236    
-2020-12-09 18:50:31,005 - Epoch: [76][ 1750/ 4498]    Overall Loss 0.023129    Objective Loss 0.023129    MSE 0.023129    LR 0.000063    Time 0.033936    
-2020-12-09 18:50:39,055 - Epoch: [76][ 2000/ 4498]    Overall Loss 0.023135    Objective Loss 0.023135    MSE 0.023135    LR 0.000063    Time 0.033711    
-2020-12-09 18:50:47,105 - Epoch: [76][ 2250/ 4498]    Overall Loss 0.023142    Objective Loss 0.023142    MSE 0.023142    LR 0.000063    Time 0.033535    
-2020-12-09 18:50:55,157 - Epoch: [76][ 2500/ 4498]    Overall Loss 0.023145    Objective Loss 0.023145    MSE 0.023145    LR 0.000063    Time 0.033396    
-2020-12-09 18:51:03,215 - Epoch: [76][ 2750/ 4498]    Overall Loss 0.023146    Objective Loss 0.023146    MSE 0.023146    LR 0.000063    Time 0.033284    
-2020-12-09 18:51:11,271 - Epoch: [76][ 3000/ 4498]    Overall Loss 0.023146    Objective Loss 0.023146    MSE 0.023146    LR 0.000063    Time 0.033190    
-2020-12-09 18:51:19,328 - Epoch: [76][ 3250/ 4498]    Overall Loss 0.023142    Objective Loss 0.023142    MSE 0.023142    LR 0.000063    Time 0.033110    
-2020-12-09 18:51:27,378 - Epoch: [76][ 3500/ 4498]    Overall Loss 0.023146    Objective Loss 0.023146    MSE 0.023146    LR 0.000063    Time 0.033040    
-2020-12-09 18:51:35,429 - Epoch: [76][ 3750/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.032980    
-2020-12-09 18:51:43,480 - Epoch: [76][ 4000/ 4498]    Overall Loss 0.023158    Objective Loss 0.023158    MSE 0.023158    LR 0.000063    Time 0.032927    
-2020-12-09 18:51:51,537 - Epoch: [76][ 4250/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.032882    
-2020-12-09 18:51:59,560 - Epoch: [76][ 4498/ 4498]    Overall Loss 0.023164    Objective Loss 0.023164    MSE 0.023164    LR 0.000063    Time 0.032850    
-2020-12-09 18:52:00,370 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18107 |  0.00266 |    0.13668 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15697 | -0.01287 |    0.10666 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08405 | -0.00809 |    0.05727 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08725 | -0.01486 |    0.06432 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10131 | -0.00946 |    0.07346 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12075 | -0.01595 |    0.09139 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02027 |    0.11221 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27346 |  0.00008 |    0.21521 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:52:00,370 - Total sparsity: 0.00
-
-2020-12-09 18:52:00,373 - --- validate (epoch=76)-----------
-2020-12-09 18:52:00,373 - 49975 samples (100 per mini-batch)
-2020-12-09 18:52:05,746 - Epoch: [76][  250/  500]    Loss 0.024138    MSE 0.024138    
-2020-12-09 18:52:09,044 - Epoch: [76][  500/  500]    Loss 0.024103    MSE 0.024103    
-2020-12-09 18:52:09,806 - ==> MSE: 0.02410    Loss: 0.024
-
-2020-12-09 18:52:09,816 - ==> Best [MSE: 0.02406   Sparsity:0.00   Params: 176048 on epoch: 71]
-2020-12-09 18:52:09,816 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:52:09,821 - 
-
-2020-12-09 18:52:09,821 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:52:20,876 - Epoch: [77][  250/ 4498]    Overall Loss 0.023238    Objective Loss 0.023238    MSE 0.023238    LR 0.000063    Time 0.044151    
-2020-12-09 18:52:28,906 - Epoch: [77][  500/ 4498]    Overall Loss 0.023176    Objective Loss 0.023176    MSE 0.023176    LR 0.000063    Time 0.038100    
-2020-12-09 18:52:36,933 - Epoch: [77][  750/ 4498]    Overall Loss 0.023170    Objective Loss 0.023170    MSE 0.023170    LR 0.000063    Time 0.036080    
-2020-12-09 18:52:44,947 - Epoch: [77][ 1000/ 4498]    Overall Loss 0.023129    Objective Loss 0.023129    MSE 0.023129    LR 0.000063    Time 0.035057    
-2020-12-09 18:52:52,965 - Epoch: [77][ 1250/ 4498]    Overall Loss 0.023131    Objective Loss 0.023131    MSE 0.023131    LR 0.000063    Time 0.034446    
-2020-12-09 18:53:00,984 - Epoch: [77][ 1500/ 4498]    Overall Loss 0.023130    Objective Loss 0.023130    MSE 0.023130    LR 0.000063    Time 0.034040    
-2020-12-09 18:53:09,003 - Epoch: [77][ 1750/ 4498]    Overall Loss 0.023120    Objective Loss 0.023120    MSE 0.023120    LR 0.000063    Time 0.033749    
-2020-12-09 18:53:17,079 - Epoch: [77][ 2000/ 4498]    Overall Loss 0.023137    Objective Loss 0.023137    MSE 0.023137    LR 0.000063    Time 0.033560    
-2020-12-09 18:53:25,156 - Epoch: [77][ 2250/ 4498]    Overall Loss 0.023147    Objective Loss 0.023147    MSE 0.023147    LR 0.000063    Time 0.033413    
-2020-12-09 18:53:33,232 - Epoch: [77][ 2500/ 4498]    Overall Loss 0.023152    Objective Loss 0.023152    MSE 0.023152    LR 0.000063    Time 0.033296    
-2020-12-09 18:53:41,312 - Epoch: [77][ 2750/ 4498]    Overall Loss 0.023144    Objective Loss 0.023144    MSE 0.023144    LR 0.000063    Time 0.033201    
-2020-12-09 18:53:49,364 - Epoch: [77][ 3000/ 4498]    Overall Loss 0.023143    Objective Loss 0.023143    MSE 0.023143    LR 0.000063    Time 0.033112    
-2020-12-09 18:53:57,392 - Epoch: [77][ 3250/ 4498]    Overall Loss 0.023145    Objective Loss 0.023145    MSE 0.023145    LR 0.000063    Time 0.033030    
-2020-12-09 18:54:05,408 - Epoch: [77][ 3500/ 4498]    Overall Loss 0.023146    Objective Loss 0.023146    MSE 0.023146    LR 0.000063    Time 0.032956    
-2020-12-09 18:54:13,421 - Epoch: [77][ 3750/ 4498]    Overall Loss 0.023153    Objective Loss 0.023153    MSE 0.023153    LR 0.000063    Time 0.032891    
-2020-12-09 18:54:21,428 - Epoch: [77][ 4000/ 4498]    Overall Loss 0.023157    Objective Loss 0.023157    MSE 0.023157    LR 0.000063    Time 0.032833    
-2020-12-09 18:54:29,421 - Epoch: [77][ 4250/ 4498]    Overall Loss 0.023163    Objective Loss 0.023163    MSE 0.023163    LR 0.000063    Time 0.032778    
-2020-12-09 18:54:37,388 - Epoch: [77][ 4498/ 4498]    Overall Loss 0.023161    Objective Loss 0.023161    MSE 0.023161    LR 0.000063    Time 0.032739    
-2020-12-09 18:54:38,193 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18110 |  0.00266 |    0.13673 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15699 | -0.01280 |    0.10668 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08400 | -0.00808 |    0.05720 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08723 | -0.01487 |    0.06430 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10128 | -0.00946 |    0.07343 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12072 | -0.01596 |    0.09137 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02026 |    0.11220 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27370 |  0.00007 |    0.21541 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:54:38,193 - Total sparsity: 0.00
-
-2020-12-09 18:54:38,196 - --- validate (epoch=77)-----------
-2020-12-09 18:54:38,196 - 49975 samples (100 per mini-batch)
-2020-12-09 18:54:43,764 - Epoch: [77][  250/  500]    Loss 0.024014    MSE 0.024014    
-2020-12-09 18:54:46,996 - Epoch: [77][  500/  500]    Loss 0.024053    MSE 0.024053    
-2020-12-09 18:54:47,719 - ==> MSE: 0.02405    Loss: 0.024
-
-2020-12-09 18:54:47,729 - ==> Best [MSE: 0.02405   Sparsity:0.00   Params: 176048 on epoch: 77]
-2020-12-09 18:54:47,729 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:54:47,741 - 
-
-2020-12-09 18:54:47,741 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:54:58,922 - Epoch: [78][  250/ 4498]    Overall Loss 0.023077    Objective Loss 0.023077    MSE 0.023077    LR 0.000063    Time 0.044656    
-2020-12-09 18:55:06,991 - Epoch: [78][  500/ 4498]    Overall Loss 0.023081    Objective Loss 0.023081    MSE 0.023081    LR 0.000063    Time 0.038430    
-2020-12-09 18:55:15,063 - Epoch: [78][  750/ 4498]    Overall Loss 0.023094    Objective Loss 0.023094    MSE 0.023094    LR 0.000063    Time 0.036361    
-2020-12-09 18:55:23,124 - Epoch: [78][ 1000/ 4498]    Overall Loss 0.023074    Objective Loss 0.023074    MSE 0.023074    LR 0.000063    Time 0.035315    
-2020-12-09 18:55:31,178 - Epoch: [78][ 1250/ 4498]    Overall Loss 0.023104    Objective Loss 0.023104    MSE 0.023104    LR 0.000063    Time 0.034681    
-2020-12-09 18:55:39,233 - Epoch: [78][ 1500/ 4498]    Overall Loss 0.023115    Objective Loss 0.023115    MSE 0.023115    LR 0.000063    Time 0.034260    
-2020-12-09 18:55:47,291 - Epoch: [78][ 1750/ 4498]    Overall Loss 0.023097    Objective Loss 0.023097    MSE 0.023097    LR 0.000063    Time 0.033960    
-2020-12-09 18:55:55,353 - Epoch: [78][ 2000/ 4498]    Overall Loss 0.023105    Objective Loss 0.023105    MSE 0.023105    LR 0.000063    Time 0.033737    
-2020-12-09 18:56:03,413 - Epoch: [78][ 2250/ 4498]    Overall Loss 0.023118    Objective Loss 0.023118    MSE 0.023118    LR 0.000063    Time 0.033563    
-2020-12-09 18:56:11,476 - Epoch: [78][ 2500/ 4498]    Overall Loss 0.023122    Objective Loss 0.023122    MSE 0.023122    LR 0.000063    Time 0.033425    
-2020-12-09 18:56:19,535 - Epoch: [78][ 2750/ 4498]    Overall Loss 0.023121    Objective Loss 0.023121    MSE 0.023121    LR 0.000063    Time 0.033311    
-2020-12-09 18:56:27,597 - Epoch: [78][ 3000/ 4498]    Overall Loss 0.023134    Objective Loss 0.023134    MSE 0.023134    LR 0.000063    Time 0.033217    
-2020-12-09 18:56:35,658 - Epoch: [78][ 3250/ 4498]    Overall Loss 0.023147    Objective Loss 0.023147    MSE 0.023147    LR 0.000063    Time 0.033137    
-2020-12-09 18:56:43,721 - Epoch: [78][ 3500/ 4498]    Overall Loss 0.023151    Objective Loss 0.023151    MSE 0.023151    LR 0.000063    Time 0.033069    
-2020-12-09 18:56:51,782 - Epoch: [78][ 3750/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.033009    
-2020-12-09 18:56:59,843 - Epoch: [78][ 4000/ 4498]    Overall Loss 0.023156    Objective Loss 0.023156    MSE 0.023156    LR 0.000063    Time 0.032957    
-2020-12-09 18:57:07,902 - Epoch: [78][ 4250/ 4498]    Overall Loss 0.023155    Objective Loss 0.023155    MSE 0.023155    LR 0.000063    Time 0.032911    
-2020-12-09 18:57:15,927 - Epoch: [78][ 4498/ 4498]    Overall Loss 0.023158    Objective Loss 0.023158    MSE 0.023158    LR 0.000063    Time 0.032877    
-2020-12-09 18:57:16,758 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18117 |  0.00270 |    0.13679 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15703 | -0.01278 |    0.10670 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08396 | -0.00810 |    0.05716 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08720 | -0.01484 |    0.06429 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10126 | -0.00944 |    0.07342 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12069 | -0.01593 |    0.09135 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02026 |    0.11220 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27396 |  0.00007 |    0.21562 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:57:16,758 - Total sparsity: 0.00
-
-2020-12-09 18:57:16,762 - --- validate (epoch=78)-----------
-2020-12-09 18:57:16,762 - 49975 samples (100 per mini-batch)
-2020-12-09 18:57:22,138 - Epoch: [78][  250/  500]    Loss 0.024350    MSE 0.024350    
-2020-12-09 18:57:25,422 - Epoch: [78][  500/  500]    Loss 0.024281    MSE 0.024281    
-2020-12-09 18:57:26,148 - ==> MSE: 0.02428    Loss: 0.024
-
-2020-12-09 18:57:26,158 - ==> Best [MSE: 0.02405   Sparsity:0.00   Params: 176048 on epoch: 77]
-2020-12-09 18:57:26,158 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 18:57:26,163 - 
-
-2020-12-09 18:57:26,163 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 18:57:37,311 - Epoch: [79][  250/ 4498]    Overall Loss 0.023054    Objective Loss 0.023054    MSE 0.023054    LR 0.000063    Time 0.044523    
-2020-12-09 18:57:45,365 - Epoch: [79][  500/ 4498]    Overall Loss 0.023083    Objective Loss 0.023083    MSE 0.023083    LR 0.000063    Time 0.038335    
-2020-12-09 18:57:53,417 - Epoch: [79][  750/ 4498]    Overall Loss 0.023102    Objective Loss 0.023102    MSE 0.023101    LR 0.000063    Time 0.036270    
-2020-12-09 18:58:01,483 - Epoch: [79][ 1000/ 4498]    Overall Loss 0.023114    Objective Loss 0.023114    MSE 0.023114    LR 0.000063    Time 0.035252    
-2020-12-09 18:58:09,549 - Epoch: [79][ 1250/ 4498]    Overall Loss 0.023105    Objective Loss 0.023105    MSE 0.023105    LR 0.000063    Time 0.034640    
-2020-12-09 18:58:17,615 - Epoch: [79][ 1500/ 4498]    Overall Loss 0.023100    Objective Loss 0.023100    MSE 0.023100    LR 0.000063    Time 0.034232    
-2020-12-09 18:58:25,681 - Epoch: [79][ 1750/ 4498]    Overall Loss 0.023110    Objective Loss 0.023110    MSE 0.023110    LR 0.000063    Time 0.033941    
-2020-12-09 18:58:33,744 - Epoch: [79][ 2000/ 4498]    Overall Loss 0.023123    Objective Loss 0.023123    MSE 0.023123    LR 0.000063    Time 0.033722    
-2020-12-09 18:58:41,812 - Epoch: [79][ 2250/ 4498]    Overall Loss 0.023125    Objective Loss 0.023125    MSE 0.023125    LR 0.000063    Time 0.033553    
-2020-12-09 18:58:49,880 - Epoch: [79][ 2500/ 4498]    Overall Loss 0.023128    Objective Loss 0.023128    MSE 0.023128    LR 0.000063    Time 0.033418    
-2020-12-09 18:58:57,953 - Epoch: [79][ 2750/ 4498]    Overall Loss 0.023118    Objective Loss 0.023118    MSE 0.023118    LR 0.000063    Time 0.033310    
-2020-12-09 18:59:06,027 - Epoch: [79][ 3000/ 4498]    Overall Loss 0.023122    Objective Loss 0.023122    MSE 0.023122    LR 0.000063    Time 0.033219    
-2020-12-09 18:59:14,099 - Epoch: [79][ 3250/ 4498]    Overall Loss 0.023143    Objective Loss 0.023143    MSE 0.023143    LR 0.000063    Time 0.033142    
-2020-12-09 18:59:22,172 - Epoch: [79][ 3500/ 4498]    Overall Loss 0.023150    Objective Loss 0.023150    MSE 0.023150    LR 0.000063    Time 0.033077    
-2020-12-09 18:59:30,245 - Epoch: [79][ 3750/ 4498]    Overall Loss 0.023150    Objective Loss 0.023150    MSE 0.023150    LR 0.000063    Time 0.033020    
-2020-12-09 18:59:38,314 - Epoch: [79][ 4000/ 4498]    Overall Loss 0.023154    Objective Loss 0.023154    MSE 0.023154    LR 0.000063    Time 0.032969    
-2020-12-09 18:59:46,387 - Epoch: [79][ 4250/ 4498]    Overall Loss 0.023160    Objective Loss 0.023160    MSE 0.023160    LR 0.000063    Time 0.032925    
-2020-12-09 18:59:54,427 - Epoch: [79][ 4498/ 4498]    Overall Loss 0.023155    Objective Loss 0.023155    MSE 0.023155    LR 0.000063    Time 0.032894    
-2020-12-09 18:59:55,271 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18124 |  0.00274 |    0.13685 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15705 | -0.01285 |    0.10672 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08392 | -0.00806 |    0.05713 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08718 | -0.01482 |    0.06427 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10122 | -0.00944 |    0.07339 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12067 | -0.01592 |    0.09134 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02026 |    0.11219 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27421 |  0.00006 |    0.21582 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 18:59:55,271 - Total sparsity: 0.00
-
-2020-12-09 18:59:55,274 - --- validate (epoch=79)-----------
-2020-12-09 18:59:55,274 - 49975 samples (100 per mini-batch)
-2020-12-09 19:00:00,774 - Epoch: [79][  250/  500]    Loss 0.024245    MSE 0.024245    
-2020-12-09 19:00:04,060 - Epoch: [79][  500/  500]    Loss 0.024201    MSE 0.024202    
-2020-12-09 19:00:04,805 - ==> MSE: 0.02420    Loss: 0.024
-
-2020-12-09 19:00:04,815 - ==> Best [MSE: 0.02405   Sparsity:0.00   Params: 176048 on epoch: 77]
-2020-12-09 19:00:04,815 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:00:04,820 - 
-
-2020-12-09 19:00:04,820 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:00:15,991 - Epoch: [80][  250/ 4498]    Overall Loss 0.022896    Objective Loss 0.022896    MSE 0.022896    LR 0.000031    Time 0.044614    
-2020-12-09 19:00:24,037 - Epoch: [80][  500/ 4498]    Overall Loss 0.022991    Objective Loss 0.022991    MSE 0.022991    LR 0.000031    Time 0.038364    
-2020-12-09 19:00:32,067 - Epoch: [80][  750/ 4498]    Overall Loss 0.023028    Objective Loss 0.023028    MSE 0.023028    LR 0.000031    Time 0.036260    
-2020-12-09 19:00:40,082 - Epoch: [80][ 1000/ 4498]    Overall Loss 0.023000    Objective Loss 0.023000    MSE 0.023000    LR 0.000031    Time 0.035193    
-2020-12-09 19:00:48,094 - Epoch: [80][ 1250/ 4498]    Overall Loss 0.022987    Objective Loss 0.022987    MSE 0.022987    LR 0.000031    Time 0.034550    
-2020-12-09 19:00:56,105 - Epoch: [80][ 1500/ 4498]    Overall Loss 0.022976    Objective Loss 0.022976    MSE 0.022976    LR 0.000031    Time 0.034121    
-2020-12-09 19:01:04,110 - Epoch: [80][ 1750/ 4498]    Overall Loss 0.022981    Objective Loss 0.022981    MSE 0.022981    LR 0.000031    Time 0.033811    
-2020-12-09 19:01:12,119 - Epoch: [80][ 2000/ 4498]    Overall Loss 0.022983    Objective Loss 0.022983    MSE 0.022983    LR 0.000031    Time 0.033581    
-2020-12-09 19:01:20,129 - Epoch: [80][ 2250/ 4498]    Overall Loss 0.022981    Objective Loss 0.022981    MSE 0.022981    LR 0.000031    Time 0.033402    
-2020-12-09 19:01:28,140 - Epoch: [80][ 2500/ 4498]    Overall Loss 0.022989    Objective Loss 0.022989    MSE 0.022989    LR 0.000031    Time 0.033259    
-2020-12-09 19:01:36,151 - Epoch: [80][ 2750/ 4498]    Overall Loss 0.022996    Objective Loss 0.022996    MSE 0.022996    LR 0.000031    Time 0.033143    
-2020-12-09 19:01:44,168 - Epoch: [80][ 3000/ 4498]    Overall Loss 0.023001    Objective Loss 0.023001    MSE 0.023001    LR 0.000031    Time 0.033047    
-2020-12-09 19:01:52,181 - Epoch: [80][ 3250/ 4498]    Overall Loss 0.023009    Objective Loss 0.023009    MSE 0.023009    LR 0.000031    Time 0.032965    
-2020-12-09 19:02:00,196 - Epoch: [80][ 3500/ 4498]    Overall Loss 0.023012    Objective Loss 0.023012    MSE 0.023012    LR 0.000031    Time 0.032896    
-2020-12-09 19:02:08,215 - Epoch: [80][ 3750/ 4498]    Overall Loss 0.023016    Objective Loss 0.023016    MSE 0.023016    LR 0.000031    Time 0.032837    
-2020-12-09 19:02:16,228 - Epoch: [80][ 4000/ 4498]    Overall Loss 0.023017    Objective Loss 0.023017    MSE 0.023017    LR 0.000031    Time 0.032783    
-2020-12-09 19:02:24,238 - Epoch: [80][ 4250/ 4498]    Overall Loss 0.023019    Objective Loss 0.023019    MSE 0.023019    LR 0.000031    Time 0.032735    
-2020-12-09 19:02:32,213 - Epoch: [80][ 4498/ 4498]    Overall Loss 0.023019    Objective Loss 0.023019    MSE 0.023019    LR 0.000031    Time 0.032701    
-2020-12-09 19:02:33,041 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18129 |  0.00271 |    0.13688 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15705 | -0.01277 |    0.10671 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08387 | -0.00806 |    0.05708 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08715 | -0.01481 |    0.06424 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10119 | -0.00941 |    0.07337 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12065 | -0.01590 |    0.09131 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15517 | -0.02022 |    0.11218 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27437 |  0.00006 |    0.21595 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:02:33,041 - Total sparsity: 0.00
-
-2020-12-09 19:02:33,044 - --- validate (epoch=80)-----------
-2020-12-09 19:02:33,044 - 49975 samples (100 per mini-batch)
-2020-12-09 19:02:38,645 - Epoch: [80][  250/  500]    Loss 0.024023    MSE 0.024023    
-2020-12-09 19:02:41,925 - Epoch: [80][  500/  500]    Loss 0.023978    MSE 0.023979    
-2020-12-09 19:02:42,668 - ==> MSE: 0.02398    Loss: 0.024
-
-2020-12-09 19:02:42,677 - ==> Best [MSE: 0.02398   Sparsity:0.00   Params: 176048 on epoch: 80]
-2020-12-09 19:02:42,677 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:02:42,689 - 
-
-2020-12-09 19:02:42,690 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:02:53,794 - Epoch: [81][  250/ 4498]    Overall Loss 0.022989    Objective Loss 0.022989    MSE 0.022989    LR 0.000031    Time 0.044350    
-2020-12-09 19:03:01,850 - Epoch: [81][  500/ 4498]    Overall Loss 0.022994    Objective Loss 0.022994    MSE 0.022994    LR 0.000031    Time 0.038239    
-2020-12-09 19:03:09,884 - Epoch: [81][  750/ 4498]    Overall Loss 0.022970    Objective Loss 0.022970    MSE 0.022970    LR 0.000031    Time 0.036183    
-2020-12-09 19:03:17,912 - Epoch: [81][ 1000/ 4498]    Overall Loss 0.022971    Objective Loss 0.022971    MSE 0.022971    LR 0.000031    Time 0.035148    
-2020-12-09 19:03:25,942 - Epoch: [81][ 1250/ 4498]    Overall Loss 0.022989    Objective Loss 0.022989    MSE 0.022989    LR 0.000031    Time 0.034528    
-2020-12-09 19:03:33,976 - Epoch: [81][ 1500/ 4498]    Overall Loss 0.022994    Objective Loss 0.022994    MSE 0.022994    LR 0.000031    Time 0.034118    
-2020-12-09 19:03:42,007 - Epoch: [81][ 1750/ 4498]    Overall Loss 0.022992    Objective Loss 0.022992    MSE 0.022992    LR 0.000031    Time 0.033823    
-2020-12-09 19:03:50,036 - Epoch: [81][ 2000/ 4498]    Overall Loss 0.022984    Objective Loss 0.022984    MSE 0.022984    LR 0.000031    Time 0.033601    
-2020-12-09 19:03:58,065 - Epoch: [81][ 2250/ 4498]    Overall Loss 0.022986    Objective Loss 0.022986    MSE 0.022986    LR 0.000031    Time 0.033429    
-2020-12-09 19:04:06,093 - Epoch: [81][ 2500/ 4498]    Overall Loss 0.022995    Objective Loss 0.022995    MSE 0.022995    LR 0.000031    Time 0.033290    
-2020-12-09 19:04:14,119 - Epoch: [81][ 2750/ 4498]    Overall Loss 0.023011    Objective Loss 0.023011    MSE 0.023011    LR 0.000031    Time 0.033176    
-2020-12-09 19:04:22,144 - Epoch: [81][ 3000/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.033081    
-2020-12-09 19:04:30,173 - Epoch: [81][ 3250/ 4498]    Overall Loss 0.023021    Objective Loss 0.023021    MSE 0.023021    LR 0.000031    Time 0.033001    
-2020-12-09 19:04:38,191 - Epoch: [81][ 3500/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000031    Time 0.032930    
-2020-12-09 19:04:46,203 - Epoch: [81][ 3750/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.032867    
-2020-12-09 19:04:54,208 - Epoch: [81][ 4000/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.032809    
-2020-12-09 19:05:02,212 - Epoch: [81][ 4250/ 4498]    Overall Loss 0.023034    Objective Loss 0.023034    MSE 0.023034    LR 0.000031    Time 0.032759    
-2020-12-09 19:05:10,181 - Epoch: [81][ 4498/ 4498]    Overall Loss 0.023038    Objective Loss 0.023038    MSE 0.023038    LR 0.000031    Time 0.032721    
-2020-12-09 19:05:10,955 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18131 |  0.00272 |    0.13690 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15704 | -0.01280 |    0.10671 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08384 | -0.00807 |    0.05705 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08714 | -0.01478 |    0.06422 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10117 | -0.00940 |    0.07335 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12064 | -0.01588 |    0.09130 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02021 |    0.11217 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27455 |  0.00006 |    0.21608 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:05:10,955 - Total sparsity: 0.00
-
-2020-12-09 19:05:10,958 - --- validate (epoch=81)-----------
-2020-12-09 19:05:10,958 - 49975 samples (100 per mini-batch)
-2020-12-09 19:05:16,444 - Epoch: [81][  250/  500]    Loss 0.024116    MSE 0.024116    
-2020-12-09 19:05:19,758 - Epoch: [81][  500/  500]    Loss 0.024076    MSE 0.024076    
-2020-12-09 19:05:20,478 - ==> MSE: 0.02408    Loss: 0.024
-
-2020-12-09 19:05:20,488 - ==> Best [MSE: 0.02398   Sparsity:0.00   Params: 176048 on epoch: 80]
-2020-12-09 19:05:20,488 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:05:20,493 - 
-
-2020-12-09 19:05:20,493 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:05:31,614 - Epoch: [82][  250/ 4498]    Overall Loss 0.022953    Objective Loss 0.022953    MSE 0.022953    LR 0.000031    Time 0.044418    
-2020-12-09 19:05:39,674 - Epoch: [82][  500/ 4498]    Overall Loss 0.022967    Objective Loss 0.022967    MSE 0.022967    LR 0.000031    Time 0.038294    
-2020-12-09 19:05:47,695 - Epoch: [82][  750/ 4498]    Overall Loss 0.022993    Objective Loss 0.022993    MSE 0.022993    LR 0.000031    Time 0.036200    
-2020-12-09 19:05:55,710 - Epoch: [82][ 1000/ 4498]    Overall Loss 0.022958    Objective Loss 0.022958    MSE 0.022958    LR 0.000031    Time 0.035148    
-2020-12-09 19:06:03,718 - Epoch: [82][ 1250/ 4498]    Overall Loss 0.022957    Objective Loss 0.022957    MSE 0.022957    LR 0.000031    Time 0.034512    
-2020-12-09 19:06:11,724 - Epoch: [82][ 1500/ 4498]    Overall Loss 0.022983    Objective Loss 0.022983    MSE 0.022983    LR 0.000031    Time 0.034085    
-2020-12-09 19:06:19,735 - Epoch: [82][ 1750/ 4498]    Overall Loss 0.022994    Objective Loss 0.022994    MSE 0.022994    LR 0.000031    Time 0.033784    
-2020-12-09 19:06:27,747 - Epoch: [82][ 2000/ 4498]    Overall Loss 0.023005    Objective Loss 0.023005    MSE 0.023005    LR 0.000031    Time 0.033558    
-2020-12-09 19:06:35,755 - Epoch: [82][ 2250/ 4498]    Overall Loss 0.023012    Objective Loss 0.023012    MSE 0.023012    LR 0.000031    Time 0.033381    
-2020-12-09 19:06:43,769 - Epoch: [82][ 2500/ 4498]    Overall Loss 0.023012    Objective Loss 0.023012    MSE 0.023012    LR 0.000031    Time 0.033242    
-2020-12-09 19:06:51,778 - Epoch: [82][ 2750/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.033126    
-2020-12-09 19:06:59,783 - Epoch: [82][ 3000/ 4498]    Overall Loss 0.023024    Objective Loss 0.023024    MSE 0.023024    LR 0.000031    Time 0.033028    
-2020-12-09 19:07:07,787 - Epoch: [82][ 3250/ 4498]    Overall Loss 0.023021    Objective Loss 0.023021    MSE 0.023021    LR 0.000031    Time 0.032945    
-2020-12-09 19:07:15,794 - Epoch: [82][ 3500/ 4498]    Overall Loss 0.023025    Objective Loss 0.023025    MSE 0.023025    LR 0.000031    Time 0.032875    
-2020-12-09 19:07:23,791 - Epoch: [82][ 3750/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.032811    
-2020-12-09 19:07:31,786 - Epoch: [82][ 4000/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.032755    
-2020-12-09 19:07:39,787 - Epoch: [82][ 4250/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.032707    
-2020-12-09 19:07:47,759 - Epoch: [82][ 4498/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032673    
-2020-12-09 19:07:48,576 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18134 |  0.00269 |    0.13692 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15704 | -0.01277 |    0.10672 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08381 | -0.00804 |    0.05702 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08712 | -0.01481 |    0.06421 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10115 | -0.00939 |    0.07334 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12062 | -0.01586 |    0.09128 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02020 |    0.11217 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27471 |  0.00006 |    0.21621 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:07:48,576 - Total sparsity: 0.00
-
-2020-12-09 19:07:48,580 - --- validate (epoch=82)-----------
-2020-12-09 19:07:48,580 - 49975 samples (100 per mini-batch)
-2020-12-09 19:07:54,048 - Epoch: [82][  250/  500]    Loss 0.023992    MSE 0.023992    
-2020-12-09 19:07:57,249 - Epoch: [82][  500/  500]    Loss 0.024035    MSE 0.024034    
-2020-12-09 19:07:57,949 - ==> MSE: 0.02403    Loss: 0.024
-
-2020-12-09 19:07:57,959 - ==> Best [MSE: 0.02398   Sparsity:0.00   Params: 176048 on epoch: 80]
-2020-12-09 19:07:57,959 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:07:57,964 - 
-
-2020-12-09 19:07:57,964 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:08:08,926 - Epoch: [83][  250/ 4498]    Overall Loss 0.023025    Objective Loss 0.023025    MSE 0.023025    LR 0.000031    Time 0.043778    
-2020-12-09 19:08:16,898 - Epoch: [83][  500/ 4498]    Overall Loss 0.022976    Objective Loss 0.022976    MSE 0.022976    LR 0.000031    Time 0.037799    
-2020-12-09 19:08:24,875 - Epoch: [83][  750/ 4498]    Overall Loss 0.023000    Objective Loss 0.023000    MSE 0.023000    LR 0.000031    Time 0.035814    
-2020-12-09 19:08:32,839 - Epoch: [83][ 1000/ 4498]    Overall Loss 0.023003    Objective Loss 0.023003    MSE 0.023003    LR 0.000031    Time 0.034807    
-2020-12-09 19:08:40,802 - Epoch: [83][ 1250/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.034203    
-2020-12-09 19:08:48,765 - Epoch: [83][ 1500/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.033799    
-2020-12-09 19:08:56,727 - Epoch: [83][ 1750/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.033511    
-2020-12-09 19:09:04,689 - Epoch: [83][ 2000/ 4498]    Overall Loss 0.023026    Objective Loss 0.023026    MSE 0.023026    LR 0.000031    Time 0.033294    
-2020-12-09 19:09:12,654 - Epoch: [83][ 2250/ 4498]    Overall Loss 0.023022    Objective Loss 0.023022    MSE 0.023022    LR 0.000031    Time 0.033127    
-2020-12-09 19:09:20,616 - Epoch: [83][ 2500/ 4498]    Overall Loss 0.023024    Objective Loss 0.023024    MSE 0.023024    LR 0.000031    Time 0.032993    
-2020-12-09 19:09:28,600 - Epoch: [83][ 2750/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.032890    
-2020-12-09 19:09:36,656 - Epoch: [83][ 3000/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.032829    
-2020-12-09 19:09:44,721 - Epoch: [83][ 3250/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.032780    
-2020-12-09 19:09:52,767 - Epoch: [83][ 3500/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.032732    
-2020-12-09 19:10:00,772 - Epoch: [83][ 3750/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032680    
-2020-12-09 19:10:08,792 - Epoch: [83][ 4000/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.032639    
-2020-12-09 19:10:16,807 - Epoch: [83][ 4250/ 4498]    Overall Loss 0.023049    Objective Loss 0.023049    MSE 0.023049    LR 0.000031    Time 0.032600    
-2020-12-09 19:10:24,778 - Epoch: [83][ 4498/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.032572    
-2020-12-09 19:10:25,578 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18138 |  0.00274 |    0.13696 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15706 | -0.01277 |    0.10673 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08379 | -0.00804 |    0.05700 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08711 | -0.01480 |    0.06420 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10113 | -0.00937 |    0.07332 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12060 | -0.01586 |    0.09127 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02019 |    0.11215 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27487 |  0.00005 |    0.21633 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:10:25,578 - Total sparsity: 0.00
-
-2020-12-09 19:10:25,581 - --- validate (epoch=83)-----------
-2020-12-09 19:10:25,581 - 49975 samples (100 per mini-batch)
-2020-12-09 19:10:31,072 - Epoch: [83][  250/  500]    Loss 0.024141    MSE 0.024141    
-2020-12-09 19:10:34,355 - Epoch: [83][  500/  500]    Loss 0.024050    MSE 0.024050    
-2020-12-09 19:10:35,024 - ==> MSE: 0.02405    Loss: 0.024
-
-2020-12-09 19:10:35,034 - ==> Best [MSE: 0.02398   Sparsity:0.00   Params: 176048 on epoch: 80]
-2020-12-09 19:10:35,034 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:10:35,039 - 
-
-2020-12-09 19:10:35,039 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:10:46,102 - Epoch: [84][  250/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.044182    
-2020-12-09 19:10:54,154 - Epoch: [84][  500/ 4498]    Overall Loss 0.023002    Objective Loss 0.023002    MSE 0.023002    LR 0.000031    Time 0.038161    
-2020-12-09 19:11:02,209 - Epoch: [84][  750/ 4498]    Overall Loss 0.022996    Objective Loss 0.022996    MSE 0.022996    LR 0.000031    Time 0.036158    
-2020-12-09 19:11:10,256 - Epoch: [84][ 1000/ 4498]    Overall Loss 0.023005    Objective Loss 0.023005    MSE 0.023005    LR 0.000031    Time 0.035148    
-2020-12-09 19:11:18,291 - Epoch: [84][ 1250/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000031    Time 0.034532    
-2020-12-09 19:11:26,320 - Epoch: [84][ 1500/ 4498]    Overall Loss 0.022999    Objective Loss 0.022999    MSE 0.022999    LR 0.000031    Time 0.034118    
-2020-12-09 19:11:34,352 - Epoch: [84][ 1750/ 4498]    Overall Loss 0.023007    Objective Loss 0.023007    MSE 0.023007    LR 0.000031    Time 0.033824    
-2020-12-09 19:11:42,385 - Epoch: [84][ 2000/ 4498]    Overall Loss 0.023004    Objective Loss 0.023004    MSE 0.023004    LR 0.000031    Time 0.033604    
-2020-12-09 19:11:50,422 - Epoch: [84][ 2250/ 4498]    Overall Loss 0.023009    Objective Loss 0.023009    MSE 0.023009    LR 0.000031    Time 0.033435    
-2020-12-09 19:11:58,461 - Epoch: [84][ 2500/ 4498]    Overall Loss 0.023011    Objective Loss 0.023011    MSE 0.023011    LR 0.000031    Time 0.033300    
-2020-12-09 19:12:06,503 - Epoch: [84][ 2750/ 4498]    Overall Loss 0.023011    Objective Loss 0.023011    MSE 0.023011    LR 0.000031    Time 0.033191    
-2020-12-09 19:12:14,546 - Epoch: [84][ 3000/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.033100    
-2020-12-09 19:12:22,584 - Epoch: [84][ 3250/ 4498]    Overall Loss 0.023024    Objective Loss 0.023024    MSE 0.023024    LR 0.000031    Time 0.033022    
-2020-12-09 19:12:30,603 - Epoch: [84][ 3500/ 4498]    Overall Loss 0.023021    Objective Loss 0.023021    MSE 0.023021    LR 0.000031    Time 0.032950    
-2020-12-09 19:12:38,630 - Epoch: [84][ 3750/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.032889    
-2020-12-09 19:12:46,647 - Epoch: [84][ 4000/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.032833    
-2020-12-09 19:12:54,661 - Epoch: [84][ 4250/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.032784    
-2020-12-09 19:13:02,643 - Epoch: [84][ 4498/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032748    
-2020-12-09 19:13:03,450 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18141 |  0.00268 |    0.13698 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15707 | -0.01275 |    0.10673 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08377 | -0.00801 |    0.05697 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08710 | -0.01477 |    0.06419 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10111 | -0.00935 |    0.07330 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12058 | -0.01585 |    0.09125 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02019 |    0.11215 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27502 |  0.00005 |    0.21645 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:13:03,450 - Total sparsity: 0.00
-
-2020-12-09 19:13:03,453 - --- validate (epoch=84)-----------
-2020-12-09 19:13:03,453 - 49975 samples (100 per mini-batch)
-2020-12-09 19:13:08,757 - Epoch: [84][  250/  500]    Loss 0.023955    MSE 0.023955    
-2020-12-09 19:13:12,032 - Epoch: [84][  500/  500]    Loss 0.023947    MSE 0.023948    
-2020-12-09 19:13:12,734 - ==> MSE: 0.02395    Loss: 0.024
-
-2020-12-09 19:13:12,744 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:13:12,744 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:13:12,756 - 
-
-2020-12-09 19:13:12,757 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:13:23,913 - Epoch: [85][  250/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.044556    
-2020-12-09 19:13:32,010 - Epoch: [85][  500/ 4498]    Overall Loss 0.023020    Objective Loss 0.023020    MSE 0.023020    LR 0.000031    Time 0.038438    
-2020-12-09 19:13:40,097 - Epoch: [85][  750/ 4498]    Overall Loss 0.023055    Objective Loss 0.023055    MSE 0.023055    LR 0.000031    Time 0.036385    
-2020-12-09 19:13:48,170 - Epoch: [85][ 1000/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.035344    
-2020-12-09 19:13:56,240 - Epoch: [85][ 1250/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.034718    
-2020-12-09 19:14:04,311 - Epoch: [85][ 1500/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.034301    
-2020-12-09 19:14:12,387 - Epoch: [85][ 1750/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.034006    
-2020-12-09 19:14:20,419 - Epoch: [85][ 2000/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.033762    
-2020-12-09 19:14:28,439 - Epoch: [85][ 2250/ 4498]    Overall Loss 0.023034    Objective Loss 0.023034    MSE 0.023034    LR 0.000031    Time 0.033568    
-2020-12-09 19:14:36,458 - Epoch: [85][ 2500/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.033412    
-2020-12-09 19:14:44,470 - Epoch: [85][ 2750/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.033282    
-2020-12-09 19:14:52,487 - Epoch: [85][ 3000/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.033175    
-2020-12-09 19:15:00,514 - Epoch: [85][ 3250/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.033088    
-2020-12-09 19:15:08,531 - Epoch: [85][ 3500/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.033010    
-2020-12-09 19:15:16,549 - Epoch: [85][ 3750/ 4498]    Overall Loss 0.023028    Objective Loss 0.023028    MSE 0.023028    LR 0.000031    Time 0.032943    
-2020-12-09 19:15:24,558 - Epoch: [85][ 4000/ 4498]    Overall Loss 0.023041    Objective Loss 0.023041    MSE 0.023041    LR 0.000031    Time 0.032882    
-2020-12-09 19:15:32,558 - Epoch: [85][ 4250/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032826    
-2020-12-09 19:15:40,526 - Epoch: [85][ 4498/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.032784    
-2020-12-09 19:15:41,298 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18145 |  0.00273 |    0.13701 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15707 | -0.01274 |    0.10674 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08375 | -0.00802 |    0.05695 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08708 | -0.01478 |    0.06418 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10109 | -0.00935 |    0.07329 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12056 | -0.01584 |    0.09123 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02018 |    0.11214 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27518 |  0.00005 |    0.21658 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:15:41,298 - Total sparsity: 0.00
-
-2020-12-09 19:15:41,301 - --- validate (epoch=85)-----------
-2020-12-09 19:15:41,301 - 49975 samples (100 per mini-batch)
-2020-12-09 19:15:46,776 - Epoch: [85][  250/  500]    Loss 0.024075    MSE 0.024075    
-2020-12-09 19:15:50,081 - Epoch: [85][  500/  500]    Loss 0.024085    MSE 0.024085    
-2020-12-09 19:15:50,798 - ==> MSE: 0.02409    Loss: 0.024
-
-2020-12-09 19:15:50,809 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:15:50,809 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:15:50,814 - 
-
-2020-12-09 19:15:50,814 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:16:02,086 - Epoch: [86][  250/ 4498]    Overall Loss 0.023022    Objective Loss 0.023022    MSE 0.023022    LR 0.000031    Time 0.045022    
-2020-12-09 19:16:10,210 - Epoch: [86][  500/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.038724    
-2020-12-09 19:16:18,325 - Epoch: [86][  750/ 4498]    Overall Loss 0.023038    Objective Loss 0.023038    MSE 0.023038    LR 0.000031    Time 0.036613    
-2020-12-09 19:16:26,425 - Epoch: [86][ 1000/ 4498]    Overall Loss 0.023026    Objective Loss 0.023026    MSE 0.023026    LR 0.000031    Time 0.035543    
-2020-12-09 19:16:34,533 - Epoch: [86][ 1250/ 4498]    Overall Loss 0.023028    Objective Loss 0.023028    MSE 0.023028    LR 0.000031    Time 0.034906    
-2020-12-09 19:16:42,639 - Epoch: [86][ 1500/ 4498]    Overall Loss 0.023020    Objective Loss 0.023020    MSE 0.023020    LR 0.000031    Time 0.034481    
-2020-12-09 19:16:50,746 - Epoch: [86][ 1750/ 4498]    Overall Loss 0.023025    Objective Loss 0.023025    MSE 0.023025    LR 0.000031    Time 0.034178    
-2020-12-09 19:16:58,852 - Epoch: [86][ 2000/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000031    Time 0.033950    
-2020-12-09 19:17:06,963 - Epoch: [86][ 2250/ 4498]    Overall Loss 0.023028    Objective Loss 0.023028    MSE 0.023028    LR 0.000031    Time 0.033776    
-2020-12-09 19:17:15,077 - Epoch: [86][ 2500/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.033637    
-2020-12-09 19:17:23,190 - Epoch: [86][ 2750/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.033522    
-2020-12-09 19:17:31,296 - Epoch: [86][ 3000/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.033426    
-2020-12-09 19:17:39,405 - Epoch: [86][ 3250/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.033344    
-2020-12-09 19:17:47,518 - Epoch: [86][ 3500/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.033275    
-2020-12-09 19:17:55,604 - Epoch: [86][ 3750/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.033209    
-2020-12-09 19:18:03,656 - Epoch: [86][ 4000/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.033142    
-2020-12-09 19:18:11,790 - Epoch: [86][ 4250/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.033102    
-2020-12-09 19:18:19,906 - Epoch: [86][ 4498/ 4498]    Overall Loss 0.023041    Objective Loss 0.023041    MSE 0.023041    LR 0.000031    Time 0.033079    
-2020-12-09 19:18:20,739 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18151 |  0.00270 |    0.13704 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15709 | -0.01274 |    0.10675 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08373 | -0.00802 |    0.05693 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08706 | -0.01476 |    0.06417 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10106 | -0.00934 |    0.07327 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12054 | -0.01582 |    0.09122 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02016 |    0.11214 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27534 |  0.00005 |    0.21670 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:18:20,739 - Total sparsity: 0.00
-
-2020-12-09 19:18:20,742 - --- validate (epoch=86)-----------
-2020-12-09 19:18:20,742 - 49975 samples (100 per mini-batch)
-2020-12-09 19:18:26,139 - Epoch: [86][  250/  500]    Loss 0.024127    MSE 0.024127    
-2020-12-09 19:18:29,337 - Epoch: [86][  500/  500]    Loss 0.024099    MSE 0.024099    
-2020-12-09 19:18:30,026 - ==> MSE: 0.02410    Loss: 0.024
-
-2020-12-09 19:18:30,037 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:18:30,037 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:18:30,042 - 
-
-2020-12-09 19:18:30,042 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:18:41,102 - Epoch: [87][  250/ 4498]    Overall Loss 0.023123    Objective Loss 0.023123    MSE 0.023123    LR 0.000031    Time 0.044172    
-2020-12-09 19:18:49,174 - Epoch: [87][  500/ 4498]    Overall Loss 0.023111    Objective Loss 0.023111    MSE 0.023111    LR 0.000031    Time 0.038194    
-2020-12-09 19:18:57,254 - Epoch: [87][  750/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.036214    
-2020-12-09 19:19:05,344 - Epoch: [87][ 1000/ 4498]    Overall Loss 0.023059    Objective Loss 0.023059    MSE 0.023059    LR 0.000031    Time 0.035234    
-2020-12-09 19:19:13,439 - Epoch: [87][ 1250/ 4498]    Overall Loss 0.023061    Objective Loss 0.023061    MSE 0.023061    LR 0.000031    Time 0.034649    
-2020-12-09 19:19:21,522 - Epoch: [87][ 1500/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.034251    
-2020-12-09 19:19:29,606 - Epoch: [87][ 1750/ 4498]    Overall Loss 0.023027    Objective Loss 0.023027    MSE 0.023027    LR 0.000031    Time 0.033968    
-2020-12-09 19:19:37,690 - Epoch: [87][ 2000/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000031    Time 0.033755    
-2020-12-09 19:19:45,773 - Epoch: [87][ 2250/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.033590    
-2020-12-09 19:19:53,850 - Epoch: [87][ 2500/ 4498]    Overall Loss 0.023030    Objective Loss 0.023030    MSE 0.023030    LR 0.000031    Time 0.033454    
-2020-12-09 19:20:01,925 - Epoch: [87][ 2750/ 4498]    Overall Loss 0.023030    Objective Loss 0.023030    MSE 0.023030    LR 0.000031    Time 0.033343    
-2020-12-09 19:20:09,998 - Epoch: [87][ 3000/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.033250    
-2020-12-09 19:20:18,075 - Epoch: [87][ 3250/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.033172    
-2020-12-09 19:20:26,151 - Epoch: [87][ 3500/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.033105    
-2020-12-09 19:20:34,214 - Epoch: [87][ 3750/ 4498]    Overall Loss 0.023053    Objective Loss 0.023053    MSE 0.023053    LR 0.000031    Time 0.033044    
-2020-12-09 19:20:42,273 - Epoch: [87][ 4000/ 4498]    Overall Loss 0.023056    Objective Loss 0.023056    MSE 0.023056    LR 0.000031    Time 0.032989    
-2020-12-09 19:20:50,342 - Epoch: [87][ 4250/ 4498]    Overall Loss 0.023060    Objective Loss 0.023060    MSE 0.023060    LR 0.000031    Time 0.032943    
-2020-12-09 19:20:58,368 - Epoch: [87][ 4498/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.032908    
-2020-12-09 19:20:59,162 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18150 |  0.00280 |    0.13704 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15711 | -0.01269 |    0.10675 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08371 | -0.00802 |    0.05691 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08705 | -0.01476 |    0.06416 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10105 | -0.00933 |    0.07325 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12052 | -0.01581 |    0.09120 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02017 |    0.11213 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27549 |  0.00004 |    0.21682 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:20:59,163 - Total sparsity: 0.00
-
-2020-12-09 19:20:59,166 - --- validate (epoch=87)-----------
-2020-12-09 19:20:59,166 - 49975 samples (100 per mini-batch)
-2020-12-09 19:21:04,907 - Epoch: [87][  250/  500]    Loss 0.024082    MSE 0.024082    
-2020-12-09 19:21:08,163 - Epoch: [87][  500/  500]    Loss 0.024025    MSE 0.024025    
-2020-12-09 19:21:08,902 - ==> MSE: 0.02402    Loss: 0.024
-
-2020-12-09 19:21:08,913 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:21:08,913 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:21:08,918 - 
-
-2020-12-09 19:21:08,918 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:21:20,104 - Epoch: [88][  250/ 4498]    Overall Loss 0.023027    Objective Loss 0.023027    MSE 0.023027    LR 0.000031    Time 0.044673    
-2020-12-09 19:21:28,178 - Epoch: [88][  500/ 4498]    Overall Loss 0.023041    Objective Loss 0.023041    MSE 0.023041    LR 0.000031    Time 0.038451    
-2020-12-09 19:21:36,245 - Epoch: [88][  750/ 4498]    Overall Loss 0.023007    Objective Loss 0.023007    MSE 0.023007    LR 0.000031    Time 0.036367    
-2020-12-09 19:21:44,306 - Epoch: [88][ 1000/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.035318    
-2020-12-09 19:21:52,364 - Epoch: [88][ 1250/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.034688    
-2020-12-09 19:22:00,425 - Epoch: [88][ 1500/ 4498]    Overall Loss 0.023022    Objective Loss 0.023022    MSE 0.023022    LR 0.000031    Time 0.034269    
-2020-12-09 19:22:08,486 - Epoch: [88][ 1750/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.033970    
-2020-12-09 19:22:16,548 - Epoch: [88][ 2000/ 4498]    Overall Loss 0.023010    Objective Loss 0.023010    MSE 0.023010    LR 0.000031    Time 0.033746    
-2020-12-09 19:22:24,611 - Epoch: [88][ 2250/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.033573    
-2020-12-09 19:22:32,675 - Epoch: [88][ 2500/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.033434    
-2020-12-09 19:22:40,739 - Epoch: [88][ 2750/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.033321    
-2020-12-09 19:22:48,801 - Epoch: [88][ 3000/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.033226    
-2020-12-09 19:22:56,866 - Epoch: [88][ 3250/ 4498]    Overall Loss 0.023030    Objective Loss 0.023030    MSE 0.023029    LR 0.000031    Time 0.033146    
-2020-12-09 19:23:04,934 - Epoch: [88][ 3500/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.033079    
-2020-12-09 19:23:13,004 - Epoch: [88][ 3750/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.033021    
-2020-12-09 19:23:21,067 - Epoch: [88][ 4000/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032968    
-2020-12-09 19:23:29,128 - Epoch: [88][ 4250/ 4498]    Overall Loss 0.023049    Objective Loss 0.023049    MSE 0.023049    LR 0.000031    Time 0.032922    
-2020-12-09 19:23:37,146 - Epoch: [88][ 4498/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.032886    
-2020-12-09 19:23:37,978 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18155 |  0.00280 |    0.13709 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15712 | -0.01272 |    0.10677 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08369 | -0.00802 |    0.05688 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08704 | -0.01476 |    0.06415 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10103 | -0.00933 |    0.07323 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12051 | -0.01581 |    0.09119 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02017 |    0.11213 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27564 |  0.00004 |    0.21694 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:23:37,978 - Total sparsity: 0.00
-
-2020-12-09 19:23:37,981 - --- validate (epoch=88)-----------
-2020-12-09 19:23:37,981 - 49975 samples (100 per mini-batch)
-2020-12-09 19:23:43,528 - Epoch: [88][  250/  500]    Loss 0.024011    MSE 0.024011    
-2020-12-09 19:23:46,824 - Epoch: [88][  500/  500]    Loss 0.023989    MSE 0.023988    
-2020-12-09 19:23:47,560 - ==> MSE: 0.02399    Loss: 0.024
-
-2020-12-09 19:23:47,571 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:23:47,571 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:23:47,576 - 
-
-2020-12-09 19:23:47,576 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:23:58,808 - Epoch: [89][  250/ 4498]    Overall Loss 0.022966    Objective Loss 0.022966    MSE 0.022966    LR 0.000031    Time 0.044856    
-2020-12-09 19:24:06,878 - Epoch: [89][  500/ 4498]    Overall Loss 0.023012    Objective Loss 0.023012    MSE 0.023012    LR 0.000031    Time 0.038534    
-2020-12-09 19:24:14,946 - Epoch: [89][  750/ 4498]    Overall Loss 0.022994    Objective Loss 0.022994    MSE 0.022994    LR 0.000031    Time 0.036424    
-2020-12-09 19:24:23,012 - Epoch: [89][ 1000/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.035366    
-2020-12-09 19:24:31,077 - Epoch: [89][ 1250/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.034732    
-2020-12-09 19:24:39,143 - Epoch: [89][ 1500/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.034309    
-2020-12-09 19:24:47,208 - Epoch: [89][ 1750/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.034006    
-2020-12-09 19:24:55,273 - Epoch: [89][ 2000/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.033780    
-2020-12-09 19:25:03,339 - Epoch: [89][ 2250/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.033603    
-2020-12-09 19:25:11,411 - Epoch: [89][ 2500/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.033465    
-2020-12-09 19:25:19,418 - Epoch: [89][ 2750/ 4498]    Overall Loss 0.023055    Objective Loss 0.023055    MSE 0.023055    LR 0.000031    Time 0.033328    
-2020-12-09 19:25:27,406 - Epoch: [89][ 3000/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.033208    
-2020-12-09 19:25:35,400 - Epoch: [89][ 3250/ 4498]    Overall Loss 0.023044    Objective Loss 0.023044    MSE 0.023044    LR 0.000031    Time 0.033107    
-2020-12-09 19:25:43,385 - Epoch: [89][ 3500/ 4498]    Overall Loss 0.023049    Objective Loss 0.023049    MSE 0.023049    LR 0.000031    Time 0.033019    
-2020-12-09 19:25:51,341 - Epoch: [89][ 3750/ 4498]    Overall Loss 0.023048    Objective Loss 0.023048    MSE 0.023048    LR 0.000031    Time 0.032935    
-2020-12-09 19:25:59,303 - Epoch: [89][ 4000/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032863    
-2020-12-09 19:26:07,277 - Epoch: [89][ 4250/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.032802    
-2020-12-09 19:26:15,200 - Epoch: [89][ 4498/ 4498]    Overall Loss 0.023051    Objective Loss 0.023051    MSE 0.023051    LR 0.000031    Time 0.032752    
-2020-12-09 19:26:16,041 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18161 |  0.00274 |    0.13713 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15713 | -0.01271 |    0.10678 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08367 | -0.00802 |    0.05685 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08703 | -0.01476 |    0.06414 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10101 | -0.00932 |    0.07322 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12049 | -0.01580 |    0.09117 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02015 |    0.11212 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27578 |  0.00004 |    0.21705 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:26:16,041 - Total sparsity: 0.00
-
-2020-12-09 19:26:16,044 - --- validate (epoch=89)-----------
-2020-12-09 19:26:16,044 - 49975 samples (100 per mini-batch)
-2020-12-09 19:26:21,334 - Epoch: [89][  250/  500]    Loss 0.023973    MSE 0.023973    
-2020-12-09 19:26:24,591 - Epoch: [89][  500/  500]    Loss 0.023983    MSE 0.023983    
-2020-12-09 19:26:25,331 - ==> MSE: 0.02398    Loss: 0.024
-
-2020-12-09 19:26:25,342 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:26:25,342 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:26:25,347 - 
-
-2020-12-09 19:26:25,347 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:26:36,596 - Epoch: [90][  250/ 4498]    Overall Loss 0.023082    Objective Loss 0.023082    MSE 0.023082    LR 0.000031    Time 0.044928    
-2020-12-09 19:26:44,711 - Epoch: [90][  500/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.038659    
-2020-12-09 19:26:52,818 - Epoch: [90][  750/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.036559    
-2020-12-09 19:27:00,923 - Epoch: [90][ 1000/ 4498]    Overall Loss 0.023009    Objective Loss 0.023009    MSE 0.023009    LR 0.000031    Time 0.035507    
-2020-12-09 19:27:09,026 - Epoch: [90][ 1250/ 4498]    Overall Loss 0.023006    Objective Loss 0.023006    MSE 0.023006    LR 0.000031    Time 0.034874    
-2020-12-09 19:27:17,130 - Epoch: [90][ 1500/ 4498]    Overall Loss 0.022995    Objective Loss 0.022995    MSE 0.022995    LR 0.000031    Time 0.034453    
-2020-12-09 19:27:25,233 - Epoch: [90][ 1750/ 4498]    Overall Loss 0.022996    Objective Loss 0.022996    MSE 0.022996    LR 0.000031    Time 0.034151    
-2020-12-09 19:27:33,336 - Epoch: [90][ 2000/ 4498]    Overall Loss 0.023009    Objective Loss 0.023009    MSE 0.023009    LR 0.000031    Time 0.033925    
-2020-12-09 19:27:41,442 - Epoch: [90][ 2250/ 4498]    Overall Loss 0.023024    Objective Loss 0.023024    MSE 0.023025    LR 0.000031    Time 0.033751    
-2020-12-09 19:27:49,549 - Epoch: [90][ 2500/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.033612    
-2020-12-09 19:27:57,657 - Epoch: [90][ 2750/ 4498]    Overall Loss 0.023025    Objective Loss 0.023025    MSE 0.023025    LR 0.000031    Time 0.033498    
-2020-12-09 19:28:05,765 - Epoch: [90][ 3000/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.033404    
-2020-12-09 19:28:13,872 - Epoch: [90][ 3250/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.033323    
-2020-12-09 19:28:21,976 - Epoch: [90][ 3500/ 4498]    Overall Loss 0.023030    Objective Loss 0.023030    MSE 0.023030    LR 0.000031    Time 0.033254    
-2020-12-09 19:28:30,054 - Epoch: [90][ 3750/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.033186    
-2020-12-09 19:28:38,132 - Epoch: [90][ 4000/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.033127    
-2020-12-09 19:28:46,212 - Epoch: [90][ 4250/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.033076    
-2020-12-09 19:28:54,247 - Epoch: [90][ 4498/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.033036    
-2020-12-09 19:28:55,058 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18160 |  0.00284 |    0.13712 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15714 | -0.01270 |    0.10679 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08366 | -0.00803 |    0.05683 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08702 | -0.01475 |    0.06413 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10099 | -0.00931 |    0.07320 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12047 | -0.01581 |    0.09116 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02015 |    0.11212 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27593 |  0.00003 |    0.21716 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:28:55,058 - Total sparsity: 0.00
-
-2020-12-09 19:28:55,061 - --- validate (epoch=90)-----------
-2020-12-09 19:28:55,062 - 49975 samples (100 per mini-batch)
-2020-12-09 19:29:00,811 - Epoch: [90][  250/  500]    Loss 0.024057    MSE 0.024057    
-2020-12-09 19:29:04,220 - Epoch: [90][  500/  500]    Loss 0.024048    MSE 0.024049    
-2020-12-09 19:29:04,950 - ==> MSE: 0.02405    Loss: 0.024
-
-2020-12-09 19:29:04,961 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:29:04,961 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:29:04,966 - 
-
-2020-12-09 19:29:04,966 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:29:16,011 - Epoch: [91][  250/ 4498]    Overall Loss 0.023012    Objective Loss 0.023012    MSE 0.023012    LR 0.000031    Time 0.044113    
-2020-12-09 19:29:24,040 - Epoch: [91][  500/ 4498]    Overall Loss 0.022991    Objective Loss 0.022991    MSE 0.022991    LR 0.000031    Time 0.038079    
-2020-12-09 19:29:32,077 - Epoch: [91][  750/ 4498]    Overall Loss 0.022978    Objective Loss 0.022978    MSE 0.022978    LR 0.000031    Time 0.036079    
-2020-12-09 19:29:40,117 - Epoch: [91][ 1000/ 4498]    Overall Loss 0.022971    Objective Loss 0.022971    MSE 0.022971    LR 0.000031    Time 0.035082    
-2020-12-09 19:29:48,156 - Epoch: [91][ 1250/ 4498]    Overall Loss 0.022970    Objective Loss 0.022970    MSE 0.022970    LR 0.000031    Time 0.034483    
-2020-12-09 19:29:56,193 - Epoch: [91][ 1500/ 4498]    Overall Loss 0.022972    Objective Loss 0.022972    MSE 0.022972    LR 0.000031    Time 0.034083    
-2020-12-09 19:30:04,229 - Epoch: [91][ 1750/ 4498]    Overall Loss 0.022983    Objective Loss 0.022983    MSE 0.022983    LR 0.000031    Time 0.033796    
-2020-12-09 19:30:12,266 - Epoch: [91][ 2000/ 4498]    Overall Loss 0.022988    Objective Loss 0.022988    MSE 0.022987    LR 0.000031    Time 0.033581    
-2020-12-09 19:30:20,301 - Epoch: [91][ 2250/ 4498]    Overall Loss 0.022998    Objective Loss 0.022998    MSE 0.022998    LR 0.000031    Time 0.033414    
-2020-12-09 19:30:28,335 - Epoch: [91][ 2500/ 4498]    Overall Loss 0.023020    Objective Loss 0.023020    MSE 0.023020    LR 0.000031    Time 0.033279    
-2020-12-09 19:30:36,369 - Epoch: [91][ 2750/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000031    Time 0.033169    
-2020-12-09 19:30:44,402 - Epoch: [91][ 3000/ 4498]    Overall Loss 0.023027    Objective Loss 0.023027    MSE 0.023027    LR 0.000031    Time 0.033076    
-2020-12-09 19:30:52,438 - Epoch: [91][ 3250/ 4498]    Overall Loss 0.023028    Objective Loss 0.023028    MSE 0.023028    LR 0.000031    Time 0.032999    
-2020-12-09 19:31:00,472 - Epoch: [91][ 3500/ 4498]    Overall Loss 0.023025    Objective Loss 0.023025    MSE 0.023025    LR 0.000031    Time 0.032933    
-2020-12-09 19:31:08,477 - Epoch: [91][ 3750/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.032868    
-2020-12-09 19:31:16,475 - Epoch: [91][ 4000/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.032808    
-2020-12-09 19:31:24,459 - Epoch: [91][ 4250/ 4498]    Overall Loss 0.023044    Objective Loss 0.023044    MSE 0.023044    LR 0.000031    Time 0.032753    
-2020-12-09 19:31:32,395 - Epoch: [91][ 4498/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.032709    
-2020-12-09 19:31:33,230 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18171 |  0.00271 |    0.13720 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15716 | -0.01267 |    0.10680 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08363 | -0.00801 |    0.05681 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08701 | -0.01475 |    0.06412 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10098 | -0.00931 |    0.07319 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12045 | -0.01579 |    0.09115 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02015 |    0.11212 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27607 |  0.00003 |    0.21728 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:31:33,231 - Total sparsity: 0.00
-
-2020-12-09 19:31:33,234 - --- validate (epoch=91)-----------
-2020-12-09 19:31:33,234 - 49975 samples (100 per mini-batch)
-2020-12-09 19:31:38,824 - Epoch: [91][  250/  500]    Loss 0.024001    MSE 0.024001    
-2020-12-09 19:31:42,123 - Epoch: [91][  500/  500]    Loss 0.024069    MSE 0.024069    
-2020-12-09 19:31:42,871 - ==> MSE: 0.02407    Loss: 0.024
-
-2020-12-09 19:31:42,882 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:31:42,882 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:31:42,887 - 
-
-2020-12-09 19:31:42,887 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:31:53,940 - Epoch: [92][  250/ 4498]    Overall Loss 0.023013    Objective Loss 0.023013    MSE 0.023013    LR 0.000031    Time 0.044144    
-2020-12-09 19:32:01,970 - Epoch: [92][  500/ 4498]    Overall Loss 0.023027    Objective Loss 0.023027    MSE 0.023027    LR 0.000031    Time 0.038097    
-2020-12-09 19:32:09,998 - Epoch: [92][  750/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.036080    
-2020-12-09 19:32:18,024 - Epoch: [92][ 1000/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.035068    
-2020-12-09 19:32:26,043 - Epoch: [92][ 1250/ 4498]    Overall Loss 0.023020    Objective Loss 0.023020    MSE 0.023020    LR 0.000031    Time 0.034456    
-2020-12-09 19:32:34,057 - Epoch: [92][ 1500/ 4498]    Overall Loss 0.023034    Objective Loss 0.023034    MSE 0.023034    LR 0.000031    Time 0.034044    
-2020-12-09 19:32:42,085 - Epoch: [92][ 1750/ 4498]    Overall Loss 0.023052    Objective Loss 0.023052    MSE 0.023052    LR 0.000031    Time 0.033758    
-2020-12-09 19:32:50,171 - Epoch: [92][ 2000/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.033573    
-2020-12-09 19:32:58,262 - Epoch: [92][ 2250/ 4498]    Overall Loss 0.023054    Objective Loss 0.023054    MSE 0.023054    LR 0.000031    Time 0.033431    
-2020-12-09 19:33:06,352 - Epoch: [92][ 2500/ 4498]    Overall Loss 0.023057    Objective Loss 0.023057    MSE 0.023057    LR 0.000031    Time 0.033317    
-2020-12-09 19:33:14,440 - Epoch: [92][ 2750/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.033223    
-2020-12-09 19:33:22,523 - Epoch: [92][ 3000/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.033143    
-2020-12-09 19:33:30,611 - Epoch: [92][ 3250/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.033077    
-2020-12-09 19:33:38,698 - Epoch: [92][ 3500/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.033020    
-2020-12-09 19:33:46,772 - Epoch: [92][ 3750/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.032967    
-2020-12-09 19:33:54,841 - Epoch: [92][ 4000/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.032920    
-2020-12-09 19:34:02,908 - Epoch: [92][ 4250/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.032877    
-2020-12-09 19:34:10,937 - Epoch: [92][ 4498/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.032847    
-2020-12-09 19:34:11,740 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18168 |  0.00278 |    0.13719 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15717 | -0.01269 |    0.10682 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08361 | -0.00801 |    0.05678 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08700 | -0.01473 |    0.06411 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10096 | -0.00930 |    0.07318 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12044 | -0.01579 |    0.09113 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02014 |    0.11211 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27621 |  0.00003 |    0.21739 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:34:11,740 - Total sparsity: 0.00
-
-2020-12-09 19:34:11,743 - --- validate (epoch=92)-----------
-2020-12-09 19:34:11,743 - 49975 samples (100 per mini-batch)
-2020-12-09 19:34:17,075 - Epoch: [92][  250/  500]    Loss 0.024136    MSE 0.024136    
-2020-12-09 19:34:20,435 - Epoch: [92][  500/  500]    Loss 0.024038    MSE 0.024037    
-2020-12-09 19:34:21,187 - ==> MSE: 0.02404    Loss: 0.024
-
-2020-12-09 19:34:21,198 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:34:21,198 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:34:21,203 - 
-
-2020-12-09 19:34:21,203 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:34:32,289 - Epoch: [93][  250/ 4498]    Overall Loss 0.023015    Objective Loss 0.023015    MSE 0.023015    LR 0.000031    Time 0.044273    
-2020-12-09 19:34:40,311 - Epoch: [93][  500/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.038146    
-2020-12-09 19:34:48,329 - Epoch: [93][  750/ 4498]    Overall Loss 0.023056    Objective Loss 0.023056    MSE 0.023056    LR 0.000031    Time 0.036099    
-2020-12-09 19:34:56,335 - Epoch: [93][ 1000/ 4498]    Overall Loss 0.023044    Objective Loss 0.023044    MSE 0.023044    LR 0.000031    Time 0.035063    
-2020-12-09 19:35:04,339 - Epoch: [93][ 1250/ 4498]    Overall Loss 0.023050    Objective Loss 0.023050    MSE 0.023050    LR 0.000031    Time 0.034440    
-2020-12-09 19:35:12,344 - Epoch: [93][ 1500/ 4498]    Overall Loss 0.023051    Objective Loss 0.023051    MSE 0.023051    LR 0.000031    Time 0.034025    
-2020-12-09 19:35:20,434 - Epoch: [93][ 1750/ 4498]    Overall Loss 0.023081    Objective Loss 0.023081    MSE 0.023081    LR 0.000031    Time 0.033777    
-2020-12-09 19:35:28,516 - Epoch: [93][ 2000/ 4498]    Overall Loss 0.023068    Objective Loss 0.023068    MSE 0.023068    LR 0.000031    Time 0.033587    
-2020-12-09 19:35:36,597 - Epoch: [93][ 2250/ 4498]    Overall Loss 0.023060    Objective Loss 0.023060    MSE 0.023060    LR 0.000031    Time 0.033439    
-2020-12-09 19:35:44,674 - Epoch: [93][ 2500/ 4498]    Overall Loss 0.023055    Objective Loss 0.023055    MSE 0.023055    LR 0.000031    Time 0.033319    
-2020-12-09 19:35:52,752 - Epoch: [93][ 2750/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.033222    
-2020-12-09 19:36:00,835 - Epoch: [93][ 3000/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.033142    
-2020-12-09 19:36:08,915 - Epoch: [93][ 3250/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.033073    
-2020-12-09 19:36:16,990 - Epoch: [93][ 3500/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.033013    
-2020-12-09 19:36:25,056 - Epoch: [93][ 3750/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.032959    
-2020-12-09 19:36:33,122 - Epoch: [93][ 4000/ 4498]    Overall Loss 0.023048    Objective Loss 0.023048    MSE 0.023048    LR 0.000031    Time 0.032911    
-2020-12-09 19:36:41,200 - Epoch: [93][ 4250/ 4498]    Overall Loss 0.023047    Objective Loss 0.023047    MSE 0.023047    LR 0.000031    Time 0.032872    
-2020-12-09 19:36:49,240 - Epoch: [93][ 4498/ 4498]    Overall Loss 0.023049    Objective Loss 0.023049    MSE 0.023049    LR 0.000031    Time 0.032844    
-2020-12-09 19:36:50,044 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18174 |  0.00275 |    0.13724 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15717 | -0.01267 |    0.10682 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08359 | -0.00802 |    0.05676 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08699 | -0.01473 |    0.06410 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10093 | -0.00929 |    0.07316 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12042 | -0.01578 |    0.09112 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02014 |    0.11211 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27635 |  0.00003 |    0.21750 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:36:50,044 - Total sparsity: 0.00
-
-2020-12-09 19:36:50,047 - --- validate (epoch=93)-----------
-2020-12-09 19:36:50,047 - 49975 samples (100 per mini-batch)
-2020-12-09 19:36:55,689 - Epoch: [93][  250/  500]    Loss 0.024120    MSE 0.024120    
-2020-12-09 19:36:58,868 - Epoch: [93][  500/  500]    Loss 0.024059    MSE 0.024060    
-2020-12-09 19:36:59,535 - ==> MSE: 0.02406    Loss: 0.024
-
-2020-12-09 19:36:59,547 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:36:59,547 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:36:59,552 - 
-
-2020-12-09 19:36:59,552 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:37:10,689 - Epoch: [94][  250/ 4498]    Overall Loss 0.023088    Objective Loss 0.023088    MSE 0.023088    LR 0.000031    Time 0.044481    
-2020-12-09 19:37:18,708 - Epoch: [94][  500/ 4498]    Overall Loss 0.023083    Objective Loss 0.023083    MSE 0.023083    LR 0.000031    Time 0.038243    
-2020-12-09 19:37:26,718 - Epoch: [94][  750/ 4498]    Overall Loss 0.023057    Objective Loss 0.023057    MSE 0.023057    LR 0.000031    Time 0.036152    
-2020-12-09 19:37:34,719 - Epoch: [94][ 1000/ 4498]    Overall Loss 0.023066    Objective Loss 0.023066    MSE 0.023066    LR 0.000031    Time 0.035098    
-2020-12-09 19:37:42,714 - Epoch: [94][ 1250/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.034461    
-2020-12-09 19:37:50,707 - Epoch: [94][ 1500/ 4498]    Overall Loss 0.023024    Objective Loss 0.023024    MSE 0.023024    LR 0.000031    Time 0.034034    
-2020-12-09 19:37:58,701 - Epoch: [94][ 1750/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.033730    
-2020-12-09 19:38:06,693 - Epoch: [94][ 2000/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.033501    
-2020-12-09 19:38:14,682 - Epoch: [94][ 2250/ 4498]    Overall Loss 0.023048    Objective Loss 0.023048    MSE 0.023048    LR 0.000031    Time 0.033322    
-2020-12-09 19:38:22,672 - Epoch: [94][ 2500/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.033179    
-2020-12-09 19:38:30,657 - Epoch: [94][ 2750/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023029    LR 0.000031    Time 0.033060    
-2020-12-09 19:38:38,651 - Epoch: [94][ 3000/ 4498]    Overall Loss 0.023038    Objective Loss 0.023038    MSE 0.023038    LR 0.000031    Time 0.032964    
-2020-12-09 19:38:46,645 - Epoch: [94][ 3250/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.032883    
-2020-12-09 19:38:54,630 - Epoch: [94][ 3500/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.032810    
-2020-12-09 19:39:02,586 - Epoch: [94][ 3750/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.032740    
-2020-12-09 19:39:10,558 - Epoch: [94][ 4000/ 4498]    Overall Loss 0.023049    Objective Loss 0.023049    MSE 0.023049    LR 0.000031    Time 0.032682    
-2020-12-09 19:39:18,538 - Epoch: [94][ 4250/ 4498]    Overall Loss 0.023052    Objective Loss 0.023052    MSE 0.023052    LR 0.000031    Time 0.032633    
-2020-12-09 19:39:26,469 - Epoch: [94][ 4498/ 4498]    Overall Loss 0.023048    Objective Loss 0.023048    MSE 0.023048    LR 0.000031    Time 0.032594    
-2020-12-09 19:39:27,295 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18179 |  0.00276 |    0.13729 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15719 | -0.01267 |    0.10683 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08358 | -0.00799 |    0.05674 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08697 | -0.01472 |    0.06409 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10092 | -0.00930 |    0.07315 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12040 | -0.01577 |    0.09110 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02014 |    0.11210 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27649 |  0.00003 |    0.21761 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:39:27,295 - Total sparsity: 0.00
-
-2020-12-09 19:39:27,298 - --- validate (epoch=94)-----------
-2020-12-09 19:39:27,298 - 49975 samples (100 per mini-batch)
-2020-12-09 19:39:32,931 - Epoch: [94][  250/  500]    Loss 0.024028    MSE 0.024028    
-2020-12-09 19:39:36,242 - Epoch: [94][  500/  500]    Loss 0.024029    MSE 0.024030    
-2020-12-09 19:39:36,935 - ==> MSE: 0.02403    Loss: 0.024
-
-2020-12-09 19:39:36,947 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:39:36,947 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:39:36,951 - 
-
-2020-12-09 19:39:36,951 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:39:48,079 - Epoch: [95][  250/ 4498]    Overall Loss 0.022904    Objective Loss 0.022904    MSE 0.022904    LR 0.000031    Time 0.044441    
-2020-12-09 19:39:56,205 - Epoch: [95][  500/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.038438    
-2020-12-09 19:40:04,323 - Epoch: [95][  750/ 4498]    Overall Loss 0.023005    Objective Loss 0.023005    MSE 0.023005    LR 0.000031    Time 0.036426    
-2020-12-09 19:40:12,429 - Epoch: [95][ 1000/ 4498]    Overall Loss 0.022995    Objective Loss 0.022995    MSE 0.022995    LR 0.000031    Time 0.035408    
-2020-12-09 19:40:20,513 - Epoch: [95][ 1250/ 4498]    Overall Loss 0.022995    Objective Loss 0.022995    MSE 0.022995    LR 0.000031    Time 0.034780    
-2020-12-09 19:40:28,603 - Epoch: [95][ 1500/ 4498]    Overall Loss 0.023007    Objective Loss 0.023007    MSE 0.023007    LR 0.000031    Time 0.034365    
-2020-12-09 19:40:36,695 - Epoch: [95][ 1750/ 4498]    Overall Loss 0.023005    Objective Loss 0.023005    MSE 0.023005    LR 0.000031    Time 0.034070    
-2020-12-09 19:40:44,786 - Epoch: [95][ 2000/ 4498]    Overall Loss 0.023002    Objective Loss 0.023002    MSE 0.023002    LR 0.000031    Time 0.033848    
-2020-12-09 19:40:52,872 - Epoch: [95][ 2250/ 4498]    Overall Loss 0.023009    Objective Loss 0.023009    MSE 0.023009    LR 0.000031    Time 0.033673    
-2020-12-09 19:41:00,957 - Epoch: [95][ 2500/ 4498]    Overall Loss 0.023009    Objective Loss 0.023009    MSE 0.023009    LR 0.000031    Time 0.033534    
-2020-12-09 19:41:09,055 - Epoch: [95][ 2750/ 4498]    Overall Loss 0.023001    Objective Loss 0.023001    MSE 0.023001    LR 0.000031    Time 0.033423    
-2020-12-09 19:41:17,147 - Epoch: [95][ 3000/ 4498]    Overall Loss 0.023005    Objective Loss 0.023005    MSE 0.023005    LR 0.000031    Time 0.033330    
-2020-12-09 19:41:25,244 - Epoch: [95][ 3250/ 4498]    Overall Loss 0.023010    Objective Loss 0.023010    MSE 0.023010    LR 0.000031    Time 0.033252    
-2020-12-09 19:41:33,315 - Epoch: [95][ 3500/ 4498]    Overall Loss 0.023016    Objective Loss 0.023016    MSE 0.023016    LR 0.000031    Time 0.033178    
-2020-12-09 19:41:41,328 - Epoch: [95][ 3750/ 4498]    Overall Loss 0.023016    Objective Loss 0.023016    MSE 0.023016    LR 0.000031    Time 0.033098    
-2020-12-09 19:41:49,345 - Epoch: [95][ 4000/ 4498]    Overall Loss 0.023029    Objective Loss 0.023029    MSE 0.023028    LR 0.000031    Time 0.033030    
-2020-12-09 19:41:57,369 - Epoch: [95][ 4250/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.032971    
-2020-12-09 19:42:05,350 - Epoch: [95][ 4498/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.032924    
-2020-12-09 19:42:06,172 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18185 |  0.00269 |    0.13733 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15721 | -0.01264 |    0.10685 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08356 | -0.00800 |    0.05672 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08696 | -0.01471 |    0.06408 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10091 | -0.00929 |    0.07314 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12038 | -0.01575 |    0.09108 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15519 | -0.02013 |    0.11209 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27662 |  0.00003 |    0.21772 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:42:06,172 - Total sparsity: 0.00
-
-2020-12-09 19:42:06,175 - --- validate (epoch=95)-----------
-2020-12-09 19:42:06,175 - 49975 samples (100 per mini-batch)
-2020-12-09 19:42:11,603 - Epoch: [95][  250/  500]    Loss 0.024014    MSE 0.024014    
-2020-12-09 19:42:15,101 - Epoch: [95][  500/  500]    Loss 0.024006    MSE 0.024006    
-2020-12-09 19:42:15,830 - ==> MSE: 0.02401    Loss: 0.024
-
-2020-12-09 19:42:15,842 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:42:15,842 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:42:15,846 - 
-
-2020-12-09 19:42:15,846 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:42:26,902 - Epoch: [96][  250/ 4498]    Overall Loss 0.022978    Objective Loss 0.022978    MSE 0.022978    LR 0.000031    Time 0.044153    
-2020-12-09 19:42:34,957 - Epoch: [96][  500/ 4498]    Overall Loss 0.022986    Objective Loss 0.022986    MSE 0.022986    LR 0.000031    Time 0.038152    
-2020-12-09 19:42:43,008 - Epoch: [96][  750/ 4498]    Overall Loss 0.023010    Objective Loss 0.023010    MSE 0.023010    LR 0.000031    Time 0.036147    
-2020-12-09 19:42:51,056 - Epoch: [96][ 1000/ 4498]    Overall Loss 0.023049    Objective Loss 0.023049    MSE 0.023049    LR 0.000031    Time 0.035141    
-2020-12-09 19:42:59,103 - Epoch: [96][ 1250/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.034537    
-2020-12-09 19:43:07,147 - Epoch: [96][ 1500/ 4498]    Overall Loss 0.023048    Objective Loss 0.023048    MSE 0.023048    LR 0.000031    Time 0.034132    
-2020-12-09 19:43:15,197 - Epoch: [96][ 1750/ 4498]    Overall Loss 0.023054    Objective Loss 0.023054    MSE 0.023054    LR 0.000031    Time 0.033846    
-2020-12-09 19:43:23,250 - Epoch: [96][ 2000/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.033633    
-2020-12-09 19:43:31,306 - Epoch: [96][ 2250/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.033469    
-2020-12-09 19:43:39,365 - Epoch: [96][ 2500/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.033339    
-2020-12-09 19:43:47,421 - Epoch: [96][ 2750/ 4498]    Overall Loss 0.023026    Objective Loss 0.023026    MSE 0.023026    LR 0.000031    Time 0.033231    
-2020-12-09 19:43:55,482 - Epoch: [96][ 3000/ 4498]    Overall Loss 0.023020    Objective Loss 0.023020    MSE 0.023020    LR 0.000031    Time 0.033143    
-2020-12-09 19:44:03,545 - Epoch: [96][ 3250/ 4498]    Overall Loss 0.023017    Objective Loss 0.023017    MSE 0.023017    LR 0.000031    Time 0.033069    
-2020-12-09 19:44:11,595 - Epoch: [96][ 3500/ 4498]    Overall Loss 0.023023    Objective Loss 0.023023    MSE 0.023023    LR 0.000031    Time 0.033002    
-2020-12-09 19:44:19,613 - Epoch: [96][ 3750/ 4498]    Overall Loss 0.023030    Objective Loss 0.023030    MSE 0.023030    LR 0.000031    Time 0.032936    
-2020-12-09 19:44:27,634 - Epoch: [96][ 4000/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.032878    
-2020-12-09 19:44:35,681 - Epoch: [96][ 4250/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.032834    
-2020-12-09 19:44:43,669 - Epoch: [96][ 4498/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032796    
-2020-12-09 19:44:44,504 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18187 |  0.00269 |    0.13736 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15723 | -0.01267 |    0.10687 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08355 | -0.00800 |    0.05669 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08695 | -0.01472 |    0.06407 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10089 | -0.00928 |    0.07312 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12037 | -0.01577 |    0.09107 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02013 |    0.11209 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27675 |  0.00002 |    0.21783 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:44:44,504 - Total sparsity: 0.00
-
-2020-12-09 19:44:44,507 - --- validate (epoch=96)-----------
-2020-12-09 19:44:44,507 - 49975 samples (100 per mini-batch)
-2020-12-09 19:44:49,998 - Epoch: [96][  250/  500]    Loss 0.024041    MSE 0.024041    
-2020-12-09 19:44:53,291 - Epoch: [96][  500/  500]    Loss 0.024034    MSE 0.024033    
-2020-12-09 19:44:54,039 - ==> MSE: 0.02403    Loss: 0.024
-
-2020-12-09 19:44:54,051 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:44:54,051 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:44:54,056 - 
-
-2020-12-09 19:44:54,056 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:45:05,118 - Epoch: [97][  250/ 4498]    Overall Loss 0.023006    Objective Loss 0.023006    MSE 0.023006    LR 0.000031    Time 0.044179    
-2020-12-09 19:45:13,132 - Epoch: [97][  500/ 4498]    Overall Loss 0.023054    Objective Loss 0.023054    MSE 0.023054    LR 0.000031    Time 0.038082    
-2020-12-09 19:45:21,138 - Epoch: [97][  750/ 4498]    Overall Loss 0.023082    Objective Loss 0.023082    MSE 0.023082    LR 0.000031    Time 0.036040    
-2020-12-09 19:45:29,139 - Epoch: [97][ 1000/ 4498]    Overall Loss 0.023069    Objective Loss 0.023069    MSE 0.023069    LR 0.000031    Time 0.035014    
-2020-12-09 19:45:37,148 - Epoch: [97][ 1250/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.034404    
-2020-12-09 19:45:45,155 - Epoch: [97][ 1500/ 4498]    Overall Loss 0.023035    Objective Loss 0.023035    MSE 0.023035    LR 0.000031    Time 0.033996    
-2020-12-09 19:45:53,163 - Epoch: [97][ 1750/ 4498]    Overall Loss 0.023020    Objective Loss 0.023020    MSE 0.023020    LR 0.000031    Time 0.033706    
-2020-12-09 19:46:01,170 - Epoch: [97][ 2000/ 4498]    Overall Loss 0.023022    Objective Loss 0.023022    MSE 0.023022    LR 0.000031    Time 0.033488    
-2020-12-09 19:46:09,168 - Epoch: [97][ 2250/ 4498]    Overall Loss 0.023030    Objective Loss 0.023030    MSE 0.023030    LR 0.000031    Time 0.033314    
-2020-12-09 19:46:17,175 - Epoch: [97][ 2500/ 4498]    Overall Loss 0.023033    Objective Loss 0.023033    MSE 0.023033    LR 0.000031    Time 0.033178    
-2020-12-09 19:46:25,180 - Epoch: [97][ 2750/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.033067    
-2020-12-09 19:46:33,159 - Epoch: [97][ 3000/ 4498]    Overall Loss 0.023037    Objective Loss 0.023037    MSE 0.023037    LR 0.000031    Time 0.032965    
-2020-12-09 19:46:41,137 - Epoch: [97][ 3250/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.032879    
-2020-12-09 19:46:49,107 - Epoch: [97][ 3500/ 4498]    Overall Loss 0.023040    Objective Loss 0.023040    MSE 0.023040    LR 0.000031    Time 0.032802    
-2020-12-09 19:46:57,055 - Epoch: [97][ 3750/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.032731    
-2020-12-09 19:47:05,013 - Epoch: [97][ 4000/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.032670    
-2020-12-09 19:47:12,976 - Epoch: [97][ 4250/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.032618    
-2020-12-09 19:47:20,902 - Epoch: [97][ 4498/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.032579    
-2020-12-09 19:47:21,703 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18191 |  0.00274 |    0.13738 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15724 | -0.01266 |    0.10687 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08353 | -0.00800 |    0.05668 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08693 | -0.01471 |    0.06406 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10087 | -0.00927 |    0.07311 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12035 | -0.01574 |    0.09105 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02013 |    0.11208 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27689 |  0.00003 |    0.21793 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:47:21,703 - Total sparsity: 0.00
-
-2020-12-09 19:47:21,706 - --- validate (epoch=97)-----------
-2020-12-09 19:47:21,706 - 49975 samples (100 per mini-batch)
-2020-12-09 19:47:27,172 - Epoch: [97][  250/  500]    Loss 0.024199    MSE 0.024199    
-2020-12-09 19:47:30,421 - Epoch: [97][  500/  500]    Loss 0.024091    MSE 0.024090    
-2020-12-09 19:47:31,138 - ==> MSE: 0.02409    Loss: 0.024
-
-2020-12-09 19:47:31,150 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:47:31,150 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:47:31,155 - 
-
-2020-12-09 19:47:31,155 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:47:42,262 - Epoch: [98][  250/ 4498]    Overall Loss 0.022977    Objective Loss 0.022977    MSE 0.022977    LR 0.000031    Time 0.044360    
-2020-12-09 19:47:50,318 - Epoch: [98][  500/ 4498]    Overall Loss 0.022975    Objective Loss 0.022975    MSE 0.022975    LR 0.000031    Time 0.038257    
-2020-12-09 19:47:58,364 - Epoch: [98][  750/ 4498]    Overall Loss 0.022993    Objective Loss 0.022993    MSE 0.022993    LR 0.000031    Time 0.036210    
-2020-12-09 19:48:06,414 - Epoch: [98][ 1000/ 4498]    Overall Loss 0.022977    Objective Loss 0.022977    MSE 0.022977    LR 0.000031    Time 0.035190    
-2020-12-09 19:48:14,484 - Epoch: [98][ 1250/ 4498]    Overall Loss 0.022997    Objective Loss 0.022997    MSE 0.022997    LR 0.000031    Time 0.034594    
-2020-12-09 19:48:22,523 - Epoch: [98][ 1500/ 4498]    Overall Loss 0.023006    Objective Loss 0.023006    MSE 0.023006    LR 0.000031    Time 0.034176    
-2020-12-09 19:48:30,592 - Epoch: [98][ 1750/ 4498]    Overall Loss 0.023002    Objective Loss 0.023002    MSE 0.023002    LR 0.000031    Time 0.033895    
-2020-12-09 19:48:38,713 - Epoch: [98][ 2000/ 4498]    Overall Loss 0.023004    Objective Loss 0.023004    MSE 0.023004    LR 0.000031    Time 0.033710    
-2020-12-09 19:48:46,835 - Epoch: [98][ 2250/ 4498]    Overall Loss 0.023015    Objective Loss 0.023015    MSE 0.023015    LR 0.000031    Time 0.033567    
-2020-12-09 19:48:54,955 - Epoch: [98][ 2500/ 4498]    Overall Loss 0.023026    Objective Loss 0.023026    MSE 0.023026    LR 0.000031    Time 0.033451    
-2020-12-09 19:49:03,077 - Epoch: [98][ 2750/ 4498]    Overall Loss 0.023031    Objective Loss 0.023031    MSE 0.023031    LR 0.000031    Time 0.033357    
-2020-12-09 19:49:11,198 - Epoch: [98][ 3000/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.033279    
-2020-12-09 19:49:19,316 - Epoch: [98][ 3250/ 4498]    Overall Loss 0.023046    Objective Loss 0.023046    MSE 0.023046    LR 0.000031    Time 0.033211    
-2020-12-09 19:49:27,435 - Epoch: [98][ 3500/ 4498]    Overall Loss 0.023041    Objective Loss 0.023041    MSE 0.023041    LR 0.000031    Time 0.033154    
-2020-12-09 19:49:35,555 - Epoch: [98][ 3750/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.033104    
-2020-12-09 19:49:43,675 - Epoch: [98][ 4000/ 4498]    Overall Loss 0.023045    Objective Loss 0.023045    MSE 0.023045    LR 0.000031    Time 0.033061    
-2020-12-09 19:49:51,781 - Epoch: [98][ 4250/ 4498]    Overall Loss 0.023042    Objective Loss 0.023042    MSE 0.023042    LR 0.000031    Time 0.033020    
-2020-12-09 19:49:59,852 - Epoch: [98][ 4498/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.032990    
-2020-12-09 19:50:00,687 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18195 |  0.00270 |    0.13743 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15725 | -0.01265 |    0.10688 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08350 | -0.00799 |    0.05665 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08692 | -0.01471 |    0.06405 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10085 | -0.00926 |    0.07309 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12033 | -0.01574 |    0.09104 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02014 |    0.11208 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27702 |  0.00003 |    0.21804 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:50:00,687 - Total sparsity: 0.00
-
-2020-12-09 19:50:00,690 - --- validate (epoch=98)-----------
-2020-12-09 19:50:00,690 - 49975 samples (100 per mini-batch)
-2020-12-09 19:50:06,297 - Epoch: [98][  250/  500]    Loss 0.024018    MSE 0.024018    
-2020-12-09 19:50:09,524 - Epoch: [98][  500/  500]    Loss 0.024006    MSE 0.024005    
-2020-12-09 19:50:10,284 - ==> MSE: 0.02401    Loss: 0.024
-
-2020-12-09 19:50:10,296 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:50:10,296 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:50:10,301 - 
-
-2020-12-09 19:50:10,301 - Training epoch: 449775 samples (100 per mini-batch)
-2020-12-09 19:50:21,472 - Epoch: [99][  250/ 4498]    Overall Loss 0.023032    Objective Loss 0.023032    MSE 0.023032    LR 0.000031    Time 0.044614    
-2020-12-09 19:50:29,500 - Epoch: [99][  500/ 4498]    Overall Loss 0.023018    Objective Loss 0.023018    MSE 0.023018    LR 0.000031    Time 0.038329    
-2020-12-09 19:50:37,546 - Epoch: [99][  750/ 4498]    Overall Loss 0.023007    Objective Loss 0.023007    MSE 0.023007    LR 0.000031    Time 0.036258    
-2020-12-09 19:50:45,580 - Epoch: [99][ 1000/ 4498]    Overall Loss 0.022991    Objective Loss 0.022991    MSE 0.022991    LR 0.000031    Time 0.035210    
-2020-12-09 19:50:53,614 - Epoch: [99][ 1250/ 4498]    Overall Loss 0.022998    Objective Loss 0.022998    MSE 0.022998    LR 0.000031    Time 0.034581    
-2020-12-09 19:51:01,652 - Epoch: [99][ 1500/ 4498]    Overall Loss 0.022999    Objective Loss 0.022999    MSE 0.022999    LR 0.000031    Time 0.034165    
-2020-12-09 19:51:09,695 - Epoch: [99][ 1750/ 4498]    Overall Loss 0.023006    Objective Loss 0.023006    MSE 0.023006    LR 0.000031    Time 0.033871    
-2020-12-09 19:51:17,733 - Epoch: [99][ 2000/ 4498]    Overall Loss 0.023006    Objective Loss 0.023006    MSE 0.023006    LR 0.000031    Time 0.033647    
-2020-12-09 19:51:25,767 - Epoch: [99][ 2250/ 4498]    Overall Loss 0.023014    Objective Loss 0.023014    MSE 0.023014    LR 0.000031    Time 0.033471    
-2020-12-09 19:51:33,798 - Epoch: [99][ 2500/ 4498]    Overall Loss 0.023021    Objective Loss 0.023021    MSE 0.023021    LR 0.000031    Time 0.033330    
-2020-12-09 19:51:41,829 - Epoch: [99][ 2750/ 4498]    Overall Loss 0.023025    Objective Loss 0.023025    MSE 0.023025    LR 0.000031    Time 0.033214    
-2020-12-09 19:51:49,870 - Epoch: [99][ 3000/ 4498]    Overall Loss 0.023036    Objective Loss 0.023036    MSE 0.023036    LR 0.000031    Time 0.033119    
-2020-12-09 19:51:57,907 - Epoch: [99][ 3250/ 4498]    Overall Loss 0.023043    Objective Loss 0.023043    MSE 0.023043    LR 0.000031    Time 0.033039    
-2020-12-09 19:52:05,940 - Epoch: [99][ 3500/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.032969    
-2020-12-09 19:52:13,953 - Epoch: [99][ 3750/ 4498]    Overall Loss 0.023038    Objective Loss 0.023038    MSE 0.023038    LR 0.000031    Time 0.032903    
-2020-12-09 19:52:21,968 - Epoch: [99][ 4000/ 4498]    Overall Loss 0.023044    Objective Loss 0.023044    MSE 0.023044    LR 0.000031    Time 0.032846    
-2020-12-09 19:52:29,988 - Epoch: [99][ 4250/ 4498]    Overall Loss 0.023039    Objective Loss 0.023039    MSE 0.023039    LR 0.000031    Time 0.032797    
-2020-12-09 19:52:37,968 - Epoch: [99][ 4498/ 4498]    Overall Loss 0.023041    Objective Loss 0.023041    MSE 0.023041    LR 0.000031    Time 0.032760    
-2020-12-09 19:52:38,787 - 
-Parameters:
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-|    | Name            | Shape           |   NNZ (dense) |   NNZ (sparse) |   Cols (%) |   Rows (%) |   Ch (%) |   2D (%) |   3D (%) |   Fine (%) |     Std |     Mean |   Abs-Mean |
-|----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------|
-|  0 | conv1.op.weight | (16, 3, 3, 3)   |           432 |            432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.18200 |  0.00277 |    0.13747 |
-|  1 | conv2.op.weight | (32, 16, 3, 3)  |          4608 |           4608 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15726 | -0.01265 |    0.10689 |
-|  2 | conv3.op.weight | (32, 32, 3, 3)  |          9216 |           9216 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08348 | -0.00798 |    0.05663 |
-|  3 | conv4.op.weight | (64, 32, 3, 3)  |         18432 |          18432 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.08691 | -0.01468 |    0.06404 |
-|  4 | conv5.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.10083 | -0.00927 |    0.07308 |
-|  5 | conv6.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.12032 | -0.01574 |    0.09103 |
-|  6 | conv7.op.weight | (64, 64, 3, 3)  |         36864 |          36864 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.15518 | -0.02013 |    0.11207 |
-|  7 | conv8.op.weight | (512, 64, 1, 1) |         32768 |          32768 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.27715 |  0.00004 |    0.21814 |
-|  8 | Total sparsity: | -               |        176048 |         176048 |          0 |          0 |  0.00000 |  0.00000 |  0.00000 |    0.00000 | 0.00000 |  0.00000 |    0.00000 |
-+----+-----------------+-----------------+---------------+----------------+------------+------------+----------+----------+----------+------------+---------+----------+------------+
-2020-12-09 19:52:38,787 - Total sparsity: 0.00
-
-2020-12-09 19:52:38,790 - --- validate (epoch=99)-----------
-2020-12-09 19:52:38,790 - 49975 samples (100 per mini-batch)
-2020-12-09 19:52:44,318 - Epoch: [99][  250/  500]    Loss 0.024021    MSE 0.024021    
-2020-12-09 19:52:47,779 - Epoch: [99][  500/  500]    Loss 0.024074    MSE 0.024074    
-2020-12-09 19:52:48,521 - ==> MSE: 0.02407    Loss: 0.024
-
-2020-12-09 19:52:48,533 - ==> Best [MSE: 0.02395   Sparsity:0.00   Params: 176048 on epoch: 84]
-2020-12-09 19:52:48,533 - Saving checkpoint to: logs/2020.12.09-153101/checkpoint.pth.tar
-2020-12-09 19:52:48,538 - --- test ---------------------
-2020-12-09 19:52:48,538 - 165412 samples (100 per mini-batch)
-2020-12-09 19:52:54,224 - Test: [  250/ 1655]    Loss 0.032516    MSE 0.032516    
-2020-12-09 19:52:57,671 - Test: [  500/ 1655]    Loss 0.032434    MSE 0.032434    
-2020-12-09 19:53:01,156 - Test: [  750/ 1655]    Loss 0.032403    MSE 0.032403    
-2020-12-09 19:53:04,623 - Test: [ 1000/ 1655]    Loss 0.032407    MSE 0.032407    
-2020-12-09 19:53:08,094 - Test: [ 1250/ 1655]    Loss 0.032375    MSE 0.032375    
-2020-12-09 19:53:11,547 - Test: [ 1500/ 1655]    Loss 0.032393    MSE 0.032393    
-2020-12-09 19:53:13,711 - Test: [ 1655/ 1655]    Loss 0.032384    MSE 0.032383    
-2020-12-09 19:53:14,438 - ==> MSE: 0.03238    Loss: 0.032
-
-2020-12-09 19:53:15,627 - 
-2020-12-09 19:53:15,632 - Log file for this run: /home/gorkemulkar/Workspace/Python/AI8X_GitHub/ai8x-training/logs/2020.12.09-153101/2020.12.09-153101.log
diff --git a/trained/ai85-faceid-qat8.pth.tar b/trained/ai85-faceid-qat8.pth.tar
deleted file mode 100644
index a6ae5196..00000000
Binary files a/trained/ai85-faceid-qat8.pth.tar and /dev/null differ
diff --git a/trained/ai85-faceid_112-qat-q.pth.tar b/trained/ai85-faceid_112-qat-q.pth.tar
new file mode 100644
index 00000000..6b8ce550
Binary files /dev/null and b/trained/ai85-faceid_112-qat-q.pth.tar differ
diff --git a/trained/ai85-faceid_112-qat.log b/trained/ai85-faceid_112-qat.log
new file mode 100644
index 00000000..ee7c7c79
--- /dev/null
+++ b/trained/ai85-faceid_112-qat.log
@@ -0,0 +1,11100 @@
+2023-11-30 20:29:19,330 - Log file for this run: /home/oguzhanbuyuksolak/Repos/pr271/ai8x-training/logs/2023.11.30-202919/2023.11.30-202919.log
+2023-11-30 20:29:21,496 - WARNING: kd_student_wt == 0, Overwriting criterion with a dummy loss
+2023-11-30 20:29:21,496 - Optimizer Type: <class 'torch.optim.adam.Adam'>
+2023-11-30 20:29:21,496 - Optimizer Args: {'lr': 0.001, 'betas': (0.9, 0.999), 'eps': 1e-08, 'weight_decay': 0.0, 'amsgrad': False}
+2023-11-30 20:29:31,791 - Reading compression schedule from: policies/schedule-faceid_112.yaml
+2023-11-30 20:29:32,443 - => loading checkpoint pretrained/ir152_dim64/best.pth.tar
+2023-11-30 20:29:32,580 - => Checkpoint contents:
++----------------------+-------------+---------+
+| Key                  | Type        | Value   |
+|----------------------+-------------+---------|
+| arch                 | str         | ir_152  |
+| compression_sched    | dict        |         |
+| epoch                | int         | 3       |
+| extras               | dict        |         |
+| optimizer_state_dict | dict        |         |
+| optimizer_type       | type        | Adam    |
+| state_dict           | OrderedDict |         |
++----------------------+-------------+---------+
+
+2023-11-30 20:29:32,580 - => Checkpoint['extras'] contents:
++---------------------------+-----------+----------+
+| Key                       | Type      |    Value |
+|---------------------------+-----------+----------|
+| best_epoch                | int       | 3        |
+| best_mAP                  | int       | 0        |
+| best_top1                 | float     | 0.964031 |
+| current_mAP               | int       | 0        |
+| current_top1              | float     | 0.964031 |
+| loss_optimizer_state_dict | dict      |          |
+| loss_weights              | Parameter |          |
++---------------------------+-----------+----------+
+
+2023-11-30 20:29:32,582 - Loaded compression schedule from checkpoint (epoch 3)
+2023-11-30 20:29:32,649 - => loaded 'state_dict' from checkpoint 'pretrained/ir152_dim64/best.pth.tar'
+2023-11-30 20:29:32,663 - 
+Student-Teacher knowledge distillation enabled:
+2023-11-30 20:29:32,663 - 	Teacher Model: ir_152
+2023-11-30 20:29:32,663 - 	Temperature: 1.0
+2023-11-30 20:29:32,663 - 	Loss Weights (distillation | student | teacher): 1.00 | 0.00 | 0.00
+2023-11-30 20:29:32,663 - 	Starting from Epoch: 0
+2023-11-30 20:29:32,663 - Dataset sizes:
+	training=3114790
+	validation=167951
+	test=167951
+2023-11-30 20:29:32,663 - 
+
+2023-11-30 20:29:32,663 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-11-30 20:31:23,247 - Epoch: [0][  100/12168]    Overall Loss 0.029846    Objective Loss 0.000000    Distill Loss 0.029846                                        LR 0.001000    Time 1.105770    
+2023-11-30 20:32:55,704 - Epoch: [0][  200/12168]    Overall Loss 0.029405    Objective Loss 0.000000    Distill Loss 0.029405                                        LR 0.001000    Time 1.015135    
+2023-11-30 20:34:20,744 - Epoch: [0][  300/12168]    Overall Loss 0.029035    Objective Loss 0.000000    Distill Loss 0.029035                                        LR 0.001000    Time 0.960199    
+2023-11-30 20:35:55,419 - Epoch: [0][  400/12168]    Overall Loss 0.028706    Objective Loss 0.000000    Distill Loss 0.028706                                        LR 0.001000    Time 0.956818    
+2023-11-30 20:37:46,257 - Epoch: [0][  500/12168]    Overall Loss 0.028395    Objective Loss 0.000000    Distill Loss 0.028395                                        LR 0.001000    Time 0.987115    
+2023-11-30 20:39:44,214 - Epoch: [0][  600/12168]    Overall Loss 0.028100    Objective Loss 0.000000    Distill Loss 0.028100                                        LR 0.001000    Time 1.019180    
+2023-11-30 20:41:30,064 - Epoch: [0][  700/12168]    Overall Loss 0.027823    Objective Loss 0.000000    Distill Loss 0.027823                                        LR 0.001000    Time 1.024787    
+2023-11-30 20:43:09,439 - Epoch: [0][  800/12168]    Overall Loss 0.027567    Objective Loss 0.000000    Distill Loss 0.027567                                        LR 0.001000    Time 1.020898    
+2023-11-30 20:45:01,891 - Epoch: [0][  900/12168]    Overall Loss 0.027332    Objective Loss 0.000000    Distill Loss 0.027332                                        LR 0.001000    Time 1.032405    
+2023-11-30 20:46:47,077 - Epoch: [0][ 1000/12168]    Overall Loss 0.027112    Objective Loss 0.000000    Distill Loss 0.027112                                        LR 0.001000    Time 1.034343    
+2023-11-30 20:48:47,045 - Epoch: [0][ 1100/12168]    Overall Loss 0.026901    Objective Loss 0.000000    Distill Loss 0.026901                                        LR 0.001000    Time 1.049368    
+2023-11-30 20:50:17,327 - Epoch: [0][ 1200/12168]    Overall Loss 0.026708    Objective Loss 0.000000    Distill Loss 0.026708                                        LR 0.001000    Time 1.037150    
+2023-11-30 20:51:50,895 - Epoch: [0][ 1300/12168]    Overall Loss 0.026517    Objective Loss 0.000000    Distill Loss 0.026517                                        LR 0.001000    Time 1.029339    
+2023-11-30 20:53:46,085 - Epoch: [0][ 1400/12168]    Overall Loss 0.026345    Objective Loss 0.000000    Distill Loss 0.026345                                        LR 0.001000    Time 1.038089    
+2023-11-30 20:55:24,042 - Epoch: [0][ 1500/12168]    Overall Loss 0.026178    Objective Loss 0.000000    Distill Loss 0.026178                                        LR 0.001000    Time 1.034183    
+2023-11-30 20:56:59,061 - Epoch: [0][ 1600/12168]    Overall Loss 0.026016    Objective Loss 0.000000    Distill Loss 0.026016                                        LR 0.001000    Time 1.028929    
+2023-11-30 20:58:51,315 - Epoch: [0][ 1700/12168]    Overall Loss 0.025862    Objective Loss 0.000000    Distill Loss 0.025862                                        LR 0.001000    Time 1.034432    
+2023-11-30 21:00:41,304 - Epoch: [0][ 1800/12168]    Overall Loss 0.025716    Objective Loss 0.000000    Distill Loss 0.025716                                        LR 0.001000    Time 1.038064    
+2023-11-30 21:02:12,729 - Epoch: [0][ 1900/12168]    Overall Loss 0.025573    Objective Loss 0.000000    Distill Loss 0.025573                                        LR 0.001000    Time 1.031544    
+2023-11-30 21:03:50,481 - Epoch: [0][ 2000/12168]    Overall Loss 0.025435    Objective Loss 0.000000    Distill Loss 0.025435                                        LR 0.001000    Time 1.028840    
+2023-11-30 21:05:22,238 - Epoch: [0][ 2100/12168]    Overall Loss 0.025304    Objective Loss 0.000000    Distill Loss 0.025304                                        LR 0.001000    Time 1.023538    
+2023-11-30 21:06:51,438 - Epoch: [0][ 2200/12168]    Overall Loss 0.025175    Objective Loss 0.000000    Distill Loss 0.025175                                        LR 0.001000    Time 1.017555    
+2023-11-30 21:08:18,834 - Epoch: [0][ 2300/12168]    Overall Loss 0.025046    Objective Loss 0.000000    Distill Loss 0.025046                                        LR 0.001000    Time 1.011309    
+2023-11-30 21:09:53,356 - Epoch: [0][ 2400/12168]    Overall Loss 0.024925    Objective Loss 0.000000    Distill Loss 0.024925                                        LR 0.001000    Time 1.008552    
+2023-11-30 21:11:15,531 - Epoch: [0][ 2500/12168]    Overall Loss 0.024806    Objective Loss 0.000000    Distill Loss 0.024806                                        LR 0.001000    Time 1.001077    
+2023-11-30 21:12:41,465 - Epoch: [0][ 2600/12168]    Overall Loss 0.024688    Objective Loss 0.000000    Distill Loss 0.024688                                        LR 0.001000    Time 0.995623    
+2023-11-30 21:14:14,026 - Epoch: [0][ 2700/12168]    Overall Loss 0.024576    Objective Loss 0.000000    Distill Loss 0.024576                                        LR 0.001000    Time 0.993027    
+2023-11-30 21:15:43,061 - Epoch: [0][ 2800/12168]    Overall Loss 0.024467    Objective Loss 0.000000    Distill Loss 0.024467                                        LR 0.001000    Time 0.989358    
+2023-11-30 21:17:16,228 - Epoch: [0][ 2900/12168]    Overall Loss 0.024359    Objective Loss 0.000000    Distill Loss 0.024359                                        LR 0.001000    Time 0.987366    
+2023-11-30 21:18:43,162 - Epoch: [0][ 3000/12168]    Overall Loss 0.024253    Objective Loss 0.000000    Distill Loss 0.024253                                        LR 0.001000    Time 0.983429    
+2023-11-30 21:20:12,793 - Epoch: [0][ 3100/12168]    Overall Loss 0.024147    Objective Loss 0.000000    Distill Loss 0.024147                                        LR 0.001000    Time 0.980617    
+2023-11-30 21:21:39,466 - Epoch: [0][ 3200/12168]    Overall Loss 0.024045    Objective Loss 0.000000    Distill Loss 0.024045                                        LR 0.001000    Time 0.977055    
+2023-11-30 21:23:05,966 - Epoch: [0][ 3300/12168]    Overall Loss 0.023947    Objective Loss 0.000000    Distill Loss 0.023947                                        LR 0.001000    Time 0.973658    
+2023-11-30 21:24:44,520 - Epoch: [0][ 3400/12168]    Overall Loss 0.023852    Objective Loss 0.000000    Distill Loss 0.023852                                        LR 0.001000    Time 0.974005    
+2023-11-30 21:26:12,957 - Epoch: [0][ 3500/12168]    Overall Loss 0.023756    Objective Loss 0.000000    Distill Loss 0.023756                                        LR 0.001000    Time 0.971442    
+2023-11-30 21:27:34,815 - Epoch: [0][ 3600/12168]    Overall Loss 0.023663    Objective Loss 0.000000    Distill Loss 0.023663                                        LR 0.001000    Time 0.967194    
+2023-11-30 21:29:06,404 - Epoch: [0][ 3700/12168]    Overall Loss 0.023572    Objective Loss 0.000000    Distill Loss 0.023572                                        LR 0.001000    Time 0.965805    
+2023-11-30 21:30:33,861 - Epoch: [0][ 3800/12168]    Overall Loss 0.023484    Objective Loss 0.000000    Distill Loss 0.023484                                        LR 0.001000    Time 0.963402    
+2023-11-30 21:31:57,811 - Epoch: [0][ 3900/12168]    Overall Loss 0.023398    Objective Loss 0.000000    Distill Loss 0.023398                                        LR 0.001000    Time 0.960223    
+2023-11-30 21:33:20,255 - Epoch: [0][ 4000/12168]    Overall Loss 0.023313    Objective Loss 0.000000    Distill Loss 0.023313                                        LR 0.001000    Time 0.956827    
+2023-11-30 21:34:51,422 - Epoch: [0][ 4100/12168]    Overall Loss 0.023230    Objective Loss 0.000000    Distill Loss 0.023230                                        LR 0.001000    Time 0.955724    
+2023-11-30 21:36:21,565 - Epoch: [0][ 4200/12168]    Overall Loss 0.023149    Objective Loss 0.000000    Distill Loss 0.023149                                        LR 0.001000    Time 0.954430    
+2023-11-30 21:37:51,545 - Epoch: [0][ 4300/12168]    Overall Loss 0.023069    Objective Loss 0.000000    Distill Loss 0.023069                                        LR 0.001000    Time 0.953157    
+2023-11-30 21:39:23,513 - Epoch: [0][ 4400/12168]    Overall Loss 0.022991    Objective Loss 0.000000    Distill Loss 0.022991                                        LR 0.001000    Time 0.952395    
+2023-11-30 21:40:48,124 - Epoch: [0][ 4500/12168]    Overall Loss 0.022915    Objective Loss 0.000000    Distill Loss 0.022915                                        LR 0.001000    Time 0.950031    
+2023-11-30 21:42:16,557 - Epoch: [0][ 4600/12168]    Overall Loss 0.022840    Objective Loss 0.000000    Distill Loss 0.022840                                        LR 0.001000    Time 0.948601    
+2023-11-30 21:43:41,300 - Epoch: [0][ 4700/12168]    Overall Loss 0.022767    Objective Loss 0.000000    Distill Loss 0.022767                                        LR 0.001000    Time 0.946448    
+2023-11-30 21:45:07,937 - Epoch: [0][ 4800/12168]    Overall Loss 0.022695    Objective Loss 0.000000    Distill Loss 0.022695                                        LR 0.001000    Time 0.944778    
+2023-11-30 21:46:35,755 - Epoch: [0][ 4900/12168]    Overall Loss 0.022624    Objective Loss 0.000000    Distill Loss 0.022624                                        LR 0.001000    Time 0.943417    
+2023-11-30 21:48:00,365 - Epoch: [0][ 5000/12168]    Overall Loss 0.022556    Objective Loss 0.000000    Distill Loss 0.022556                                        LR 0.001000    Time 0.941469    
+2023-11-30 21:49:21,296 - Epoch: [0][ 5100/12168]    Overall Loss 0.022489    Objective Loss 0.000000    Distill Loss 0.022489                                        LR 0.001000    Time 0.938877    
+2023-11-30 21:50:44,480 - Epoch: [0][ 5200/12168]    Overall Loss 0.022424    Objective Loss 0.000000    Distill Loss 0.022424                                        LR 0.001000    Time 0.936817    
+2023-11-30 21:52:13,510 - Epoch: [0][ 5300/12168]    Overall Loss 0.022359    Objective Loss 0.000000    Distill Loss 0.022359                                        LR 0.001000    Time 0.935938    
+2023-11-30 21:53:52,353 - Epoch: [0][ 5400/12168]    Overall Loss 0.022295    Objective Loss 0.000000    Distill Loss 0.022295                                        LR 0.001000    Time 0.936908    
+2023-11-30 21:55:24,701 - Epoch: [0][ 5500/12168]    Overall Loss 0.022233    Objective Loss 0.000000    Distill Loss 0.022233                                        LR 0.001000    Time 0.936663    
+2023-11-30 21:57:02,164 - Epoch: [0][ 5600/12168]    Overall Loss 0.022171    Objective Loss 0.000000    Distill Loss 0.022171                                        LR 0.001000    Time 0.937340    
+2023-11-30 21:58:38,863 - Epoch: [0][ 5700/12168]    Overall Loss 0.022111    Objective Loss 0.000000    Distill Loss 0.022111                                        LR 0.001000    Time 0.937859    
+2023-11-30 22:00:30,649 - Epoch: [0][ 5800/12168]    Overall Loss 0.022052    Objective Loss 0.000000    Distill Loss 0.022052                                        LR 0.001000    Time 0.940961    
+2023-11-30 22:01:54,916 - Epoch: [0][ 5900/12168]    Overall Loss 0.021994    Objective Loss 0.000000    Distill Loss 0.021994                                        LR 0.001000    Time 0.939294    
+2023-11-30 22:03:38,066 - Epoch: [0][ 6000/12168]    Overall Loss 0.021938    Objective Loss 0.000000    Distill Loss 0.021938                                        LR 0.001000    Time 0.940829    
+2023-11-30 22:05:15,885 - Epoch: [0][ 6100/12168]    Overall Loss 0.021882    Objective Loss 0.000000    Distill Loss 0.021882                                        LR 0.001000    Time 0.941441    
+2023-11-30 22:06:55,395 - Epoch: [0][ 6200/12168]    Overall Loss 0.021827    Objective Loss 0.000000    Distill Loss 0.021827                                        LR 0.001000    Time 0.942305    
+2023-11-30 22:08:39,253 - Epoch: [0][ 6300/12168]    Overall Loss 0.021773    Objective Loss 0.000000    Distill Loss 0.021773                                        LR 0.001000    Time 0.943832    
+2023-11-30 22:10:21,433 - Epoch: [0][ 6400/12168]    Overall Loss 0.021720    Objective Loss 0.000000    Distill Loss 0.021720                                        LR 0.001000    Time 0.945049    
+2023-11-30 22:11:39,648 - Epoch: [0][ 6500/12168]    Overall Loss 0.021667    Objective Loss 0.000000    Distill Loss 0.021667                                        LR 0.001000    Time 0.942542    
+2023-11-30 22:12:49,761 - Epoch: [0][ 6600/12168]    Overall Loss 0.021615    Objective Loss 0.000000    Distill Loss 0.021615                                        LR 0.001000    Time 0.938883    
+2023-11-30 22:13:58,585 - Epoch: [0][ 6700/12168]    Overall Loss 0.021564    Objective Loss 0.000000    Distill Loss 0.021564                                        LR 0.001000    Time 0.935141    
+2023-11-30 22:15:06,520 - Epoch: [0][ 6800/12168]    Overall Loss 0.021515    Objective Loss 0.000000    Distill Loss 0.021515                                        LR 0.001000    Time 0.931379    
+2023-11-30 22:16:16,304 - Epoch: [0][ 6900/12168]    Overall Loss 0.021465    Objective Loss 0.000000    Distill Loss 0.021465                                        LR 0.001000    Time 0.927994    
+2023-11-30 22:17:24,380 - Epoch: [0][ 7000/12168]    Overall Loss 0.021416    Objective Loss 0.000000    Distill Loss 0.021416                                        LR 0.001000    Time 0.924461    
+2023-11-30 22:19:21,161 - Epoch: [0][ 7100/12168]    Overall Loss 0.021367    Objective Loss 0.000000    Distill Loss 0.021367                                        LR 0.001000    Time 0.927887    
+2023-11-30 22:21:07,284 - Epoch: [0][ 7200/12168]    Overall Loss 0.021321    Objective Loss 0.000000    Distill Loss 0.021321                                        LR 0.001000    Time 0.929738    
+2023-11-30 22:22:57,079 - Epoch: [0][ 7300/12168]    Overall Loss 0.021274    Objective Loss 0.000000    Distill Loss 0.021274                                        LR 0.001000    Time 0.932042    
+2023-11-30 22:24:43,004 - Epoch: [0][ 7400/12168]    Overall Loss 0.021229    Objective Loss 0.000000    Distill Loss 0.021229                                        LR 0.001000    Time 0.933760    
+2023-11-30 22:26:33,407 - Epoch: [0][ 7500/12168]    Overall Loss 0.021184    Objective Loss 0.000000    Distill Loss 0.021184                                        LR 0.001000    Time 0.936029    
+2023-11-30 22:28:20,584 - Epoch: [0][ 7600/12168]    Overall Loss 0.021140    Objective Loss 0.000000    Distill Loss 0.021140                                        LR 0.001000    Time 0.937814    
+2023-11-30 22:30:13,851 - Epoch: [0][ 7700/12168]    Overall Loss 0.021097    Objective Loss 0.000000    Distill Loss 0.021097                                        LR 0.001000    Time 0.940344    
+2023-11-30 22:32:19,649 - Epoch: [0][ 7800/12168]    Overall Loss 0.021055    Objective Loss 0.000000    Distill Loss 0.021055                                        LR 0.001000    Time 0.944415    
+2023-11-30 22:33:50,111 - Epoch: [0][ 7900/12168]    Overall Loss 0.021013    Objective Loss 0.000000    Distill Loss 0.021013                                        LR 0.001000    Time 0.943910    
+2023-11-30 22:35:44,092 - Epoch: [0][ 8000/12168]    Overall Loss 0.020970    Objective Loss 0.000000    Distill Loss 0.020970                                        LR 0.001000    Time 0.946358    
+2023-11-30 22:37:24,432 - Epoch: [0][ 8100/12168]    Overall Loss 0.020928    Objective Loss 0.000000    Distill Loss 0.020928                                        LR 0.001000    Time 0.947061    
+2023-11-30 22:39:09,718 - Epoch: [0][ 8200/12168]    Overall Loss 0.020888    Objective Loss 0.000000    Distill Loss 0.020888                                        LR 0.001000    Time 0.948351    
+2023-11-30 22:40:59,050 - Epoch: [0][ 8300/12168]    Overall Loss 0.020847    Objective Loss 0.000000    Distill Loss 0.020847                                        LR 0.001000    Time 0.950097    
+2023-11-30 22:42:37,662 - Epoch: [0][ 8400/12168]    Overall Loss 0.020808    Objective Loss 0.000000    Distill Loss 0.020808                                        LR 0.001000    Time 0.950524    
+2023-11-30 22:44:17,948 - Epoch: [0][ 8500/12168]    Overall Loss 0.020769    Objective Loss 0.000000    Distill Loss 0.020769                                        LR 0.001000    Time 0.951139    
+2023-11-30 22:46:00,972 - Epoch: [0][ 8600/12168]    Overall Loss 0.020731    Objective Loss 0.000000    Distill Loss 0.020731                                        LR 0.001000    Time 0.952058    
+2023-11-30 22:47:40,688 - Epoch: [0][ 8700/12168]    Overall Loss 0.020693    Objective Loss 0.000000    Distill Loss 0.020693                                        LR 0.001000    Time 0.952576    
+2023-11-30 22:49:22,682 - Epoch: [0][ 8800/12168]    Overall Loss 0.020654    Objective Loss 0.000000    Distill Loss 0.020654                                        LR 0.001000    Time 0.953341    
+2023-11-30 22:51:00,546 - Epoch: [0][ 8900/12168]    Overall Loss 0.020617    Objective Loss 0.000000    Distill Loss 0.020617                                        LR 0.001000    Time 0.953624    
+2023-11-30 22:52:48,683 - Epoch: [0][ 9000/12168]    Overall Loss 0.020580    Objective Loss 0.000000    Distill Loss 0.020580                                        LR 0.001000    Time 0.955043    
+2023-11-30 22:54:39,069 - Epoch: [0][ 9100/12168]    Overall Loss 0.020545    Objective Loss 0.000000    Distill Loss 0.020545                                        LR 0.001000    Time 0.956677    
+2023-11-30 22:56:27,753 - Epoch: [0][ 9200/12168]    Overall Loss 0.020509    Objective Loss 0.000000    Distill Loss 0.020509                                        LR 0.001000    Time 0.958091    
+2023-11-30 22:58:14,523 - Epoch: [0][ 9300/12168]    Overall Loss 0.020473    Objective Loss 0.000000    Distill Loss 0.020473                                        LR 0.001000    Time 0.959269    
+2023-11-30 22:59:51,765 - Epoch: [0][ 9400/12168]    Overall Loss 0.020439    Objective Loss 0.000000    Distill Loss 0.020439                                        LR 0.001000    Time 0.959408    
+2023-11-30 23:01:40,391 - Epoch: [0][ 9500/12168]    Overall Loss 0.020404    Objective Loss 0.000000    Distill Loss 0.020404                                        LR 0.001000    Time 0.960743    
+2023-11-30 23:03:32,743 - Epoch: [0][ 9600/12168]    Overall Loss 0.020370    Objective Loss 0.000000    Distill Loss 0.020370                                        LR 0.001000    Time 0.962438    
+2023-11-30 23:05:12,071 - Epoch: [0][ 9700/12168]    Overall Loss 0.020336    Objective Loss 0.000000    Distill Loss 0.020336                                        LR 0.001000    Time 0.962755    
+2023-11-30 23:07:19,316 - Epoch: [0][ 9800/12168]    Overall Loss 0.020302    Objective Loss 0.000000    Distill Loss 0.020302                                        LR 0.001000    Time 0.965914    
+2023-11-30 23:08:48,711 - Epoch: [0][ 9900/12168]    Overall Loss 0.020269    Objective Loss 0.000000    Distill Loss 0.020269                                        LR 0.001000    Time 0.965186    
+2023-11-30 23:10:39,438 - Epoch: [0][10000/12168]    Overall Loss 0.020236    Objective Loss 0.000000    Distill Loss 0.020236                                        LR 0.001000    Time 0.966607    
+2023-11-30 23:12:42,564 - Epoch: [0][10100/12168]    Overall Loss 0.020204    Objective Loss 0.000000    Distill Loss 0.020204                                        LR 0.001000    Time 0.969226    
+2023-11-30 23:14:40,346 - Epoch: [0][10200/12168]    Overall Loss 0.020172    Objective Loss 0.000000    Distill Loss 0.020172                                        LR 0.001000    Time 0.971271    
+2023-11-30 23:16:42,505 - Epoch: [0][10300/12168]    Overall Loss 0.020140    Objective Loss 0.000000    Distill Loss 0.020140                                        LR 0.001000    Time 0.973700    
+2023-11-30 23:18:39,796 - Epoch: [0][10400/12168]    Overall Loss 0.020110    Objective Loss 0.000000    Distill Loss 0.020110                                        LR 0.001000    Time 0.975615    
+2023-11-30 23:20:37,750 - Epoch: [0][10500/12168]    Overall Loss 0.020080    Objective Loss 0.000000    Distill Loss 0.020080                                        LR 0.001000    Time 0.977557    
+2023-11-30 23:22:25,053 - Epoch: [0][10600/12168]    Overall Loss 0.020049    Objective Loss 0.000000    Distill Loss 0.020049                                        LR 0.001000    Time 0.978457    
+2023-11-30 23:24:10,373 - Epoch: [0][10700/12168]    Overall Loss 0.020018    Objective Loss 0.000000    Distill Loss 0.020018                                        LR 0.001000    Time 0.979155    
+2023-11-30 23:25:58,199 - Epoch: [0][10800/12168]    Overall Loss 0.019989    Objective Loss 0.000000    Distill Loss 0.019989                                        LR 0.001000    Time 0.980072    
+2023-11-30 23:27:37,432 - Epoch: [0][10900/12168]    Overall Loss 0.019959    Objective Loss 0.000000    Distill Loss 0.019959                                        LR 0.001000    Time 0.980183    
+2023-11-30 23:29:20,135 - Epoch: [0][11000/12168]    Overall Loss 0.019929    Objective Loss 0.000000    Distill Loss 0.019929                                        LR 0.001000    Time 0.980609    
+2023-11-30 23:30:56,798 - Epoch: [0][11100/12168]    Overall Loss 0.019901    Objective Loss 0.000000    Distill Loss 0.019901                                        LR 0.001000    Time 0.980482    
+2023-11-30 23:32:29,972 - Epoch: [0][11200/12168]    Overall Loss 0.019873    Objective Loss 0.000000    Distill Loss 0.019873                                        LR 0.001000    Time 0.980046    
+2023-11-30 23:34:16,216 - Epoch: [0][11300/12168]    Overall Loss 0.019845    Objective Loss 0.000000    Distill Loss 0.019845                                        LR 0.001000    Time 0.980775    
+2023-11-30 23:35:54,280 - Epoch: [0][11400/12168]    Overall Loss 0.019817    Objective Loss 0.000000    Distill Loss 0.019817                                        LR 0.001000    Time 0.980773    
+2023-11-30 23:37:27,202 - Epoch: [0][11500/12168]    Overall Loss 0.019790    Objective Loss 0.000000    Distill Loss 0.019790                                        LR 0.001000    Time 0.980324    
+2023-11-30 23:38:56,583 - Epoch: [0][11600/12168]    Overall Loss 0.019762    Objective Loss 0.000000    Distill Loss 0.019762                                        LR 0.001000    Time 0.979578    
+2023-11-30 23:40:27,772 - Epoch: [0][11700/12168]    Overall Loss 0.019736    Objective Loss 0.000000    Distill Loss 0.019736                                        LR 0.001000    Time 0.978999    
+2023-11-30 23:42:17,313 - Epoch: [0][11800/12168]    Overall Loss 0.019709    Objective Loss 0.000000    Distill Loss 0.019709                                        LR 0.001000    Time 0.979985    
+2023-11-30 23:43:53,450 - Epoch: [0][11900/12168]    Overall Loss 0.019682    Objective Loss 0.000000    Distill Loss 0.019682                                        LR 0.001000    Time 0.979828    
+2023-11-30 23:45:34,102 - Epoch: [0][12000/12168]    Overall Loss 0.019655    Objective Loss 0.000000    Distill Loss 0.019655                                        LR 0.001000    Time 0.980050    
+2023-11-30 23:47:32,558 - Epoch: [0][12100/12168]    Overall Loss 0.019629    Objective Loss 0.000000    Distill Loss 0.019629                                        LR 0.001000    Time 0.981739    
+2023-11-30 23:48:39,792 - Epoch: [0][12168/12168]    Overall Loss 0.019612    Objective Loss 0.000000    Distill Loss 0.019612                                        LR 0.001000    Time 0.981778    
+2023-11-30 23:48:40,275 - --- validate (epoch=0)-----------
+2023-11-30 23:48:40,275 - 167951 samples (256 per mini-batch)
+2023-11-30 23:49:33,545 - Epoch: [0][  100/  657]    Loss 0.000000    Overall Loss 0.017119    
+2023-11-30 23:50:22,245 - Epoch: [0][  200/  657]    Loss 0.000000    Overall Loss 0.017143    
+2023-11-30 23:51:21,185 - Epoch: [0][  300/  657]    Loss 0.000000    Overall Loss 0.017139    
+2023-11-30 23:52:20,513 - Epoch: [0][  400/  657]    Loss 0.000000    Overall Loss 0.017147    
+2023-11-30 23:53:16,107 - Epoch: [0][  500/  657]    Loss 0.000000    Overall Loss 0.017152    
+2023-11-30 23:54:11,265 - Epoch: [0][  600/  657]    Loss 0.000000    Overall Loss 0.017146    
+2023-11-30 23:54:44,630 - Epoch: [0][  657/  657]    Loss 0.000000    Overall Loss 0.017143    
+2023-11-30 23:54:44,961 - ==> Overall Loss: 0.017
+
+2023-11-30 23:54:44,993 - ==> Best [Overall Loss: 0.017143 on epoch: 0]
+2023-11-30 23:54:44,993 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-11-30 23:54:45,013 - 
+
+2023-11-30 23:54:45,013 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-11-30 23:57:09,349 - Epoch: [1][  100/12168]    Overall Loss 0.016367    Objective Loss 0.000000    Distill Loss 0.016367                                        LR 0.001000    Time 1.443294    
+2023-11-30 23:59:06,305 - Epoch: [1][  200/12168]    Overall Loss 0.016341    Objective Loss 0.000000    Distill Loss 0.016341                                        LR 0.001000    Time 1.306391    
+2023-12-01 00:01:02,451 - Epoch: [1][  300/12168]    Overall Loss 0.016365    Objective Loss 0.000000    Distill Loss 0.016365                                        LR 0.001000    Time 1.258058    
+2023-12-01 00:03:02,523 - Epoch: [1][  400/12168]    Overall Loss 0.016348    Objective Loss 0.000000    Distill Loss 0.016348                                        LR 0.001000    Time 1.243704    
+2023-12-01 00:05:08,225 - Epoch: [1][  500/12168]    Overall Loss 0.016331    Objective Loss 0.000000    Distill Loss 0.016331                                        LR 0.001000    Time 1.246354    
+2023-12-01 00:06:54,214 - Epoch: [1][  600/12168]    Overall Loss 0.016330    Objective Loss 0.000000    Distill Loss 0.016330                                        LR 0.001000    Time 1.215265    
+2023-12-01 00:08:27,031 - Epoch: [1][  700/12168]    Overall Loss 0.016332    Objective Loss 0.000000    Distill Loss 0.016332                                        LR 0.001000    Time 1.174240    
+2023-12-01 00:09:58,198 - Epoch: [1][  800/12168]    Overall Loss 0.016326    Objective Loss 0.000000    Distill Loss 0.016326                                        LR 0.001000    Time 1.141410    
+2023-12-01 00:11:12,707 - Epoch: [1][  900/12168]    Overall Loss 0.016328    Objective Loss 0.000000    Distill Loss 0.016328                                        LR 0.001000    Time 1.097367    
+2023-12-01 00:12:59,850 - Epoch: [1][ 1000/12168]    Overall Loss 0.016332    Objective Loss 0.000000    Distill Loss 0.016332                                        LR 0.001000    Time 1.094766    
+2023-12-01 00:14:42,136 - Epoch: [1][ 1100/12168]    Overall Loss 0.016325    Objective Loss 0.000000    Distill Loss 0.016325                                        LR 0.001000    Time 1.088222    
+2023-12-01 00:16:24,580 - Epoch: [1][ 1200/12168]    Overall Loss 0.016310    Objective Loss 0.000000    Distill Loss 0.016310                                        LR 0.001000    Time 1.082901    
+2023-12-01 00:17:53,589 - Epoch: [1][ 1300/12168]    Overall Loss 0.016295    Objective Loss 0.000000    Distill Loss 0.016295                                        LR 0.001000    Time 1.068064    
+2023-12-01 00:19:33,298 - Epoch: [1][ 1400/12168]    Overall Loss 0.016283    Objective Loss 0.000000    Distill Loss 0.016283                                        LR 0.001000    Time 1.062989    
+2023-12-01 00:21:12,797 - Epoch: [1][ 1500/12168]    Overall Loss 0.016280    Objective Loss 0.000000    Distill Loss 0.016280                                        LR 0.001000    Time 1.058451    
+2023-12-01 00:22:54,224 - Epoch: [1][ 1600/12168]    Overall Loss 0.016268    Objective Loss 0.000000    Distill Loss 0.016268                                        LR 0.001000    Time 1.055685    
+2023-12-01 00:24:37,683 - Epoch: [1][ 1700/12168]    Overall Loss 0.016260    Objective Loss 0.000000    Distill Loss 0.016260                                        LR 0.001000    Time 1.054439    
+2023-12-01 00:26:05,993 - Epoch: [1][ 1800/12168]    Overall Loss 0.016249    Objective Loss 0.000000    Distill Loss 0.016249                                        LR 0.001000    Time 1.044917    
+2023-12-01 00:27:54,453 - Epoch: [1][ 1900/12168]    Overall Loss 0.016241    Objective Loss 0.000000    Distill Loss 0.016241                                        LR 0.001000    Time 1.047002    
+2023-12-01 00:29:29,582 - Epoch: [1][ 2000/12168]    Overall Loss 0.016232    Objective Loss 0.000000    Distill Loss 0.016232                                        LR 0.001000    Time 1.042213    
+2023-12-01 00:31:15,606 - Epoch: [1][ 2100/12168]    Overall Loss 0.016225    Objective Loss 0.000000    Distill Loss 0.016225                                        LR 0.001000    Time 1.043068    
+2023-12-01 00:32:49,825 - Epoch: [1][ 2200/12168]    Overall Loss 0.016217    Objective Loss 0.000000    Distill Loss 0.016217                                        LR 0.001000    Time 1.038479    
+2023-12-01 00:34:34,002 - Epoch: [1][ 2300/12168]    Overall Loss 0.016204    Objective Loss 0.000000    Distill Loss 0.016204                                        LR 0.001000    Time 1.038619    
+2023-12-01 00:36:07,439 - Epoch: [1][ 2400/12168]    Overall Loss 0.016192    Objective Loss 0.000000    Distill Loss 0.016192                                        LR 0.001000    Time 1.034272    
+2023-12-01 00:37:40,487 - Epoch: [1][ 2500/12168]    Overall Loss 0.016180    Objective Loss 0.000000    Distill Loss 0.016180                                        LR 0.001000    Time 1.030118    
+2023-12-01 00:39:16,785 - Epoch: [1][ 2600/12168]    Overall Loss 0.016171    Objective Loss 0.000000    Distill Loss 0.016171                                        LR 0.001000    Time 1.027533    
+2023-12-01 00:40:50,057 - Epoch: [1][ 2700/12168]    Overall Loss 0.016164    Objective Loss 0.000000    Distill Loss 0.016164                                        LR 0.001000    Time 1.024019    
+2023-12-01 00:42:20,023 - Epoch: [1][ 2800/12168]    Overall Loss 0.016157    Objective Loss 0.000000    Distill Loss 0.016157                                        LR 0.001000    Time 1.019575    
+2023-12-01 00:44:05,812 - Epoch: [1][ 2900/12168]    Overall Loss 0.016150    Objective Loss 0.000000    Distill Loss 0.016150                                        LR 0.001000    Time 1.020893    
+2023-12-01 00:45:42,364 - Epoch: [1][ 3000/12168]    Overall Loss 0.016140    Objective Loss 0.000000    Distill Loss 0.016140                                        LR 0.001000    Time 1.019045    
+2023-12-01 00:47:24,168 - Epoch: [1][ 3100/12168]    Overall Loss 0.016129    Objective Loss 0.000000    Distill Loss 0.016129                                        LR 0.001000    Time 1.019010    
+2023-12-01 00:49:07,132 - Epoch: [1][ 3200/12168]    Overall Loss 0.016121    Objective Loss 0.000000    Distill Loss 0.016121                                        LR 0.001000    Time 1.019340    
+2023-12-01 00:50:45,026 - Epoch: [1][ 3300/12168]    Overall Loss 0.016110    Objective Loss 0.000000    Distill Loss 0.016110                                        LR 0.001000    Time 1.018114    
+2023-12-01 00:52:29,425 - Epoch: [1][ 3400/12168]    Overall Loss 0.016104    Objective Loss 0.000000    Distill Loss 0.016104                                        LR 0.001000    Time 1.018873    
+2023-12-01 00:54:20,559 - Epoch: [1][ 3500/12168]    Overall Loss 0.016094    Objective Loss 0.000000    Distill Loss 0.016094                                        LR 0.001000    Time 1.021513    
+2023-12-01 00:55:57,770 - Epoch: [1][ 3600/12168]    Overall Loss 0.016084    Objective Loss 0.000000    Distill Loss 0.016084                                        LR 0.001000    Time 1.020139    
+2023-12-01 00:57:41,760 - Epoch: [1][ 3700/12168]    Overall Loss 0.016076    Objective Loss 0.000000    Distill Loss 0.016076                                        LR 0.001000    Time 1.020671    
+2023-12-01 00:59:28,248 - Epoch: [1][ 3800/12168]    Overall Loss 0.016070    Objective Loss 0.000000    Distill Loss 0.016070                                        LR 0.001000    Time 1.021832    
+2023-12-01 01:01:03,585 - Epoch: [1][ 3900/12168]    Overall Loss 0.016060    Objective Loss 0.000000    Distill Loss 0.016060                                        LR 0.001000    Time 1.020075    
+2023-12-01 01:02:36,193 - Epoch: [1][ 4000/12168]    Overall Loss 0.016051    Objective Loss 0.000000    Distill Loss 0.016051                                        LR 0.001000    Time 1.017724    
+2023-12-01 01:04:13,790 - Epoch: [1][ 4100/12168]    Overall Loss 0.016043    Objective Loss 0.000000    Distill Loss 0.016043                                        LR 0.001000    Time 1.016703    
+2023-12-01 01:05:50,638 - Epoch: [1][ 4200/12168]    Overall Loss 0.016034    Objective Loss 0.000000    Distill Loss 0.016034                                        LR 0.001000    Time 1.015554    
+2023-12-01 01:07:28,440 - Epoch: [1][ 4300/12168]    Overall Loss 0.016025    Objective Loss 0.000000    Distill Loss 0.016025                                        LR 0.001000    Time 1.014679    
+2023-12-01 01:09:16,076 - Epoch: [1][ 4400/12168]    Overall Loss 0.016015    Objective Loss 0.000000    Distill Loss 0.016015                                        LR 0.001000    Time 1.016079    
+2023-12-01 01:11:01,308 - Epoch: [1][ 4500/12168]    Overall Loss 0.016008    Objective Loss 0.000000    Distill Loss 0.016008                                        LR 0.001000    Time 1.016883    
+2023-12-01 01:12:38,645 - Epoch: [1][ 4600/12168]    Overall Loss 0.016000    Objective Loss 0.000000    Distill Loss 0.016000                                        LR 0.001000    Time 1.015935    
+2023-12-01 01:14:14,082 - Epoch: [1][ 4700/12168]    Overall Loss 0.015991    Objective Loss 0.000000    Distill Loss 0.015991                                        LR 0.001000    Time 1.014624    
+2023-12-01 01:15:57,223 - Epoch: [1][ 4800/12168]    Overall Loss 0.015983    Objective Loss 0.000000    Distill Loss 0.015983                                        LR 0.001000    Time 1.014972    
+2023-12-01 01:17:41,433 - Epoch: [1][ 4900/12168]    Overall Loss 0.015976    Objective Loss 0.000000    Distill Loss 0.015976                                        LR 0.001000    Time 1.015524    
+2023-12-01 01:19:22,500 - Epoch: [1][ 5000/12168]    Overall Loss 0.015968    Objective Loss 0.000000    Distill Loss 0.015968                                        LR 0.001000    Time 1.015426    
+2023-12-01 01:20:46,800 - Epoch: [1][ 5100/12168]    Overall Loss 0.015961    Objective Loss 0.000000    Distill Loss 0.015961                                        LR 0.001000    Time 1.012044    
+2023-12-01 01:22:36,910 - Epoch: [1][ 5200/12168]    Overall Loss 0.015954    Objective Loss 0.000000    Distill Loss 0.015954                                        LR 0.001000    Time 1.013755    
+2023-12-01 01:24:28,081 - Epoch: [1][ 5300/12168]    Overall Loss 0.015947    Objective Loss 0.000000    Distill Loss 0.015947                                        LR 0.001000    Time 1.015602    
+2023-12-01 01:26:10,811 - Epoch: [1][ 5400/12168]    Overall Loss 0.015939    Objective Loss 0.000000    Distill Loss 0.015939                                        LR 0.001000    Time 1.015817    
+2023-12-01 01:27:59,557 - Epoch: [1][ 5500/12168]    Overall Loss 0.015933    Objective Loss 0.000000    Distill Loss 0.015933                                        LR 0.001000    Time 1.017118    
+2023-12-01 01:29:36,553 - Epoch: [1][ 5600/12168]    Overall Loss 0.015924    Objective Loss 0.000000    Distill Loss 0.015924                                        LR 0.001000    Time 1.016275    
+2023-12-01 01:31:26,930 - Epoch: [1][ 5700/12168]    Overall Loss 0.015916    Objective Loss 0.000000    Distill Loss 0.015916                                        LR 0.001000    Time 1.017809    
+2023-12-01 01:32:53,720 - Epoch: [1][ 5800/12168]    Overall Loss 0.015908    Objective Loss 0.000000    Distill Loss 0.015908                                        LR 0.001000    Time 1.015223    
+2023-12-01 01:34:21,758 - Epoch: [1][ 5900/12168]    Overall Loss 0.015901    Objective Loss 0.000000    Distill Loss 0.015901                                        LR 0.001000    Time 1.012936    
+2023-12-01 01:36:13,827 - Epoch: [1][ 6000/12168]    Overall Loss 0.015895    Objective Loss 0.000000    Distill Loss 0.015895                                        LR 0.001000    Time 1.014731    
+2023-12-01 01:37:50,054 - Epoch: [1][ 6100/12168]    Overall Loss 0.015887    Objective Loss 0.000000    Distill Loss 0.015887                                        LR 0.001000    Time 1.013870    
+2023-12-01 01:39:31,090 - Epoch: [1][ 6200/12168]    Overall Loss 0.015879    Objective Loss 0.000000    Distill Loss 0.015879                                        LR 0.001000    Time 1.013812    
+2023-12-01 01:41:11,389 - Epoch: [1][ 6300/12168]    Overall Loss 0.015872    Objective Loss 0.000000    Distill Loss 0.015872                                        LR 0.001000    Time 1.013639    
+2023-12-01 01:42:59,195 - Epoch: [1][ 6400/12168]    Overall Loss 0.015866    Objective Loss 0.000000    Distill Loss 0.015866                                        LR 0.001000    Time 1.014644    
+2023-12-01 01:44:44,027 - Epoch: [1][ 6500/12168]    Overall Loss 0.015859    Objective Loss 0.000000    Distill Loss 0.015859                                        LR 0.001000    Time 1.015161    
+2023-12-01 01:46:18,528 - Epoch: [1][ 6600/12168]    Overall Loss 0.015851    Objective Loss 0.000000    Distill Loss 0.015851                                        LR 0.001000    Time 1.014098    
+2023-12-01 01:47:58,171 - Epoch: [1][ 6700/12168]    Overall Loss 0.015844    Objective Loss 0.000000    Distill Loss 0.015844                                        LR 0.001000    Time 1.013833    
+2023-12-01 01:49:39,626 - Epoch: [1][ 6800/12168]    Overall Loss 0.015837    Objective Loss 0.000000    Distill Loss 0.015837                                        LR 0.001000    Time 1.013842    
+2023-12-01 01:51:27,437 - Epoch: [1][ 6900/12168]    Overall Loss 0.015830    Objective Loss 0.000000    Distill Loss 0.015830                                        LR 0.001000    Time 1.014772    
+2023-12-01 01:53:08,948 - Epoch: [1][ 7000/12168]    Overall Loss 0.015823    Objective Loss 0.000000    Distill Loss 0.015823                                        LR 0.001000    Time 1.014776    
+2023-12-01 01:54:59,339 - Epoch: [1][ 7100/12168]    Overall Loss 0.015815    Objective Loss 0.000000    Distill Loss 0.015815                                        LR 0.001000    Time 1.016031    
+2023-12-01 01:56:35,457 - Epoch: [1][ 7200/12168]    Overall Loss 0.015808    Objective Loss 0.000000    Distill Loss 0.015808                                        LR 0.001000    Time 1.015268    
+2023-12-01 01:58:15,051 - Epoch: [1][ 7300/12168]    Overall Loss 0.015802    Objective Loss 0.000000    Distill Loss 0.015802                                        LR 0.001000    Time 1.015002    
+2023-12-01 01:59:54,466 - Epoch: [1][ 7400/12168]    Overall Loss 0.015795    Objective Loss 0.000000    Distill Loss 0.015795                                        LR 0.001000    Time 1.014720    
+2023-12-01 02:01:41,702 - Epoch: [1][ 7500/12168]    Overall Loss 0.015788    Objective Loss 0.000000    Distill Loss 0.015788                                        LR 0.001000    Time 1.015487    
+2023-12-01 02:03:38,025 - Epoch: [1][ 7600/12168]    Overall Loss 0.015782    Objective Loss 0.000000    Distill Loss 0.015782                                        LR 0.001000    Time 1.017430    
+2023-12-01 02:05:10,772 - Epoch: [1][ 7700/12168]    Overall Loss 0.015776    Objective Loss 0.000000    Distill Loss 0.015776                                        LR 0.001000    Time 1.016261    
+2023-12-01 02:07:05,414 - Epoch: [1][ 7800/12168]    Overall Loss 0.015770    Objective Loss 0.000000    Distill Loss 0.015770                                        LR 0.001000    Time 1.017929    
+2023-12-01 02:08:48,799 - Epoch: [1][ 7900/12168]    Overall Loss 0.015763    Objective Loss 0.000000    Distill Loss 0.015763                                        LR 0.001000    Time 1.018129    
+2023-12-01 02:10:29,404 - Epoch: [1][ 8000/12168]    Overall Loss 0.015755    Objective Loss 0.000000    Distill Loss 0.015755                                        LR 0.001000    Time 1.017978    
+2023-12-01 02:12:10,021 - Epoch: [1][ 8100/12168]    Overall Loss 0.015748    Objective Loss 0.000000    Distill Loss 0.015748                                        LR 0.001000    Time 1.017831    
+2023-12-01 02:13:55,058 - Epoch: [1][ 8200/12168]    Overall Loss 0.015743    Objective Loss 0.000000    Distill Loss 0.015743                                        LR 0.001000    Time 1.018227    
+2023-12-01 02:15:27,309 - Epoch: [1][ 8300/12168]    Overall Loss 0.015736    Objective Loss 0.000000    Distill Loss 0.015736                                        LR 0.001000    Time 1.017073    
+2023-12-01 02:17:12,109 - Epoch: [1][ 8400/12168]    Overall Loss 0.015730    Objective Loss 0.000000    Distill Loss 0.015730                                        LR 0.001000    Time 1.017440    
+2023-12-01 02:19:06,838 - Epoch: [1][ 8500/12168]    Overall Loss 0.015723    Objective Loss 0.000000    Distill Loss 0.015723                                        LR 0.001000    Time 1.018967    
+2023-12-01 02:20:15,491 - Epoch: [1][ 8600/12168]    Overall Loss 0.015716    Objective Loss 0.000000    Distill Loss 0.015716                                        LR 0.001000    Time 1.015101    
+2023-12-01 02:21:29,450 - Epoch: [1][ 8700/12168]    Overall Loss 0.015710    Objective Loss 0.000000    Distill Loss 0.015710                                        LR 0.001000    Time 1.011933    
+2023-12-01 02:22:39,718 - Epoch: [1][ 8800/12168]    Overall Loss 0.015703    Objective Loss 0.000000    Distill Loss 0.015703                                        LR 0.001000    Time 1.008418    
+2023-12-01 02:23:46,053 - Epoch: [1][ 8900/12168]    Overall Loss 0.015696    Objective Loss 0.000000    Distill Loss 0.015696                                        LR 0.001000    Time 1.004541    
+2023-12-01 02:24:53,411 - Epoch: [1][ 9000/12168]    Overall Loss 0.015690    Objective Loss 0.000000    Distill Loss 0.015690                                        LR 0.001000    Time 1.000863    
+2023-12-01 02:26:19,445 - Epoch: [1][ 9100/12168]    Overall Loss 0.015685    Objective Loss 0.000000    Distill Loss 0.015685                                        LR 0.001000    Time 0.999318    
+2023-12-01 02:28:04,183 - Epoch: [1][ 9200/12168]    Overall Loss 0.015678    Objective Loss 0.000000    Distill Loss 0.015678                                        LR 0.001000    Time 0.999839    
+2023-12-01 02:29:49,279 - Epoch: [1][ 9300/12168]    Overall Loss 0.015672    Objective Loss 0.000000    Distill Loss 0.015672                                        LR 0.001000    Time 1.000388    
+2023-12-01 02:31:27,638 - Epoch: [1][ 9400/12168]    Overall Loss 0.015667    Objective Loss 0.000000    Distill Loss 0.015667                                        LR 0.001000    Time 1.000209    
+2023-12-01 02:33:09,579 - Epoch: [1][ 9500/12168]    Overall Loss 0.015661    Objective Loss 0.000000    Distill Loss 0.015661                                        LR 0.001000    Time 1.000410    
+2023-12-01 02:34:48,640 - Epoch: [1][ 9600/12168]    Overall Loss 0.015655    Objective Loss 0.000000    Distill Loss 0.015655                                        LR 0.001000    Time 1.000307    
+2023-12-01 02:36:31,235 - Epoch: [1][ 9700/12168]    Overall Loss 0.015649    Objective Loss 0.000000    Distill Loss 0.015649                                        LR 0.001000    Time 1.000571    
+2023-12-01 02:38:36,938 - Epoch: [1][ 9800/12168]    Overall Loss 0.015643    Objective Loss 0.000000    Distill Loss 0.015643                                        LR 0.001000    Time 1.003187    
+2023-12-01 02:40:22,873 - Epoch: [1][ 9900/12168]    Overall Loss 0.015637    Objective Loss 0.000000    Distill Loss 0.015637                                        LR 0.001000    Time 1.003754    
+2023-12-01 02:42:19,747 - Epoch: [1][10000/12168]    Overall Loss 0.015631    Objective Loss 0.000000    Distill Loss 0.015631                                        LR 0.001000    Time 1.005403    
+2023-12-01 02:44:14,532 - Epoch: [1][10100/12168]    Overall Loss 0.015624    Objective Loss 0.000000    Distill Loss 0.015624                                        LR 0.001000    Time 1.006813    
+2023-12-01 02:46:01,551 - Epoch: [1][10200/12168]    Overall Loss 0.015618    Objective Loss 0.000000    Distill Loss 0.015618                                        LR 0.001000    Time 1.007433    
+2023-12-01 02:47:30,623 - Epoch: [1][10300/12168]    Overall Loss 0.015612    Objective Loss 0.000000    Distill Loss 0.015612                                        LR 0.001000    Time 1.006299    
+2023-12-01 02:49:08,440 - Epoch: [1][10400/12168]    Overall Loss 0.015607    Objective Loss 0.000000    Distill Loss 0.015607                                        LR 0.001000    Time 1.006028    
+2023-12-01 02:50:54,811 - Epoch: [1][10500/12168]    Overall Loss 0.015601    Objective Loss 0.000000    Distill Loss 0.015601                                        LR 0.001000    Time 1.006577    
+2023-12-01 02:52:48,148 - Epoch: [1][10600/12168]    Overall Loss 0.015594    Objective Loss 0.000000    Distill Loss 0.015594                                        LR 0.001000    Time 1.007772    
+2023-12-01 02:54:27,272 - Epoch: [1][10700/12168]    Overall Loss 0.015588    Objective Loss 0.000000    Distill Loss 0.015588                                        LR 0.001000    Time 1.007617    
+2023-12-01 02:56:35,471 - Epoch: [1][10800/12168]    Overall Loss 0.015583    Objective Loss 0.000000    Distill Loss 0.015583                                        LR 0.001000    Time 1.010157    
+2023-12-01 02:58:37,368 - Epoch: [1][10900/12168]    Overall Loss 0.015576    Objective Loss 0.000000    Distill Loss 0.015576                                        LR 0.001000    Time 1.012072    
+2023-12-01 03:00:18,819 - Epoch: [1][11000/12168]    Overall Loss 0.015570    Objective Loss 0.000000    Distill Loss 0.015570                                        LR 0.001000    Time 1.012094    
+2023-12-01 03:02:08,240 - Epoch: [1][11100/12168]    Overall Loss 0.015565    Objective Loss 0.000000    Distill Loss 0.015565                                        LR 0.001000    Time 1.012833    
+2023-12-01 03:03:49,556 - Epoch: [1][11200/12168]    Overall Loss 0.015559    Objective Loss 0.000000    Distill Loss 0.015559                                        LR 0.001000    Time 1.012835    
+2023-12-01 03:05:39,341 - Epoch: [1][11300/12168]    Overall Loss 0.015553    Objective Loss 0.000000    Distill Loss 0.015553                                        LR 0.001000    Time 1.013587    
+2023-12-01 03:07:29,353 - Epoch: [1][11400/12168]    Overall Loss 0.015548    Objective Loss 0.000000    Distill Loss 0.015548                                        LR 0.001000    Time 1.014345    
+2023-12-01 03:09:14,875 - Epoch: [1][11500/12168]    Overall Loss 0.015542    Objective Loss 0.000000    Distill Loss 0.015542                                        LR 0.001000    Time 1.014700    
+2023-12-01 03:11:09,953 - Epoch: [1][11600/12168]    Overall Loss 0.015536    Objective Loss 0.000000    Distill Loss 0.015536                                        LR 0.001000    Time 1.015872    
+2023-12-01 03:12:41,257 - Epoch: [1][11700/12168]    Overall Loss 0.015531    Objective Loss 0.000000    Distill Loss 0.015531                                        LR 0.001000    Time 1.014993    
+2023-12-01 03:14:40,460 - Epoch: [1][11800/12168]    Overall Loss 0.015526    Objective Loss 0.000000    Distill Loss 0.015526                                        LR 0.001000    Time 1.016493    
+2023-12-01 03:16:24,814 - Epoch: [1][11900/12168]    Overall Loss 0.015520    Objective Loss 0.000000    Distill Loss 0.015520                                        LR 0.001000    Time 1.016719    
+2023-12-01 03:18:06,874 - Epoch: [1][12000/12168]    Overall Loss 0.015514    Objective Loss 0.000000    Distill Loss 0.015514                                        LR 0.001000    Time 1.016751    
+2023-12-01 03:19:48,436 - Epoch: [1][12100/12168]    Overall Loss 0.015509    Objective Loss 0.000000    Distill Loss 0.015509                                        LR 0.001000    Time 1.016741    
+2023-12-01 03:21:03,235 - Epoch: [1][12168/12168]    Overall Loss 0.015505    Objective Loss 0.000000    Distill Loss 0.015505                                        LR 0.001000    Time 1.017206    
+2023-12-01 03:21:04,025 - --- validate (epoch=1)-----------
+2023-12-01 03:21:04,025 - 167951 samples (256 per mini-batch)
+2023-12-01 03:21:56,819 - Epoch: [1][  100/  657]    Loss 0.000000    Overall Loss 0.015512    
+2023-12-01 03:22:44,706 - Epoch: [1][  200/  657]    Loss 0.000000    Overall Loss 0.015540    
+2023-12-01 03:23:32,651 - Epoch: [1][  300/  657]    Loss 0.000000    Overall Loss 0.015546    
+2023-12-01 03:24:20,617 - Epoch: [1][  400/  657]    Loss 0.000000    Overall Loss 0.015551    
+2023-12-01 03:25:08,576 - Epoch: [1][  500/  657]    Loss 0.000000    Overall Loss 0.015551    
+2023-12-01 03:25:56,536 - Epoch: [1][  600/  657]    Loss 0.000000    Overall Loss 0.015542    
+2023-12-01 03:26:23,432 - Epoch: [1][  657/  657]    Loss 0.000000    Overall Loss 0.015551    
+2023-12-01 03:26:23,836 - ==> Overall Loss: 0.016
+
+2023-12-01 03:26:23,839 - ==> Best [Overall Loss: 0.015551 on epoch: 1]
+2023-12-01 03:26:23,839 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-01 03:26:23,867 - 
+
+2023-12-01 03:26:23,867 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-01 03:28:30,528 - Epoch: [2][  100/12168]    Overall Loss 0.014766    Objective Loss 0.000000    Distill Loss 0.014766                                        LR 0.001000    Time 1.266533    
+2023-12-01 03:30:10,997 - Epoch: [2][  200/12168]    Overall Loss 0.014759    Objective Loss 0.000000    Distill Loss 0.014759                                        LR 0.001000    Time 1.135577    
+2023-12-01 03:31:57,273 - Epoch: [2][  300/12168]    Overall Loss 0.014779    Objective Loss 0.000000    Distill Loss 0.014779                                        LR 0.001000    Time 1.111278    
+2023-12-01 03:33:32,340 - Epoch: [2][  400/12168]    Overall Loss 0.014772    Objective Loss 0.000000    Distill Loss 0.014772                                        LR 0.001000    Time 1.071110    
+2023-12-01 03:35:15,633 - Epoch: [2][  500/12168]    Overall Loss 0.014773    Objective Loss 0.000000    Distill Loss 0.014773                                        LR 0.001000    Time 1.063461    
+2023-12-01 03:36:48,883 - Epoch: [2][  600/12168]    Overall Loss 0.014769    Objective Loss 0.000000    Distill Loss 0.014769                                        LR 0.001000    Time 1.041622    
+2023-12-01 03:38:13,746 - Epoch: [2][  700/12168]    Overall Loss 0.014768    Objective Loss 0.000000    Distill Loss 0.014768                                        LR 0.001000    Time 1.014042    
+2023-12-01 03:39:58,223 - Epoch: [2][  800/12168]    Overall Loss 0.014767    Objective Loss 0.000000    Distill Loss 0.014767                                        LR 0.001000    Time 1.017873    
+2023-12-01 03:41:29,143 - Epoch: [2][  900/12168]    Overall Loss 0.014769    Objective Loss 0.000000    Distill Loss 0.014769                                        LR 0.001000    Time 1.005790    
+2023-12-01 03:43:07,222 - Epoch: [2][ 1000/12168]    Overall Loss 0.014766    Objective Loss 0.000000    Distill Loss 0.014766                                        LR 0.001000    Time 1.003282    
+2023-12-01 03:44:46,174 - Epoch: [2][ 1100/12168]    Overall Loss 0.014763    Objective Loss 0.000000    Distill Loss 0.014763                                        LR 0.001000    Time 1.002025    
+2023-12-01 03:46:05,399 - Epoch: [2][ 1200/12168]    Overall Loss 0.014756    Objective Loss 0.000000    Distill Loss 0.014756                                        LR 0.001000    Time 0.984538    
+2023-12-01 03:47:39,149 - Epoch: [2][ 1300/12168]    Overall Loss 0.014747    Objective Loss 0.000000    Distill Loss 0.014747                                        LR 0.001000    Time 0.980913    
+2023-12-01 03:49:13,795 - Epoch: [2][ 1400/12168]    Overall Loss 0.014744    Objective Loss 0.000000    Distill Loss 0.014744                                        LR 0.001000    Time 0.978447    
+2023-12-01 03:51:08,640 - Epoch: [2][ 1500/12168]    Overall Loss 0.014741    Objective Loss 0.000000    Distill Loss 0.014741                                        LR 0.001000    Time 0.989776    
+2023-12-01 03:52:37,684 - Epoch: [2][ 1600/12168]    Overall Loss 0.014739    Objective Loss 0.000000    Distill Loss 0.014739                                        LR 0.001000    Time 0.983562    
+2023-12-01 03:54:17,365 - Epoch: [2][ 1700/12168]    Overall Loss 0.014736    Objective Loss 0.000000    Distill Loss 0.014736                                        LR 0.001000    Time 0.984338    
+2023-12-01 03:55:47,444 - Epoch: [2][ 1800/12168]    Overall Loss 0.014733    Objective Loss 0.000000    Distill Loss 0.014733                                        LR 0.001000    Time 0.979692    
+2023-12-01 03:57:30,229 - Epoch: [2][ 1900/12168]    Overall Loss 0.014730    Objective Loss 0.000000    Distill Loss 0.014730                                        LR 0.001000    Time 0.982222    
+2023-12-01 03:59:06,090 - Epoch: [2][ 2000/12168]    Overall Loss 0.014727    Objective Loss 0.000000    Distill Loss 0.014727                                        LR 0.001000    Time 0.981038    
+2023-12-01 04:00:52,628 - Epoch: [2][ 2100/12168]    Overall Loss 0.014723    Objective Loss 0.000000    Distill Loss 0.014723                                        LR 0.001000    Time 0.985052    
+2023-12-01 04:02:30,403 - Epoch: [2][ 2200/12168]    Overall Loss 0.014721    Objective Loss 0.000000    Distill Loss 0.014721                                        LR 0.001000    Time 0.984716    
+2023-12-01 04:04:01,543 - Epoch: [2][ 2300/12168]    Overall Loss 0.014714    Objective Loss 0.000000    Distill Loss 0.014714                                        LR 0.001000    Time 0.981526    
+2023-12-01 04:05:29,371 - Epoch: [2][ 2400/12168]    Overall Loss 0.014707    Objective Loss 0.000000    Distill Loss 0.014707                                        LR 0.001000    Time 0.977221    
+2023-12-01 04:07:01,644 - Epoch: [2][ 2500/12168]    Overall Loss 0.014701    Objective Loss 0.000000    Distill Loss 0.014701                                        LR 0.001000    Time 0.975038    
+2023-12-01 04:08:44,440 - Epoch: [2][ 2600/12168]    Overall Loss 0.014695    Objective Loss 0.000000    Distill Loss 0.014695                                        LR 0.001000    Time 0.977071    
+2023-12-01 04:10:26,215 - Epoch: [2][ 2700/12168]    Overall Loss 0.014693    Objective Loss 0.000000    Distill Loss 0.014693                                        LR 0.001000    Time 0.978575    
+2023-12-01 04:12:09,602 - Epoch: [2][ 2800/12168]    Overall Loss 0.014688    Objective Loss 0.000000    Distill Loss 0.014688                                        LR 0.001000    Time 0.980547    
+2023-12-01 04:13:58,198 - Epoch: [2][ 2900/12168]    Overall Loss 0.014686    Objective Loss 0.000000    Distill Loss 0.014686                                        LR 0.001000    Time 0.984179    
+2023-12-01 04:15:30,850 - Epoch: [2][ 3000/12168]    Overall Loss 0.014683    Objective Loss 0.000000    Distill Loss 0.014683                                        LR 0.001000    Time 0.982255    
+2023-12-01 04:17:06,374 - Epoch: [2][ 3100/12168]    Overall Loss 0.014677    Objective Loss 0.000000    Distill Loss 0.014677                                        LR 0.001000    Time 0.981381    
+2023-12-01 04:18:46,866 - Epoch: [2][ 3200/12168]    Overall Loss 0.014674    Objective Loss 0.000000    Distill Loss 0.014674                                        LR 0.001000    Time 0.982114    
+2023-12-01 04:20:25,246 - Epoch: [2][ 3300/12168]    Overall Loss 0.014670    Objective Loss 0.000000    Distill Loss 0.014670                                        LR 0.001000    Time 0.982164    
+2023-12-01 04:21:59,853 - Epoch: [2][ 3400/12168]    Overall Loss 0.014668    Objective Loss 0.000000    Distill Loss 0.014668                                        LR 0.001000    Time 0.981100    
+2023-12-01 04:23:41,080 - Epoch: [2][ 3500/12168]    Overall Loss 0.014664    Objective Loss 0.000000    Distill Loss 0.014664                                        LR 0.001000    Time 0.981988    
+2023-12-01 04:25:16,705 - Epoch: [2][ 3600/12168]    Overall Loss 0.014660    Objective Loss 0.000000    Distill Loss 0.014660                                        LR 0.001000    Time 0.981272    
+2023-12-01 04:27:12,085 - Epoch: [2][ 3700/12168]    Overall Loss 0.014656    Objective Loss 0.000000    Distill Loss 0.014656                                        LR 0.001000    Time 0.985933    
+2023-12-01 04:28:50,993 - Epoch: [2][ 3800/12168]    Overall Loss 0.014654    Objective Loss 0.000000    Distill Loss 0.014654                                        LR 0.001000    Time 0.986013    
+2023-12-01 04:30:30,129 - Epoch: [2][ 3900/12168]    Overall Loss 0.014650    Objective Loss 0.000000    Distill Loss 0.014650                                        LR 0.001000    Time 0.986149    
+2023-12-01 04:32:10,257 - Epoch: [2][ 4000/12168]    Overall Loss 0.014645    Objective Loss 0.000000    Distill Loss 0.014645                                        LR 0.001000    Time 0.986525    
+2023-12-01 04:33:48,333 - Epoch: [2][ 4100/12168]    Overall Loss 0.014644    Objective Loss 0.000000    Distill Loss 0.014644                                        LR 0.001000    Time 0.986383    
+2023-12-01 04:35:27,997 - Epoch: [2][ 4200/12168]    Overall Loss 0.014640    Objective Loss 0.000000    Distill Loss 0.014640                                        LR 0.001000    Time 0.986625    
+2023-12-01 04:37:08,116 - Epoch: [2][ 4300/12168]    Overall Loss 0.014636    Objective Loss 0.000000    Distill Loss 0.014636                                        LR 0.001000    Time 0.986962    
+2023-12-01 04:38:55,789 - Epoch: [2][ 4400/12168]    Overall Loss 0.014631    Objective Loss 0.000000    Distill Loss 0.014631                                        LR 0.001000    Time 0.989001    
+2023-12-01 04:40:39,071 - Epoch: [2][ 4500/12168]    Overall Loss 0.014629    Objective Loss 0.000000    Distill Loss 0.014629                                        LR 0.001000    Time 0.989973    
+2023-12-01 04:42:15,662 - Epoch: [2][ 4600/12168]    Overall Loss 0.014625    Objective Loss 0.000000    Distill Loss 0.014625                                        LR 0.001000    Time 0.989448    
+2023-12-01 04:43:46,213 - Epoch: [2][ 4700/12168]    Overall Loss 0.014622    Objective Loss 0.000000    Distill Loss 0.014622                                        LR 0.001000    Time 0.987661    
+2023-12-01 04:45:24,921 - Epoch: [2][ 4800/12168]    Overall Loss 0.014619    Objective Loss 0.000000    Distill Loss 0.014619                                        LR 0.001000    Time 0.987647    
+2023-12-01 04:47:14,075 - Epoch: [2][ 4900/12168]    Overall Loss 0.014615    Objective Loss 0.000000    Distill Loss 0.014615                                        LR 0.001000    Time 0.989766    
+2023-12-01 04:48:58,001 - Epoch: [2][ 5000/12168]    Overall Loss 0.014612    Objective Loss 0.000000    Distill Loss 0.014612                                        LR 0.001000    Time 0.990754    
+2023-12-01 04:50:39,182 - Epoch: [2][ 5100/12168]    Overall Loss 0.014610    Objective Loss 0.000000    Distill Loss 0.014610                                        LR 0.001000    Time 0.991166    
+2023-12-01 04:52:21,545 - Epoch: [2][ 5200/12168]    Overall Loss 0.014607    Objective Loss 0.000000    Distill Loss 0.014607                                        LR 0.001000    Time 0.991789    
+2023-12-01 04:53:51,709 - Epoch: [2][ 5300/12168]    Overall Loss 0.014604    Objective Loss 0.000000    Distill Loss 0.014604                                        LR 0.001000    Time 0.990087    
+2023-12-01 04:55:31,577 - Epoch: [2][ 5400/12168]    Overall Loss 0.014601    Objective Loss 0.000000    Distill Loss 0.014601                                        LR 0.001000    Time 0.990245    
+2023-12-01 04:57:09,169 - Epoch: [2][ 5500/12168]    Overall Loss 0.014597    Objective Loss 0.000000    Distill Loss 0.014597                                        LR 0.001000    Time 0.989983    
+2023-12-01 04:58:45,366 - Epoch: [2][ 5600/12168]    Overall Loss 0.014594    Objective Loss 0.000000    Distill Loss 0.014594                                        LR 0.001000    Time 0.989481    
+2023-12-01 05:00:17,098 - Epoch: [2][ 5700/12168]    Overall Loss 0.014591    Objective Loss 0.000000    Distill Loss 0.014591                                        LR 0.001000    Time 0.988214    
+2023-12-01 05:02:02,710 - Epoch: [2][ 5800/12168]    Overall Loss 0.014586    Objective Loss 0.000000    Distill Loss 0.014586                                        LR 0.001000    Time 0.989383    
+2023-12-01 05:03:46,599 - Epoch: [2][ 5900/12168]    Overall Loss 0.014584    Objective Loss 0.000000    Distill Loss 0.014584                                        LR 0.001000    Time 0.990221    
+2023-12-01 05:05:06,481 - Epoch: [2][ 6000/12168]    Overall Loss 0.014581    Objective Loss 0.000000    Distill Loss 0.014581                                        LR 0.001000    Time 0.987030    
+2023-12-01 05:06:42,125 - Epoch: [2][ 6100/12168]    Overall Loss 0.014578    Objective Loss 0.000000    Distill Loss 0.014578                                        LR 0.001000    Time 0.986528    
+2023-12-01 05:08:18,829 - Epoch: [2][ 6200/12168]    Overall Loss 0.014576    Objective Loss 0.000000    Distill Loss 0.014576                                        LR 0.001000    Time 0.986212    
+2023-12-01 05:09:56,048 - Epoch: [2][ 6300/12168]    Overall Loss 0.014573    Objective Loss 0.000000    Distill Loss 0.014573                                        LR 0.001000    Time 0.985988    
+2023-12-01 05:11:37,629 - Epoch: [2][ 6400/12168]    Overall Loss 0.014571    Objective Loss 0.000000    Distill Loss 0.014571                                        LR 0.001000    Time 0.986453    
+2023-12-01 05:13:23,866 - Epoch: [2][ 6500/12168]    Overall Loss 0.014568    Objective Loss 0.000000    Distill Loss 0.014568                                        LR 0.001000    Time 0.987620    
+2023-12-01 05:14:58,706 - Epoch: [2][ 6600/12168]    Overall Loss 0.014565    Objective Loss 0.000000    Distill Loss 0.014565                                        LR 0.001000    Time 0.987025    
+2023-12-01 05:16:28,686 - Epoch: [2][ 6700/12168]    Overall Loss 0.014562    Objective Loss 0.000000    Distill Loss 0.014562                                        LR 0.001000    Time 0.985722    
+2023-12-01 05:18:03,968 - Epoch: [2][ 6800/12168]    Overall Loss 0.014559    Objective Loss 0.000000    Distill Loss 0.014559                                        LR 0.001000    Time 0.985237    
+2023-12-01 05:19:51,364 - Epoch: [2][ 6900/12168]    Overall Loss 0.014556    Objective Loss 0.000000    Distill Loss 0.014556                                        LR 0.001000    Time 0.986522    
+2023-12-01 05:21:42,043 - Epoch: [2][ 7000/12168]    Overall Loss 0.014553    Objective Loss 0.000000    Distill Loss 0.014553                                        LR 0.001000    Time 0.988239    
+2023-12-01 05:23:28,706 - Epoch: [2][ 7100/12168]    Overall Loss 0.014549    Objective Loss 0.000000    Distill Loss 0.014549                                        LR 0.001000    Time 0.989342    
+2023-12-01 05:25:06,666 - Epoch: [2][ 7200/12168]    Overall Loss 0.014547    Objective Loss 0.000000    Distill Loss 0.014547                                        LR 0.001000    Time 0.989206    
+2023-12-01 05:26:52,240 - Epoch: [2][ 7300/12168]    Overall Loss 0.014544    Objective Loss 0.000000    Distill Loss 0.014544                                        LR 0.001000    Time 0.990116    
+2023-12-01 05:28:34,879 - Epoch: [2][ 7400/12168]    Overall Loss 0.014541    Objective Loss 0.000000    Distill Loss 0.014541                                        LR 0.001000    Time 0.990605    
+2023-12-01 05:30:18,024 - Epoch: [2][ 7500/12168]    Overall Loss 0.014537    Objective Loss 0.000000    Distill Loss 0.014537                                        LR 0.001000    Time 0.991149    
+2023-12-01 05:31:56,351 - Epoch: [2][ 7600/12168]    Overall Loss 0.014535    Objective Loss 0.000000    Distill Loss 0.014535                                        LR 0.001000    Time 0.991044    
+2023-12-01 05:33:43,710 - Epoch: [2][ 7700/12168]    Overall Loss 0.014533    Objective Loss 0.000000    Distill Loss 0.014533                                        LR 0.001000    Time 0.992115    
+2023-12-01 05:35:27,322 - Epoch: [2][ 7800/12168]    Overall Loss 0.014531    Objective Loss 0.000000    Distill Loss 0.014531                                        LR 0.001000    Time 0.992678    
+2023-12-01 05:37:11,289 - Epoch: [2][ 7900/12168]    Overall Loss 0.014529    Objective Loss 0.000000    Distill Loss 0.014529                                        LR 0.001000    Time 0.993272    
+2023-12-01 05:38:56,980 - Epoch: [2][ 8000/12168]    Overall Loss 0.014525    Objective Loss 0.000000    Distill Loss 0.014525                                        LR 0.001000    Time 0.994067    
+2023-12-01 05:40:29,009 - Epoch: [2][ 8100/12168]    Overall Loss 0.014521    Objective Loss 0.000000    Distill Loss 0.014521                                        LR 0.001000    Time 0.993155    
+2023-12-01 05:42:10,482 - Epoch: [2][ 8200/12168]    Overall Loss 0.014519    Objective Loss 0.000000    Distill Loss 0.014519                                        LR 0.001000    Time 0.993418    
+2023-12-01 05:43:37,330 - Epoch: [2][ 8300/12168]    Overall Loss 0.014517    Objective Loss 0.000000    Distill Loss 0.014517                                        LR 0.001000    Time 0.991911    
+2023-12-01 05:45:17,959 - Epoch: [2][ 8400/12168]    Overall Loss 0.014514    Objective Loss 0.000000    Distill Loss 0.014514                                        LR 0.001000    Time 0.992082    
+2023-12-01 05:46:56,166 - Epoch: [2][ 8500/12168]    Overall Loss 0.014511    Objective Loss 0.000000    Distill Loss 0.014511                                        LR 0.001000    Time 0.991963    
+2023-12-01 05:48:36,096 - Epoch: [2][ 8600/12168]    Overall Loss 0.014508    Objective Loss 0.000000    Distill Loss 0.014508                                        LR 0.001000    Time 0.992048    
+2023-12-01 05:50:31,401 - Epoch: [2][ 8700/12168]    Overall Loss 0.014505    Objective Loss 0.000000    Distill Loss 0.014505                                        LR 0.001000    Time 0.993897    
+2023-12-01 05:52:09,765 - Epoch: [2][ 8800/12168]    Overall Loss 0.014502    Objective Loss 0.000000    Distill Loss 0.014502                                        LR 0.001000    Time 0.993780    
+2023-12-01 05:53:50,885 - Epoch: [2][ 8900/12168]    Overall Loss 0.014499    Objective Loss 0.000000    Distill Loss 0.014499                                        LR 0.001000    Time 0.993975    
+2023-12-01 05:55:44,263 - Epoch: [2][ 9000/12168]    Overall Loss 0.014497    Objective Loss 0.000000    Distill Loss 0.014497                                        LR 0.001000    Time 0.995528    
+2023-12-01 05:57:15,441 - Epoch: [2][ 9100/12168]    Overall Loss 0.014494    Objective Loss 0.000000    Distill Loss 0.014494                                        LR 0.001000    Time 0.994607    
+2023-12-01 05:59:00,005 - Epoch: [2][ 9200/12168]    Overall Loss 0.014491    Objective Loss 0.000000    Distill Loss 0.014491                                        LR 0.001000    Time 0.995161    
+2023-12-01 06:00:43,492 - Epoch: [2][ 9300/12168]    Overall Loss 0.014489    Objective Loss 0.000000    Distill Loss 0.014489                                        LR 0.001000    Time 0.995587    
+2023-12-01 06:02:28,293 - Epoch: [2][ 9400/12168]    Overall Loss 0.014486    Objective Loss 0.000000    Distill Loss 0.014486                                        LR 0.001000    Time 0.996144    
+2023-12-01 06:04:17,738 - Epoch: [2][ 9500/12168]    Overall Loss 0.014483    Objective Loss 0.000000    Distill Loss 0.014483                                        LR 0.001000    Time 0.997178    
+2023-12-01 06:05:49,747 - Epoch: [2][ 9600/12168]    Overall Loss 0.014480    Objective Loss 0.000000    Distill Loss 0.014480                                        LR 0.001000    Time 0.996374    
+2023-12-01 06:07:39,004 - Epoch: [2][ 9700/12168]    Overall Loss 0.014478    Objective Loss 0.000000    Distill Loss 0.014478                                        LR 0.001000    Time 0.997365    
+2023-12-01 06:09:26,997 - Epoch: [2][ 9800/12168]    Overall Loss 0.014474    Objective Loss 0.000000    Distill Loss 0.014474                                        LR 0.001000    Time 0.998207    
+2023-12-01 06:11:07,355 - Epoch: [2][ 9900/12168]    Overall Loss 0.014471    Objective Loss 0.000000    Distill Loss 0.014471                                        LR 0.001000    Time 0.998260    
+2023-12-01 06:12:56,726 - Epoch: [2][10000/12168]    Overall Loss 0.014468    Objective Loss 0.000000    Distill Loss 0.014468                                        LR 0.001000    Time 0.999214    
+2023-12-01 06:14:50,869 - Epoch: [2][10100/12168]    Overall Loss 0.014466    Objective Loss 0.000000    Distill Loss 0.014466                                        LR 0.001000    Time 1.000622    
+2023-12-01 06:16:30,380 - Epoch: [2][10200/12168]    Overall Loss 0.014463    Objective Loss 0.000000    Distill Loss 0.014463                                        LR 0.001000    Time 1.000567    
+2023-12-01 06:18:07,900 - Epoch: [2][10300/12168]    Overall Loss 0.014460    Objective Loss 0.000000    Distill Loss 0.014460                                        LR 0.001000    Time 1.000320    
+2023-12-01 06:19:42,381 - Epoch: [2][10400/12168]    Overall Loss 0.014458    Objective Loss 0.000000    Distill Loss 0.014458                                        LR 0.001000    Time 0.999785    
+2023-12-01 06:20:52,873 - Epoch: [2][10500/12168]    Overall Loss 0.014456    Objective Loss 0.000000    Distill Loss 0.014456                                        LR 0.001000    Time 0.996977    
+2023-12-01 06:22:05,013 - Epoch: [2][10600/12168]    Overall Loss 0.014453    Objective Loss 0.000000    Distill Loss 0.014453                                        LR 0.001000    Time 0.994376    
+2023-12-01 06:23:14,249 - Epoch: [2][10700/12168]    Overall Loss 0.014451    Objective Loss 0.000000    Distill Loss 0.014451                                        LR 0.001000    Time 0.991553    
+2023-12-01 06:24:22,120 - Epoch: [2][10800/12168]    Overall Loss 0.014448    Objective Loss 0.000000    Distill Loss 0.014448                                        LR 0.001000    Time 0.988656    
+2023-12-01 06:25:28,720 - Epoch: [2][10900/12168]    Overall Loss 0.014445    Objective Loss 0.000000    Distill Loss 0.014445                                        LR 0.001000    Time 0.985696    
+2023-12-01 06:27:01,279 - Epoch: [2][11000/12168]    Overall Loss 0.014442    Objective Loss 0.000000    Distill Loss 0.014442                                        LR 0.001000    Time 0.985149    
+2023-12-01 06:28:44,035 - Epoch: [2][11100/12168]    Overall Loss 0.014440    Objective Loss 0.000000    Distill Loss 0.014440                                        LR 0.001000    Time 0.985530    
+2023-12-01 06:30:37,946 - Epoch: [2][11200/12168]    Overall Loss 0.014438    Objective Loss 0.000000    Distill Loss 0.014438                                        LR 0.001000    Time 0.986901    
+2023-12-01 06:32:19,569 - Epoch: [2][11300/12168]    Overall Loss 0.014436    Objective Loss 0.000000    Distill Loss 0.014436                                        LR 0.001000    Time 0.987159    
+2023-12-01 06:34:18,300 - Epoch: [2][11400/12168]    Overall Loss 0.014433    Objective Loss 0.000000    Distill Loss 0.014433                                        LR 0.001000    Time 0.988914    
+2023-12-01 06:36:15,676 - Epoch: [2][11500/12168]    Overall Loss 0.014430    Objective Loss 0.000000    Distill Loss 0.014430                                        LR 0.001000    Time 0.990521    
+2023-12-01 06:38:04,474 - Epoch: [2][11600/12168]    Overall Loss 0.014428    Objective Loss 0.000000    Distill Loss 0.014428                                        LR 0.001000    Time 0.991361    
+2023-12-01 06:39:58,445 - Epoch: [2][11700/12168]    Overall Loss 0.014426    Objective Loss 0.000000    Distill Loss 0.014426                                        LR 0.001000    Time 0.992628    
+2023-12-01 06:41:28,819 - Epoch: [2][11800/12168]    Overall Loss 0.014424    Objective Loss 0.000000    Distill Loss 0.014424                                        LR 0.001000    Time 0.991874    
+2023-12-01 06:43:22,726 - Epoch: [2][11900/12168]    Overall Loss 0.014421    Objective Loss 0.000000    Distill Loss 0.014421                                        LR 0.001000    Time 0.993110    
+2023-12-01 06:45:08,367 - Epoch: [2][12000/12168]    Overall Loss 0.014419    Objective Loss 0.000000    Distill Loss 0.014419                                        LR 0.001000    Time 0.993637    
+2023-12-01 06:46:55,459 - Epoch: [2][12100/12168]    Overall Loss 0.014416    Objective Loss 0.000000    Distill Loss 0.014416                                        LR 0.001000    Time 0.994275    
+2023-12-01 06:48:00,369 - Epoch: [2][12168/12168]    Overall Loss 0.014414    Objective Loss 0.000000    Distill Loss 0.014414                                        LR 0.001000    Time 0.994053    
+2023-12-01 06:48:00,996 - --- validate (epoch=2)-----------
+2023-12-01 06:48:00,996 - 167951 samples (256 per mini-batch)
+2023-12-01 06:48:54,111 - Epoch: [2][  100/  657]    Loss 0.000000    Overall Loss 0.014788    
+2023-12-01 06:49:42,020 - Epoch: [2][  200/  657]    Loss 0.000000    Overall Loss 0.014787    
+2023-12-01 06:50:30,010 - Epoch: [2][  300/  657]    Loss 0.000000    Overall Loss 0.014762    
+2023-12-01 06:51:18,004 - Epoch: [2][  400/  657]    Loss 0.000000    Overall Loss 0.014752    
+2023-12-01 06:52:05,999 - Epoch: [2][  500/  657]    Loss 0.000000    Overall Loss 0.014740    
+2023-12-01 06:52:53,972 - Epoch: [2][  600/  657]    Loss 0.000000    Overall Loss 0.014742    
+2023-12-01 06:53:20,918 - Epoch: [2][  657/  657]    Loss 0.000000    Overall Loss 0.014740    
+2023-12-01 06:53:21,341 - ==> Overall Loss: 0.015
+
+2023-12-01 06:53:21,344 - ==> Best [Overall Loss: 0.014740 on epoch: 2]
+2023-12-01 06:53:21,344 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-01 06:53:21,372 - 
+
+2023-12-01 06:53:21,373 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-01 06:55:21,612 - Epoch: [3][  100/12168]    Overall Loss 0.014048    Objective Loss 0.000000    Distill Loss 0.014048                                        LR 0.001000    Time 1.202313    
+2023-12-01 06:56:52,520 - Epoch: [3][  200/12168]    Overall Loss 0.014052    Objective Loss 0.000000    Distill Loss 0.014052                                        LR 0.001000    Time 1.055661    
+2023-12-01 06:58:43,368 - Epoch: [3][  300/12168]    Overall Loss 0.014061    Objective Loss 0.000000    Distill Loss 0.014061                                        LR 0.001000    Time 1.073243    
+2023-12-01 07:00:25,269 - Epoch: [3][  400/12168]    Overall Loss 0.014051    Objective Loss 0.000000    Distill Loss 0.014051                                        LR 0.001000    Time 1.059667    
+2023-12-01 07:02:12,190 - Epoch: [3][  500/12168]    Overall Loss 0.014046    Objective Loss 0.000000    Distill Loss 0.014046                                        LR 0.001000    Time 1.061560    
+2023-12-01 07:03:52,362 - Epoch: [3][  600/12168]    Overall Loss 0.014051    Objective Loss 0.000000    Distill Loss 0.014051                                        LR 0.001000    Time 1.051576    
+2023-12-01 07:05:15,498 - Epoch: [3][  700/12168]    Overall Loss 0.014045    Objective Loss 0.000000    Distill Loss 0.014045                                        LR 0.001000    Time 1.020106    
+2023-12-01 07:06:48,966 - Epoch: [3][  800/12168]    Overall Loss 0.014039    Objective Loss 0.000000    Distill Loss 0.014039                                        LR 0.001000    Time 1.009419    
+2023-12-01 07:08:30,643 - Epoch: [3][  900/12168]    Overall Loss 0.014041    Objective Loss 0.000000    Distill Loss 0.014041                                        LR 0.001000    Time 1.010228    
+2023-12-01 07:10:05,297 - Epoch: [3][ 1000/12168]    Overall Loss 0.014042    Objective Loss 0.000000    Distill Loss 0.014042                                        LR 0.001000    Time 1.003851    
+2023-12-01 07:12:01,376 - Epoch: [3][ 1100/12168]    Overall Loss 0.014045    Objective Loss 0.000000    Distill Loss 0.014045                                        LR 0.001000    Time 1.018112    
+2023-12-01 07:13:38,115 - Epoch: [3][ 1200/12168]    Overall Loss 0.014039    Objective Loss 0.000000    Distill Loss 0.014039                                        LR 0.001000    Time 1.013878    
+2023-12-01 07:15:04,890 - Epoch: [3][ 1300/12168]    Overall Loss 0.014037    Objective Loss 0.000000    Distill Loss 0.014037                                        LR 0.001000    Time 1.002632    
+2023-12-01 07:16:47,078 - Epoch: [3][ 1400/12168]    Overall Loss 0.014037    Objective Loss 0.000000    Distill Loss 0.014037                                        LR 0.001000    Time 1.004001    
+2023-12-01 07:18:28,117 - Epoch: [3][ 1500/12168]    Overall Loss 0.014042    Objective Loss 0.000000    Distill Loss 0.014042                                        LR 0.001000    Time 1.004422    
+2023-12-01 07:20:01,206 - Epoch: [3][ 1600/12168]    Overall Loss 0.014041    Objective Loss 0.000000    Distill Loss 0.014041                                        LR 0.001000    Time 0.999821    
+2023-12-01 07:21:49,665 - Epoch: [3][ 1700/12168]    Overall Loss 0.014041    Objective Loss 0.000000    Distill Loss 0.014041                                        LR 0.001000    Time 1.004803    
+2023-12-01 07:23:43,221 - Epoch: [3][ 1800/12168]    Overall Loss 0.014039    Objective Loss 0.000000    Distill Loss 0.014039                                        LR 0.001000    Time 1.012063    
+2023-12-01 07:25:26,800 - Epoch: [3][ 1900/12168]    Overall Loss 0.014037    Objective Loss 0.000000    Distill Loss 0.014037                                        LR 0.001000    Time 1.013308    
+2023-12-01 07:26:58,871 - Epoch: [3][ 2000/12168]    Overall Loss 0.014037    Objective Loss 0.000000    Distill Loss 0.014037                                        LR 0.001000    Time 1.008674    
+2023-12-01 07:28:32,483 - Epoch: [3][ 2100/12168]    Overall Loss 0.014036    Objective Loss 0.000000    Distill Loss 0.014036                                        LR 0.001000    Time 1.005216    
+2023-12-01 07:30:08,079 - Epoch: [3][ 2200/12168]    Overall Loss 0.014036    Objective Loss 0.000000    Distill Loss 0.014036                                        LR 0.001000    Time 1.002974    
+2023-12-01 07:31:41,187 - Epoch: [3][ 2300/12168]    Overall Loss 0.014031    Objective Loss 0.000000    Distill Loss 0.014031                                        LR 0.001000    Time 0.999845    
+2023-12-01 07:33:11,501 - Epoch: [3][ 2400/12168]    Overall Loss 0.014028    Objective Loss 0.000000    Distill Loss 0.014028                                        LR 0.001000    Time 0.995813    
+2023-12-01 07:34:47,320 - Epoch: [3][ 2500/12168]    Overall Loss 0.014025    Objective Loss 0.000000    Distill Loss 0.014025                                        LR 0.001000    Time 0.994304    
+2023-12-01 07:36:26,530 - Epoch: [3][ 2600/12168]    Overall Loss 0.014022    Objective Loss 0.000000    Distill Loss 0.014022                                        LR 0.001000    Time 0.994217    
+2023-12-01 07:38:06,584 - Epoch: [3][ 2700/12168]    Overall Loss 0.014018    Objective Loss 0.000000    Distill Loss 0.014018                                        LR 0.001000    Time 0.994448    
+2023-12-01 07:39:44,729 - Epoch: [3][ 2800/12168]    Overall Loss 0.014016    Objective Loss 0.000000    Distill Loss 0.014016                                        LR 0.001000    Time 0.993981    
+2023-12-01 07:41:20,256 - Epoch: [3][ 2900/12168]    Overall Loss 0.014015    Objective Loss 0.000000    Distill Loss 0.014015                                        LR 0.001000    Time 0.992644    
+2023-12-01 07:42:51,171 - Epoch: [3][ 3000/12168]    Overall Loss 0.014012    Objective Loss 0.000000    Distill Loss 0.014012                                        LR 0.001000    Time 0.989858    
+2023-12-01 07:44:32,732 - Epoch: [3][ 3100/12168]    Overall Loss 0.014007    Objective Loss 0.000000    Distill Loss 0.014007                                        LR 0.001000    Time 0.990687    
+2023-12-01 07:46:09,238 - Epoch: [3][ 3200/12168]    Overall Loss 0.014004    Objective Loss 0.000000    Distill Loss 0.014004                                        LR 0.001000    Time 0.989883    
+2023-12-01 07:47:53,651 - Epoch: [3][ 3300/12168]    Overall Loss 0.014002    Objective Loss 0.000000    Distill Loss 0.014002                                        LR 0.001000    Time 0.991525    
+2023-12-01 07:49:29,032 - Epoch: [3][ 3400/12168]    Overall Loss 0.014000    Objective Loss 0.000000    Distill Loss 0.014000                                        LR 0.001000    Time 0.990413    
+2023-12-01 07:51:11,925 - Epoch: [3][ 3500/12168]    Overall Loss 0.013998    Objective Loss 0.000000    Distill Loss 0.013998                                        LR 0.001000    Time 0.991512    
+2023-12-01 07:52:53,110 - Epoch: [3][ 3600/12168]    Overall Loss 0.013995    Objective Loss 0.000000    Distill Loss 0.013995                                        LR 0.001000    Time 0.992075    
+2023-12-01 07:54:20,640 - Epoch: [3][ 3700/12168]    Overall Loss 0.013993    Objective Loss 0.000000    Distill Loss 0.013993                                        LR 0.001000    Time 0.988917    
+2023-12-01 07:55:51,768 - Epoch: [3][ 3800/12168]    Overall Loss 0.013992    Objective Loss 0.000000    Distill Loss 0.013992                                        LR 0.001000    Time 0.986872    
+2023-12-01 07:57:27,632 - Epoch: [3][ 3900/12168]    Overall Loss 0.013989    Objective Loss 0.000000    Distill Loss 0.013989                                        LR 0.001000    Time 0.986146    
+2023-12-01 07:59:01,381 - Epoch: [3][ 4000/12168]    Overall Loss 0.013986    Objective Loss 0.000000    Distill Loss 0.013986                                        LR 0.001000    Time 0.984927    
+2023-12-01 08:00:33,961 - Epoch: [3][ 4100/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.001000    Time 0.983484    
+2023-12-01 08:01:59,414 - Epoch: [3][ 4200/12168]    Overall Loss 0.013984    Objective Loss 0.000000    Distill Loss 0.013984                                        LR 0.001000    Time 0.980411    
+2023-12-01 08:03:38,567 - Epoch: [3][ 4300/12168]    Overall Loss 0.013983    Objective Loss 0.000000    Distill Loss 0.013983                                        LR 0.001000    Time 0.980668    
+2023-12-01 08:05:10,141 - Epoch: [3][ 4400/12168]    Overall Loss 0.013981    Objective Loss 0.000000    Distill Loss 0.013981                                        LR 0.001000    Time 0.979191    
+2023-12-01 08:06:42,177 - Epoch: [3][ 4500/12168]    Overall Loss 0.013981    Objective Loss 0.000000    Distill Loss 0.013981                                        LR 0.001000    Time 0.977882    
+2023-12-01 08:08:28,005 - Epoch: [3][ 4600/12168]    Overall Loss 0.013979    Objective Loss 0.000000    Distill Loss 0.013979                                        LR 0.001000    Time 0.979628    
+2023-12-01 08:10:03,804 - Epoch: [3][ 4700/12168]    Overall Loss 0.013978    Objective Loss 0.000000    Distill Loss 0.013978                                        LR 0.001000    Time 0.979166    
+2023-12-01 08:11:42,885 - Epoch: [3][ 4800/12168]    Overall Loss 0.013977    Objective Loss 0.000000    Distill Loss 0.013977                                        LR 0.001000    Time 0.979407    
+2023-12-01 08:13:22,308 - Epoch: [3][ 4900/12168]    Overall Loss 0.013976    Objective Loss 0.000000    Distill Loss 0.013976                                        LR 0.001000    Time 0.979708    
+2023-12-01 08:15:13,882 - Epoch: [3][ 5000/12168]    Overall Loss 0.013974    Objective Loss 0.000000    Distill Loss 0.013974                                        LR 0.001000    Time 0.982427    
+2023-12-01 08:16:42,617 - Epoch: [3][ 5100/12168]    Overall Loss 0.013974    Objective Loss 0.000000    Distill Loss 0.013974                                        LR 0.001000    Time 0.980562    
+2023-12-01 08:18:19,195 - Epoch: [3][ 5200/12168]    Overall Loss 0.013973    Objective Loss 0.000000    Distill Loss 0.013973                                        LR 0.001000    Time 0.980276    
+2023-12-01 08:19:53,810 - Epoch: [3][ 5300/12168]    Overall Loss 0.013971    Objective Loss 0.000000    Distill Loss 0.013971                                        LR 0.001000    Time 0.979631    
+2023-12-01 08:21:41,490 - Epoch: [3][ 5400/12168]    Overall Loss 0.013970    Objective Loss 0.000000    Distill Loss 0.013970                                        LR 0.001000    Time 0.981429    
+2023-12-01 08:23:15,726 - Epoch: [3][ 5500/12168]    Overall Loss 0.013968    Objective Loss 0.000000    Distill Loss 0.013968                                        LR 0.001000    Time 0.980717    
+2023-12-01 08:24:55,369 - Epoch: [3][ 5600/12168]    Overall Loss 0.013965    Objective Loss 0.000000    Distill Loss 0.013965                                        LR 0.001000    Time 0.980997    
+2023-12-01 08:26:25,729 - Epoch: [3][ 5700/12168]    Overall Loss 0.013964    Objective Loss 0.000000    Distill Loss 0.013964                                        LR 0.001000    Time 0.979637    
+2023-12-01 08:28:00,655 - Epoch: [3][ 5800/12168]    Overall Loss 0.013962    Objective Loss 0.000000    Distill Loss 0.013962                                        LR 0.001000    Time 0.979112    
+2023-12-01 08:29:30,623 - Epoch: [3][ 5900/12168]    Overall Loss 0.013961    Objective Loss 0.000000    Distill Loss 0.013961                                        LR 0.001000    Time 0.977765    
+2023-12-01 08:30:57,553 - Epoch: [3][ 6000/12168]    Overall Loss 0.013960    Objective Loss 0.000000    Distill Loss 0.013960                                        LR 0.001000    Time 0.975956    
+2023-12-01 08:32:44,609 - Epoch: [3][ 6100/12168]    Overall Loss 0.013958    Objective Loss 0.000000    Distill Loss 0.013958                                        LR 0.001000    Time 0.977506    
+2023-12-01 08:34:21,602 - Epoch: [3][ 6200/12168]    Overall Loss 0.013955    Objective Loss 0.000000    Distill Loss 0.013955                                        LR 0.001000    Time 0.977382    
+2023-12-01 08:36:04,686 - Epoch: [3][ 6300/12168]    Overall Loss 0.013954    Objective Loss 0.000000    Distill Loss 0.013954                                        LR 0.001000    Time 0.978230    
+2023-12-01 08:37:42,178 - Epoch: [3][ 6400/12168]    Overall Loss 0.013952    Objective Loss 0.000000    Distill Loss 0.013952                                        LR 0.001000    Time 0.978177    
+2023-12-01 08:39:21,700 - Epoch: [3][ 6500/12168]    Overall Loss 0.013950    Objective Loss 0.000000    Distill Loss 0.013950                                        LR 0.001000    Time 0.978438    
+2023-12-01 08:41:04,938 - Epoch: [3][ 6600/12168]    Overall Loss 0.013948    Objective Loss 0.000000    Distill Loss 0.013948                                        LR 0.001000    Time 0.979254    
+2023-12-01 08:42:37,068 - Epoch: [3][ 6700/12168]    Overall Loss 0.013946    Objective Loss 0.000000    Distill Loss 0.013946                                        LR 0.001000    Time 0.978388    
+2023-12-01 08:44:06,745 - Epoch: [3][ 6800/12168]    Overall Loss 0.013945    Objective Loss 0.000000    Distill Loss 0.013945                                        LR 0.001000    Time 0.977187    
+2023-12-01 08:45:47,265 - Epoch: [3][ 6900/12168]    Overall Loss 0.013943    Objective Loss 0.000000    Distill Loss 0.013943                                        LR 0.001000    Time 0.977592    
+2023-12-01 08:47:37,900 - Epoch: [3][ 7000/12168]    Overall Loss 0.013941    Objective Loss 0.000000    Distill Loss 0.013941                                        LR 0.001000    Time 0.979430    
+2023-12-01 08:49:17,846 - Epoch: [3][ 7100/12168]    Overall Loss 0.013939    Objective Loss 0.000000    Distill Loss 0.013939                                        LR 0.001000    Time 0.979711    
+2023-12-01 08:50:57,094 - Epoch: [3][ 7200/12168]    Overall Loss 0.013938    Objective Loss 0.000000    Distill Loss 0.013938                                        LR 0.001000    Time 0.979887    
+2023-12-01 08:52:42,865 - Epoch: [3][ 7300/12168]    Overall Loss 0.013936    Objective Loss 0.000000    Distill Loss 0.013936                                        LR 0.001000    Time 0.980953    
+2023-12-01 08:54:20,709 - Epoch: [3][ 7400/12168]    Overall Loss 0.013934    Objective Loss 0.000000    Distill Loss 0.013934                                        LR 0.001000    Time 0.980918    
+2023-12-01 08:55:48,623 - Epoch: [3][ 7500/12168]    Overall Loss 0.013932    Objective Loss 0.000000    Distill Loss 0.013932                                        LR 0.001000    Time 0.979560    
+2023-12-01 08:57:32,903 - Epoch: [3][ 7600/12168]    Overall Loss 0.013931    Objective Loss 0.000000    Distill Loss 0.013931                                        LR 0.001000    Time 0.980391    
+2023-12-01 08:59:19,028 - Epoch: [3][ 7700/12168]    Overall Loss 0.013929    Objective Loss 0.000000    Distill Loss 0.013929                                        LR 0.001000    Time 0.981440    
+2023-12-01 09:00:53,335 - Epoch: [3][ 7800/12168]    Overall Loss 0.013927    Objective Loss 0.000000    Distill Loss 0.013927                                        LR 0.001000    Time 0.980947    
+2023-12-01 09:02:41,170 - Epoch: [3][ 7900/12168]    Overall Loss 0.013927    Objective Loss 0.000000    Distill Loss 0.013927                                        LR 0.001000    Time 0.982179    
+2023-12-01 09:04:20,738 - Epoch: [3][ 8000/12168]    Overall Loss 0.013925    Objective Loss 0.000000    Distill Loss 0.013925                                        LR 0.001000    Time 0.982347    
+2023-12-01 09:06:21,598 - Epoch: [3][ 8100/12168]    Overall Loss 0.013924    Objective Loss 0.000000    Distill Loss 0.013924                                        LR 0.001000    Time 0.985140    
+2023-12-01 09:08:08,499 - Epoch: [3][ 8200/12168]    Overall Loss 0.013922    Objective Loss 0.000000    Distill Loss 0.013922                                        LR 0.001000    Time 0.986161    
+2023-12-01 09:09:42,654 - Epoch: [3][ 8300/12168]    Overall Loss 0.013922    Objective Loss 0.000000    Distill Loss 0.013922                                        LR 0.001000    Time 0.985623    
+2023-12-01 09:11:22,771 - Epoch: [3][ 8400/12168]    Overall Loss 0.013920    Objective Loss 0.000000    Distill Loss 0.013920                                        LR 0.001000    Time 0.985807    
+2023-12-01 09:12:53,611 - Epoch: [3][ 8500/12168]    Overall Loss 0.013917    Objective Loss 0.000000    Distill Loss 0.013917                                        LR 0.001000    Time 0.984895    
+2023-12-01 09:14:28,510 - Epoch: [3][ 8600/12168]    Overall Loss 0.013916    Objective Loss 0.000000    Distill Loss 0.013916                                        LR 0.001000    Time 0.984477    
+2023-12-01 09:16:09,596 - Epoch: [3][ 8700/12168]    Overall Loss 0.013914    Objective Loss 0.000000    Distill Loss 0.013914                                        LR 0.001000    Time 0.984780    
+2023-12-01 09:17:57,384 - Epoch: [3][ 8800/12168]    Overall Loss 0.013912    Objective Loss 0.000000    Distill Loss 0.013912                                        LR 0.001000    Time 0.985837    
+2023-12-01 09:19:37,413 - Epoch: [3][ 8900/12168]    Overall Loss 0.013911    Objective Loss 0.000000    Distill Loss 0.013911                                        LR 0.001000    Time 0.985998    
+2023-12-01 09:21:16,947 - Epoch: [3][ 9000/12168]    Overall Loss 0.013908    Objective Loss 0.000000    Distill Loss 0.013908                                        LR 0.001000    Time 0.986101    
+2023-12-01 09:22:51,781 - Epoch: [3][ 9100/12168]    Overall Loss 0.013907    Objective Loss 0.000000    Distill Loss 0.013907                                        LR 0.001000    Time 0.985686    
+2023-12-01 09:24:29,694 - Epoch: [3][ 9200/12168]    Overall Loss 0.013906    Objective Loss 0.000000    Distill Loss 0.013906                                        LR 0.001000    Time 0.985614    
+2023-12-01 09:26:12,174 - Epoch: [3][ 9300/12168]    Overall Loss 0.013905    Objective Loss 0.000000    Distill Loss 0.013905                                        LR 0.001000    Time 0.986034    
+2023-12-01 09:28:01,412 - Epoch: [3][ 9400/12168]    Overall Loss 0.013903    Objective Loss 0.000000    Distill Loss 0.013903                                        LR 0.001000    Time 0.987165    
+2023-12-01 09:29:45,474 - Epoch: [3][ 9500/12168]    Overall Loss 0.013901    Objective Loss 0.000000    Distill Loss 0.013901                                        LR 0.001000    Time 0.987727    
+2023-12-01 09:31:24,320 - Epoch: [3][ 9600/12168]    Overall Loss 0.013899    Objective Loss 0.000000    Distill Loss 0.013899                                        LR 0.001000    Time 0.987734    
+2023-12-01 09:33:10,749 - Epoch: [3][ 9700/12168]    Overall Loss 0.013898    Objective Loss 0.000000    Distill Loss 0.013898                                        LR 0.001000    Time 0.988522    
+2023-12-01 09:34:51,182 - Epoch: [3][ 9800/12168]    Overall Loss 0.013896    Objective Loss 0.000000    Distill Loss 0.013896                                        LR 0.001000    Time 0.988683    
+2023-12-01 09:36:37,762 - Epoch: [3][ 9900/12168]    Overall Loss 0.013895    Objective Loss 0.000000    Distill Loss 0.013895                                        LR 0.001000    Time 0.989461    
+2023-12-01 09:38:20,146 - Epoch: [3][10000/12168]    Overall Loss 0.013894    Objective Loss 0.000000    Distill Loss 0.013894                                        LR 0.001000    Time 0.989804    
+2023-12-01 09:39:50,076 - Epoch: [3][10100/12168]    Overall Loss 0.013893    Objective Loss 0.000000    Distill Loss 0.013893                                        LR 0.001000    Time 0.988907    
+2023-12-01 09:41:41,610 - Epoch: [3][10200/12168]    Overall Loss 0.013891    Objective Loss 0.000000    Distill Loss 0.013891                                        LR 0.001000    Time 0.990146    
+2023-12-01 09:43:21,231 - Epoch: [3][10300/12168]    Overall Loss 0.013890    Objective Loss 0.000000    Distill Loss 0.013890                                        LR 0.001000    Time 0.990204    
+2023-12-01 09:45:01,843 - Epoch: [3][10400/12168]    Overall Loss 0.013889    Objective Loss 0.000000    Distill Loss 0.013889                                        LR 0.001000    Time 0.990357    
+2023-12-01 09:46:47,103 - Epoch: [3][10500/12168]    Overall Loss 0.013888    Objective Loss 0.000000    Distill Loss 0.013888                                        LR 0.001000    Time 0.990949    
+2023-12-01 09:48:37,402 - Epoch: [3][10600/12168]    Overall Loss 0.013886    Objective Loss 0.000000    Distill Loss 0.013886                                        LR 0.001000    Time 0.992005    
+2023-12-01 09:50:21,058 - Epoch: [3][10700/12168]    Overall Loss 0.013884    Objective Loss 0.000000    Distill Loss 0.013884                                        LR 0.001000    Time 0.992421    
+2023-12-01 09:51:53,554 - Epoch: [3][10800/12168]    Overall Loss 0.013883    Objective Loss 0.000000    Distill Loss 0.013883                                        LR 0.001000    Time 0.991795    
+2023-12-01 09:53:38,612 - Epoch: [3][10900/12168]    Overall Loss 0.013881    Objective Loss 0.000000    Distill Loss 0.013881                                        LR 0.001000    Time 0.992334    
+2023-12-01 09:55:25,131 - Epoch: [3][11000/12168]    Overall Loss 0.013879    Objective Loss 0.000000    Distill Loss 0.013879                                        LR 0.001000    Time 0.992996    
+2023-12-01 09:57:13,297 - Epoch: [3][11100/12168]    Overall Loss 0.013878    Objective Loss 0.000000    Distill Loss 0.013878                                        LR 0.001000    Time 0.993794    
+2023-12-01 09:59:02,149 - Epoch: [3][11200/12168]    Overall Loss 0.013878    Objective Loss 0.000000    Distill Loss 0.013878                                        LR 0.001000    Time 0.994639    
+2023-12-01 10:00:34,944 - Epoch: [3][11300/12168]    Overall Loss 0.013876    Objective Loss 0.000000    Distill Loss 0.013876                                        LR 0.001000    Time 0.994048    
+2023-12-01 10:02:05,328 - Epoch: [3][11400/12168]    Overall Loss 0.013874    Objective Loss 0.000000    Distill Loss 0.013874                                        LR 0.001000    Time 0.993256    
+2023-12-01 10:03:45,988 - Epoch: [3][11500/12168]    Overall Loss 0.013873    Objective Loss 0.000000    Distill Loss 0.013873                                        LR 0.001000    Time 0.993372    
+2023-12-01 10:05:39,241 - Epoch: [3][11600/12168]    Overall Loss 0.013871    Objective Loss 0.000000    Distill Loss 0.013871                                        LR 0.001000    Time 0.994571    
+2023-12-01 10:07:22,933 - Epoch: [3][11700/12168]    Overall Loss 0.013870    Objective Loss 0.000000    Distill Loss 0.013870                                        LR 0.001000    Time 0.994932    
+2023-12-01 10:09:10,496 - Epoch: [3][11800/12168]    Overall Loss 0.013869    Objective Loss 0.000000    Distill Loss 0.013869                                        LR 0.001000    Time 0.995615    
+2023-12-01 10:11:07,681 - Epoch: [3][11900/12168]    Overall Loss 0.013867    Objective Loss 0.000000    Distill Loss 0.013867                                        LR 0.001000    Time 0.997096    
+2023-12-01 10:12:54,257 - Epoch: [3][12000/12168]    Overall Loss 0.013865    Objective Loss 0.000000    Distill Loss 0.013865                                        LR 0.001000    Time 0.997667    
+2023-12-01 10:14:40,751 - Epoch: [3][12100/12168]    Overall Loss 0.013864    Objective Loss 0.000000    Distill Loss 0.013864                                        LR 0.001000    Time 0.998223    
+2023-12-01 10:15:35,565 - Epoch: [3][12168/12168]    Overall Loss 0.013863    Objective Loss 0.000000    Distill Loss 0.013863                                        LR 0.001000    Time 0.997149    
+2023-12-01 10:15:36,253 - --- validate (epoch=3)-----------
+2023-12-01 10:15:36,253 - 167951 samples (256 per mini-batch)
+2023-12-01 10:16:30,160 - Epoch: [3][  100/  657]    Loss 0.000000    Overall Loss 0.014320    
+2023-12-01 10:17:18,144 - Epoch: [3][  200/  657]    Loss 0.000000    Overall Loss 0.014329    
+2023-12-01 10:18:06,096 - Epoch: [3][  300/  657]    Loss 0.000000    Overall Loss 0.014344    
+2023-12-01 10:18:54,115 - Epoch: [3][  400/  657]    Loss 0.000000    Overall Loss 0.014347    
+2023-12-01 10:19:42,113 - Epoch: [3][  500/  657]    Loss 0.000000    Overall Loss 0.014348    
+2023-12-01 10:20:29,917 - Epoch: [3][  600/  657]    Loss 0.000000    Overall Loss 0.014351    
+2023-12-01 10:20:56,722 - Epoch: [3][  657/  657]    Loss 0.000000    Overall Loss 0.014349    
+2023-12-01 10:20:56,951 - ==> Overall Loss: 0.014
+
+2023-12-01 10:20:56,953 - ==> Best [Overall Loss: 0.014349 on epoch: 3]
+2023-12-01 10:20:56,953 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-01 10:20:56,981 - 
+
+2023-12-01 10:20:56,981 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-01 10:22:15,505 - Epoch: [4][  100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.001000    Time 0.785193    
+2023-12-01 10:23:24,372 - Epoch: [4][  200/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.001000    Time 0.736910    
+2023-12-01 10:24:31,971 - Epoch: [4][  300/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.001000    Time 0.716586    
+2023-12-01 10:25:47,983 - Epoch: [4][  400/12168]    Overall Loss 0.013630    Objective Loss 0.000000    Distill Loss 0.013630                                        LR 0.001000    Time 0.727455    
+2023-12-01 10:27:22,884 - Epoch: [4][  500/12168]    Overall Loss 0.013619    Objective Loss 0.000000    Distill Loss 0.013619                                        LR 0.001000    Time 0.771750    
+2023-12-01 10:28:57,294 - Epoch: [4][  600/12168]    Overall Loss 0.013616    Objective Loss 0.000000    Distill Loss 0.013616                                        LR 0.001000    Time 0.800464    
+2023-12-01 10:30:26,421 - Epoch: [4][  700/12168]    Overall Loss 0.013622    Objective Loss 0.000000    Distill Loss 0.013622                                        LR 0.001000    Time 0.813424    
+2023-12-01 10:32:17,925 - Epoch: [4][  800/12168]    Overall Loss 0.013630    Objective Loss 0.000000    Distill Loss 0.013630                                        LR 0.001000    Time 0.851116    
+2023-12-01 10:33:54,992 - Epoch: [4][  900/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.001000    Time 0.864392    
+2023-12-01 10:35:35,181 - Epoch: [4][ 1000/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.001000    Time 0.878134    
+2023-12-01 10:37:21,804 - Epoch: [4][ 1100/12168]    Overall Loss 0.013641    Objective Loss 0.000000    Distill Loss 0.013641                                        LR 0.001000    Time 0.895226    
+2023-12-01 10:38:57,444 - Epoch: [4][ 1200/12168]    Overall Loss 0.013638    Objective Loss 0.000000    Distill Loss 0.013638                                        LR 0.001000    Time 0.900318    
+2023-12-01 10:40:43,660 - Epoch: [4][ 1300/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.001000    Time 0.912761    
+2023-12-01 10:42:22,884 - Epoch: [4][ 1400/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.001000    Time 0.918433    
+2023-12-01 10:43:59,333 - Epoch: [4][ 1500/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.001000    Time 0.921499    
+2023-12-01 10:45:55,593 - Epoch: [4][ 1600/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.001000    Time 0.936563    
+2023-12-01 10:47:27,136 - Epoch: [4][ 1700/12168]    Overall Loss 0.013646    Objective Loss 0.000000    Distill Loss 0.013646                                        LR 0.001000    Time 0.935315    
+2023-12-01 10:49:02,111 - Epoch: [4][ 1800/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.001000    Time 0.936113    
+2023-12-01 10:50:39,669 - Epoch: [4][ 1900/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.001000    Time 0.938186    
+2023-12-01 10:52:31,475 - Epoch: [4][ 2000/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.001000    Time 0.947176    
+2023-12-01 10:54:03,404 - Epoch: [4][ 2100/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.001000    Time 0.945844    
+2023-12-01 10:55:48,947 - Epoch: [4][ 2200/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.001000    Time 0.950822    
+2023-12-01 10:57:26,186 - Epoch: [4][ 2300/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.001000    Time 0.951756    
+2023-12-01 10:58:48,774 - Epoch: [4][ 2400/12168]    Overall Loss 0.013630    Objective Loss 0.000000    Distill Loss 0.013630                                        LR 0.001000    Time 0.946508    
+2023-12-01 11:00:23,549 - Epoch: [4][ 2500/12168]    Overall Loss 0.013625    Objective Loss 0.000000    Distill Loss 0.013625                                        LR 0.001000    Time 0.946555    
+2023-12-01 11:02:01,085 - Epoch: [4][ 2600/12168]    Overall Loss 0.013621    Objective Loss 0.000000    Distill Loss 0.013621                                        LR 0.001000    Time 0.947661    
+2023-12-01 11:03:46,765 - Epoch: [4][ 2700/12168]    Overall Loss 0.013619    Objective Loss 0.000000    Distill Loss 0.013619                                        LR 0.001000    Time 0.951700    
+2023-12-01 11:05:25,222 - Epoch: [4][ 2800/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.001000    Time 0.952871    
+2023-12-01 11:06:53,653 - Epoch: [4][ 2900/12168]    Overall Loss 0.013620    Objective Loss 0.000000    Distill Loss 0.013620                                        LR 0.001000    Time 0.950505    
+2023-12-01 11:08:37,491 - Epoch: [4][ 3000/12168]    Overall Loss 0.013617    Objective Loss 0.000000    Distill Loss 0.013617                                        LR 0.001000    Time 0.953431    
+2023-12-01 11:10:15,876 - Epoch: [4][ 3100/12168]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                                        LR 0.001000    Time 0.954411    
+2023-12-01 11:11:35,128 - Epoch: [4][ 3200/12168]    Overall Loss 0.013612    Objective Loss 0.000000    Distill Loss 0.013612                                        LR 0.001000    Time 0.949349    
+2023-12-01 11:13:12,064 - Epoch: [4][ 3300/12168]    Overall Loss 0.013612    Objective Loss 0.000000    Distill Loss 0.013612                                        LR 0.001000    Time 0.949953    
+2023-12-01 11:14:53,022 - Epoch: [4][ 3400/12168]    Overall Loss 0.013612    Objective Loss 0.000000    Distill Loss 0.013612                                        LR 0.001000    Time 0.951705    
+2023-12-01 11:16:29,611 - Epoch: [4][ 3500/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.001000    Time 0.952108    
+2023-12-01 11:18:08,464 - Epoch: [4][ 3600/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.001000    Time 0.953117    
+2023-12-01 11:19:38,181 - Epoch: [4][ 3700/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.001000    Time 0.951603    
+2023-12-01 11:21:32,478 - Epoch: [4][ 3800/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.001000    Time 0.956638    
+2023-12-01 11:23:10,009 - Epoch: [4][ 3900/12168]    Overall Loss 0.013605    Objective Loss 0.000000    Distill Loss 0.013605                                        LR 0.001000    Time 0.957115    
+2023-12-01 11:24:55,863 - Epoch: [4][ 4000/12168]    Overall Loss 0.013602    Objective Loss 0.000000    Distill Loss 0.013602                                        LR 0.001000    Time 0.959648    
+2023-12-01 11:26:28,505 - Epoch: [4][ 4100/12168]    Overall Loss 0.013601    Objective Loss 0.000000    Distill Loss 0.013601                                        LR 0.001000    Time 0.958836    
+2023-12-01 11:28:14,584 - Epoch: [4][ 4200/12168]    Overall Loss 0.013599    Objective Loss 0.000000    Distill Loss 0.013599                                        LR 0.001000    Time 0.961262    
+2023-12-01 11:29:56,484 - Epoch: [4][ 4300/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.001000    Time 0.962603    
+2023-12-01 11:31:46,827 - Epoch: [4][ 4400/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.001000    Time 0.965802    
+2023-12-01 11:33:13,030 - Epoch: [4][ 4500/12168]    Overall Loss 0.013593    Objective Loss 0.000000    Distill Loss 0.013593                                        LR 0.001000    Time 0.963494    
+2023-12-01 11:34:49,366 - Epoch: [4][ 4600/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.001000    Time 0.963489    
+2023-12-01 11:36:42,564 - Epoch: [4][ 4700/12168]    Overall Loss 0.013590    Objective Loss 0.000000    Distill Loss 0.013590                                        LR 0.001000    Time 0.967073    
+2023-12-01 11:38:14,984 - Epoch: [4][ 4800/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.001000    Time 0.966178    
+2023-12-01 11:39:55,555 - Epoch: [4][ 4900/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.001000    Time 0.966983    
+2023-12-01 11:41:37,077 - Epoch: [4][ 5000/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.001000    Time 0.967947    
+2023-12-01 11:43:16,293 - Epoch: [4][ 5100/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.001000    Time 0.968420    
+2023-12-01 11:44:58,626 - Epoch: [4][ 5200/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.001000    Time 0.969475    
+2023-12-01 11:46:33,368 - Epoch: [4][ 5300/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.001000    Time 0.969057    
+2023-12-01 11:48:04,412 - Epoch: [4][ 5400/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.001000    Time 0.967970    
+2023-12-01 11:49:40,930 - Epoch: [4][ 5500/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.001000    Time 0.967918    
+2023-12-01 11:51:07,035 - Epoch: [4][ 5600/12168]    Overall Loss 0.013581    Objective Loss 0.000000    Distill Loss 0.013581                                        LR 0.001000    Time 0.966009    
+2023-12-01 11:52:48,970 - Epoch: [4][ 5700/12168]    Overall Loss 0.013580    Objective Loss 0.000000    Distill Loss 0.013580                                        LR 0.001000    Time 0.966943    
+2023-12-01 11:54:30,185 - Epoch: [4][ 5800/12168]    Overall Loss 0.013579    Objective Loss 0.000000    Distill Loss 0.013579                                        LR 0.001000    Time 0.967721    
+2023-12-01 11:56:08,620 - Epoch: [4][ 5900/12168]    Overall Loss 0.013579    Objective Loss 0.000000    Distill Loss 0.013579                                        LR 0.001000    Time 0.968002    
+2023-12-01 11:57:40,519 - Epoch: [4][ 6000/12168]    Overall Loss 0.013579    Objective Loss 0.000000    Distill Loss 0.013579                                        LR 0.001000    Time 0.967184    
+2023-12-01 11:59:29,502 - Epoch: [4][ 6100/12168]    Overall Loss 0.013577    Objective Loss 0.000000    Distill Loss 0.013577                                        LR 0.001000    Time 0.969193    
+2023-12-01 12:01:00,948 - Epoch: [4][ 6200/12168]    Overall Loss 0.013577    Objective Loss 0.000000    Distill Loss 0.013577                                        LR 0.001000    Time 0.968309    
+2023-12-01 12:02:37,428 - Epoch: [4][ 6300/12168]    Overall Loss 0.013577    Objective Loss 0.000000    Distill Loss 0.013577                                        LR 0.001000    Time 0.968252    
+2023-12-01 12:04:23,995 - Epoch: [4][ 6400/12168]    Overall Loss 0.013577    Objective Loss 0.000000    Distill Loss 0.013577                                        LR 0.001000    Time 0.969773    
+2023-12-01 12:05:56,830 - Epoch: [4][ 6500/12168]    Overall Loss 0.013575    Objective Loss 0.000000    Distill Loss 0.013575                                        LR 0.001000    Time 0.969135    
+2023-12-01 12:07:40,301 - Epoch: [4][ 6600/12168]    Overall Loss 0.013573    Objective Loss 0.000000    Distill Loss 0.013573                                        LR 0.001000    Time 0.970127    
+2023-12-01 12:09:21,890 - Epoch: [4][ 6700/12168]    Overall Loss 0.013572    Objective Loss 0.000000    Distill Loss 0.013572                                        LR 0.001000    Time 0.970809    
+2023-12-01 12:11:09,021 - Epoch: [4][ 6800/12168]    Overall Loss 0.013572    Objective Loss 0.000000    Distill Loss 0.013572                                        LR 0.001000    Time 0.972286    
+2023-12-01 12:12:32,188 - Epoch: [4][ 6900/12168]    Overall Loss 0.013570    Objective Loss 0.000000    Distill Loss 0.013570                                        LR 0.001000    Time 0.970247    
+2023-12-01 12:14:19,327 - Epoch: [4][ 7000/12168]    Overall Loss 0.013568    Objective Loss 0.000000    Distill Loss 0.013568                                        LR 0.001000    Time 0.971691    
+2023-12-01 12:16:20,573 - Epoch: [4][ 7100/12168]    Overall Loss 0.013566    Objective Loss 0.000000    Distill Loss 0.013566                                        LR 0.001000    Time 0.975081    
+2023-12-01 12:17:57,973 - Epoch: [4][ 7200/12168]    Overall Loss 0.013566    Objective Loss 0.000000    Distill Loss 0.013566                                        LR 0.001000    Time 0.975065    
+2023-12-01 12:19:41,746 - Epoch: [4][ 7300/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.001000    Time 0.975923    
+2023-12-01 12:21:31,362 - Epoch: [4][ 7400/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.001000    Time 0.977546    
+2023-12-01 12:23:09,017 - Epoch: [4][ 7500/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.001000    Time 0.977532    
+2023-12-01 12:24:56,847 - Epoch: [4][ 7600/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.001000    Time 0.978857    
+2023-12-01 12:26:33,146 - Epoch: [4][ 7700/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.001000    Time 0.978650    
+2023-12-01 12:28:08,374 - Epoch: [4][ 7800/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.001000    Time 0.978311    
+2023-12-01 12:29:46,375 - Epoch: [4][ 7900/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.001000    Time 0.978332    
+2023-12-01 12:31:41,103 - Epoch: [4][ 8000/12168]    Overall Loss 0.013558    Objective Loss 0.000000    Distill Loss 0.013558                                        LR 0.001000    Time 0.980443    
+2023-12-01 12:33:22,424 - Epoch: [4][ 8100/12168]    Overall Loss 0.013556    Objective Loss 0.000000    Distill Loss 0.013556                                        LR 0.001000    Time 0.980846    
+2023-12-01 12:35:01,895 - Epoch: [4][ 8200/12168]    Overall Loss 0.013555    Objective Loss 0.000000    Distill Loss 0.013555                                        LR 0.001000    Time 0.981014    
+2023-12-01 12:36:42,078 - Epoch: [4][ 8300/12168]    Overall Loss 0.013555    Objective Loss 0.000000    Distill Loss 0.013555                                        LR 0.001000    Time 0.981264    
+2023-12-01 12:38:12,645 - Epoch: [4][ 8400/12168]    Overall Loss 0.013554    Objective Loss 0.000000    Distill Loss 0.013554                                        LR 0.001000    Time 0.980363    
+2023-12-01 12:39:49,156 - Epoch: [4][ 8500/12168]    Overall Loss 0.013553    Objective Loss 0.000000    Distill Loss 0.013553                                        LR 0.001000    Time 0.980183    
+2023-12-01 12:41:38,902 - Epoch: [4][ 8600/12168]    Overall Loss 0.013552    Objective Loss 0.000000    Distill Loss 0.013552                                        LR 0.001000    Time 0.981546    
+2023-12-01 12:43:14,088 - Epoch: [4][ 8700/12168]    Overall Loss 0.013551    Objective Loss 0.000000    Distill Loss 0.013551                                        LR 0.001000    Time 0.981204    
+2023-12-01 12:44:57,654 - Epoch: [4][ 8800/12168]    Overall Loss 0.013550    Objective Loss 0.000000    Distill Loss 0.013550                                        LR 0.001000    Time 0.981822    
+2023-12-01 12:46:50,782 - Epoch: [4][ 8900/12168]    Overall Loss 0.013549    Objective Loss 0.000000    Distill Loss 0.013549                                        LR 0.001000    Time 0.983501    
+2023-12-01 12:48:26,187 - Epoch: [4][ 9000/12168]    Overall Loss 0.013547    Objective Loss 0.000000    Distill Loss 0.013547                                        LR 0.001000    Time 0.983172    
+2023-12-01 12:50:06,339 - Epoch: [4][ 9100/12168]    Overall Loss 0.013547    Objective Loss 0.000000    Distill Loss 0.013547                                        LR 0.001000    Time 0.983373    
+2023-12-01 12:51:57,155 - Epoch: [4][ 9200/12168]    Overall Loss 0.013546    Objective Loss 0.000000    Distill Loss 0.013546                                        LR 0.001000    Time 0.984729    
+2023-12-01 12:53:39,117 - Epoch: [4][ 9300/12168]    Overall Loss 0.013546    Objective Loss 0.000000    Distill Loss 0.013546                                        LR 0.001000    Time 0.985103    
+2023-12-01 12:55:19,537 - Epoch: [4][ 9400/12168]    Overall Loss 0.013544    Objective Loss 0.000000    Distill Loss 0.013544                                        LR 0.001000    Time 0.985306    
+2023-12-01 12:56:57,450 - Epoch: [4][ 9500/12168]    Overall Loss 0.013543    Objective Loss 0.000000    Distill Loss 0.013543                                        LR 0.001000    Time 0.985240    
+2023-12-01 12:58:39,028 - Epoch: [4][ 9600/12168]    Overall Loss 0.013542    Objective Loss 0.000000    Distill Loss 0.013542                                        LR 0.001000    Time 0.985557    
+2023-12-01 13:00:23,217 - Epoch: [4][ 9700/12168]    Overall Loss 0.013541    Objective Loss 0.000000    Distill Loss 0.013541                                        LR 0.001000    Time 0.986137    
+2023-12-01 13:01:58,120 - Epoch: [4][ 9800/12168]    Overall Loss 0.013540    Objective Loss 0.000000    Distill Loss 0.013540                                        LR 0.001000    Time 0.985758    
+2023-12-01 13:03:48,848 - Epoch: [4][ 9900/12168]    Overall Loss 0.013539    Objective Loss 0.000000    Distill Loss 0.013539                                        LR 0.001000    Time 0.986985    
+2023-12-01 13:05:30,063 - Epoch: [4][10000/12168]    Overall Loss 0.013538    Objective Loss 0.000000    Distill Loss 0.013538                                        LR 0.001000    Time 0.987236    
+2023-12-01 13:06:59,707 - Epoch: [4][10100/12168]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                                        LR 0.001000    Time 0.986336    
+2023-12-01 13:08:42,085 - Epoch: [4][10200/12168]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                                        LR 0.001000    Time 0.986702    
+2023-12-01 13:10:28,345 - Epoch: [4][10300/12168]    Overall Loss 0.013536    Objective Loss 0.000000    Distill Loss 0.013536                                        LR 0.001000    Time 0.987438    
+2023-12-01 13:12:12,367 - Epoch: [4][10400/12168]    Overall Loss 0.013534    Objective Loss 0.000000    Distill Loss 0.013534                                        LR 0.001000    Time 0.987945    
+2023-12-01 13:13:45,719 - Epoch: [4][10500/12168]    Overall Loss 0.013534    Objective Loss 0.000000    Distill Loss 0.013534                                        LR 0.001000    Time 0.987426    
+2023-12-01 13:15:27,841 - Epoch: [4][10600/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.001000    Time 0.987744    
+2023-12-01 13:17:11,834 - Epoch: [4][10700/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.001000    Time 0.988231    
+2023-12-01 13:18:57,944 - Epoch: [4][10800/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.001000    Time 0.988906    
+2023-12-01 13:20:42,950 - Epoch: [4][10900/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.001000    Time 0.989466    
+2023-12-01 13:22:17,786 - Epoch: [4][11000/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.001000    Time 0.989091    
+2023-12-01 13:23:53,778 - Epoch: [4][11100/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.001000    Time 0.988828    
+2023-12-01 13:25:38,607 - Epoch: [4][11200/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.001000    Time 0.989358    
+2023-12-01 13:27:14,351 - Epoch: [4][11300/12168]    Overall Loss 0.013526    Objective Loss 0.000000    Distill Loss 0.013526                                        LR 0.001000    Time 0.989075    
+2023-12-01 13:28:49,516 - Epoch: [4][11400/12168]    Overall Loss 0.013526    Objective Loss 0.000000    Distill Loss 0.013526                                        LR 0.001000    Time 0.988746    
+2023-12-01 13:30:37,662 - Epoch: [4][11500/12168]    Overall Loss 0.013525    Objective Loss 0.000000    Distill Loss 0.013525                                        LR 0.001000    Time 0.989552    
+2023-12-01 13:32:36,997 - Epoch: [4][11600/12168]    Overall Loss 0.013523    Objective Loss 0.000000    Distill Loss 0.013523                                        LR 0.001000    Time 0.991308    
+2023-12-01 13:34:26,814 - Epoch: [4][11700/12168]    Overall Loss 0.013523    Objective Loss 0.000000    Distill Loss 0.013523                                        LR 0.001000    Time 0.992221    
+2023-12-01 13:35:55,652 - Epoch: [4][11800/12168]    Overall Loss 0.013522    Objective Loss 0.000000    Distill Loss 0.013522                                        LR 0.001000    Time 0.991340    
+2023-12-01 13:37:45,070 - Epoch: [4][11900/12168]    Overall Loss 0.013521    Objective Loss 0.000000    Distill Loss 0.013521                                        LR 0.001000    Time 0.992204    
+2023-12-01 13:39:29,789 - Epoch: [4][12000/12168]    Overall Loss 0.013520    Objective Loss 0.000000    Distill Loss 0.013520                                        LR 0.001000    Time 0.992662    
+2023-12-01 13:41:13,743 - Epoch: [4][12100/12168]    Overall Loss 0.013519    Objective Loss 0.000000    Distill Loss 0.013519                                        LR 0.001000    Time 0.993048    
+2023-12-01 13:42:20,890 - Epoch: [4][12168/12168]    Overall Loss 0.013518    Objective Loss 0.000000    Distill Loss 0.013518                                        LR 0.001000    Time 0.993017    
+2023-12-01 13:42:21,664 - --- validate (epoch=4)-----------
+2023-12-01 13:42:21,665 - 167951 samples (256 per mini-batch)
+2023-12-01 13:43:15,406 - Epoch: [4][  100/  657]    Loss 0.000000    Overall Loss 0.014035    
+2023-12-01 13:44:03,356 - Epoch: [4][  200/  657]    Loss 0.000000    Overall Loss 0.014032    
+2023-12-01 13:44:51,364 - Epoch: [4][  300/  657]    Loss 0.000000    Overall Loss 0.014043    
+2023-12-01 13:45:39,406 - Epoch: [4][  400/  657]    Loss 0.000000    Overall Loss 0.014031    
+2023-12-01 13:46:27,449 - Epoch: [4][  500/  657]    Loss 0.000000    Overall Loss 0.014029    
+2023-12-01 13:47:15,465 - Epoch: [4][  600/  657]    Loss 0.000000    Overall Loss 0.014031    
+2023-12-01 13:47:42,424 - Epoch: [4][  657/  657]    Loss 0.000000    Overall Loss 0.014029    
+2023-12-01 13:47:42,808 - ==> Overall Loss: 0.014
+
+2023-12-01 13:47:42,811 - ==> Best [Overall Loss: 0.014029 on epoch: 4]
+2023-12-01 13:47:42,811 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-01 13:47:42,839 - 
+
+2023-12-01 13:47:42,839 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-01 13:49:52,175 - Epoch: [5][  100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.001000    Time 1.293285    
+2023-12-01 13:51:23,200 - Epoch: [5][  200/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.001000    Time 1.101728    
+2023-12-01 13:52:57,194 - Epoch: [5][  300/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.001000    Time 1.047777    
+2023-12-01 13:54:31,518 - Epoch: [5][  400/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.001000    Time 1.021624    
+2023-12-01 13:56:13,729 - Epoch: [5][  500/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.001000    Time 1.021706    
+2023-12-01 13:57:51,677 - Epoch: [5][  600/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.001000    Time 1.014656    
+2023-12-01 13:59:28,951 - Epoch: [5][  700/12168]    Overall Loss 0.013348    Objective Loss 0.000000    Distill Loss 0.013348                                        LR 0.001000    Time 1.008657    
+2023-12-01 14:00:57,542 - Epoch: [5][  800/12168]    Overall Loss 0.013350    Objective Loss 0.000000    Distill Loss 0.013350                                        LR 0.001000    Time 0.993304    
+2023-12-01 14:02:34,869 - Epoch: [5][  900/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.001000    Time 0.991071    
+2023-12-01 14:04:10,135 - Epoch: [5][ 1000/12168]    Overall Loss 0.013366    Objective Loss 0.000000    Distill Loss 0.013366                                        LR 0.001000    Time 0.987223    
+2023-12-01 14:05:39,345 - Epoch: [5][ 1100/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.001000    Time 0.978569    
+2023-12-01 14:06:55,417 - Epoch: [5][ 1200/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.001000    Time 0.960409    
+2023-12-01 14:08:25,293 - Epoch: [5][ 1300/12168]    Overall Loss 0.013353    Objective Loss 0.000000    Distill Loss 0.013353                                        LR 0.001000    Time 0.955661    
+2023-12-01 14:09:50,961 - Epoch: [5][ 1400/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.001000    Time 0.948586    
+2023-12-01 14:11:24,485 - Epoch: [5][ 1500/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.001000    Time 0.947691    
+2023-12-01 14:13:04,622 - Epoch: [5][ 1600/12168]    Overall Loss 0.013353    Objective Loss 0.000000    Distill Loss 0.013353                                        LR 0.001000    Time 0.951041    
+2023-12-01 14:14:52,382 - Epoch: [5][ 1700/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.001000    Time 0.958481    
+2023-12-01 14:16:28,490 - Epoch: [5][ 1800/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.001000    Time 0.958622    
+2023-12-01 14:18:11,065 - Epoch: [5][ 1900/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.001000    Time 0.962151    
+2023-12-01 14:19:44,436 - Epoch: [5][ 2000/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.001000    Time 0.960725    
+2023-12-01 14:21:18,918 - Epoch: [5][ 2100/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.001000    Time 0.959964    
+2023-12-01 14:22:50,847 - Epoch: [5][ 2200/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.001000    Time 0.958112    
+2023-12-01 14:24:10,293 - Epoch: [5][ 2300/12168]    Overall Loss 0.013349    Objective Loss 0.000000    Distill Loss 0.013349                                        LR 0.001000    Time 0.950994    
+2023-12-01 14:25:15,063 - Epoch: [5][ 2400/12168]    Overall Loss 0.013346    Objective Loss 0.000000    Distill Loss 0.013346                                        LR 0.001000    Time 0.938354    
+2023-12-01 14:26:25,268 - Epoch: [5][ 2500/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.001000    Time 0.928900    
+2023-12-01 14:27:34,989 - Epoch: [5][ 2600/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.001000    Time 0.919987    
+2023-12-01 14:28:41,732 - Epoch: [5][ 2700/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.001000    Time 0.910632    
+2023-12-01 14:30:08,592 - Epoch: [5][ 2800/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.001000    Time 0.909128    
+2023-12-01 14:31:35,921 - Epoch: [5][ 2900/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.001000    Time 0.907890    
+2023-12-01 14:33:25,425 - Epoch: [5][ 3000/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.001000    Time 0.914126    
+2023-12-01 14:35:03,013 - Epoch: [5][ 3100/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.001000    Time 0.916116    
+2023-12-01 14:36:37,286 - Epoch: [5][ 3200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.001000    Time 0.916945    
+2023-12-01 14:38:08,842 - Epoch: [5][ 3300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.001000    Time 0.916901    
+2023-12-01 14:40:05,816 - Epoch: [5][ 3400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.001000    Time 0.924335    
+2023-12-01 14:42:08,999 - Epoch: [5][ 3500/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.001000    Time 0.933119    
+2023-12-01 14:43:36,958 - Epoch: [5][ 3600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.001000    Time 0.931630    
+2023-12-01 14:45:29,630 - Epoch: [5][ 3700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.001000    Time 0.936901    
+2023-12-01 14:47:15,062 - Epoch: [5][ 3800/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.001000    Time 0.939989    
+2023-12-01 14:48:57,439 - Epoch: [5][ 3900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.001000    Time 0.942135    
+2023-12-01 14:50:39,740 - Epoch: [5][ 4000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.001000    Time 0.944155    
+2023-12-01 14:52:25,288 - Epoch: [5][ 4100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.001000    Time 0.946869    
+2023-12-01 14:54:15,705 - Epoch: [5][ 4200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.001000    Time 0.950612    
+2023-12-01 14:56:01,501 - Epoch: [5][ 4300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.001000    Time 0.953107    
+2023-12-01 14:57:38,428 - Epoch: [5][ 4400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.001000    Time 0.953473    
+2023-12-01 14:59:22,666 - Epoch: [5][ 4500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.001000    Time 0.955447    
+2023-12-01 15:00:53,259 - Epoch: [5][ 4600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.001000    Time 0.954369    
+2023-12-01 15:02:53,340 - Epoch: [5][ 4700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.001000    Time 0.959610    
+2023-12-01 15:04:22,623 - Epoch: [5][ 4800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.001000    Time 0.958218    
+2023-12-01 15:06:09,906 - Epoch: [5][ 4900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.001000    Time 0.960555    
+2023-12-01 15:07:59,910 - Epoch: [5][ 5000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.001000    Time 0.963343    
+2023-12-01 15:09:43,298 - Epoch: [5][ 5100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.001000    Time 0.964725    
+2023-12-01 15:11:45,177 - Epoch: [5][ 5200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.001000    Time 0.969609    
+2023-12-01 15:13:11,098 - Epoch: [5][ 5300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.001000    Time 0.967525    
+2023-12-01 15:14:51,673 - Epoch: [5][ 5400/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.001000    Time 0.968231    
+2023-12-01 15:16:33,223 - Epoch: [5][ 5500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.001000    Time 0.969089    
+2023-12-01 15:18:23,492 - Epoch: [5][ 5600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.001000    Time 0.971474    
+2023-12-01 15:20:14,013 - Epoch: [5][ 5700/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.001000    Time 0.973819    
+2023-12-01 15:21:53,182 - Epoch: [5][ 5800/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.001000    Time 0.974125    
+2023-12-01 15:23:27,254 - Epoch: [5][ 5900/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.001000    Time 0.973558    
+2023-12-01 15:24:59,625 - Epoch: [5][ 6000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.001000    Time 0.972726    
+2023-12-01 15:26:39,513 - Epoch: [5][ 6100/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.001000    Time 0.973153    
+2023-12-01 15:28:05,023 - Epoch: [5][ 6200/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.001000    Time 0.971248    
+2023-12-01 15:29:44,640 - Epoch: [5][ 6300/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.001000    Time 0.971643    
+2023-12-01 15:31:14,326 - Epoch: [5][ 6400/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.001000    Time 0.970473    
+2023-12-01 15:33:06,393 - Epoch: [5][ 6500/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.001000    Time 0.972782    
+2023-12-01 15:34:39,041 - Epoch: [5][ 6600/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.001000    Time 0.972080    
+2023-12-01 15:36:29,354 - Epoch: [5][ 6700/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.001000    Time 0.974035    
+2023-12-01 15:38:09,385 - Epoch: [5][ 6800/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.001000    Time 0.974420    
+2023-12-01 15:39:50,003 - Epoch: [5][ 6900/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.001000    Time 0.974879    
+2023-12-01 15:41:35,511 - Epoch: [5][ 7000/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.001000    Time 0.976024    
+2023-12-01 15:43:12,252 - Epoch: [5][ 7100/12168]    Overall Loss 0.013306    Objective Loss 0.000000    Distill Loss 0.013306                                        LR 0.001000    Time 0.975902    
+2023-12-01 15:44:44,756 - Epoch: [5][ 7200/12168]    Overall Loss 0.013306    Objective Loss 0.000000    Distill Loss 0.013306                                        LR 0.001000    Time 0.975194    
+2023-12-01 15:46:28,516 - Epoch: [5][ 7300/12168]    Overall Loss 0.013306    Objective Loss 0.000000    Distill Loss 0.013306                                        LR 0.001000    Time 0.976048    
+2023-12-01 15:48:11,679 - Epoch: [5][ 7400/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.001000    Time 0.976798    
+2023-12-01 15:49:36,443 - Epoch: [5][ 7500/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.001000    Time 0.975075    
+2023-12-01 15:51:23,117 - Epoch: [5][ 7600/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.001000    Time 0.976280    
+2023-12-01 15:52:59,612 - Epoch: [5][ 7700/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.001000    Time 0.976132    
+2023-12-01 15:54:38,512 - Epoch: [5][ 7800/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.001000    Time 0.976296    
+2023-12-01 15:56:15,161 - Epoch: [5][ 7900/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.001000    Time 0.976171    
+2023-12-01 15:57:45,023 - Epoch: [5][ 8000/12168]    Overall Loss 0.013302    Objective Loss 0.000000    Distill Loss 0.013302                                        LR 0.001000    Time 0.975201    
+2023-12-01 15:59:35,979 - Epoch: [5][ 8100/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.001000    Time 0.976859    
+2023-12-01 16:01:09,424 - Epoch: [5][ 8200/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.001000    Time 0.976341    
+2023-12-01 16:02:51,804 - Epoch: [5][ 8300/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.001000    Time 0.976912    
+2023-12-01 16:04:30,990 - Epoch: [5][ 8400/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.001000    Time 0.977089    
+2023-12-01 16:06:21,123 - Epoch: [5][ 8500/12168]    Overall Loss 0.013299    Objective Loss 0.000000    Distill Loss 0.013299                                        LR 0.001000    Time 0.978550    
+2023-12-01 16:08:03,031 - Epoch: [5][ 8600/12168]    Overall Loss 0.013298    Objective Loss 0.000000    Distill Loss 0.013298                                        LR 0.001000    Time 0.979020    
+2023-12-01 16:09:50,117 - Epoch: [5][ 8700/12168]    Overall Loss 0.013297    Objective Loss 0.000000    Distill Loss 0.013297                                        LR 0.001000    Time 0.980075    
+2023-12-01 16:11:32,339 - Epoch: [5][ 8800/12168]    Overall Loss 0.013297    Objective Loss 0.000000    Distill Loss 0.013297                                        LR 0.001000    Time 0.980553    
+2023-12-01 16:13:11,945 - Epoch: [5][ 8900/12168]    Overall Loss 0.013296    Objective Loss 0.000000    Distill Loss 0.013296                                        LR 0.001000    Time 0.980726    
+2023-12-01 16:15:07,572 - Epoch: [5][ 9000/12168]    Overall Loss 0.013295    Objective Loss 0.000000    Distill Loss 0.013295                                        LR 0.001000    Time 0.982676    
+2023-12-01 16:16:33,984 - Epoch: [5][ 9100/12168]    Overall Loss 0.013295    Objective Loss 0.000000    Distill Loss 0.013295                                        LR 0.001000    Time 0.981372    
+2023-12-01 16:18:19,399 - Epoch: [5][ 9200/12168]    Overall Loss 0.013294    Objective Loss 0.000000    Distill Loss 0.013294                                        LR 0.001000    Time 0.982163    
+2023-12-01 16:20:08,678 - Epoch: [5][ 9300/12168]    Overall Loss 0.013294    Objective Loss 0.000000    Distill Loss 0.013294                                        LR 0.001000    Time 0.983352    
+2023-12-01 16:21:52,054 - Epoch: [5][ 9400/12168]    Overall Loss 0.013294    Objective Loss 0.000000    Distill Loss 0.013294                                        LR 0.001000    Time 0.983887    
+2023-12-01 16:23:15,445 - Epoch: [5][ 9500/12168]    Overall Loss 0.013293    Objective Loss 0.000000    Distill Loss 0.013293                                        LR 0.001000    Time 0.982308    
+2023-12-01 16:25:01,586 - Epoch: [5][ 9600/12168]    Overall Loss 0.013292    Objective Loss 0.000000    Distill Loss 0.013292                                        LR 0.001000    Time 0.983131    
+2023-12-01 16:26:49,649 - Epoch: [5][ 9700/12168]    Overall Loss 0.013291    Objective Loss 0.000000    Distill Loss 0.013291                                        LR 0.001000    Time 0.984135    
+2023-12-01 16:28:31,810 - Epoch: [5][ 9800/12168]    Overall Loss 0.013290    Objective Loss 0.000000    Distill Loss 0.013290                                        LR 0.001000    Time 0.984517    
+2023-12-01 16:30:02,435 - Epoch: [5][ 9900/12168]    Overall Loss 0.013289    Objective Loss 0.000000    Distill Loss 0.013289                                        LR 0.001000    Time 0.983726    
+2023-12-01 16:31:49,220 - Epoch: [5][10000/12168]    Overall Loss 0.013289    Objective Loss 0.000000    Distill Loss 0.013289                                        LR 0.001000    Time 0.984566    
+2023-12-01 16:33:28,618 - Epoch: [5][10100/12168]    Overall Loss 0.013288    Objective Loss 0.000000    Distill Loss 0.013288                                        LR 0.001000    Time 0.984659    
+2023-12-01 16:35:12,460 - Epoch: [5][10200/12168]    Overall Loss 0.013287    Objective Loss 0.000000    Distill Loss 0.013287                                        LR 0.001000    Time 0.985185    
+2023-12-01 16:36:54,345 - Epoch: [5][10300/12168]    Overall Loss 0.013287    Objective Loss 0.000000    Distill Loss 0.013287                                        LR 0.001000    Time 0.985511    
+2023-12-01 16:38:25,672 - Epoch: [5][10400/12168]    Overall Loss 0.013286    Objective Loss 0.000000    Distill Loss 0.013286                                        LR 0.001000    Time 0.984816    
+2023-12-01 16:40:29,658 - Epoch: [5][10500/12168]    Overall Loss 0.013285    Objective Loss 0.000000    Distill Loss 0.013285                                        LR 0.001000    Time 0.987244    
+2023-12-01 16:42:01,155 - Epoch: [5][10600/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.001000    Time 0.986562    
+2023-12-01 16:43:28,469 - Epoch: [5][10700/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.001000    Time 0.985501    
+2023-12-01 16:45:15,639 - Epoch: [5][10800/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.001000    Time 0.986299    
+2023-12-01 16:46:51,397 - Epoch: [5][10900/12168]    Overall Loss 0.013283    Objective Loss 0.000000    Distill Loss 0.013283                                        LR 0.001000    Time 0.986034    
+2023-12-01 16:48:32,268 - Epoch: [5][11000/12168]    Overall Loss 0.013282    Objective Loss 0.000000    Distill Loss 0.013282                                        LR 0.001000    Time 0.986240    
+2023-12-01 16:50:21,791 - Epoch: [5][11100/12168]    Overall Loss 0.013282    Objective Loss 0.000000    Distill Loss 0.013282                                        LR 0.001000    Time 0.987221    
+2023-12-01 16:52:02,995 - Epoch: [5][11200/12168]    Overall Loss 0.013281    Objective Loss 0.000000    Distill Loss 0.013281                                        LR 0.001000    Time 0.987442    
+2023-12-01 16:53:48,306 - Epoch: [5][11300/12168]    Overall Loss 0.013280    Objective Loss 0.000000    Distill Loss 0.013280                                        LR 0.001000    Time 0.988023    
+2023-12-01 16:55:27,963 - Epoch: [5][11400/12168]    Overall Loss 0.013279    Objective Loss 0.000000    Distill Loss 0.013279                                        LR 0.001000    Time 0.988097    
+2023-12-01 16:57:17,586 - Epoch: [5][11500/12168]    Overall Loss 0.013278    Objective Loss 0.000000    Distill Loss 0.013278                                        LR 0.001000    Time 0.989037    
+2023-12-01 16:58:48,077 - Epoch: [5][11600/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.001000    Time 0.988311    
+2023-12-01 17:00:28,480 - Epoch: [5][11700/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.001000    Time 0.988444    
+2023-12-01 17:02:09,552 - Epoch: [5][11800/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.001000    Time 0.988633    
+2023-12-01 17:03:48,811 - Epoch: [5][11900/12168]    Overall Loss 0.013276    Objective Loss 0.000000    Distill Loss 0.013276                                        LR 0.001000    Time 0.988665    
+2023-12-01 17:05:36,693 - Epoch: [5][12000/12168]    Overall Loss 0.013275    Objective Loss 0.000000    Distill Loss 0.013275                                        LR 0.001000    Time 0.989416    
+2023-12-01 17:07:28,737 - Epoch: [5][12100/12168]    Overall Loss 0.013275    Objective Loss 0.000000    Distill Loss 0.013275                                        LR 0.001000    Time 0.990498    
+2023-12-01 17:08:37,426 - Epoch: [5][12168/12168]    Overall Loss 0.013274    Objective Loss 0.000000    Distill Loss 0.013274                                        LR 0.001000    Time 0.990608    
+2023-12-01 17:08:38,130 - --- validate (epoch=5)-----------
+2023-12-01 17:08:38,131 - 167951 samples (256 per mini-batch)
+2023-12-01 17:09:30,403 - Epoch: [5][  100/  657]    Loss 0.000000    Overall Loss 0.013854    
+2023-12-01 17:10:18,392 - Epoch: [5][  200/  657]    Loss 0.000000    Overall Loss 0.013839    
+2023-12-01 17:11:06,375 - Epoch: [5][  300/  657]    Loss 0.000000    Overall Loss 0.013829    
+2023-12-01 17:11:54,330 - Epoch: [5][  400/  657]    Loss 0.000000    Overall Loss 0.013834    
+2023-12-01 17:12:42,320 - Epoch: [5][  500/  657]    Loss 0.000000    Overall Loss 0.013841    
+2023-12-01 17:13:30,381 - Epoch: [5][  600/  657]    Loss 0.000000    Overall Loss 0.013836    
+2023-12-01 17:13:57,340 - Epoch: [5][  657/  657]    Loss 0.000000    Overall Loss 0.013839    
+2023-12-01 17:13:57,698 - ==> Overall Loss: 0.014
+
+2023-12-01 17:13:57,701 - ==> Best [Overall Loss: 0.013839 on epoch: 5]
+2023-12-01 17:13:57,701 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-01 17:13:57,732 - 
+
+2023-12-01 17:13:57,732 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-01 17:15:55,508 - Epoch: [6][  100/12168]    Overall Loss 0.013108    Objective Loss 0.000000    Distill Loss 0.013108                                        LR 0.001000    Time 1.177678    
+2023-12-01 17:17:43,651 - Epoch: [6][  200/12168]    Overall Loss 0.013136    Objective Loss 0.000000    Distill Loss 0.013136                                        LR 0.001000    Time 1.129516    
+2023-12-01 17:19:17,716 - Epoch: [6][  300/12168]    Overall Loss 0.013139    Objective Loss 0.000000    Distill Loss 0.013139                                        LR 0.001000    Time 1.066538    
+2023-12-01 17:20:58,311 - Epoch: [6][  400/12168]    Overall Loss 0.013137    Objective Loss 0.000000    Distill Loss 0.013137                                        LR 0.001000    Time 1.051371    
+2023-12-01 17:22:31,889 - Epoch: [6][  500/12168]    Overall Loss 0.013137    Objective Loss 0.000000    Distill Loss 0.013137                                        LR 0.001000    Time 1.028239    
+2023-12-01 17:24:10,285 - Epoch: [6][  600/12168]    Overall Loss 0.013141    Objective Loss 0.000000    Distill Loss 0.013141                                        LR 0.001000    Time 1.020847    
+2023-12-01 17:25:38,105 - Epoch: [6][  700/12168]    Overall Loss 0.013137    Objective Loss 0.000000    Distill Loss 0.013137                                        LR 0.001000    Time 1.000459    
+2023-12-01 17:27:09,918 - Epoch: [6][  800/12168]    Overall Loss 0.013140    Objective Loss 0.000000    Distill Loss 0.013140                                        LR 0.001000    Time 0.990159    
+2023-12-01 17:28:37,061 - Epoch: [6][  900/12168]    Overall Loss 0.013142    Objective Loss 0.000000    Distill Loss 0.013142                                        LR 0.001000    Time 0.976959    
+2023-12-01 17:30:23,502 - Epoch: [6][ 1000/12168]    Overall Loss 0.013148    Objective Loss 0.000000    Distill Loss 0.013148                                        LR 0.001000    Time 0.985696    
+2023-12-01 17:32:00,905 - Epoch: [6][ 1100/12168]    Overall Loss 0.013152    Objective Loss 0.000000    Distill Loss 0.013152                                        LR 0.001000    Time 0.984629    
+2023-12-01 17:33:33,133 - Epoch: [6][ 1200/12168]    Overall Loss 0.013146    Objective Loss 0.000000    Distill Loss 0.013146                                        LR 0.001000    Time 0.979428    
+2023-12-01 17:35:25,296 - Epoch: [6][ 1300/12168]    Overall Loss 0.013140    Objective Loss 0.000000    Distill Loss 0.013140                                        LR 0.001000    Time 0.990361    
+2023-12-01 17:37:07,685 - Epoch: [6][ 1400/12168]    Overall Loss 0.013145    Objective Loss 0.000000    Distill Loss 0.013145                                        LR 0.001000    Time 0.992751    
+2023-12-01 17:38:49,257 - Epoch: [6][ 1500/12168]    Overall Loss 0.013150    Objective Loss 0.000000    Distill Loss 0.013150                                        LR 0.001000    Time 0.994278    
+2023-12-01 17:40:52,952 - Epoch: [6][ 1600/12168]    Overall Loss 0.013148    Objective Loss 0.000000    Distill Loss 0.013148                                        LR 0.001000    Time 1.009441    
+2023-12-01 17:42:48,165 - Epoch: [6][ 1700/12168]    Overall Loss 0.013152    Objective Loss 0.000000    Distill Loss 0.013152                                        LR 0.001000    Time 1.017831    
+2023-12-01 17:44:39,190 - Epoch: [6][ 1800/12168]    Overall Loss 0.013154    Objective Loss 0.000000    Distill Loss 0.013154                                        LR 0.001000    Time 1.022961    
+2023-12-01 17:46:16,817 - Epoch: [6][ 1900/12168]    Overall Loss 0.013155    Objective Loss 0.000000    Distill Loss 0.013155                                        LR 0.001000    Time 1.020500    
+2023-12-01 17:47:56,954 - Epoch: [6][ 2000/12168]    Overall Loss 0.013155    Objective Loss 0.000000    Distill Loss 0.013155                                        LR 0.001000    Time 1.019541    
+2023-12-01 17:49:36,121 - Epoch: [6][ 2100/12168]    Overall Loss 0.013154    Objective Loss 0.000000    Distill Loss 0.013154                                        LR 0.001000    Time 1.018210    
+2023-12-01 17:51:19,030 - Epoch: [6][ 2200/12168]    Overall Loss 0.013152    Objective Loss 0.000000    Distill Loss 0.013152                                        LR 0.001000    Time 1.018702    
+2023-12-01 17:52:55,785 - Epoch: [6][ 2300/12168]    Overall Loss 0.013150    Objective Loss 0.000000    Distill Loss 0.013150                                        LR 0.001000    Time 1.016476    
+2023-12-01 17:54:48,627 - Epoch: [6][ 2400/12168]    Overall Loss 0.013149    Objective Loss 0.000000    Distill Loss 0.013149                                        LR 0.001000    Time 1.021137    
+2023-12-01 17:56:33,247 - Epoch: [6][ 2500/12168]    Overall Loss 0.013147    Objective Loss 0.000000    Distill Loss 0.013147                                        LR 0.001000    Time 1.022137    
+2023-12-01 17:58:09,290 - Epoch: [6][ 2600/12168]    Overall Loss 0.013144    Objective Loss 0.000000    Distill Loss 0.013144                                        LR 0.001000    Time 1.019761    
+2023-12-01 17:59:47,350 - Epoch: [6][ 2700/12168]    Overall Loss 0.013146    Objective Loss 0.000000    Distill Loss 0.013146                                        LR 0.001000    Time 1.018308    
+2023-12-01 18:01:30,626 - Epoch: [6][ 2800/12168]    Overall Loss 0.013145    Objective Loss 0.000000    Distill Loss 0.013145                                        LR 0.001000    Time 1.018822    
+2023-12-01 18:03:07,198 - Epoch: [6][ 2900/12168]    Overall Loss 0.013146    Objective Loss 0.000000    Distill Loss 0.013146                                        LR 0.001000    Time 1.016988    
+2023-12-01 18:04:49,641 - Epoch: [6][ 3000/12168]    Overall Loss 0.013145    Objective Loss 0.000000    Distill Loss 0.013145                                        LR 0.001000    Time 1.017234    
+2023-12-01 18:06:22,166 - Epoch: [6][ 3100/12168]    Overall Loss 0.013140    Objective Loss 0.000000    Distill Loss 0.013140                                        LR 0.001000    Time 1.014265    
+2023-12-01 18:07:57,433 - Epoch: [6][ 3200/12168]    Overall Loss 0.013138    Objective Loss 0.000000    Distill Loss 0.013138                                        LR 0.001000    Time 1.012338    
+2023-12-01 18:09:37,316 - Epoch: [6][ 3300/12168]    Overall Loss 0.013137    Objective Loss 0.000000    Distill Loss 0.013137                                        LR 0.001000    Time 1.011927    
+2023-12-01 18:11:23,527 - Epoch: [6][ 3400/12168]    Overall Loss 0.013136    Objective Loss 0.000000    Distill Loss 0.013136                                        LR 0.001000    Time 1.013400    
+2023-12-01 18:12:57,597 - Epoch: [6][ 3500/12168]    Overall Loss 0.013134    Objective Loss 0.000000    Distill Loss 0.013134                                        LR 0.001000    Time 1.011321    
+2023-12-01 18:14:30,986 - Epoch: [6][ 3600/12168]    Overall Loss 0.013133    Objective Loss 0.000000    Distill Loss 0.013133                                        LR 0.001000    Time 1.009168    
+2023-12-01 18:16:15,812 - Epoch: [6][ 3700/12168]    Overall Loss 0.013133    Objective Loss 0.000000    Distill Loss 0.013133                                        LR 0.001000    Time 1.010223    
+2023-12-01 18:18:09,685 - Epoch: [6][ 3800/12168]    Overall Loss 0.013134    Objective Loss 0.000000    Distill Loss 0.013134                                        LR 0.001000    Time 1.013603    
+2023-12-01 18:19:54,339 - Epoch: [6][ 3900/12168]    Overall Loss 0.013135    Objective Loss 0.000000    Distill Loss 0.013135                                        LR 0.001000    Time 1.014446    
+2023-12-01 18:21:39,556 - Epoch: [6][ 4000/12168]    Overall Loss 0.013132    Objective Loss 0.000000    Distill Loss 0.013132                                        LR 0.001000    Time 1.015388    
+2023-12-01 18:23:30,315 - Epoch: [6][ 4100/12168]    Overall Loss 0.013132    Objective Loss 0.000000    Distill Loss 0.013132                                        LR 0.001000    Time 1.017635    
+2023-12-01 18:25:20,979 - Epoch: [6][ 4200/12168]    Overall Loss 0.013132    Objective Loss 0.000000    Distill Loss 0.013132                                        LR 0.001000    Time 1.019752    
+2023-12-01 18:27:12,894 - Epoch: [6][ 4300/12168]    Overall Loss 0.013130    Objective Loss 0.000000    Distill Loss 0.013130                                        LR 0.001000    Time 1.022063    
+2023-12-01 18:28:39,439 - Epoch: [6][ 4400/12168]    Overall Loss 0.013129    Objective Loss 0.000000    Distill Loss 0.013129                                        LR 0.001000    Time 1.018502    
+2023-12-01 18:29:52,663 - Epoch: [6][ 4500/12168]    Overall Loss 0.013130    Objective Loss 0.000000    Distill Loss 0.013130                                        LR 0.001000    Time 1.012140    
+2023-12-01 18:31:09,263 - Epoch: [6][ 4600/12168]    Overall Loss 0.013128    Objective Loss 0.000000    Distill Loss 0.013128                                        LR 0.001000    Time 1.006788    
+2023-12-01 18:32:23,421 - Epoch: [6][ 4700/12168]    Overall Loss 0.013127    Objective Loss 0.000000    Distill Loss 0.013127                                        LR 0.001000    Time 1.001144    
+2023-12-01 18:33:39,293 - Epoch: [6][ 4800/12168]    Overall Loss 0.013126    Objective Loss 0.000000    Distill Loss 0.013126                                        LR 0.001000    Time 0.996091    
+2023-12-01 18:35:13,320 - Epoch: [6][ 4900/12168]    Overall Loss 0.013124    Objective Loss 0.000000    Distill Loss 0.013124                                        LR 0.001000    Time 0.994950    
+2023-12-01 18:37:02,980 - Epoch: [6][ 5000/12168]    Overall Loss 0.013124    Objective Loss 0.000000    Distill Loss 0.013124                                        LR 0.001000    Time 0.996982    
+2023-12-01 18:38:47,080 - Epoch: [6][ 5100/12168]    Overall Loss 0.013125    Objective Loss 0.000000    Distill Loss 0.013125                                        LR 0.001000    Time 0.997844    
+2023-12-01 18:40:36,517 - Epoch: [6][ 5200/12168]    Overall Loss 0.013125    Objective Loss 0.000000    Distill Loss 0.013125                                        LR 0.001000    Time 0.999699    
+2023-12-01 18:42:26,636 - Epoch: [6][ 5300/12168]    Overall Loss 0.013125    Objective Loss 0.000000    Distill Loss 0.013125                                        LR 0.001000    Time 1.001612    
+2023-12-01 18:44:11,231 - Epoch: [6][ 5400/12168]    Overall Loss 0.013125    Objective Loss 0.000000    Distill Loss 0.013125                                        LR 0.001000    Time 1.002432    
+2023-12-01 18:45:51,114 - Epoch: [6][ 5500/12168]    Overall Loss 0.013124    Objective Loss 0.000000    Distill Loss 0.013124                                        LR 0.001000    Time 1.002365    
+2023-12-01 18:47:39,850 - Epoch: [6][ 5600/12168]    Overall Loss 0.013123    Objective Loss 0.000000    Distill Loss 0.013123                                        LR 0.001000    Time 1.003882    
+2023-12-01 18:49:25,414 - Epoch: [6][ 5700/12168]    Overall Loss 0.013123    Objective Loss 0.000000    Distill Loss 0.013123                                        LR 0.001000    Time 1.004789    
+2023-12-01 18:51:19,985 - Epoch: [6][ 5800/12168]    Overall Loss 0.013121    Objective Loss 0.000000    Distill Loss 0.013121                                        LR 0.001000    Time 1.007217    
+2023-12-01 18:52:59,286 - Epoch: [6][ 5900/12168]    Overall Loss 0.013121    Objective Loss 0.000000    Distill Loss 0.013121                                        LR 0.001000    Time 1.006975    
+2023-12-01 18:54:40,002 - Epoch: [6][ 6000/12168]    Overall Loss 0.013121    Objective Loss 0.000000    Distill Loss 0.013121                                        LR 0.001000    Time 1.006977    
+2023-12-01 18:56:19,444 - Epoch: [6][ 6100/12168]    Overall Loss 0.013120    Objective Loss 0.000000    Distill Loss 0.013120                                        LR 0.001000    Time 1.006770    
+2023-12-01 18:57:49,972 - Epoch: [6][ 6200/12168]    Overall Loss 0.013119    Objective Loss 0.000000    Distill Loss 0.013119                                        LR 0.001000    Time 1.005132    
+2023-12-01 18:59:44,687 - Epoch: [6][ 6300/12168]    Overall Loss 0.013118    Objective Loss 0.000000    Distill Loss 0.013118                                        LR 0.001000    Time 1.007385    
+2023-12-01 19:01:33,767 - Epoch: [6][ 6400/12168]    Overall Loss 0.013118    Objective Loss 0.000000    Distill Loss 0.013118                                        LR 0.001000    Time 1.008687    
+2023-12-01 19:03:09,048 - Epoch: [6][ 6500/12168]    Overall Loss 0.013117    Objective Loss 0.000000    Distill Loss 0.013117                                        LR 0.001000    Time 1.007827    
+2023-12-01 19:04:55,263 - Epoch: [6][ 6600/12168]    Overall Loss 0.013116    Objective Loss 0.000000    Distill Loss 0.013116                                        LR 0.001000    Time 1.008649    
+2023-12-01 19:06:37,414 - Epoch: [6][ 6700/12168]    Overall Loss 0.013116    Objective Loss 0.000000    Distill Loss 0.013116                                        LR 0.001000    Time 1.008840    
+2023-12-01 19:08:22,934 - Epoch: [6][ 6800/12168]    Overall Loss 0.013115    Objective Loss 0.000000    Distill Loss 0.013115                                        LR 0.001000    Time 1.009520    
+2023-12-01 19:10:03,980 - Epoch: [6][ 6900/12168]    Overall Loss 0.013113    Objective Loss 0.000000    Distill Loss 0.013113                                        LR 0.001000    Time 1.009533    
+2023-12-01 19:11:50,934 - Epoch: [6][ 7000/12168]    Overall Loss 0.013113    Objective Loss 0.000000    Distill Loss 0.013113                                        LR 0.001000    Time 1.010389    
+2023-12-01 19:13:40,480 - Epoch: [6][ 7100/12168]    Overall Loss 0.013112    Objective Loss 0.000000    Distill Loss 0.013112                                        LR 0.001000    Time 1.011587    
+2023-12-01 19:15:12,727 - Epoch: [6][ 7200/12168]    Overall Loss 0.013112    Objective Loss 0.000000    Distill Loss 0.013112                                        LR 0.001000    Time 1.010348    
+2023-12-01 19:16:55,403 - Epoch: [6][ 7300/12168]    Overall Loss 0.013112    Objective Loss 0.000000    Distill Loss 0.013112                                        LR 0.001000    Time 1.010572    
+2023-12-01 19:18:33,379 - Epoch: [6][ 7400/12168]    Overall Loss 0.013112    Objective Loss 0.000000    Distill Loss 0.013112                                        LR 0.001000    Time 1.010155    
+2023-12-01 19:20:18,230 - Epoch: [6][ 7500/12168]    Overall Loss 0.013111    Objective Loss 0.000000    Distill Loss 0.013111                                        LR 0.001000    Time 1.010665    
+2023-12-01 19:22:15,436 - Epoch: [6][ 7600/12168]    Overall Loss 0.013111    Objective Loss 0.000000    Distill Loss 0.013111                                        LR 0.001000    Time 1.012788    
+2023-12-01 19:23:56,434 - Epoch: [6][ 7700/12168]    Overall Loss 0.013111    Objective Loss 0.000000    Distill Loss 0.013111                                        LR 0.001000    Time 1.012750    
+2023-12-01 19:25:46,066 - Epoch: [6][ 7800/12168]    Overall Loss 0.013111    Objective Loss 0.000000    Distill Loss 0.013111                                        LR 0.001000    Time 1.013821    
+2023-12-01 19:27:28,541 - Epoch: [6][ 7900/12168]    Overall Loss 0.013112    Objective Loss 0.000000    Distill Loss 0.013112                                        LR 0.001000    Time 1.013958    
+2023-12-01 19:29:16,180 - Epoch: [6][ 8000/12168]    Overall Loss 0.013110    Objective Loss 0.000000    Distill Loss 0.013110                                        LR 0.001000    Time 1.014738    
+2023-12-01 19:31:02,251 - Epoch: [6][ 8100/12168]    Overall Loss 0.013110    Objective Loss 0.000000    Distill Loss 0.013110                                        LR 0.001000    Time 1.015305    
+2023-12-01 19:32:44,945 - Epoch: [6][ 8200/12168]    Overall Loss 0.013110    Objective Loss 0.000000    Distill Loss 0.013110                                        LR 0.001000    Time 1.015446    
+2023-12-01 19:34:21,889 - Epoch: [6][ 8300/12168]    Overall Loss 0.013111    Objective Loss 0.000000    Distill Loss 0.013111                                        LR 0.001000    Time 1.014890    
+2023-12-01 19:36:16,833 - Epoch: [6][ 8400/12168]    Overall Loss 0.013110    Objective Loss 0.000000    Distill Loss 0.013110                                        LR 0.001000    Time 1.016491    
+2023-12-01 19:37:59,393 - Epoch: [6][ 8500/12168]    Overall Loss 0.013110    Objective Loss 0.000000    Distill Loss 0.013110                                        LR 0.001000    Time 1.016597    
+2023-12-01 19:39:46,464 - Epoch: [6][ 8600/12168]    Overall Loss 0.013109    Objective Loss 0.000000    Distill Loss 0.013109                                        LR 0.001000    Time 1.017226    
+2023-12-01 19:41:29,217 - Epoch: [6][ 8700/12168]    Overall Loss 0.013109    Objective Loss 0.000000    Distill Loss 0.013109                                        LR 0.001000    Time 1.017343    
+2023-12-01 19:43:22,597 - Epoch: [6][ 8800/12168]    Overall Loss 0.013108    Objective Loss 0.000000    Distill Loss 0.013108                                        LR 0.001000    Time 1.018666    
+2023-12-01 19:44:58,195 - Epoch: [6][ 8900/12168]    Overall Loss 0.013107    Objective Loss 0.000000    Distill Loss 0.013107                                        LR 0.001000    Time 1.017961    
+2023-12-01 19:46:31,122 - Epoch: [6][ 9000/12168]    Overall Loss 0.013107    Objective Loss 0.000000    Distill Loss 0.013107                                        LR 0.001000    Time 1.016975    
+2023-12-01 19:48:16,936 - Epoch: [6][ 9100/12168]    Overall Loss 0.013107    Objective Loss 0.000000    Distill Loss 0.013107                                        LR 0.001000    Time 1.017426    
+2023-12-01 19:50:11,322 - Epoch: [6][ 9200/12168]    Overall Loss 0.013106    Objective Loss 0.000000    Distill Loss 0.013106                                        LR 0.001000    Time 1.018800    
+2023-12-01 19:51:55,976 - Epoch: [6][ 9300/12168]    Overall Loss 0.013106    Objective Loss 0.000000    Distill Loss 0.013106                                        LR 0.001000    Time 1.019097    
+2023-12-01 19:53:32,532 - Epoch: [6][ 9400/12168]    Overall Loss 0.013106    Objective Loss 0.000000    Distill Loss 0.013106                                        LR 0.001000    Time 1.018527    
+2023-12-01 19:55:13,268 - Epoch: [6][ 9500/12168]    Overall Loss 0.013105    Objective Loss 0.000000    Distill Loss 0.013105                                        LR 0.001000    Time 1.018409    
+2023-12-01 19:56:57,731 - Epoch: [6][ 9600/12168]    Overall Loss 0.013104    Objective Loss 0.000000    Distill Loss 0.013104                                        LR 0.001000    Time 1.018681    
+2023-12-01 19:58:57,430 - Epoch: [6][ 9700/12168]    Overall Loss 0.013104    Objective Loss 0.000000    Distill Loss 0.013104                                        LR 0.001000    Time 1.020519    
+2023-12-01 20:00:32,168 - Epoch: [6][ 9800/12168]    Overall Loss 0.013103    Objective Loss 0.000000    Distill Loss 0.013103                                        LR 0.001000    Time 1.019772    
+2023-12-01 20:02:21,049 - Epoch: [6][ 9900/12168]    Overall Loss 0.013102    Objective Loss 0.000000    Distill Loss 0.013102                                        LR 0.001000    Time 1.020468    
+2023-12-01 20:04:12,122 - Epoch: [6][10000/12168]    Overall Loss 0.013102    Objective Loss 0.000000    Distill Loss 0.013102                                        LR 0.001000    Time 1.021370    
+2023-12-01 20:05:57,700 - Epoch: [6][10100/12168]    Overall Loss 0.013102    Objective Loss 0.000000    Distill Loss 0.013102                                        LR 0.001000    Time 1.021710    
+2023-12-01 20:07:56,883 - Epoch: [6][10200/12168]    Overall Loss 0.013101    Objective Loss 0.000000    Distill Loss 0.013101                                        LR 0.001000    Time 1.023378    
+2023-12-01 20:09:36,141 - Epoch: [6][10300/12168]    Overall Loss 0.013101    Objective Loss 0.000000    Distill Loss 0.013101                                        LR 0.001000    Time 1.023078    
+2023-12-01 20:11:18,392 - Epoch: [6][10400/12168]    Overall Loss 0.013101    Objective Loss 0.000000    Distill Loss 0.013101                                        LR 0.001000    Time 1.023072    
+2023-12-01 20:13:04,889 - Epoch: [6][10500/12168]    Overall Loss 0.013101    Objective Loss 0.000000    Distill Loss 0.013101                                        LR 0.001000    Time 1.023470    
+2023-12-01 20:14:51,700 - Epoch: [6][10600/12168]    Overall Loss 0.013100    Objective Loss 0.000000    Distill Loss 0.013100                                        LR 0.001000    Time 1.023891    
+2023-12-01 20:16:30,208 - Epoch: [6][10700/12168]    Overall Loss 0.013100    Objective Loss 0.000000    Distill Loss 0.013100                                        LR 0.001000    Time 1.023527    
+2023-12-01 20:18:05,665 - Epoch: [6][10800/12168]    Overall Loss 0.013100    Objective Loss 0.000000    Distill Loss 0.013100                                        LR 0.001000    Time 1.022888    
+2023-12-01 20:19:31,896 - Epoch: [6][10900/12168]    Overall Loss 0.013099    Objective Loss 0.000000    Distill Loss 0.013099                                        LR 0.001000    Time 1.021414    
+2023-12-01 20:21:10,125 - Epoch: [6][11000/12168]    Overall Loss 0.013099    Objective Loss 0.000000    Distill Loss 0.013099                                        LR 0.001000    Time 1.021058    
+2023-12-01 20:22:54,181 - Epoch: [6][11100/12168]    Overall Loss 0.013099    Objective Loss 0.000000    Distill Loss 0.013099                                        LR 0.001000    Time 1.021233    
+2023-12-01 20:24:34,912 - Epoch: [6][11200/12168]    Overall Loss 0.013098    Objective Loss 0.000000    Distill Loss 0.013098                                        LR 0.001000    Time 1.021108    
+2023-12-01 20:26:17,236 - Epoch: [6][11300/12168]    Overall Loss 0.013098    Objective Loss 0.000000    Distill Loss 0.013098                                        LR 0.001000    Time 1.021127    
+2023-12-01 20:28:05,450 - Epoch: [6][11400/12168]    Overall Loss 0.013098    Objective Loss 0.000000    Distill Loss 0.013098                                        LR 0.001000    Time 1.021661    
+2023-12-01 20:29:52,862 - Epoch: [6][11500/12168]    Overall Loss 0.013097    Objective Loss 0.000000    Distill Loss 0.013097                                        LR 0.001000    Time 1.022117    
+2023-12-01 20:31:31,863 - Epoch: [6][11600/12168]    Overall Loss 0.013097    Objective Loss 0.000000    Distill Loss 0.013097                                        LR 0.001000    Time 1.021839    
+2023-12-01 20:33:13,330 - Epoch: [6][11700/12168]    Overall Loss 0.013096    Objective Loss 0.000000    Distill Loss 0.013096                                        LR 0.001000    Time 1.021777    
+2023-12-01 20:34:54,400 - Epoch: [6][11800/12168]    Overall Loss 0.013096    Objective Loss 0.000000    Distill Loss 0.013096                                        LR 0.001000    Time 1.021683    
+2023-12-01 20:36:48,112 - Epoch: [6][11900/12168]    Overall Loss 0.013096    Objective Loss 0.000000    Distill Loss 0.013096                                        LR 0.001000    Time 1.022653    
+2023-12-01 20:38:29,277 - Epoch: [6][12000/12168]    Overall Loss 0.013094    Objective Loss 0.000000    Distill Loss 0.013094                                        LR 0.001000    Time 1.022560    
+2023-12-01 20:40:11,631 - Epoch: [6][12100/12168]    Overall Loss 0.013095    Objective Loss 0.000000    Distill Loss 0.013095                                        LR 0.001000    Time 1.022568    
+2023-12-01 20:41:27,771 - Epoch: [6][12168/12168]    Overall Loss 0.013094    Objective Loss 0.000000    Distill Loss 0.013094                                        LR 0.001000    Time 1.023110    
+2023-12-01 20:41:28,510 - --- validate (epoch=6)-----------
+2023-12-01 20:41:28,511 - 167951 samples (256 per mini-batch)
+2023-12-01 20:42:22,256 - Epoch: [6][  100/  657]    Loss 0.000000    Overall Loss 0.013737    
+2023-12-01 20:43:10,192 - Epoch: [6][  200/  657]    Loss 0.000000    Overall Loss 0.013743    
+2023-12-01 20:43:58,203 - Epoch: [6][  300/  657]    Loss 0.000000    Overall Loss 0.013728    
+2023-12-01 20:44:46,192 - Epoch: [6][  400/  657]    Loss 0.000000    Overall Loss 0.013726    
+2023-12-01 20:45:34,186 - Epoch: [6][  500/  657]    Loss 0.000000    Overall Loss 0.013734    
+2023-12-01 20:46:22,243 - Epoch: [6][  600/  657]    Loss 0.000000    Overall Loss 0.013730    
+2023-12-01 20:46:49,152 - Epoch: [6][  657/  657]    Loss 0.000000    Overall Loss 0.013733    
+2023-12-01 20:46:49,517 - ==> Overall Loss: 0.014
+
+2023-12-01 20:46:49,519 - ==> Best [Overall Loss: 0.013733 on epoch: 6]
+2023-12-01 20:46:49,519 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-01 20:46:49,559 - 
+
+2023-12-01 20:46:49,559 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-01 20:48:30,561 - Epoch: [7][  100/12168]    Overall Loss 0.013024    Objective Loss 0.000000    Distill Loss 0.013024                                        LR 0.001000    Time 1.009935    
+2023-12-01 20:50:14,680 - Epoch: [7][  200/12168]    Overall Loss 0.012985    Objective Loss 0.000000    Distill Loss 0.012985                                        LR 0.001000    Time 1.025525    
+2023-12-01 20:51:45,677 - Epoch: [7][  300/12168]    Overall Loss 0.013012    Objective Loss 0.000000    Distill Loss 0.013012                                        LR 0.001000    Time 0.986983    
+2023-12-01 20:53:24,524 - Epoch: [7][  400/12168]    Overall Loss 0.013001    Objective Loss 0.000000    Distill Loss 0.013001                                        LR 0.001000    Time 0.987338    
+2023-12-01 20:54:56,148 - Epoch: [7][  500/12168]    Overall Loss 0.012999    Objective Loss 0.000000    Distill Loss 0.012999                                        LR 0.001000    Time 0.973103    
+2023-12-01 20:56:35,774 - Epoch: [7][  600/12168]    Overall Loss 0.012991    Objective Loss 0.000000    Distill Loss 0.012991                                        LR 0.001000    Time 0.976951    
+2023-12-01 20:58:10,168 - Epoch: [7][  700/12168]    Overall Loss 0.012993    Objective Loss 0.000000    Distill Loss 0.012993                                        LR 0.001000    Time 0.972224    
+2023-12-01 20:59:50,836 - Epoch: [7][  800/12168]    Overall Loss 0.012996    Objective Loss 0.000000    Distill Loss 0.012996                                        LR 0.001000    Time 0.976522    
+2023-12-01 21:01:29,460 - Epoch: [7][  900/12168]    Overall Loss 0.013002    Objective Loss 0.000000    Distill Loss 0.013002                                        LR 0.001000    Time 0.977594    
+2023-12-01 21:03:32,031 - Epoch: [7][ 1000/12168]    Overall Loss 0.013007    Objective Loss 0.000000    Distill Loss 0.013007                                        LR 0.001000    Time 1.002399    
+2023-12-01 21:05:06,022 - Epoch: [7][ 1100/12168]    Overall Loss 0.013004    Objective Loss 0.000000    Distill Loss 0.013004                                        LR 0.001000    Time 0.996711    
+2023-12-01 21:06:56,110 - Epoch: [7][ 1200/12168]    Overall Loss 0.012999    Objective Loss 0.000000    Distill Loss 0.012999                                        LR 0.001000    Time 1.005386    
+2023-12-01 21:08:50,689 - Epoch: [7][ 1300/12168]    Overall Loss 0.012999    Objective Loss 0.000000    Distill Loss 0.012999                                        LR 0.001000    Time 1.016181    
+2023-12-01 21:10:34,303 - Epoch: [7][ 1400/12168]    Overall Loss 0.013001    Objective Loss 0.000000    Distill Loss 0.013001                                        LR 0.001000    Time 1.017601    
+2023-12-01 21:12:16,653 - Epoch: [7][ 1500/12168]    Overall Loss 0.013001    Objective Loss 0.000000    Distill Loss 0.013001                                        LR 0.001000    Time 1.017990    
+2023-12-01 21:13:53,695 - Epoch: [7][ 1600/12168]    Overall Loss 0.013003    Objective Loss 0.000000    Distill Loss 0.013003                                        LR 0.001000    Time 1.015012    
+2023-12-01 21:15:36,736 - Epoch: [7][ 1700/12168]    Overall Loss 0.013003    Objective Loss 0.000000    Distill Loss 0.013003                                        LR 0.001000    Time 1.015914    
+2023-12-01 21:17:19,330 - Epoch: [7][ 1800/12168]    Overall Loss 0.013001    Objective Loss 0.000000    Distill Loss 0.013001                                        LR 0.001000    Time 1.016467    
+2023-12-01 21:19:02,341 - Epoch: [7][ 1900/12168]    Overall Loss 0.013000    Objective Loss 0.000000    Distill Loss 0.013000                                        LR 0.001000    Time 1.017181    
+2023-12-01 21:20:54,923 - Epoch: [7][ 2000/12168]    Overall Loss 0.013000    Objective Loss 0.000000    Distill Loss 0.013000                                        LR 0.001000    Time 1.022610    
+2023-12-01 21:22:25,220 - Epoch: [7][ 2100/12168]    Overall Loss 0.013002    Objective Loss 0.000000    Distill Loss 0.013002                                        LR 0.001000    Time 1.016909    
+2023-12-01 21:24:00,905 - Epoch: [7][ 2200/12168]    Overall Loss 0.013003    Objective Loss 0.000000    Distill Loss 0.013003                                        LR 0.001000    Time 1.014176    
+2023-12-01 21:25:47,634 - Epoch: [7][ 2300/12168]    Overall Loss 0.013001    Objective Loss 0.000000    Distill Loss 0.013001                                        LR 0.001000    Time 1.016482    
+2023-12-01 21:27:29,090 - Epoch: [7][ 2400/12168]    Overall Loss 0.012997    Objective Loss 0.000000    Distill Loss 0.012997                                        LR 0.001000    Time 1.016399    
+2023-12-01 21:29:05,585 - Epoch: [7][ 2500/12168]    Overall Loss 0.012996    Objective Loss 0.000000    Distill Loss 0.012996                                        LR 0.001000    Time 1.014338    
+2023-12-01 21:30:41,571 - Epoch: [7][ 2600/12168]    Overall Loss 0.012991    Objective Loss 0.000000    Distill Loss 0.012991                                        LR 0.001000    Time 1.012240    
+2023-12-01 21:32:27,350 - Epoch: [7][ 2700/12168]    Overall Loss 0.012989    Objective Loss 0.000000    Distill Loss 0.012989                                        LR 0.001000    Time 1.013925    
+2023-12-01 21:34:02,148 - Epoch: [7][ 2800/12168]    Overall Loss 0.012991    Objective Loss 0.000000    Distill Loss 0.012991                                        LR 0.001000    Time 1.011567    
+2023-12-01 21:35:28,627 - Epoch: [7][ 2900/12168]    Overall Loss 0.012991    Objective Loss 0.000000    Distill Loss 0.012991                                        LR 0.001000    Time 1.006504    
+2023-12-01 21:37:16,838 - Epoch: [7][ 3000/12168]    Overall Loss 0.012989    Objective Loss 0.000000    Distill Loss 0.012989                                        LR 0.001000    Time 1.009021    
+2023-12-01 21:39:00,314 - Epoch: [7][ 3100/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.009849    
+2023-12-01 21:40:33,273 - Epoch: [7][ 3200/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.007339    
+2023-12-01 21:42:09,538 - Epoch: [7][ 3300/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.005983    
+2023-12-01 21:43:40,659 - Epoch: [7][ 3400/12168]    Overall Loss 0.012985    Objective Loss 0.000000    Distill Loss 0.012985                                        LR 0.001000    Time 1.003193    
+2023-12-01 21:45:15,864 - Epoch: [7][ 3500/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.001730    
+2023-12-01 21:47:00,999 - Epoch: [7][ 3600/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.003106    
+2023-12-01 21:48:41,285 - Epoch: [7][ 3700/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.003098    
+2023-12-01 21:50:26,415 - Epoch: [7][ 3800/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.004365    
+2023-12-01 21:52:09,294 - Epoch: [7][ 3900/12168]    Overall Loss 0.012984    Objective Loss 0.000000    Distill Loss 0.012984                                        LR 0.001000    Time 1.004989    
+2023-12-01 21:54:03,914 - Epoch: [7][ 4000/12168]    Overall Loss 0.012981    Objective Loss 0.000000    Distill Loss 0.012981                                        LR 0.001000    Time 1.008518    
+2023-12-01 21:55:46,433 - Epoch: [7][ 4100/12168]    Overall Loss 0.012982    Objective Loss 0.000000    Distill Loss 0.012982                                        LR 0.001000    Time 1.008923    
+2023-12-01 21:57:45,982 - Epoch: [7][ 4200/12168]    Overall Loss 0.012981    Objective Loss 0.000000    Distill Loss 0.012981                                        LR 0.001000    Time 1.013363    
+2023-12-01 21:59:23,892 - Epoch: [7][ 4300/12168]    Overall Loss 0.012978    Objective Loss 0.000000    Distill Loss 0.012978                                        LR 0.001000    Time 1.012565    
+2023-12-01 22:01:19,049 - Epoch: [7][ 4400/12168]    Overall Loss 0.012977    Objective Loss 0.000000    Distill Loss 0.012977                                        LR 0.001000    Time 1.015722    
+2023-12-01 22:03:06,149 - Epoch: [7][ 4500/12168]    Overall Loss 0.012979    Objective Loss 0.000000    Distill Loss 0.012979                                        LR 0.001000    Time 1.016949    
+2023-12-01 22:04:50,647 - Epoch: [7][ 4600/12168]    Overall Loss 0.012979    Objective Loss 0.000000    Distill Loss 0.012979                                        LR 0.001000    Time 1.017557    
+2023-12-01 22:06:28,850 - Epoch: [7][ 4700/12168]    Overall Loss 0.012978    Objective Loss 0.000000    Distill Loss 0.012978                                        LR 0.001000    Time 1.016799    
+2023-12-01 22:08:21,042 - Epoch: [7][ 4800/12168]    Overall Loss 0.012977    Objective Loss 0.000000    Distill Loss 0.012977                                        LR 0.001000    Time 1.018988    
+2023-12-01 22:10:12,592 - Epoch: [7][ 4900/12168]    Overall Loss 0.012975    Objective Loss 0.000000    Distill Loss 0.012975                                        LR 0.001000    Time 1.020956    
+2023-12-01 22:11:53,897 - Epoch: [7][ 5000/12168]    Overall Loss 0.012976    Objective Loss 0.000000    Distill Loss 0.012976                                        LR 0.001000    Time 1.020797    
+2023-12-01 22:13:38,476 - Epoch: [7][ 5100/12168]    Overall Loss 0.012976    Objective Loss 0.000000    Distill Loss 0.012976                                        LR 0.001000    Time 1.021285    
+2023-12-01 22:15:16,185 - Epoch: [7][ 5200/12168]    Overall Loss 0.012975    Objective Loss 0.000000    Distill Loss 0.012975                                        LR 0.001000    Time 1.020434    
+2023-12-01 22:16:39,471 - Epoch: [7][ 5300/12168]    Overall Loss 0.012975    Objective Loss 0.000000    Distill Loss 0.012975                                        LR 0.001000    Time 1.016894    
+2023-12-01 22:18:22,421 - Epoch: [7][ 5400/12168]    Overall Loss 0.012974    Objective Loss 0.000000    Distill Loss 0.012974                                        LR 0.001000    Time 1.017126    
+2023-12-01 22:20:10,683 - Epoch: [7][ 5500/12168]    Overall Loss 0.012974    Objective Loss 0.000000    Distill Loss 0.012974                                        LR 0.001000    Time 1.018316    
+2023-12-01 22:21:54,498 - Epoch: [7][ 5600/12168]    Overall Loss 0.012974    Objective Loss 0.000000    Distill Loss 0.012974                                        LR 0.001000    Time 1.018669    
+2023-12-01 22:23:25,725 - Epoch: [7][ 5700/12168]    Overall Loss 0.012973    Objective Loss 0.000000    Distill Loss 0.012973                                        LR 0.001000    Time 1.016801    
+2023-12-01 22:25:04,398 - Epoch: [7][ 5800/12168]    Overall Loss 0.012972    Objective Loss 0.000000    Distill Loss 0.012972                                        LR 0.001000    Time 1.016281    
+2023-12-01 22:26:45,909 - Epoch: [7][ 5900/12168]    Overall Loss 0.012973    Objective Loss 0.000000    Distill Loss 0.012973                                        LR 0.001000    Time 1.016260    
+2023-12-01 22:28:07,272 - Epoch: [7][ 6000/12168]    Overall Loss 0.012973    Objective Loss 0.000000    Distill Loss 0.012973                                        LR 0.001000    Time 1.012882    
+2023-12-01 22:29:16,919 - Epoch: [7][ 6100/12168]    Overall Loss 0.012973    Objective Loss 0.000000    Distill Loss 0.012973                                        LR 0.001000    Time 1.007694    
+2023-12-01 22:30:27,290 - Epoch: [7][ 6200/12168]    Overall Loss 0.012972    Objective Loss 0.000000    Distill Loss 0.012972                                        LR 0.001000    Time 1.002790    
+2023-12-01 22:31:35,966 - Epoch: [7][ 6300/12168]    Overall Loss 0.012971    Objective Loss 0.000000    Distill Loss 0.012971                                        LR 0.001000    Time 0.997773    
+2023-12-01 22:32:41,699 - Epoch: [7][ 6400/12168]    Overall Loss 0.012971    Objective Loss 0.000000    Distill Loss 0.012971                                        LR 0.001000    Time 0.992453    
+2023-12-01 22:33:57,090 - Epoch: [7][ 6500/12168]    Overall Loss 0.012971    Objective Loss 0.000000    Distill Loss 0.012971                                        LR 0.001000    Time 0.988782    
+2023-12-01 22:35:33,623 - Epoch: [7][ 6600/12168]    Overall Loss 0.012971    Objective Loss 0.000000    Distill Loss 0.012971                                        LR 0.001000    Time 0.988426    
+2023-12-01 22:37:31,043 - Epoch: [7][ 6700/12168]    Overall Loss 0.012970    Objective Loss 0.000000    Distill Loss 0.012970                                        LR 0.001000    Time 0.991197    
+2023-12-01 22:39:17,753 - Epoch: [7][ 6800/12168]    Overall Loss 0.012970    Objective Loss 0.000000    Distill Loss 0.012970                                        LR 0.001000    Time 0.992313    
+2023-12-01 22:41:09,191 - Epoch: [7][ 6900/12168]    Overall Loss 0.012968    Objective Loss 0.000000    Distill Loss 0.012968                                        LR 0.001000    Time 0.994081    
+2023-12-01 22:42:40,609 - Epoch: [7][ 7000/12168]    Overall Loss 0.012967    Objective Loss 0.000000    Distill Loss 0.012967                                        LR 0.001000    Time 0.992938    
+2023-12-01 22:44:34,635 - Epoch: [7][ 7100/12168]    Overall Loss 0.012967    Objective Loss 0.000000    Distill Loss 0.012967                                        LR 0.001000    Time 0.995012    
+2023-12-01 22:46:18,805 - Epoch: [7][ 7200/12168]    Overall Loss 0.012966    Objective Loss 0.000000    Distill Loss 0.012966                                        LR 0.001000    Time 0.995660    
+2023-12-01 22:48:14,292 - Epoch: [7][ 7300/12168]    Overall Loss 0.012965    Objective Loss 0.000000    Distill Loss 0.012965                                        LR 0.001000    Time 0.997840    
+2023-12-01 22:50:12,820 - Epoch: [7][ 7400/12168]    Overall Loss 0.012965    Objective Loss 0.000000    Distill Loss 0.012965                                        LR 0.001000    Time 1.000372    
+2023-12-01 22:51:50,522 - Epoch: [7][ 7500/12168]    Overall Loss 0.012965    Objective Loss 0.000000    Distill Loss 0.012965                                        LR 0.001000    Time 1.000059    
+2023-12-01 22:53:44,789 - Epoch: [7][ 7600/12168]    Overall Loss 0.012966    Objective Loss 0.000000    Distill Loss 0.012966                                        LR 0.001000    Time 1.001935    
+2023-12-01 22:55:37,946 - Epoch: [7][ 7700/12168]    Overall Loss 0.012965    Objective Loss 0.000000    Distill Loss 0.012965                                        LR 0.001000    Time 1.003617    
+2023-12-01 22:57:12,495 - Epoch: [7][ 7800/12168]    Overall Loss 0.012965    Objective Loss 0.000000    Distill Loss 0.012965                                        LR 0.001000    Time 1.002871    
+2023-12-01 22:59:20,461 - Epoch: [7][ 7900/12168]    Overall Loss 0.012966    Objective Loss 0.000000    Distill Loss 0.012966                                        LR 0.001000    Time 1.006374    
+2023-12-01 23:01:15,152 - Epoch: [7][ 8000/12168]    Overall Loss 0.012964    Objective Loss 0.000000    Distill Loss 0.012964                                        LR 0.001000    Time 1.008130    
+2023-12-01 23:03:02,630 - Epoch: [7][ 8100/12168]    Overall Loss 0.012963    Objective Loss 0.000000    Distill Loss 0.012963                                        LR 0.001000    Time 1.008952    
+2023-12-01 23:04:47,021 - Epoch: [7][ 8200/12168]    Overall Loss 0.012964    Objective Loss 0.000000    Distill Loss 0.012964                                        LR 0.001000    Time 1.009377    
+2023-12-01 23:06:44,942 - Epoch: [7][ 8300/12168]    Overall Loss 0.012964    Objective Loss 0.000000    Distill Loss 0.012964                                        LR 0.001000    Time 1.011423    
+2023-12-01 23:08:19,981 - Epoch: [7][ 8400/12168]    Overall Loss 0.012963    Objective Loss 0.000000    Distill Loss 0.012963                                        LR 0.001000    Time 1.010695    
+2023-12-01 23:10:02,938 - Epoch: [7][ 8500/12168]    Overall Loss 0.012963    Objective Loss 0.000000    Distill Loss 0.012963                                        LR 0.001000    Time 1.010916    
+2023-12-01 23:11:51,233 - Epoch: [7][ 8600/12168]    Overall Loss 0.012962    Objective Loss 0.000000    Distill Loss 0.012962                                        LR 0.001000    Time 1.011753    
+2023-12-01 23:13:43,701 - Epoch: [7][ 8700/12168]    Overall Loss 0.012962    Objective Loss 0.000000    Distill Loss 0.012962                                        LR 0.001000    Time 1.013050    
+2023-12-01 23:15:29,448 - Epoch: [7][ 8800/12168]    Overall Loss 0.012961    Objective Loss 0.000000    Distill Loss 0.012961                                        LR 0.001000    Time 1.013554    
+2023-12-01 23:17:14,798 - Epoch: [7][ 8900/12168]    Overall Loss 0.012961    Objective Loss 0.000000    Distill Loss 0.012961                                        LR 0.001000    Time 1.014003    
+2023-12-01 23:19:02,590 - Epoch: [7][ 9000/12168]    Overall Loss 0.012960    Objective Loss 0.000000    Distill Loss 0.012960                                        LR 0.001000    Time 1.014712    
+2023-12-01 23:20:56,762 - Epoch: [7][ 9100/12168]    Overall Loss 0.012961    Objective Loss 0.000000    Distill Loss 0.012961                                        LR 0.001000    Time 1.016107    
+2023-12-01 23:22:43,091 - Epoch: [7][ 9200/12168]    Overall Loss 0.012960    Objective Loss 0.000000    Distill Loss 0.012960                                        LR 0.001000    Time 1.016619    
+2023-12-01 23:24:28,941 - Epoch: [7][ 9300/12168]    Overall Loss 0.012960    Objective Loss 0.000000    Distill Loss 0.012960                                        LR 0.001000    Time 1.017068    
+2023-12-01 23:26:06,882 - Epoch: [7][ 9400/12168]    Overall Loss 0.012960    Objective Loss 0.000000    Distill Loss 0.012960                                        LR 0.001000    Time 1.016667    
+2023-12-01 23:28:05,437 - Epoch: [7][ 9500/12168]    Overall Loss 0.012960    Objective Loss 0.000000    Distill Loss 0.012960                                        LR 0.001000    Time 1.018444    
+2023-12-01 23:29:40,018 - Epoch: [7][ 9600/12168]    Overall Loss 0.012959    Objective Loss 0.000000    Distill Loss 0.012959                                        LR 0.001000    Time 1.017687    
+2023-12-01 23:31:20,264 - Epoch: [7][ 9700/12168]    Overall Loss 0.012959    Objective Loss 0.000000    Distill Loss 0.012959                                        LR 0.001000    Time 1.017529    
+2023-12-01 23:33:09,106 - Epoch: [7][ 9800/12168]    Overall Loss 0.012958    Objective Loss 0.000000    Distill Loss 0.012958                                        LR 0.001000    Time 1.018252    
+2023-12-01 23:35:02,387 - Epoch: [7][ 9900/12168]    Overall Loss 0.012958    Objective Loss 0.000000    Distill Loss 0.012958                                        LR 0.001000    Time 1.019408    
+2023-12-01 23:36:43,386 - Epoch: [7][10000/12168]    Overall Loss 0.012957    Objective Loss 0.000000    Distill Loss 0.012957                                        LR 0.001000    Time 1.019313    
+2023-12-01 23:38:40,466 - Epoch: [7][10100/12168]    Overall Loss 0.012957    Objective Loss 0.000000    Distill Loss 0.012957                                        LR 0.001000    Time 1.020812    
+2023-12-01 23:40:18,703 - Epoch: [7][10200/12168]    Overall Loss 0.012957    Objective Loss 0.000000    Distill Loss 0.012957                                        LR 0.001000    Time 1.020435    
+2023-12-01 23:42:01,305 - Epoch: [7][10300/12168]    Overall Loss 0.012957    Objective Loss 0.000000    Distill Loss 0.012957                                        LR 0.001000    Time 1.020488    
+2023-12-01 23:43:36,801 - Epoch: [7][10400/12168]    Overall Loss 0.012957    Objective Loss 0.000000    Distill Loss 0.012957                                        LR 0.001000    Time 1.019858    
+2023-12-01 23:45:13,408 - Epoch: [7][10500/12168]    Overall Loss 0.012957    Objective Loss 0.000000    Distill Loss 0.012957                                        LR 0.001000    Time 1.019344    
+2023-12-01 23:46:52,913 - Epoch: [7][10600/12168]    Overall Loss 0.012956    Objective Loss 0.000000    Distill Loss 0.012956                                        LR 0.001000    Time 1.019114    
+2023-12-01 23:48:43,079 - Epoch: [7][10700/12168]    Overall Loss 0.012955    Objective Loss 0.000000    Distill Loss 0.012955                                        LR 0.001000    Time 1.019885    
+2023-12-01 23:50:30,108 - Epoch: [7][10800/12168]    Overall Loss 0.012955    Objective Loss 0.000000    Distill Loss 0.012955                                        LR 0.001000    Time 1.020351    
+2023-12-01 23:52:15,693 - Epoch: [7][10900/12168]    Overall Loss 0.012955    Objective Loss 0.000000    Distill Loss 0.012955                                        LR 0.001000    Time 1.020676    
+2023-12-01 23:53:56,689 - Epoch: [7][11000/12168]    Overall Loss 0.012954    Objective Loss 0.000000    Distill Loss 0.012954                                        LR 0.001000    Time 1.020578    
+2023-12-01 23:55:43,025 - Epoch: [7][11100/12168]    Overall Loss 0.012954    Objective Loss 0.000000    Distill Loss 0.012954                                        LR 0.001000    Time 1.020963    
+2023-12-01 23:57:32,784 - Epoch: [7][11200/12168]    Overall Loss 0.012954    Objective Loss 0.000000    Distill Loss 0.012954                                        LR 0.001000    Time 1.021647    
+2023-12-01 23:59:26,810 - Epoch: [7][11300/12168]    Overall Loss 0.012953    Objective Loss 0.000000    Distill Loss 0.012953                                        LR 0.001000    Time 1.022696    
+2023-12-02 00:00:56,000 - Epoch: [7][11400/12168]    Overall Loss 0.012953    Objective Loss 0.000000    Distill Loss 0.012953                                        LR 0.001000    Time 1.021548    
+2023-12-02 00:02:37,058 - Epoch: [7][11500/12168]    Overall Loss 0.012953    Objective Loss 0.000000    Distill Loss 0.012953                                        LR 0.001000    Time 1.021452    
+2023-12-02 00:04:33,505 - Epoch: [7][11600/12168]    Overall Loss 0.012952    Objective Loss 0.000000    Distill Loss 0.012952                                        LR 0.001000    Time 1.022684    
+2023-12-02 00:06:06,827 - Epoch: [7][11700/12168]    Overall Loss 0.012952    Objective Loss 0.000000    Distill Loss 0.012952                                        LR 0.001000    Time 1.021919    
+2023-12-02 00:08:00,699 - Epoch: [7][11800/12168]    Overall Loss 0.012952    Objective Loss 0.000000    Distill Loss 0.012952                                        LR 0.001000    Time 1.022908    
+2023-12-02 00:09:58,252 - Epoch: [7][11900/12168]    Overall Loss 0.012952    Objective Loss 0.000000    Distill Loss 0.012952                                        LR 0.001000    Time 1.024190    
+2023-12-02 00:11:37,631 - Epoch: [7][12000/12168]    Overall Loss 0.012952    Objective Loss 0.000000    Distill Loss 0.012952                                        LR 0.001000    Time 1.023936    
+2023-12-02 00:13:27,065 - Epoch: [7][12100/12168]    Overall Loss 0.012952    Objective Loss 0.000000    Distill Loss 0.012952                                        LR 0.001000    Time 1.024517    
+2023-12-02 00:14:37,033 - Epoch: [7][12168/12168]    Overall Loss 0.012951    Objective Loss 0.000000    Distill Loss 0.012951                                        LR 0.001000    Time 1.024542    
+2023-12-02 00:14:37,711 - --- validate (epoch=7)-----------
+2023-12-02 00:14:37,711 - 167951 samples (256 per mini-batch)
+2023-12-02 00:15:31,535 - Epoch: [7][  100/  657]    Loss 0.000000    Overall Loss 0.013617    
+2023-12-02 00:16:19,459 - Epoch: [7][  200/  657]    Loss 0.000000    Overall Loss 0.013608    
+2023-12-02 00:17:07,438 - Epoch: [7][  300/  657]    Loss 0.000000    Overall Loss 0.013624    
+2023-12-02 00:17:55,402 - Epoch: [7][  400/  657]    Loss 0.000000    Overall Loss 0.013622    
+2023-12-02 00:18:43,385 - Epoch: [7][  500/  657]    Loss 0.000000    Overall Loss 0.013623    
+2023-12-02 00:19:31,450 - Epoch: [7][  600/  657]    Loss 0.000000    Overall Loss 0.013617    
+2023-12-02 00:19:58,375 - Epoch: [7][  657/  657]    Loss 0.000000    Overall Loss 0.013621    
+2023-12-02 00:19:58,725 - ==> Overall Loss: 0.014
+
+2023-12-02 00:19:58,727 - ==> Best [Overall Loss: 0.013621 on epoch: 7]
+2023-12-02 00:19:58,727 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 00:19:58,770 - 
+
+2023-12-02 00:19:58,770 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 00:21:57,261 - Epoch: [8][  100/12168]    Overall Loss 0.012821    Objective Loss 0.000000    Distill Loss 0.012821                                        LR 0.001000    Time 1.184840    
+2023-12-02 00:23:41,742 - Epoch: [8][  200/12168]    Overall Loss 0.012815    Objective Loss 0.000000    Distill Loss 0.012815                                        LR 0.001000    Time 1.114791    
+2023-12-02 00:25:18,630 - Epoch: [8][  300/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.066127    
+2023-12-02 00:26:55,620 - Epoch: [8][  400/12168]    Overall Loss 0.012841    Objective Loss 0.000000    Distill Loss 0.012841                                        LR 0.001000    Time 1.042050    
+2023-12-02 00:28:27,478 - Epoch: [8][  500/12168]    Overall Loss 0.012838    Objective Loss 0.000000    Distill Loss 0.012838                                        LR 0.001000    Time 1.017341    
+2023-12-02 00:30:04,036 - Epoch: [8][  600/12168]    Overall Loss 0.012835    Objective Loss 0.000000    Distill Loss 0.012835                                        LR 0.001000    Time 1.008703    
+2023-12-02 00:31:49,125 - Epoch: [8][  700/12168]    Overall Loss 0.012851    Objective Loss 0.000000    Distill Loss 0.012851                                        LR 0.001000    Time 1.014720    
+2023-12-02 00:33:23,931 - Epoch: [8][  800/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 1.006379    
+2023-12-02 00:35:06,417 - Epoch: [8][  900/12168]    Overall Loss 0.012865    Objective Loss 0.000000    Distill Loss 0.012865                                        LR 0.001000    Time 1.008424    
+2023-12-02 00:36:46,032 - Epoch: [8][ 1000/12168]    Overall Loss 0.012870    Objective Loss 0.000000    Distill Loss 0.012870                                        LR 0.001000    Time 1.007189    
+2023-12-02 00:38:19,828 - Epoch: [8][ 1100/12168]    Overall Loss 0.012865    Objective Loss 0.000000    Distill Loss 0.012865                                        LR 0.001000    Time 1.000888    
+2023-12-02 00:39:51,746 - Epoch: [8][ 1200/12168]    Overall Loss 0.012862    Objective Loss 0.000000    Distill Loss 0.012862                                        LR 0.001000    Time 0.994074    
+2023-12-02 00:41:37,588 - Epoch: [8][ 1300/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 0.999018    
+2023-12-02 00:43:31,539 - Epoch: [8][ 1400/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 1.009048    
+2023-12-02 00:45:00,497 - Epoch: [8][ 1500/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 1.001079    
+2023-12-02 00:46:31,259 - Epoch: [8][ 1600/12168]    Overall Loss 0.012864    Objective Loss 0.000000    Distill Loss 0.012864                                        LR 0.001000    Time 0.995232    
+2023-12-02 00:48:06,246 - Epoch: [8][ 1700/12168]    Overall Loss 0.012867    Objective Loss 0.000000    Distill Loss 0.012867                                        LR 0.001000    Time 0.992560    
+2023-12-02 00:49:56,600 - Epoch: [8][ 1800/12168]    Overall Loss 0.012869    Objective Loss 0.000000    Distill Loss 0.012869                                        LR 0.001000    Time 0.998722    
+2023-12-02 00:51:34,908 - Epoch: [8][ 1900/12168]    Overall Loss 0.012868    Objective Loss 0.000000    Distill Loss 0.012868                                        LR 0.001000    Time 0.997895    
+2023-12-02 00:53:13,629 - Epoch: [8][ 2000/12168]    Overall Loss 0.012870    Objective Loss 0.000000    Distill Loss 0.012870                                        LR 0.001000    Time 0.997357    
+2023-12-02 00:55:03,952 - Epoch: [8][ 2100/12168]    Overall Loss 0.012872    Objective Loss 0.000000    Distill Loss 0.012872                                        LR 0.001000    Time 1.002395    
+2023-12-02 00:56:36,999 - Epoch: [8][ 2200/12168]    Overall Loss 0.012872    Objective Loss 0.000000    Distill Loss 0.012872                                        LR 0.001000    Time 0.999122    
+2023-12-02 00:57:58,484 - Epoch: [8][ 2300/12168]    Overall Loss 0.012869    Objective Loss 0.000000    Distill Loss 0.012869                                        LR 0.001000    Time 0.991107    
+2023-12-02 00:59:35,775 - Epoch: [8][ 2400/12168]    Overall Loss 0.012868    Objective Loss 0.000000    Distill Loss 0.012868                                        LR 0.001000    Time 0.990346    
+2023-12-02 01:01:16,453 - Epoch: [8][ 2500/12168]    Overall Loss 0.012863    Objective Loss 0.000000    Distill Loss 0.012863                                        LR 0.001000    Time 0.991000    
+2023-12-02 01:02:47,121 - Epoch: [8][ 2600/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.987754    
+2023-12-02 01:04:21,542 - Epoch: [8][ 2700/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 0.986139    
+2023-12-02 01:05:44,890 - Epoch: [8][ 2800/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 0.980684    
+2023-12-02 01:07:24,914 - Epoch: [8][ 2900/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 0.981356    
+2023-12-02 01:09:06,332 - Epoch: [8][ 3000/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 0.982448    
+2023-12-02 01:10:48,921 - Epoch: [8][ 3100/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 0.983847    
+2023-12-02 01:12:26,154 - Epoch: [8][ 3200/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 0.983485    
+2023-12-02 01:14:03,185 - Epoch: [8][ 3300/12168]    Overall Loss 0.012859    Objective Loss 0.000000    Distill Loss 0.012859                                        LR 0.001000    Time 0.983084    
+2023-12-02 01:15:57,761 - Epoch: [8][ 3400/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.987867    
+2023-12-02 01:17:39,398 - Epoch: [8][ 3500/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 0.988680    
+2023-12-02 01:19:20,077 - Epoch: [8][ 3600/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.989181    
+2023-12-02 01:21:03,108 - Epoch: [8][ 3700/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.990291    
+2023-12-02 01:22:56,113 - Epoch: [8][ 3800/12168]    Overall Loss 0.012862    Objective Loss 0.000000    Distill Loss 0.012862                                        LR 0.001000    Time 0.993967    
+2023-12-02 01:24:42,478 - Epoch: [8][ 3900/12168]    Overall Loss 0.012861    Objective Loss 0.000000    Distill Loss 0.012861                                        LR 0.001000    Time 0.995752    
+2023-12-02 01:26:22,703 - Epoch: [8][ 4000/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.995913    
+2023-12-02 01:27:59,973 - Epoch: [8][ 4100/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.995345    
+2023-12-02 01:29:50,156 - Epoch: [8][ 4200/12168]    Overall Loss 0.012860    Objective Loss 0.000000    Distill Loss 0.012860                                        LR 0.001000    Time 0.997879    
+2023-12-02 01:31:24,934 - Epoch: [8][ 4300/12168]    Overall Loss 0.012858    Objective Loss 0.000000    Distill Loss 0.012858                                        LR 0.001000    Time 0.996712    
+2023-12-02 01:33:12,833 - Epoch: [8][ 4400/12168]    Overall Loss 0.012858    Objective Loss 0.000000    Distill Loss 0.012858                                        LR 0.001000    Time 0.998580    
+2023-12-02 01:35:16,280 - Epoch: [8][ 4500/12168]    Overall Loss 0.012859    Objective Loss 0.000000    Distill Loss 0.012859                                        LR 0.001000    Time 1.003821    
+2023-12-02 01:36:49,879 - Epoch: [8][ 4600/12168]    Overall Loss 0.012858    Objective Loss 0.000000    Distill Loss 0.012858                                        LR 0.001000    Time 1.002345    
+2023-12-02 01:38:39,186 - Epoch: [8][ 4700/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 1.004274    
+2023-12-02 01:40:25,331 - Epoch: [8][ 4800/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 1.005464    
+2023-12-02 01:42:07,135 - Epoch: [8][ 4900/12168]    Overall Loss 0.012855    Objective Loss 0.000000    Distill Loss 0.012855                                        LR 0.001000    Time 1.005719    
+2023-12-02 01:43:57,408 - Epoch: [8][ 5000/12168]    Overall Loss 0.012855    Objective Loss 0.000000    Distill Loss 0.012855                                        LR 0.001000    Time 1.007658    
+2023-12-02 01:45:31,775 - Epoch: [8][ 5100/12168]    Overall Loss 0.012856    Objective Loss 0.000000    Distill Loss 0.012856                                        LR 0.001000    Time 1.006402    
+2023-12-02 01:47:23,616 - Epoch: [8][ 5200/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 1.008554    
+2023-12-02 01:49:07,872 - Epoch: [8][ 5300/12168]    Overall Loss 0.012857    Objective Loss 0.000000    Distill Loss 0.012857                                        LR 0.001000    Time 1.009195    
+2023-12-02 01:50:41,845 - Epoch: [8][ 5400/12168]    Overall Loss 0.012856    Objective Loss 0.000000    Distill Loss 0.012856                                        LR 0.001000    Time 1.007907    
+2023-12-02 01:52:20,008 - Epoch: [8][ 5500/12168]    Overall Loss 0.012855    Objective Loss 0.000000    Distill Loss 0.012855                                        LR 0.001000    Time 1.007428    
+2023-12-02 01:54:03,868 - Epoch: [8][ 5600/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.007983    
+2023-12-02 01:55:50,897 - Epoch: [8][ 5700/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.009076    
+2023-12-02 01:57:24,737 - Epoch: [8][ 5800/12168]    Overall Loss 0.012853    Objective Loss 0.000000    Distill Loss 0.012853                                        LR 0.001000    Time 1.007856    
+2023-12-02 01:59:17,338 - Epoch: [8][ 5900/12168]    Overall Loss 0.012853    Objective Loss 0.000000    Distill Loss 0.012853                                        LR 0.001000    Time 1.009857    
+2023-12-02 02:01:09,633 - Epoch: [8][ 6000/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.011741    
+2023-12-02 02:02:51,282 - Epoch: [8][ 6100/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.011818    
+2023-12-02 02:04:36,125 - Epoch: [8][ 6200/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.012407    
+2023-12-02 02:06:19,926 - Epoch: [8][ 6300/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.012812    
+2023-12-02 02:07:54,072 - Epoch: [8][ 6400/12168]    Overall Loss 0.012854    Objective Loss 0.000000    Distill Loss 0.012854                                        LR 0.001000    Time 1.011696    
+2023-12-02 02:09:42,860 - Epoch: [8][ 6500/12168]    Overall Loss 0.012853    Objective Loss 0.000000    Distill Loss 0.012853                                        LR 0.001000    Time 1.012867    
+2023-12-02 02:11:13,191 - Epoch: [8][ 6600/12168]    Overall Loss 0.012852    Objective Loss 0.000000    Distill Loss 0.012852                                        LR 0.001000    Time 1.011206    
+2023-12-02 02:12:55,601 - Epoch: [8][ 6700/12168]    Overall Loss 0.012851    Objective Loss 0.000000    Distill Loss 0.012851                                        LR 0.001000    Time 1.011398    
+2023-12-02 02:14:26,422 - Epoch: [8][ 6800/12168]    Overall Loss 0.012850    Objective Loss 0.000000    Distill Loss 0.012850                                        LR 0.001000    Time 1.009880    
+2023-12-02 02:16:13,148 - Epoch: [8][ 6900/12168]    Overall Loss 0.012849    Objective Loss 0.000000    Distill Loss 0.012849                                        LR 0.001000    Time 1.010710    
+2023-12-02 02:18:00,739 - Epoch: [8][ 7000/12168]    Overall Loss 0.012848    Objective Loss 0.000000    Distill Loss 0.012848                                        LR 0.001000    Time 1.011641    
+2023-12-02 02:19:35,085 - Epoch: [8][ 7100/12168]    Overall Loss 0.012848    Objective Loss 0.000000    Distill Loss 0.012848                                        LR 0.001000    Time 1.010679    
+2023-12-02 02:21:18,305 - Epoch: [8][ 7200/12168]    Overall Loss 0.012848    Objective Loss 0.000000    Distill Loss 0.012848                                        LR 0.001000    Time 1.010977    
+2023-12-02 02:22:48,663 - Epoch: [8][ 7300/12168]    Overall Loss 0.012847    Objective Loss 0.000000    Distill Loss 0.012847                                        LR 0.001000    Time 1.009505    
+2023-12-02 02:24:31,376 - Epoch: [8][ 7400/12168]    Overall Loss 0.012846    Objective Loss 0.000000    Distill Loss 0.012846                                        LR 0.001000    Time 1.009743    
+2023-12-02 02:26:13,322 - Epoch: [8][ 7500/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 1.009871    
+2023-12-02 02:27:51,169 - Epoch: [8][ 7600/12168]    Overall Loss 0.012846    Objective Loss 0.000000    Distill Loss 0.012846                                        LR 0.001000    Time 1.009457    
+2023-12-02 02:29:00,113 - Epoch: [8][ 7700/12168]    Overall Loss 0.012846    Objective Loss 0.000000    Distill Loss 0.012846                                        LR 0.001000    Time 1.005300    
+2023-12-02 02:30:11,115 - Epoch: [8][ 7800/12168]    Overall Loss 0.012846    Objective Loss 0.000000    Distill Loss 0.012846                                        LR 0.001000    Time 1.001514    
+2023-12-02 02:31:20,983 - Epoch: [8][ 7900/12168]    Overall Loss 0.012846    Objective Loss 0.000000    Distill Loss 0.012846                                        LR 0.001000    Time 0.997680    
+2023-12-02 02:32:29,672 - Epoch: [8][ 8000/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.993794    
+2023-12-02 02:33:41,487 - Epoch: [8][ 8100/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.990391    
+2023-12-02 02:35:37,712 - Epoch: [8][ 8200/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.992486    
+2023-12-02 02:37:22,380 - Epoch: [8][ 8300/12168]    Overall Loss 0.012846    Objective Loss 0.000000    Distill Loss 0.012846                                        LR 0.001000    Time 0.993137    
+2023-12-02 02:38:59,790 - Epoch: [8][ 8400/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.992910    
+2023-12-02 02:40:53,222 - Epoch: [8][ 8500/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.994573    
+2023-12-02 02:42:46,907 - Epoch: [8][ 8600/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.996226    
+2023-12-02 02:44:31,489 - Epoch: [8][ 8700/12168]    Overall Loss 0.012845    Objective Loss 0.000000    Distill Loss 0.012845                                        LR 0.001000    Time 0.996796    
+2023-12-02 02:46:12,617 - Epoch: [8][ 8800/12168]    Overall Loss 0.012844    Objective Loss 0.000000    Distill Loss 0.012844                                        LR 0.001000    Time 0.996959    
+2023-12-02 02:47:54,552 - Epoch: [8][ 8900/12168]    Overall Loss 0.012843    Objective Loss 0.000000    Distill Loss 0.012843                                        LR 0.001000    Time 0.997210    
+2023-12-02 02:49:47,367 - Epoch: [8][ 9000/12168]    Overall Loss 0.012842    Objective Loss 0.000000    Distill Loss 0.012842                                        LR 0.001000    Time 0.998664    
+2023-12-02 02:51:35,836 - Epoch: [8][ 9100/12168]    Overall Loss 0.012843    Objective Loss 0.000000    Distill Loss 0.012843                                        LR 0.001000    Time 0.999609    
+2023-12-02 02:53:14,166 - Epoch: [8][ 9200/12168]    Overall Loss 0.012843    Objective Loss 0.000000    Distill Loss 0.012843                                        LR 0.001000    Time 0.999431    
+2023-12-02 02:55:01,840 - Epoch: [8][ 9300/12168]    Overall Loss 0.012842    Objective Loss 0.000000    Distill Loss 0.012842                                        LR 0.001000    Time 1.000262    
+2023-12-02 02:57:11,447 - Epoch: [8][ 9400/12168]    Overall Loss 0.012842    Objective Loss 0.000000    Distill Loss 0.012842                                        LR 0.001000    Time 1.003408    
+2023-12-02 02:58:55,414 - Epoch: [8][ 9500/12168]    Overall Loss 0.012841    Objective Loss 0.000000    Distill Loss 0.012841                                        LR 0.001000    Time 1.003789    
+2023-12-02 03:00:37,807 - Epoch: [8][ 9600/12168]    Overall Loss 0.012841    Objective Loss 0.000000    Distill Loss 0.012841                                        LR 0.001000    Time 1.003998    
+2023-12-02 03:02:25,457 - Epoch: [8][ 9700/12168]    Overall Loss 0.012841    Objective Loss 0.000000    Distill Loss 0.012841                                        LR 0.001000    Time 1.004744    
+2023-12-02 03:04:03,732 - Epoch: [8][ 9800/12168]    Overall Loss 0.012840    Objective Loss 0.000000    Distill Loss 0.012840                                        LR 0.001000    Time 1.004519    
+2023-12-02 03:05:54,810 - Epoch: [8][ 9900/12168]    Overall Loss 0.012839    Objective Loss 0.000000    Distill Loss 0.012839                                        LR 0.001000    Time 1.005592    
+2023-12-02 03:07:45,110 - Epoch: [8][10000/12168]    Overall Loss 0.012839    Objective Loss 0.000000    Distill Loss 0.012839                                        LR 0.001000    Time 1.006565    
+2023-12-02 03:09:30,572 - Epoch: [8][10100/12168]    Overall Loss 0.012840    Objective Loss 0.000000    Distill Loss 0.012840                                        LR 0.001000    Time 1.007040    
+2023-12-02 03:11:15,556 - Epoch: [8][10200/12168]    Overall Loss 0.012839    Objective Loss 0.000000    Distill Loss 0.012839                                        LR 0.001000    Time 1.007459    
+2023-12-02 03:12:59,472 - Epoch: [8][10300/12168]    Overall Loss 0.012838    Objective Loss 0.000000    Distill Loss 0.012838                                        LR 0.001000    Time 1.007766    
+2023-12-02 03:14:35,794 - Epoch: [8][10400/12168]    Overall Loss 0.012838    Objective Loss 0.000000    Distill Loss 0.012838                                        LR 0.001000    Time 1.007337    
+2023-12-02 03:16:19,284 - Epoch: [8][10500/12168]    Overall Loss 0.012838    Objective Loss 0.000000    Distill Loss 0.012838                                        LR 0.001000    Time 1.007599    
+2023-12-02 03:18:09,691 - Epoch: [8][10600/12168]    Overall Loss 0.012838    Objective Loss 0.000000    Distill Loss 0.012838                                        LR 0.001000    Time 1.008509    
+2023-12-02 03:19:52,255 - Epoch: [8][10700/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.008668    
+2023-12-02 03:21:27,807 - Epoch: [8][10800/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.008175    
+2023-12-02 03:23:19,056 - Epoch: [8][10900/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.009132    
+2023-12-02 03:25:12,152 - Epoch: [8][11000/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.010238    
+2023-12-02 03:26:45,931 - Epoch: [8][11100/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.009585    
+2023-12-02 03:28:28,827 - Epoch: [8][11200/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.009758    
+2023-12-02 03:30:03,695 - Epoch: [8][11300/12168]    Overall Loss 0.012836    Objective Loss 0.000000    Distill Loss 0.012836                                        LR 0.001000    Time 1.009216    
+2023-12-02 03:31:43,376 - Epoch: [8][11400/12168]    Overall Loss 0.012835    Objective Loss 0.000000    Distill Loss 0.012835                                        LR 0.001000    Time 1.009107    
+2023-12-02 03:33:25,450 - Epoch: [8][11500/12168]    Overall Loss 0.012834    Objective Loss 0.000000    Distill Loss 0.012834                                        LR 0.001000    Time 1.009208    
+2023-12-02 03:35:09,427 - Epoch: [8][11600/12168]    Overall Loss 0.012834    Objective Loss 0.000000    Distill Loss 0.012834                                        LR 0.001000    Time 1.009470    
+2023-12-02 03:36:57,363 - Epoch: [8][11700/12168]    Overall Loss 0.012835    Objective Loss 0.000000    Distill Loss 0.012835                                        LR 0.001000    Time 1.010067    
+2023-12-02 03:38:40,622 - Epoch: [8][11800/12168]    Overall Loss 0.012835    Objective Loss 0.000000    Distill Loss 0.012835                                        LR 0.001000    Time 1.010258    
+2023-12-02 03:40:14,979 - Epoch: [8][11900/12168]    Overall Loss 0.012835    Objective Loss 0.000000    Distill Loss 0.012835                                        LR 0.001000    Time 1.009697    
+2023-12-02 03:42:01,712 - Epoch: [8][12000/12168]    Overall Loss 0.012834    Objective Loss 0.000000    Distill Loss 0.012834                                        LR 0.001000    Time 1.010176    
+2023-12-02 03:43:48,583 - Epoch: [8][12100/12168]    Overall Loss 0.012834    Objective Loss 0.000000    Distill Loss 0.012834                                        LR 0.001000    Time 1.010659    
+2023-12-02 03:44:54,276 - Epoch: [8][12168/12168]    Overall Loss 0.012834    Objective Loss 0.000000    Distill Loss 0.012834                                        LR 0.001000    Time 1.010410    
+2023-12-02 03:44:55,003 - --- validate (epoch=8)-----------
+2023-12-02 03:44:55,004 - 167951 samples (256 per mini-batch)
+2023-12-02 03:45:51,067 - Epoch: [8][  100/  657]    Loss 0.000000    Overall Loss 0.013537    
+2023-12-02 03:46:38,960 - Epoch: [8][  200/  657]    Loss 0.000000    Overall Loss 0.013559    
+2023-12-02 03:47:26,873 - Epoch: [8][  300/  657]    Loss 0.000000    Overall Loss 0.013569    
+2023-12-02 03:48:14,807 - Epoch: [8][  400/  657]    Loss 0.000000    Overall Loss 0.013572    
+2023-12-02 03:49:02,749 - Epoch: [8][  500/  657]    Loss 0.000000    Overall Loss 0.013574    
+2023-12-02 03:49:50,745 - Epoch: [8][  600/  657]    Loss 0.000000    Overall Loss 0.013577    
+2023-12-02 03:50:17,650 - Epoch: [8][  657/  657]    Loss 0.000000    Overall Loss 0.013579    
+2023-12-02 03:50:18,010 - ==> Overall Loss: 0.014
+
+2023-12-02 03:50:18,012 - ==> Best [Overall Loss: 0.013579 on epoch: 8]
+2023-12-02 03:50:18,012 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 03:50:18,046 - 
+
+2023-12-02 03:50:18,046 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 03:52:04,964 - Epoch: [9][  100/12168]    Overall Loss 0.012730    Objective Loss 0.000000    Distill Loss 0.012730                                        LR 0.001000    Time 1.069099    
+2023-12-02 03:53:52,294 - Epoch: [9][  200/12168]    Overall Loss 0.012725    Objective Loss 0.000000    Distill Loss 0.012725                                        LR 0.001000    Time 1.071167    
+2023-12-02 03:55:22,595 - Epoch: [9][  300/12168]    Overall Loss 0.012727    Objective Loss 0.000000    Distill Loss 0.012727                                        LR 0.001000    Time 1.015089    
+2023-12-02 03:56:58,638 - Epoch: [9][  400/12168]    Overall Loss 0.012729    Objective Loss 0.000000    Distill Loss 0.012729                                        LR 0.001000    Time 1.001407    
+2023-12-02 03:58:25,855 - Epoch: [9][  500/12168]    Overall Loss 0.012722    Objective Loss 0.000000    Distill Loss 0.012722                                        LR 0.001000    Time 0.975544    
+2023-12-02 04:00:01,914 - Epoch: [9][  600/12168]    Overall Loss 0.012736    Objective Loss 0.000000    Distill Loss 0.012736                                        LR 0.001000    Time 0.973040    
+2023-12-02 04:01:37,231 - Epoch: [9][  700/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.970191    
+2023-12-02 04:03:13,693 - Epoch: [9][  800/12168]    Overall Loss 0.012750    Objective Loss 0.000000    Distill Loss 0.012750                                        LR 0.001000    Time 0.969485    
+2023-12-02 04:04:46,870 - Epoch: [9][  900/12168]    Overall Loss 0.012756    Objective Loss 0.000000    Distill Loss 0.012756                                        LR 0.001000    Time 0.965286    
+2023-12-02 04:06:13,170 - Epoch: [9][ 1000/12168]    Overall Loss 0.012759    Objective Loss 0.000000    Distill Loss 0.012759                                        LR 0.001000    Time 0.955051    
+2023-12-02 04:07:56,711 - Epoch: [9][ 1100/12168]    Overall Loss 0.012761    Objective Loss 0.000000    Distill Loss 0.012761                                        LR 0.001000    Time 0.962350    
+2023-12-02 04:09:42,731 - Epoch: [9][ 1200/12168]    Overall Loss 0.012759    Objective Loss 0.000000    Distill Loss 0.012759                                        LR 0.001000    Time 0.970498    
+2023-12-02 04:11:34,418 - Epoch: [9][ 1300/12168]    Overall Loss 0.012755    Objective Loss 0.000000    Distill Loss 0.012755                                        LR 0.001000    Time 0.981752    
+2023-12-02 04:13:09,549 - Epoch: [9][ 1400/12168]    Overall Loss 0.012756    Objective Loss 0.000000    Distill Loss 0.012756                                        LR 0.001000    Time 0.979572    
+2023-12-02 04:14:39,448 - Epoch: [9][ 1500/12168]    Overall Loss 0.012758    Objective Loss 0.000000    Distill Loss 0.012758                                        LR 0.001000    Time 0.974196    
+2023-12-02 04:16:15,827 - Epoch: [9][ 1600/12168]    Overall Loss 0.012759    Objective Loss 0.000000    Distill Loss 0.012759                                        LR 0.001000    Time 0.973540    
+2023-12-02 04:17:56,136 - Epoch: [9][ 1700/12168]    Overall Loss 0.012763    Objective Loss 0.000000    Distill Loss 0.012763                                        LR 0.001000    Time 0.975274    
+2023-12-02 04:19:34,410 - Epoch: [9][ 1800/12168]    Overall Loss 0.012765    Objective Loss 0.000000    Distill Loss 0.012765                                        LR 0.001000    Time 0.975684    
+2023-12-02 04:21:06,079 - Epoch: [9][ 1900/12168]    Overall Loss 0.012770    Objective Loss 0.000000    Distill Loss 0.012770                                        LR 0.001000    Time 0.972575    
+2023-12-02 04:22:41,904 - Epoch: [9][ 2000/12168]    Overall Loss 0.012771    Objective Loss 0.000000    Distill Loss 0.012771                                        LR 0.001000    Time 0.971856    
+2023-12-02 04:24:28,957 - Epoch: [9][ 2100/12168]    Overall Loss 0.012773    Objective Loss 0.000000    Distill Loss 0.012773                                        LR 0.001000    Time 0.976551    
+2023-12-02 04:26:21,142 - Epoch: [9][ 2200/12168]    Overall Loss 0.012773    Objective Loss 0.000000    Distill Loss 0.012773                                        LR 0.001000    Time 0.983153    
+2023-12-02 04:27:58,471 - Epoch: [9][ 2300/12168]    Overall Loss 0.012771    Objective Loss 0.000000    Distill Loss 0.012771                                        LR 0.001000    Time 0.982721    
+2023-12-02 04:29:56,410 - Epoch: [9][ 2400/12168]    Overall Loss 0.012770    Objective Loss 0.000000    Distill Loss 0.012770                                        LR 0.001000    Time 0.990912    
+2023-12-02 04:31:33,891 - Epoch: [9][ 2500/12168]    Overall Loss 0.012767    Objective Loss 0.000000    Distill Loss 0.012767                                        LR 0.001000    Time 0.990266    
+2023-12-02 04:33:00,090 - Epoch: [9][ 2600/12168]    Overall Loss 0.012765    Objective Loss 0.000000    Distill Loss 0.012765                                        LR 0.001000    Time 0.985329    
+2023-12-02 04:34:36,271 - Epoch: [9][ 2700/12168]    Overall Loss 0.012766    Objective Loss 0.000000    Distill Loss 0.012766                                        LR 0.001000    Time 0.984456    
+2023-12-02 04:36:02,727 - Epoch: [9][ 2800/12168]    Overall Loss 0.012766    Objective Loss 0.000000    Distill Loss 0.012766                                        LR 0.001000    Time 0.980171    
+2023-12-02 04:37:36,381 - Epoch: [9][ 2900/12168]    Overall Loss 0.012768    Objective Loss 0.000000    Distill Loss 0.012768                                        LR 0.001000    Time 0.978665    
+2023-12-02 04:39:12,563 - Epoch: [9][ 3000/12168]    Overall Loss 0.012767    Objective Loss 0.000000    Distill Loss 0.012767                                        LR 0.001000    Time 0.978101    
+2023-12-02 04:40:54,530 - Epoch: [9][ 3100/12168]    Overall Loss 0.012762    Objective Loss 0.000000    Distill Loss 0.012762                                        LR 0.001000    Time 0.979440    
+2023-12-02 04:42:36,125 - Epoch: [9][ 3200/12168]    Overall Loss 0.012761    Objective Loss 0.000000    Distill Loss 0.012761                                        LR 0.001000    Time 0.980578    
+2023-12-02 04:44:15,734 - Epoch: [9][ 3300/12168]    Overall Loss 0.012759    Objective Loss 0.000000    Distill Loss 0.012759                                        LR 0.001000    Time 0.981046    
+2023-12-02 04:45:47,271 - Epoch: [9][ 3400/12168]    Overall Loss 0.012762    Objective Loss 0.000000    Distill Loss 0.012762                                        LR 0.001000    Time 0.979112    
+2023-12-02 04:47:28,361 - Epoch: [9][ 3500/12168]    Overall Loss 0.012762    Objective Loss 0.000000    Distill Loss 0.012762                                        LR 0.001000    Time 0.980019    
+2023-12-02 04:49:06,286 - Epoch: [9][ 3600/12168]    Overall Loss 0.012760    Objective Loss 0.000000    Distill Loss 0.012760                                        LR 0.001000    Time 0.979995    
+2023-12-02 04:50:49,255 - Epoch: [9][ 3700/12168]    Overall Loss 0.012760    Objective Loss 0.000000    Distill Loss 0.012760                                        LR 0.001000    Time 0.981336    
+2023-12-02 04:52:27,068 - Epoch: [9][ 3800/12168]    Overall Loss 0.012760    Objective Loss 0.000000    Distill Loss 0.012760                                        LR 0.001000    Time 0.981250    
+2023-12-02 04:54:09,176 - Epoch: [9][ 3900/12168]    Overall Loss 0.012760    Objective Loss 0.000000    Distill Loss 0.012760                                        LR 0.001000    Time 0.982270    
+2023-12-02 04:55:47,356 - Epoch: [9][ 4000/12168]    Overall Loss 0.012757    Objective Loss 0.000000    Distill Loss 0.012757                                        LR 0.001000    Time 0.982256    
+2023-12-02 04:57:20,828 - Epoch: [9][ 4100/12168]    Overall Loss 0.012757    Objective Loss 0.000000    Distill Loss 0.012757                                        LR 0.001000    Time 0.981095    
+2023-12-02 04:58:56,021 - Epoch: [9][ 4200/12168]    Overall Loss 0.012757    Objective Loss 0.000000    Distill Loss 0.012757                                        LR 0.001000    Time 0.980399    
+2023-12-02 05:00:24,745 - Epoch: [9][ 4300/12168]    Overall Loss 0.012755    Objective Loss 0.000000    Distill Loss 0.012755                                        LR 0.001000    Time 0.978231    
+2023-12-02 05:01:55,676 - Epoch: [9][ 4400/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.976663    
+2023-12-02 05:03:36,536 - Epoch: [9][ 4500/12168]    Overall Loss 0.012755    Objective Loss 0.000000    Distill Loss 0.012755                                        LR 0.001000    Time 0.977371    
+2023-12-02 05:05:13,790 - Epoch: [9][ 4600/12168]    Overall Loss 0.012755    Objective Loss 0.000000    Distill Loss 0.012755                                        LR 0.001000    Time 0.977264    
+2023-12-02 05:06:54,039 - Epoch: [9][ 4700/12168]    Overall Loss 0.012754    Objective Loss 0.000000    Distill Loss 0.012754                                        LR 0.001000    Time 0.977800    
+2023-12-02 05:08:37,107 - Epoch: [9][ 4800/12168]    Overall Loss 0.012754    Objective Loss 0.000000    Distill Loss 0.012754                                        LR 0.001000    Time 0.978900    
+2023-12-02 05:10:08,238 - Epoch: [9][ 4900/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.977519    
+2023-12-02 05:11:56,110 - Epoch: [9][ 5000/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.979542    
+2023-12-02 05:13:37,335 - Epoch: [9][ 5100/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.980182    
+2023-12-02 05:15:09,846 - Epoch: [9][ 5200/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.979121    
+2023-12-02 05:16:41,368 - Epoch: [9][ 5300/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.977914    
+2023-12-02 05:18:07,529 - Epoch: [9][ 5400/12168]    Overall Loss 0.012752    Objective Loss 0.000000    Distill Loss 0.012752                                        LR 0.001000    Time 0.975759    
+2023-12-02 05:19:52,465 - Epoch: [9][ 5500/12168]    Overall Loss 0.012753    Objective Loss 0.000000    Distill Loss 0.012753                                        LR 0.001000    Time 0.977096    
+2023-12-02 05:21:21,907 - Epoch: [9][ 5600/12168]    Overall Loss 0.012751    Objective Loss 0.000000    Distill Loss 0.012751                                        LR 0.001000    Time 0.975618    
+2023-12-02 05:23:01,119 - Epoch: [9][ 5700/12168]    Overall Loss 0.012750    Objective Loss 0.000000    Distill Loss 0.012750                                        LR 0.001000    Time 0.975907    
+2023-12-02 05:24:48,656 - Epoch: [9][ 5800/12168]    Overall Loss 0.012748    Objective Loss 0.000000    Distill Loss 0.012748                                        LR 0.001000    Time 0.977620    
+2023-12-02 05:26:44,958 - Epoch: [9][ 5900/12168]    Overall Loss 0.012749    Objective Loss 0.000000    Distill Loss 0.012749                                        LR 0.001000    Time 0.980762    
+2023-12-02 05:28:22,564 - Epoch: [9][ 6000/12168]    Overall Loss 0.012749    Objective Loss 0.000000    Distill Loss 0.012749                                        LR 0.001000    Time 0.980682    
+2023-12-02 05:30:00,340 - Epoch: [9][ 6100/12168]    Overall Loss 0.012748    Objective Loss 0.000000    Distill Loss 0.012748                                        LR 0.001000    Time 0.980633    
+2023-12-02 05:31:37,158 - Epoch: [9][ 6200/12168]    Overall Loss 0.012748    Objective Loss 0.000000    Distill Loss 0.012748                                        LR 0.001000    Time 0.980431    
+2023-12-02 05:33:15,018 - Epoch: [9][ 6300/12168]    Overall Loss 0.012747    Objective Loss 0.000000    Distill Loss 0.012747                                        LR 0.001000    Time 0.980401    
+2023-12-02 05:35:06,798 - Epoch: [9][ 6400/12168]    Overall Loss 0.012747    Objective Loss 0.000000    Distill Loss 0.012747                                        LR 0.001000    Time 0.982547    
+2023-12-02 05:36:35,148 - Epoch: [9][ 6500/12168]    Overall Loss 0.012746    Objective Loss 0.000000    Distill Loss 0.012746                                        LR 0.001000    Time 0.981022    
+2023-12-02 05:38:10,099 - Epoch: [9][ 6600/12168]    Overall Loss 0.012746    Objective Loss 0.000000    Distill Loss 0.012746                                        LR 0.001000    Time 0.980543    
+2023-12-02 05:39:55,541 - Epoch: [9][ 6700/12168]    Overall Loss 0.012746    Objective Loss 0.000000    Distill Loss 0.012746                                        LR 0.001000    Time 0.981645    
+2023-12-02 05:41:46,545 - Epoch: [9][ 6800/12168]    Overall Loss 0.012746    Objective Loss 0.000000    Distill Loss 0.012746                                        LR 0.001000    Time 0.983532    
+2023-12-02 05:43:22,318 - Epoch: [9][ 6900/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.983157    
+2023-12-02 05:45:03,042 - Epoch: [9][ 7000/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.983500    
+2023-12-02 05:46:35,500 - Epoch: [9][ 7100/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.982669    
+2023-12-02 05:48:07,866 - Epoch: [9][ 7200/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.981848    
+2023-12-02 05:49:51,969 - Epoch: [9][ 7300/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.982658    
+2023-12-02 05:51:32,318 - Epoch: [9][ 7400/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.982939    
+2023-12-02 05:53:13,876 - Epoch: [9][ 7500/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.983373    
+2023-12-02 05:54:47,919 - Epoch: [9][ 7600/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.982807    
+2023-12-02 05:56:27,362 - Epoch: [9][ 7700/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.982957    
+2023-12-02 05:58:16,245 - Epoch: [9][ 7800/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.984314    
+2023-12-02 05:59:58,010 - Epoch: [9][ 7900/12168]    Overall Loss 0.012745    Objective Loss 0.000000    Distill Loss 0.012745                                        LR 0.001000    Time 0.984735    
+2023-12-02 06:01:46,094 - Epoch: [9][ 8000/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.985935    
+2023-12-02 06:03:34,931 - Epoch: [9][ 8100/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.987199    
+2023-12-02 06:05:08,450 - Epoch: [9][ 8200/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.986564    
+2023-12-02 06:07:09,229 - Epoch: [9][ 8300/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.989228    
+2023-12-02 06:08:48,449 - Epoch: [9][ 8400/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.989263    
+2023-12-02 06:10:31,354 - Epoch: [9][ 8500/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.989730    
+2023-12-02 06:12:16,400 - Epoch: [9][ 8600/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.990435    
+2023-12-02 06:14:03,106 - Epoch: [9][ 8700/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.991315    
+2023-12-02 06:15:56,134 - Epoch: [9][ 8800/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.992894    
+2023-12-02 06:17:35,657 - Epoch: [9][ 8900/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.992919    
+2023-12-02 06:19:15,505 - Epoch: [9][ 9000/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.992980    
+2023-12-02 06:21:09,784 - Epoch: [9][ 9100/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.994626    
+2023-12-02 06:22:40,947 - Epoch: [9][ 9200/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.993723    
+2023-12-02 06:24:26,378 - Epoch: [9][ 9300/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.994374    
+2023-12-02 06:26:05,721 - Epoch: [9][ 9400/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.994363    
+2023-12-02 06:27:56,203 - Epoch: [9][ 9500/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.995525    
+2023-12-02 06:29:35,793 - Epoch: [9][ 9600/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.995528    
+2023-12-02 06:30:56,857 - Epoch: [9][ 9700/12168]    Overall Loss 0.012744    Objective Loss 0.000000    Distill Loss 0.012744                                        LR 0.001000    Time 0.993621    
+2023-12-02 06:32:05,098 - Epoch: [9][ 9800/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.990445    
+2023-12-02 06:33:17,194 - Epoch: [9][ 9900/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.987723    
+2023-12-02 06:34:26,019 - Epoch: [9][10000/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.984727    
+2023-12-02 06:35:35,171 - Epoch: [9][10100/12168]    Overall Loss 0.012743    Objective Loss 0.000000    Distill Loss 0.012743                                        LR 0.001000    Time 0.981824    
+2023-12-02 06:37:04,262 - Epoch: [9][10200/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.980932    
+2023-12-02 06:38:50,285 - Epoch: [9][10300/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.981701    
+2023-12-02 06:40:35,798 - Epoch: [9][10400/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.982406    
+2023-12-02 06:42:21,367 - Epoch: [9][10500/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.983104    
+2023-12-02 06:44:15,942 - Epoch: [9][10600/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.984637    
+2023-12-02 06:46:08,658 - Epoch: [9][10700/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.985969    
+2023-12-02 06:47:49,852 - Epoch: [9][10800/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.986209    
+2023-12-02 06:49:32,707 - Epoch: [9][10900/12168]    Overall Loss 0.012741    Objective Loss 0.000000    Distill Loss 0.012741                                        LR 0.001000    Time 0.986596    
+2023-12-02 06:51:30,447 - Epoch: [9][11000/12168]    Overall Loss 0.012741    Objective Loss 0.000000    Distill Loss 0.012741                                        LR 0.001000    Time 0.988330    
+2023-12-02 06:53:33,703 - Epoch: [9][11100/12168]    Overall Loss 0.012741    Objective Loss 0.000000    Distill Loss 0.012741                                        LR 0.001000    Time 0.990530    
+2023-12-02 06:55:26,069 - Epoch: [9][11200/12168]    Overall Loss 0.012741    Objective Loss 0.000000    Distill Loss 0.012741                                        LR 0.001000    Time 0.991718    
+2023-12-02 06:57:06,771 - Epoch: [9][11300/12168]    Overall Loss 0.012742    Objective Loss 0.000000    Distill Loss 0.012742                                        LR 0.001000    Time 0.991853    
+2023-12-02 06:58:50,234 - Epoch: [9][11400/12168]    Overall Loss 0.012741    Objective Loss 0.000000    Distill Loss 0.012741                                        LR 0.001000    Time 0.992227    
+2023-12-02 07:00:51,567 - Epoch: [9][11500/12168]    Overall Loss 0.012741    Objective Loss 0.000000    Distill Loss 0.012741                                        LR 0.001000    Time 0.994149    
+2023-12-02 07:02:39,659 - Epoch: [9][11600/12168]    Overall Loss 0.012740    Objective Loss 0.000000    Distill Loss 0.012740                                        LR 0.001000    Time 0.994897    
+2023-12-02 07:04:21,959 - Epoch: [9][11700/12168]    Overall Loss 0.012740    Objective Loss 0.000000    Distill Loss 0.012740                                        LR 0.001000    Time 0.995136    
+2023-12-02 07:06:07,973 - Epoch: [9][11800/12168]    Overall Loss 0.012740    Objective Loss 0.000000    Distill Loss 0.012740                                        LR 0.001000    Time 0.995687    
+2023-12-02 07:07:58,859 - Epoch: [9][11900/12168]    Overall Loss 0.012740    Objective Loss 0.000000    Distill Loss 0.012740                                        LR 0.001000    Time 0.996637    
+2023-12-02 07:09:47,877 - Epoch: [9][12000/12168]    Overall Loss 0.012739    Objective Loss 0.000000    Distill Loss 0.012739                                        LR 0.001000    Time 0.997416    
+2023-12-02 07:11:41,540 - Epoch: [9][12100/12168]    Overall Loss 0.012739    Objective Loss 0.000000    Distill Loss 0.012739                                        LR 0.001000    Time 0.998566    
+2023-12-02 07:12:53,911 - Epoch: [9][12168/12168]    Overall Loss 0.012739    Objective Loss 0.000000    Distill Loss 0.012739                                        LR 0.001000    Time 0.998933    
+2023-12-02 07:12:54,552 - --- validate (epoch=9)-----------
+2023-12-02 07:12:54,552 - 167951 samples (256 per mini-batch)
+2023-12-02 07:13:47,556 - Epoch: [9][  100/  657]    Loss 0.000000    Overall Loss 0.013410    
+2023-12-02 07:14:35,539 - Epoch: [9][  200/  657]    Loss 0.000000    Overall Loss 0.013418    
+2023-12-02 07:15:23,500 - Epoch: [9][  300/  657]    Loss 0.000000    Overall Loss 0.013426    
+2023-12-02 07:16:11,440 - Epoch: [9][  400/  657]    Loss 0.000000    Overall Loss 0.013411    
+2023-12-02 07:16:59,397 - Epoch: [9][  500/  657]    Loss 0.000000    Overall Loss 0.013405    
+2023-12-02 07:17:47,340 - Epoch: [9][  600/  657]    Loss 0.000000    Overall Loss 0.013407    
+2023-12-02 07:18:14,272 - Epoch: [9][  657/  657]    Loss 0.000000    Overall Loss 0.013407    
+2023-12-02 07:18:14,569 - ==> Overall Loss: 0.013
+
+2023-12-02 07:18:14,572 - ==> Best [Overall Loss: 0.013407 on epoch: 9]
+2023-12-02 07:18:14,572 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 07:18:14,605 - 
+
+2023-12-02 07:18:14,605 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 07:20:29,082 - Epoch: [10][  100/12168]    Overall Loss 0.012539    Objective Loss 0.000000    Distill Loss 0.012539                                        LR 0.000500    Time 1.344695    
+2023-12-02 07:22:01,092 - Epoch: [10][  200/12168]    Overall Loss 0.012493    Objective Loss 0.000000    Distill Loss 0.012493                                        LR 0.000500    Time 1.132362    
+2023-12-02 07:23:39,693 - Epoch: [10][  300/12168]    Overall Loss 0.012477    Objective Loss 0.000000    Distill Loss 0.012477                                        LR 0.000500    Time 1.083555    
+2023-12-02 07:25:23,258 - Epoch: [10][  400/12168]    Overall Loss 0.012474    Objective Loss 0.000000    Distill Loss 0.012474                                        LR 0.000500    Time 1.071560    
+2023-12-02 07:26:58,661 - Epoch: [10][  500/12168]    Overall Loss 0.012460    Objective Loss 0.000000    Distill Loss 0.012460                                        LR 0.000500    Time 1.048039    
+2023-12-02 07:28:29,256 - Epoch: [10][  600/12168]    Overall Loss 0.012456    Objective Loss 0.000000    Distill Loss 0.012456                                        LR 0.000500    Time 1.024347    
+2023-12-02 07:30:12,564 - Epoch: [10][  700/12168]    Overall Loss 0.012455    Objective Loss 0.000000    Distill Loss 0.012455                                        LR 0.000500    Time 1.025584    
+2023-12-02 07:31:40,286 - Epoch: [10][  800/12168]    Overall Loss 0.012454    Objective Loss 0.000000    Distill Loss 0.012454                                        LR 0.000500    Time 1.007029    
+2023-12-02 07:33:11,732 - Epoch: [10][  900/12168]    Overall Loss 0.012456    Objective Loss 0.000000    Distill Loss 0.012456                                        LR 0.000500    Time 0.996736    
+2023-12-02 07:35:01,072 - Epoch: [10][ 1000/12168]    Overall Loss 0.012461    Objective Loss 0.000000    Distill Loss 0.012461                                        LR 0.000500    Time 1.006395    
+2023-12-02 07:36:49,686 - Epoch: [10][ 1100/12168]    Overall Loss 0.012465    Objective Loss 0.000000    Distill Loss 0.012465                                        LR 0.000500    Time 1.013638    
+2023-12-02 07:38:38,377 - Epoch: [10][ 1200/12168]    Overall Loss 0.012460    Objective Loss 0.000000    Distill Loss 0.012460                                        LR 0.000500    Time 1.019738    
+2023-12-02 07:40:21,454 - Epoch: [10][ 1300/12168]    Overall Loss 0.012455    Objective Loss 0.000000    Distill Loss 0.012455                                        LR 0.000500    Time 1.020581    
+2023-12-02 07:42:05,723 - Epoch: [10][ 1400/12168]    Overall Loss 0.012453    Objective Loss 0.000000    Distill Loss 0.012453                                        LR 0.000500    Time 1.022155    
+2023-12-02 07:43:48,698 - Epoch: [10][ 1500/12168]    Overall Loss 0.012456    Objective Loss 0.000000    Distill Loss 0.012456                                        LR 0.000500    Time 1.022656    
+2023-12-02 07:45:17,563 - Epoch: [10][ 1600/12168]    Overall Loss 0.012456    Objective Loss 0.000000    Distill Loss 0.012456                                        LR 0.000500    Time 1.014277    
+2023-12-02 07:46:54,959 - Epoch: [10][ 1700/12168]    Overall Loss 0.012458    Objective Loss 0.000000    Distill Loss 0.012458                                        LR 0.000500    Time 1.011900    
+2023-12-02 07:48:22,474 - Epoch: [10][ 1800/12168]    Overall Loss 0.012457    Objective Loss 0.000000    Distill Loss 0.012457                                        LR 0.000500    Time 1.004299    
+2023-12-02 07:49:55,049 - Epoch: [10][ 1900/12168]    Overall Loss 0.012456    Objective Loss 0.000000    Distill Loss 0.012456                                        LR 0.000500    Time 1.000161    
+2023-12-02 07:51:37,525 - Epoch: [10][ 2000/12168]    Overall Loss 0.012453    Objective Loss 0.000000    Distill Loss 0.012453                                        LR 0.000500    Time 1.001387    
+2023-12-02 07:53:26,216 - Epoch: [10][ 2100/12168]    Overall Loss 0.012451    Objective Loss 0.000000    Distill Loss 0.012451                                        LR 0.000500    Time 1.005456    
+2023-12-02 07:54:59,761 - Epoch: [10][ 2200/12168]    Overall Loss 0.012451    Objective Loss 0.000000    Distill Loss 0.012451                                        LR 0.000500    Time 1.002271    
+2023-12-02 07:56:36,183 - Epoch: [10][ 2300/12168]    Overall Loss 0.012444    Objective Loss 0.000000    Distill Loss 0.012444                                        LR 0.000500    Time 1.000613    
+2023-12-02 07:58:20,269 - Epoch: [10][ 2400/12168]    Overall Loss 0.012442    Objective Loss 0.000000    Distill Loss 0.012442                                        LR 0.000500    Time 1.002287    
+2023-12-02 07:59:52,464 - Epoch: [10][ 2500/12168]    Overall Loss 0.012439    Objective Loss 0.000000    Distill Loss 0.012439                                        LR 0.000500    Time 0.999070    
+2023-12-02 08:01:34,653 - Epoch: [10][ 2600/12168]    Overall Loss 0.012438    Objective Loss 0.000000    Distill Loss 0.012438                                        LR 0.000500    Time 0.999945    
+2023-12-02 08:03:19,933 - Epoch: [10][ 2700/12168]    Overall Loss 0.012437    Objective Loss 0.000000    Distill Loss 0.012437                                        LR 0.000500    Time 1.001900    
+2023-12-02 08:05:09,589 - Epoch: [10][ 2800/12168]    Overall Loss 0.012437    Objective Loss 0.000000    Distill Loss 0.012437                                        LR 0.000500    Time 1.005279    
+2023-12-02 08:06:54,455 - Epoch: [10][ 2900/12168]    Overall Loss 0.012437    Objective Loss 0.000000    Distill Loss 0.012437                                        LR 0.000500    Time 1.006772    
+2023-12-02 08:08:21,440 - Epoch: [10][ 3000/12168]    Overall Loss 0.012433    Objective Loss 0.000000    Distill Loss 0.012433                                        LR 0.000500    Time 1.002205    
+2023-12-02 08:09:54,952 - Epoch: [10][ 3100/12168]    Overall Loss 0.012428    Objective Loss 0.000000    Distill Loss 0.012428                                        LR 0.000500    Time 1.000039    
+2023-12-02 08:11:30,435 - Epoch: [10][ 3200/12168]    Overall Loss 0.012427    Objective Loss 0.000000    Distill Loss 0.012427                                        LR 0.000500    Time 0.998624    
+2023-12-02 08:13:05,409 - Epoch: [10][ 3300/12168]    Overall Loss 0.012427    Objective Loss 0.000000    Distill Loss 0.012427                                        LR 0.000500    Time 0.997140    
+2023-12-02 08:14:44,156 - Epoch: [10][ 3400/12168]    Overall Loss 0.012427    Objective Loss 0.000000    Distill Loss 0.012427                                        LR 0.000500    Time 0.996854    
+2023-12-02 08:16:30,081 - Epoch: [10][ 3500/12168]    Overall Loss 0.012427    Objective Loss 0.000000    Distill Loss 0.012427                                        LR 0.000500    Time 0.998634    
+2023-12-02 08:18:07,915 - Epoch: [10][ 3600/12168]    Overall Loss 0.012426    Objective Loss 0.000000    Distill Loss 0.012426                                        LR 0.000500    Time 0.998069    
+2023-12-02 08:19:45,142 - Epoch: [10][ 3700/12168]    Overall Loss 0.012425    Objective Loss 0.000000    Distill Loss 0.012425                                        LR 0.000500    Time 0.997369    
+2023-12-02 08:21:27,589 - Epoch: [10][ 3800/12168]    Overall Loss 0.012426    Objective Loss 0.000000    Distill Loss 0.012426                                        LR 0.000500    Time 0.998081    
+2023-12-02 08:23:08,775 - Epoch: [10][ 3900/12168]    Overall Loss 0.012425    Objective Loss 0.000000    Distill Loss 0.012425                                        LR 0.000500    Time 0.998432    
+2023-12-02 08:24:59,385 - Epoch: [10][ 4000/12168]    Overall Loss 0.012423    Objective Loss 0.000000    Distill Loss 0.012423                                        LR 0.000500    Time 1.001122    
+2023-12-02 08:26:41,439 - Epoch: [10][ 4100/12168]    Overall Loss 0.012423    Objective Loss 0.000000    Distill Loss 0.012423                                        LR 0.000500    Time 1.001594    
+2023-12-02 08:28:17,499 - Epoch: [10][ 4200/12168]    Overall Loss 0.012424    Objective Loss 0.000000    Distill Loss 0.012424                                        LR 0.000500    Time 1.000616    
+2023-12-02 08:29:58,609 - Epoch: [10][ 4300/12168]    Overall Loss 0.012422    Objective Loss 0.000000    Distill Loss 0.012422                                        LR 0.000500    Time 1.000858    
+2023-12-02 08:31:29,881 - Epoch: [10][ 4400/12168]    Overall Loss 0.012420    Objective Loss 0.000000    Distill Loss 0.012420                                        LR 0.000500    Time 0.998853    
+2023-12-02 08:33:03,353 - Epoch: [10][ 4500/12168]    Overall Loss 0.012420    Objective Loss 0.000000    Distill Loss 0.012420                                        LR 0.000500    Time 0.997427    
+2023-12-02 08:34:34,785 - Epoch: [10][ 4600/12168]    Overall Loss 0.012420    Objective Loss 0.000000    Distill Loss 0.012420                                        LR 0.000500    Time 0.995619    
+2023-12-02 08:36:20,973 - Epoch: [10][ 4700/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.997027    
+2023-12-02 08:37:51,563 - Epoch: [10][ 4800/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.995127    
+2023-12-02 08:39:32,861 - Epoch: [10][ 4900/12168]    Overall Loss 0.012418    Objective Loss 0.000000    Distill Loss 0.012418                                        LR 0.000500    Time 0.995490    
+2023-12-02 08:41:08,790 - Epoch: [10][ 5000/12168]    Overall Loss 0.012418    Objective Loss 0.000000    Distill Loss 0.012418                                        LR 0.000500    Time 0.994764    
+2023-12-02 08:42:55,847 - Epoch: [10][ 5100/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.996249    
+2023-12-02 08:44:27,886 - Epoch: [10][ 5200/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.994789    
+2023-12-02 08:46:09,497 - Epoch: [10][ 5300/12168]    Overall Loss 0.012418    Objective Loss 0.000000    Distill Loss 0.012418                                        LR 0.000500    Time 0.995190    
+2023-12-02 08:47:53,915 - Epoch: [10][ 5400/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.996096    
+2023-12-02 08:49:30,251 - Epoch: [10][ 5500/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.995499    
+2023-12-02 08:51:04,866 - Epoch: [10][ 5600/12168]    Overall Loss 0.012419    Objective Loss 0.000000    Distill Loss 0.012419                                        LR 0.000500    Time 0.994617    
+2023-12-02 08:52:56,665 - Epoch: [10][ 5700/12168]    Overall Loss 0.012418    Objective Loss 0.000000    Distill Loss 0.012418                                        LR 0.000500    Time 0.996780    
+2023-12-02 08:54:39,937 - Epoch: [10][ 5800/12168]    Overall Loss 0.012415    Objective Loss 0.000000    Distill Loss 0.012415                                        LR 0.000500    Time 0.997399    
+2023-12-02 08:56:22,694 - Epoch: [10][ 5900/12168]    Overall Loss 0.012417    Objective Loss 0.000000    Distill Loss 0.012417                                        LR 0.000500    Time 0.997909    
+2023-12-02 08:58:06,842 - Epoch: [10][ 6000/12168]    Overall Loss 0.012418    Objective Loss 0.000000    Distill Loss 0.012418                                        LR 0.000500    Time 0.998634    
+2023-12-02 08:59:44,375 - Epoch: [10][ 6100/12168]    Overall Loss 0.012416    Objective Loss 0.000000    Distill Loss 0.012416                                        LR 0.000500    Time 0.998251    
+2023-12-02 09:01:29,163 - Epoch: [10][ 6200/12168]    Overall Loss 0.012416    Objective Loss 0.000000    Distill Loss 0.012416                                        LR 0.000500    Time 0.999050    
+2023-12-02 09:03:07,505 - Epoch: [10][ 6300/12168]    Overall Loss 0.012415    Objective Loss 0.000000    Distill Loss 0.012415                                        LR 0.000500    Time 0.998801    
+2023-12-02 09:04:34,685 - Epoch: [10][ 6400/12168]    Overall Loss 0.012415    Objective Loss 0.000000    Distill Loss 0.012415                                        LR 0.000500    Time 0.996815    
+2023-12-02 09:06:12,903 - Epoch: [10][ 6500/12168]    Overall Loss 0.012415    Objective Loss 0.000000    Distill Loss 0.012415                                        LR 0.000500    Time 0.996589    
+2023-12-02 09:08:06,223 - Epoch: [10][ 6600/12168]    Overall Loss 0.012415    Objective Loss 0.000000    Distill Loss 0.012415                                        LR 0.000500    Time 0.998658    
+2023-12-02 09:09:55,114 - Epoch: [10][ 6700/12168]    Overall Loss 0.012414    Objective Loss 0.000000    Distill Loss 0.012414                                        LR 0.000500    Time 1.000004    
+2023-12-02 09:11:28,786 - Epoch: [10][ 6800/12168]    Overall Loss 0.012414    Objective Loss 0.000000    Distill Loss 0.012414                                        LR 0.000500    Time 0.999072    
+2023-12-02 09:13:09,729 - Epoch: [10][ 6900/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 0.999221    
+2023-12-02 09:14:42,731 - Epoch: [10][ 7000/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 0.998232    
+2023-12-02 09:16:38,693 - Epoch: [10][ 7100/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.000504    
+2023-12-02 09:18:35,550 - Epoch: [10][ 7200/12168]    Overall Loss 0.012414    Objective Loss 0.000000    Distill Loss 0.012414                                        LR 0.000500    Time 1.002837    
+2023-12-02 09:20:24,908 - Epoch: [10][ 7300/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.004079    
+2023-12-02 09:22:10,185 - Epoch: [10][ 7400/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.004736    
+2023-12-02 09:23:51,075 - Epoch: [10][ 7500/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.004791    
+2023-12-02 09:25:32,869 - Epoch: [10][ 7600/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.004963    
+2023-12-02 09:27:10,558 - Epoch: [10][ 7700/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.004597    
+2023-12-02 09:29:01,897 - Epoch: [10][ 7800/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.005991    
+2023-12-02 09:30:35,578 - Epoch: [10][ 7900/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.005115    
+2023-12-02 09:32:09,401 - Epoch: [10][ 8000/12168]    Overall Loss 0.012412    Objective Loss 0.000000    Distill Loss 0.012412                                        LR 0.000500    Time 1.004278    
+2023-12-02 09:33:37,101 - Epoch: [10][ 8100/12168]    Overall Loss 0.012412    Objective Loss 0.000000    Distill Loss 0.012412                                        LR 0.000500    Time 1.002705    
+2023-12-02 09:35:23,501 - Epoch: [10][ 8200/12168]    Overall Loss 0.012412    Objective Loss 0.000000    Distill Loss 0.012412                                        LR 0.000500    Time 1.003452    
+2023-12-02 09:36:54,013 - Epoch: [10][ 8300/12168]    Overall Loss 0.012413    Objective Loss 0.000000    Distill Loss 0.012413                                        LR 0.000500    Time 1.002266    
+2023-12-02 09:38:43,947 - Epoch: [10][ 8400/12168]    Overall Loss 0.012412    Objective Loss 0.000000    Distill Loss 0.012412                                        LR 0.000500    Time 1.003421    
+2023-12-02 09:40:22,556 - Epoch: [10][ 8500/12168]    Overall Loss 0.012411    Objective Loss 0.000000    Distill Loss 0.012411                                        LR 0.000500    Time 1.003216    
+2023-12-02 09:42:07,836 - Epoch: [10][ 8600/12168]    Overall Loss 0.012411    Objective Loss 0.000000    Distill Loss 0.012411                                        LR 0.000500    Time 1.003792    
+2023-12-02 09:43:42,212 - Epoch: [10][ 8700/12168]    Overall Loss 0.012411    Objective Loss 0.000000    Distill Loss 0.012411                                        LR 0.000500    Time 1.003101    
+2023-12-02 09:45:10,739 - Epoch: [10][ 8800/12168]    Overall Loss 0.012410    Objective Loss 0.000000    Distill Loss 0.012410                                        LR 0.000500    Time 1.001762    
+2023-12-02 09:46:52,609 - Epoch: [10][ 8900/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.001951    
+2023-12-02 09:48:29,100 - Epoch: [10][ 9000/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.001539    
+2023-12-02 09:50:07,123 - Epoch: [10][ 9100/12168]    Overall Loss 0.012410    Objective Loss 0.000000    Distill Loss 0.012410                                        LR 0.000500    Time 1.001304    
+2023-12-02 09:51:59,945 - Epoch: [10][ 9200/12168]    Overall Loss 0.012410    Objective Loss 0.000000    Distill Loss 0.012410                                        LR 0.000500    Time 1.002683    
+2023-12-02 09:53:49,781 - Epoch: [10][ 9300/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.003711    
+2023-12-02 09:55:27,759 - Epoch: [10][ 9400/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.003455    
+2023-12-02 09:57:08,815 - Epoch: [10][ 9500/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.003529    
+2023-12-02 09:58:44,309 - Epoch: [10][ 9600/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.003023    
+2023-12-02 10:00:29,571 - Epoch: [10][ 9700/12168]    Overall Loss 0.012409    Objective Loss 0.000000    Distill Loss 0.012409                                        LR 0.000500    Time 1.003533    
+2023-12-02 10:02:17,648 - Epoch: [10][ 9800/12168]    Overall Loss 0.012408    Objective Loss 0.000000    Distill Loss 0.012408                                        LR 0.000500    Time 1.004320    
+2023-12-02 10:04:02,235 - Epoch: [10][ 9900/12168]    Overall Loss 0.012407    Objective Loss 0.000000    Distill Loss 0.012407                                        LR 0.000500    Time 1.004740    
+2023-12-02 10:05:40,260 - Epoch: [10][10000/12168]    Overall Loss 0.012408    Objective Loss 0.000000    Distill Loss 0.012408                                        LR 0.000500    Time 1.004494    
+2023-12-02 10:07:22,974 - Epoch: [10][10100/12168]    Overall Loss 0.012408    Objective Loss 0.000000    Distill Loss 0.012408                                        LR 0.000500    Time 1.004717    
+2023-12-02 10:09:09,137 - Epoch: [10][10200/12168]    Overall Loss 0.012407    Objective Loss 0.000000    Distill Loss 0.012407                                        LR 0.000500    Time 1.005275    
+2023-12-02 10:10:52,065 - Epoch: [10][10300/12168]    Overall Loss 0.012407    Objective Loss 0.000000    Distill Loss 0.012407                                        LR 0.000500    Time 1.005507    
+2023-12-02 10:12:29,175 - Epoch: [10][10400/12168]    Overall Loss 0.012407    Objective Loss 0.000000    Distill Loss 0.012407                                        LR 0.000500    Time 1.005176    
+2023-12-02 10:14:10,623 - Epoch: [10][10500/12168]    Overall Loss 0.012407    Objective Loss 0.000000    Distill Loss 0.012407                                        LR 0.000500    Time 1.005263    
+2023-12-02 10:15:57,578 - Epoch: [10][10600/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.005869    
+2023-12-02 10:17:38,985 - Epoch: [10][10700/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.005945    
+2023-12-02 10:19:37,759 - Epoch: [10][10800/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.007628    
+2023-12-02 10:21:31,812 - Epoch: [10][10900/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.008847    
+2023-12-02 10:23:11,162 - Epoch: [10][11000/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 1.008706    
+2023-12-02 10:25:02,892 - Epoch: [10][11100/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.009684    
+2023-12-02 10:26:39,586 - Epoch: [10][11200/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 1.009302    
+2023-12-02 10:28:17,207 - Epoch: [10][11300/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.009008    
+2023-12-02 10:29:46,633 - Epoch: [10][11400/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 1.008001    
+2023-12-02 10:30:56,569 - Epoch: [10][11500/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 1.005317    
+2023-12-02 10:32:03,718 - Epoch: [10][11600/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 1.002439    
+2023-12-02 10:33:16,180 - Epoch: [10][11700/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 1.000064    
+2023-12-02 10:34:23,891 - Epoch: [10][11800/12168]    Overall Loss 0.012406    Objective Loss 0.000000    Distill Loss 0.012406                                        LR 0.000500    Time 0.997326    
+2023-12-02 10:35:41,105 - Epoch: [10][11900/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 0.995434    
+2023-12-02 10:37:29,485 - Epoch: [10][12000/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 0.996169    
+2023-12-02 10:39:15,587 - Epoch: [10][12100/12168]    Overall Loss 0.012405    Objective Loss 0.000000    Distill Loss 0.012405                                        LR 0.000500    Time 0.996705    
+2023-12-02 10:40:32,179 - Epoch: [10][12168/12168]    Overall Loss 0.012404    Objective Loss 0.000000    Distill Loss 0.012404                                        LR 0.000500    Time 0.997429    
+2023-12-02 10:40:32,988 - --- validate (epoch=10)-----------
+2023-12-02 10:40:32,988 - 167951 samples (256 per mini-batch)
+2023-12-02 10:41:25,746 - Epoch: [10][  100/  657]    Loss 0.000000    Overall Loss 0.013055    
+2023-12-02 10:42:13,712 - Epoch: [10][  200/  657]    Loss 0.000000    Overall Loss 0.013074    
+2023-12-02 10:43:01,666 - Epoch: [10][  300/  657]    Loss 0.000000    Overall Loss 0.013074    
+2023-12-02 10:43:49,659 - Epoch: [10][  400/  657]    Loss 0.000000    Overall Loss 0.013071    
+2023-12-02 10:44:37,642 - Epoch: [10][  500/  657]    Loss 0.000000    Overall Loss 0.013067    
+2023-12-02 10:45:25,673 - Epoch: [10][  600/  657]    Loss 0.000000    Overall Loss 0.013067    
+2023-12-02 10:45:52,607 - Epoch: [10][  657/  657]    Loss 0.000000    Overall Loss 0.013064    
+2023-12-02 10:45:53,023 - ==> Overall Loss: 0.013
+
+2023-12-02 10:45:53,026 - ==> Best [Overall Loss: 0.013064 on epoch: 10]
+2023-12-02 10:45:53,027 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 10:45:53,060 - 
+
+2023-12-02 10:45:53,060 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 10:47:49,593 - Epoch: [11][  100/12168]    Overall Loss 0.012369    Objective Loss 0.000000    Distill Loss 0.012369                                        LR 0.000500    Time 1.165247    
+2023-12-02 10:49:27,080 - Epoch: [11][  200/12168]    Overall Loss 0.012334    Objective Loss 0.000000    Distill Loss 0.012334                                        LR 0.000500    Time 1.070023    
+2023-12-02 10:51:15,135 - Epoch: [11][  300/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 1.073504    
+2023-12-02 10:52:45,573 - Epoch: [11][  400/12168]    Overall Loss 0.012352    Objective Loss 0.000000    Distill Loss 0.012352                                        LR 0.000500    Time 1.031206    
+2023-12-02 10:54:17,248 - Epoch: [11][  500/12168]    Overall Loss 0.012355    Objective Loss 0.000000    Distill Loss 0.012355                                        LR 0.000500    Time 1.008301    
+2023-12-02 10:55:52,907 - Epoch: [11][  600/12168]    Overall Loss 0.012351    Objective Loss 0.000000    Distill Loss 0.012351                                        LR 0.000500    Time 0.999670    
+2023-12-02 10:57:50,043 - Epoch: [11][  700/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 1.024187    
+2023-12-02 10:59:33,312 - Epoch: [11][  800/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 1.025242    
+2023-12-02 11:01:00,675 - Epoch: [11][  900/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.008387    
+2023-12-02 11:02:49,619 - Epoch: [11][ 1000/12168]    Overall Loss 0.012353    Objective Loss 0.000000    Distill Loss 0.012353                                        LR 0.000500    Time 1.016486    
+2023-12-02 11:04:21,664 - Epoch: [11][ 1100/12168]    Overall Loss 0.012357    Objective Loss 0.000000    Distill Loss 0.012357                                        LR 0.000500    Time 1.007749    
+2023-12-02 11:06:05,824 - Epoch: [11][ 1200/12168]    Overall Loss 0.012353    Objective Loss 0.000000    Distill Loss 0.012353                                        LR 0.000500    Time 1.010564    
+2023-12-02 11:07:38,838 - Epoch: [11][ 1300/12168]    Overall Loss 0.012354    Objective Loss 0.000000    Distill Loss 0.012354                                        LR 0.000500    Time 1.004372    
+2023-12-02 11:09:24,532 - Epoch: [11][ 1400/12168]    Overall Loss 0.012357    Objective Loss 0.000000    Distill Loss 0.012357                                        LR 0.000500    Time 1.008121    
+2023-12-02 11:11:07,315 - Epoch: [11][ 1500/12168]    Overall Loss 0.012362    Objective Loss 0.000000    Distill Loss 0.012362                                        LR 0.000500    Time 1.009431    
+2023-12-02 11:12:50,350 - Epoch: [11][ 1600/12168]    Overall Loss 0.012361    Objective Loss 0.000000    Distill Loss 0.012361                                        LR 0.000500    Time 1.010734    
+2023-12-02 11:14:39,907 - Epoch: [11][ 1700/12168]    Overall Loss 0.012363    Objective Loss 0.000000    Distill Loss 0.012363                                        LR 0.000500    Time 1.015719    
+2023-12-02 11:16:08,109 - Epoch: [11][ 1800/12168]    Overall Loss 0.012364    Objective Loss 0.000000    Distill Loss 0.012364                                        LR 0.000500    Time 1.008288    
+2023-12-02 11:17:56,000 - Epoch: [11][ 1900/12168]    Overall Loss 0.012364    Objective Loss 0.000000    Distill Loss 0.012364                                        LR 0.000500    Time 1.012000    
+2023-12-02 11:19:38,456 - Epoch: [11][ 2000/12168]    Overall Loss 0.012364    Objective Loss 0.000000    Distill Loss 0.012364                                        LR 0.000500    Time 1.012625    
+2023-12-02 11:21:06,350 - Epoch: [11][ 2100/12168]    Overall Loss 0.012366    Objective Loss 0.000000    Distill Loss 0.012366                                        LR 0.000500    Time 1.006256    
+2023-12-02 11:22:28,446 - Epoch: [11][ 2200/12168]    Overall Loss 0.012364    Objective Loss 0.000000    Distill Loss 0.012364                                        LR 0.000500    Time 0.997829    
+2023-12-02 11:24:14,549 - Epoch: [11][ 2300/12168]    Overall Loss 0.012363    Objective Loss 0.000000    Distill Loss 0.012363                                        LR 0.000500    Time 1.000574    
+2023-12-02 11:25:47,645 - Epoch: [11][ 2400/12168]    Overall Loss 0.012361    Objective Loss 0.000000    Distill Loss 0.012361                                        LR 0.000500    Time 0.997671    
+2023-12-02 11:27:27,237 - Epoch: [11][ 2500/12168]    Overall Loss 0.012360    Objective Loss 0.000000    Distill Loss 0.012360                                        LR 0.000500    Time 0.997598    
+2023-12-02 11:29:02,640 - Epoch: [11][ 2600/12168]    Overall Loss 0.012356    Objective Loss 0.000000    Distill Loss 0.012356                                        LR 0.000500    Time 0.995920    
+2023-12-02 11:30:46,588 - Epoch: [11][ 2700/12168]    Overall Loss 0.012357    Objective Loss 0.000000    Distill Loss 0.012357                                        LR 0.000500    Time 0.997530    
+2023-12-02 11:32:22,199 - Epoch: [11][ 2800/12168]    Overall Loss 0.012357    Objective Loss 0.000000    Distill Loss 0.012357                                        LR 0.000500    Time 0.996048    
+2023-12-02 11:34:06,657 - Epoch: [11][ 2900/12168]    Overall Loss 0.012357    Objective Loss 0.000000    Distill Loss 0.012357                                        LR 0.000500    Time 0.997720    
+2023-12-02 11:35:41,072 - Epoch: [11][ 3000/12168]    Overall Loss 0.012357    Objective Loss 0.000000    Distill Loss 0.012357                                        LR 0.000500    Time 0.995931    
+2023-12-02 11:37:24,485 - Epoch: [11][ 3100/12168]    Overall Loss 0.012353    Objective Loss 0.000000    Distill Loss 0.012353                                        LR 0.000500    Time 0.997161    
+2023-12-02 11:39:11,697 - Epoch: [11][ 3200/12168]    Overall Loss 0.012351    Objective Loss 0.000000    Distill Loss 0.012351                                        LR 0.000500    Time 0.999501    
+2023-12-02 11:40:29,237 - Epoch: [11][ 3300/12168]    Overall Loss 0.012352    Objective Loss 0.000000    Distill Loss 0.012352                                        LR 0.000500    Time 0.992708    
+2023-12-02 11:42:24,776 - Epoch: [11][ 3400/12168]    Overall Loss 0.012354    Objective Loss 0.000000    Distill Loss 0.012354                                        LR 0.000500    Time 0.997491    
+2023-12-02 11:44:11,706 - Epoch: [11][ 3500/12168]    Overall Loss 0.012355    Objective Loss 0.000000    Distill Loss 0.012355                                        LR 0.000500    Time 0.999541    
+2023-12-02 11:45:52,818 - Epoch: [11][ 3600/12168]    Overall Loss 0.012355    Objective Loss 0.000000    Distill Loss 0.012355                                        LR 0.000500    Time 0.999861    
+2023-12-02 11:47:31,919 - Epoch: [11][ 3700/12168]    Overall Loss 0.012354    Objective Loss 0.000000    Distill Loss 0.012354                                        LR 0.000500    Time 0.999619    
+2023-12-02 11:49:10,225 - Epoch: [11][ 3800/12168]    Overall Loss 0.012355    Objective Loss 0.000000    Distill Loss 0.012355                                        LR 0.000500    Time 0.999182    
+2023-12-02 11:50:43,458 - Epoch: [11][ 3900/12168]    Overall Loss 0.012353    Objective Loss 0.000000    Distill Loss 0.012353                                        LR 0.000500    Time 0.997465    
+2023-12-02 11:52:17,329 - Epoch: [11][ 4000/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 0.995995    
+2023-12-02 11:53:56,191 - Epoch: [11][ 4100/12168]    Overall Loss 0.012351    Objective Loss 0.000000    Distill Loss 0.012351                                        LR 0.000500    Time 0.995813    
+2023-12-02 11:55:34,603 - Epoch: [11][ 4200/12168]    Overall Loss 0.012352    Objective Loss 0.000000    Distill Loss 0.012352                                        LR 0.000500    Time 0.995533    
+2023-12-02 11:57:14,948 - Epoch: [11][ 4300/12168]    Overall Loss 0.012351    Objective Loss 0.000000    Distill Loss 0.012351                                        LR 0.000500    Time 0.995715    
+2023-12-02 11:59:05,570 - Epoch: [11][ 4400/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 0.998225    
+2023-12-02 12:00:33,013 - Epoch: [11][ 4500/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 0.995472    
+2023-12-02 12:02:12,903 - Epoch: [11][ 4600/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 0.995545    
+2023-12-02 12:03:56,109 - Epoch: [11][ 4700/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 0.996320    
+2023-12-02 12:05:34,771 - Epoch: [11][ 4800/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 0.996117    
+2023-12-02 12:07:18,778 - Epoch: [11][ 4900/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 0.997013    
+2023-12-02 12:09:13,532 - Epoch: [11][ 5000/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 1.000022    
+2023-12-02 12:10:45,584 - Epoch: [11][ 5100/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 0.998462    
+2023-12-02 12:12:33,874 - Epoch: [11][ 5200/12168]    Overall Loss 0.012351    Objective Loss 0.000000    Distill Loss 0.012351                                        LR 0.000500    Time 1.000084    
+2023-12-02 12:14:16,514 - Epoch: [11][ 5300/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 1.000579    
+2023-12-02 12:15:51,009 - Epoch: [11][ 5400/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 0.999548    
+2023-12-02 12:17:30,647 - Epoch: [11][ 5500/12168]    Overall Loss 0.012350    Objective Loss 0.000000    Distill Loss 0.012350                                        LR 0.000500    Time 0.999489    
+2023-12-02 12:19:10,160 - Epoch: [11][ 5600/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 0.999410    
+2023-12-02 12:20:54,009 - Epoch: [11][ 5700/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.000094    
+2023-12-02 12:22:40,507 - Epoch: [11][ 5800/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 1.001211    
+2023-12-02 12:24:23,283 - Epoch: [11][ 5900/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.001660    
+2023-12-02 12:26:04,616 - Epoch: [11][ 6000/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.001853    
+2023-12-02 12:27:51,331 - Epoch: [11][ 6100/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 1.002923    
+2023-12-02 12:29:33,555 - Epoch: [11][ 6200/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.003233    
+2023-12-02 12:31:07,175 - Epoch: [11][ 6300/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.002168    
+2023-12-02 12:33:04,781 - Epoch: [11][ 6400/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.004884    
+2023-12-02 12:34:46,072 - Epoch: [11][ 6500/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.005006    
+2023-12-02 12:36:18,600 - Epoch: [11][ 6600/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 1.003797    
+2023-12-02 12:37:56,266 - Epoch: [11][ 6700/12168]    Overall Loss 0.012348    Objective Loss 0.000000    Distill Loss 0.012348                                        LR 0.000500    Time 1.003391    
+2023-12-02 12:39:30,347 - Epoch: [11][ 6800/12168]    Overall Loss 0.012349    Objective Loss 0.000000    Distill Loss 0.012349                                        LR 0.000500    Time 1.002470    
+2023-12-02 12:41:04,350 - Epoch: [11][ 6900/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.001564    
+2023-12-02 12:42:56,060 - Epoch: [11][ 7000/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.003213    
+2023-12-02 12:44:33,636 - Epoch: [11][ 7100/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.002826    
+2023-12-02 12:46:21,829 - Epoch: [11][ 7200/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.003923    
+2023-12-02 12:48:09,473 - Epoch: [11][ 7300/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.004916    
+2023-12-02 12:50:00,940 - Epoch: [11][ 7400/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.006398    
+2023-12-02 12:51:53,810 - Epoch: [11][ 7500/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.008028    
+2023-12-02 12:53:34,636 - Epoch: [11][ 7600/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.008030    
+2023-12-02 12:55:16,661 - Epoch: [11][ 7700/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.008188    
+2023-12-02 12:56:56,090 - Epoch: [11][ 7800/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.008009    
+2023-12-02 12:58:47,814 - Epoch: [11][ 7900/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.009390    
+2023-12-02 13:00:28,168 - Epoch: [11][ 8000/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.009316    
+2023-12-02 13:02:06,931 - Epoch: [11][ 8100/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.009048    
+2023-12-02 13:03:46,344 - Epoch: [11][ 8200/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.008865    
+2023-12-02 13:05:31,229 - Epoch: [11][ 8300/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.009346    
+2023-12-02 13:07:30,042 - Epoch: [11][ 8400/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.011473    
+2023-12-02 13:09:19,967 - Epoch: [11][ 8500/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.012505    
+2023-12-02 13:11:00,582 - Epoch: [11][ 8600/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.012430    
+2023-12-02 13:12:54,545 - Epoch: [11][ 8700/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.013892    
+2023-12-02 13:14:23,993 - Epoch: [11][ 8800/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.012534    
+2023-12-02 13:16:16,672 - Epoch: [11][ 8900/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.013817    
+2023-12-02 13:17:54,296 - Epoch: [11][ 9000/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.013399    
+2023-12-02 13:19:41,368 - Epoch: [11][ 9100/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.014028    
+2023-12-02 13:21:31,605 - Epoch: [11][ 9200/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.014987    
+2023-12-02 13:23:05,563 - Epoch: [11][ 9300/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.014176    
+2023-12-02 13:24:53,417 - Epoch: [11][ 9400/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.014860    
+2023-12-02 13:26:34,973 - Epoch: [11][ 9500/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.014866    
+2023-12-02 13:28:14,525 - Epoch: [11][ 9600/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.014664    
+2023-12-02 13:30:07,364 - Epoch: [11][ 9700/12168]    Overall Loss 0.012347    Objective Loss 0.000000    Distill Loss 0.012347                                        LR 0.000500    Time 1.015836    
+2023-12-02 13:31:52,806 - Epoch: [11][ 9800/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.016229    
+2023-12-02 13:33:12,601 - Epoch: [11][ 9900/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.014023    
+2023-12-02 13:34:56,401 - Epoch: [11][10000/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.014262    
+2023-12-02 13:36:40,845 - Epoch: [11][10100/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.014560    
+2023-12-02 13:38:13,636 - Epoch: [11][10200/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.013710    
+2023-12-02 13:39:45,157 - Epoch: [11][10300/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.012753    
+2023-12-02 13:41:30,643 - Epoch: [11][10400/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.013157    
+2023-12-02 13:43:10,765 - Epoch: [11][10500/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.013043    
+2023-12-02 13:44:46,847 - Epoch: [11][10600/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.012550    
+2023-12-02 13:46:26,517 - Epoch: [11][10700/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.012401    
+2023-12-02 13:48:26,779 - Epoch: [11][10800/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.014161    
+2023-12-02 13:50:18,292 - Epoch: [11][10900/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.015087    
+2023-12-02 13:51:52,594 - Epoch: [11][11000/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.014431    
+2023-12-02 13:53:46,049 - Epoch: [11][11100/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.015513    
+2023-12-02 13:55:35,173 - Epoch: [11][11200/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.016188    
+2023-12-02 13:57:09,896 - Epoch: [11][11300/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015577    
+2023-12-02 13:58:49,683 - Epoch: [11][11400/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015422    
+2023-12-02 14:00:25,902 - Epoch: [11][11500/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.014958    
+2023-12-02 14:02:18,470 - Epoch: [11][11600/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015912    
+2023-12-02 14:03:59,379 - Epoch: [11][11700/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015853    
+2023-12-02 14:05:33,095 - Epoch: [11][11800/12168]    Overall Loss 0.012346    Objective Loss 0.000000    Distill Loss 0.012346                                        LR 0.000500    Time 1.015185    
+2023-12-02 14:07:17,318 - Epoch: [11][11900/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015412    
+2023-12-02 14:09:06,659 - Epoch: [11][12000/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.016062    
+2023-12-02 14:10:38,112 - Epoch: [11][12100/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015222    
+2023-12-02 14:11:46,046 - Epoch: [11][12168/12168]    Overall Loss 0.012345    Objective Loss 0.000000    Distill Loss 0.012345                                        LR 0.000500    Time 1.015131    
+2023-12-02 14:11:46,793 - --- validate (epoch=11)-----------
+2023-12-02 14:11:46,793 - 167951 samples (256 per mini-batch)
+2023-12-02 14:12:40,544 - Epoch: [11][  100/  657]    Loss 0.000000    Overall Loss 0.013025    
+2023-12-02 14:13:28,435 - Epoch: [11][  200/  657]    Loss 0.000000    Overall Loss 0.013027    
+2023-12-02 14:14:16,411 - Epoch: [11][  300/  657]    Loss 0.000000    Overall Loss 0.013028    
+2023-12-02 14:15:04,324 - Epoch: [11][  400/  657]    Loss 0.000000    Overall Loss 0.013029    
+2023-12-02 14:15:52,288 - Epoch: [11][  500/  657]    Loss 0.000000    Overall Loss 0.013025    
+2023-12-02 14:16:40,288 - Epoch: [11][  600/  657]    Loss 0.000000    Overall Loss 0.013028    
+2023-12-02 14:17:07,207 - Epoch: [11][  657/  657]    Loss 0.000000    Overall Loss 0.013024    
+2023-12-02 14:17:07,619 - ==> Overall Loss: 0.013
+
+2023-12-02 14:17:07,623 - ==> Best [Overall Loss: 0.013024 on epoch: 11]
+2023-12-02 14:17:07,623 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 14:17:07,654 - 
+
+2023-12-02 14:17:07,654 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 14:18:54,827 - Epoch: [12][  100/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.071652    
+2023-12-02 14:20:32,182 - Epoch: [12][  200/12168]    Overall Loss 0.012271    Objective Loss 0.000000    Distill Loss 0.012271                                        LR 0.000500    Time 1.022565    
+2023-12-02 14:22:01,820 - Epoch: [12][  300/12168]    Overall Loss 0.012289    Objective Loss 0.000000    Distill Loss 0.012289                                        LR 0.000500    Time 0.980479    
+2023-12-02 14:23:41,578 - Epoch: [12][  400/12168]    Overall Loss 0.012275    Objective Loss 0.000000    Distill Loss 0.012275                                        LR 0.000500    Time 0.984736    
+2023-12-02 14:25:23,264 - Epoch: [12][  500/12168]    Overall Loss 0.012278    Objective Loss 0.000000    Distill Loss 0.012278                                        LR 0.000500    Time 0.991147    
+2023-12-02 14:26:52,897 - Epoch: [12][  600/12168]    Overall Loss 0.012282    Objective Loss 0.000000    Distill Loss 0.012282                                        LR 0.000500    Time 0.975334    
+2023-12-02 14:28:03,905 - Epoch: [12][  700/12168]    Overall Loss 0.012285    Objective Loss 0.000000    Distill Loss 0.012285                                        LR 0.000500    Time 0.937433    
+2023-12-02 14:29:10,532 - Epoch: [12][  800/12168]    Overall Loss 0.012288    Objective Loss 0.000000    Distill Loss 0.012288                                        LR 0.000500    Time 0.903532    
+2023-12-02 14:30:17,016 - Epoch: [12][  900/12168]    Overall Loss 0.012291    Objective Loss 0.000000    Distill Loss 0.012291                                        LR 0.000500    Time 0.877004    
+2023-12-02 14:31:26,641 - Epoch: [12][ 1000/12168]    Overall Loss 0.012299    Objective Loss 0.000000    Distill Loss 0.012299                                        LR 0.000500    Time 0.858924    
+2023-12-02 14:32:32,992 - Epoch: [12][ 1100/12168]    Overall Loss 0.012302    Objective Loss 0.000000    Distill Loss 0.012302                                        LR 0.000500    Time 0.841155    
+2023-12-02 14:34:08,796 - Epoch: [12][ 1200/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.850889    
+2023-12-02 14:35:46,063 - Epoch: [12][ 1300/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.860252    
+2023-12-02 14:37:21,468 - Epoch: [12][ 1400/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.866946    
+2023-12-02 14:39:04,289 - Epoch: [12][ 1500/12168]    Overall Loss 0.012309    Objective Loss 0.000000    Distill Loss 0.012309                                        LR 0.000500    Time 0.877692    
+2023-12-02 14:40:40,897 - Epoch: [12][ 1600/12168]    Overall Loss 0.012312    Objective Loss 0.000000    Distill Loss 0.012312                                        LR 0.000500    Time 0.883212    
+2023-12-02 14:42:13,427 - Epoch: [12][ 1700/12168]    Overall Loss 0.012313    Objective Loss 0.000000    Distill Loss 0.012313                                        LR 0.000500    Time 0.885683    
+2023-12-02 14:43:52,671 - Epoch: [12][ 1800/12168]    Overall Loss 0.012314    Objective Loss 0.000000    Distill Loss 0.012314                                        LR 0.000500    Time 0.891610    
+2023-12-02 14:45:35,287 - Epoch: [12][ 1900/12168]    Overall Loss 0.012315    Objective Loss 0.000000    Distill Loss 0.012315                                        LR 0.000500    Time 0.898688    
+2023-12-02 14:47:12,374 - Epoch: [12][ 2000/12168]    Overall Loss 0.012315    Objective Loss 0.000000    Distill Loss 0.012315                                        LR 0.000500    Time 0.902293    
+2023-12-02 14:49:24,601 - Epoch: [12][ 2100/12168]    Overall Loss 0.012316    Objective Loss 0.000000    Distill Loss 0.012316                                        LR 0.000500    Time 0.922289    
+2023-12-02 14:51:00,398 - Epoch: [12][ 2200/12168]    Overall Loss 0.012316    Objective Loss 0.000000    Distill Loss 0.012316                                        LR 0.000500    Time 0.923907    
+2023-12-02 14:52:50,444 - Epoch: [12][ 2300/12168]    Overall Loss 0.012313    Objective Loss 0.000000    Distill Loss 0.012313                                        LR 0.000500    Time 0.931580    
+2023-12-02 14:54:29,890 - Epoch: [12][ 2400/12168]    Overall Loss 0.012312    Objective Loss 0.000000    Distill Loss 0.012312                                        LR 0.000500    Time 0.934197    
+2023-12-02 14:56:20,532 - Epoch: [12][ 2500/12168]    Overall Loss 0.012310    Objective Loss 0.000000    Distill Loss 0.012310                                        LR 0.000500    Time 0.941083    
+2023-12-02 14:58:08,990 - Epoch: [12][ 2600/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.946599    
+2023-12-02 14:59:53,089 - Epoch: [12][ 2700/12168]    Overall Loss 0.012308    Objective Loss 0.000000    Distill Loss 0.012308                                        LR 0.000500    Time 0.950092    
+2023-12-02 15:01:33,988 - Epoch: [12][ 2800/12168]    Overall Loss 0.012309    Objective Loss 0.000000    Distill Loss 0.012309                                        LR 0.000500    Time 0.952193    
+2023-12-02 15:03:27,958 - Epoch: [12][ 2900/12168]    Overall Loss 0.012311    Objective Loss 0.000000    Distill Loss 0.012311                                        LR 0.000500    Time 0.958656    
+2023-12-02 15:05:03,305 - Epoch: [12][ 3000/12168]    Overall Loss 0.012310    Objective Loss 0.000000    Distill Loss 0.012310                                        LR 0.000500    Time 0.958481    
+2023-12-02 15:06:42,000 - Epoch: [12][ 3100/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.959397    
+2023-12-02 15:08:15,821 - Epoch: [12][ 3200/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.958733    
+2023-12-02 15:10:08,534 - Epoch: [12][ 3300/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.963833    
+2023-12-02 15:11:43,484 - Epoch: [12][ 3400/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.963409    
+2023-12-02 15:13:35,414 - Epoch: [12][ 3500/12168]    Overall Loss 0.012308    Objective Loss 0.000000    Distill Loss 0.012308                                        LR 0.000500    Time 0.967861    
+2023-12-02 15:15:08,785 - Epoch: [12][ 3600/12168]    Overall Loss 0.012309    Objective Loss 0.000000    Distill Loss 0.012309                                        LR 0.000500    Time 0.966911    
+2023-12-02 15:16:51,237 - Epoch: [12][ 3700/12168]    Overall Loss 0.012308    Objective Loss 0.000000    Distill Loss 0.012308                                        LR 0.000500    Time 0.968465    
+2023-12-02 15:18:17,723 - Epoch: [12][ 3800/12168]    Overall Loss 0.012310    Objective Loss 0.000000    Distill Loss 0.012310                                        LR 0.000500    Time 0.965737    
+2023-12-02 15:19:50,762 - Epoch: [12][ 3900/12168]    Overall Loss 0.012309    Objective Loss 0.000000    Distill Loss 0.012309                                        LR 0.000500    Time 0.964828    
+2023-12-02 15:21:40,872 - Epoch: [12][ 4000/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.968233    
+2023-12-02 15:23:09,667 - Epoch: [12][ 4100/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.966274    
+2023-12-02 15:24:59,563 - Epoch: [12][ 4200/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.969431    
+2023-12-02 15:26:47,922 - Epoch: [12][ 4300/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.972084    
+2023-12-02 15:28:27,273 - Epoch: [12][ 4400/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.972570    
+2023-12-02 15:30:09,851 - Epoch: [12][ 4500/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.973750    
+2023-12-02 15:32:04,864 - Epoch: [12][ 4600/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.977583    
+2023-12-02 15:34:00,929 - Epoch: [12][ 4700/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.981476    
+2023-12-02 15:35:48,229 - Epoch: [12][ 4800/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.983382    
+2023-12-02 15:37:31,732 - Epoch: [12][ 4900/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.984434    
+2023-12-02 15:39:01,814 - Epoch: [12][ 5000/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.982761    
+2023-12-02 15:40:51,456 - Epoch: [12][ 5100/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.984988    
+2023-12-02 15:42:40,550 - Epoch: [12][ 5200/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.987024    
+2023-12-02 15:44:22,435 - Epoch: [12][ 5300/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.987623    
+2023-12-02 15:45:57,457 - Epoch: [12][ 5400/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.986929    
+2023-12-02 15:47:51,802 - Epoch: [12][ 5500/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.989774    
+2023-12-02 15:49:47,425 - Epoch: [12][ 5600/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.992745    
+2023-12-02 15:51:23,522 - Epoch: [12][ 5700/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.992186    
+2023-12-02 15:52:49,916 - Epoch: [12][ 5800/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.989974    
+2023-12-02 15:54:27,010 - Epoch: [12][ 5900/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.989650    
+2023-12-02 15:55:59,382 - Epoch: [12][ 6000/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.988550    
+2023-12-02 15:57:33,975 - Epoch: [12][ 6100/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.987850    
+2023-12-02 15:59:13,215 - Epoch: [12][ 6200/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.987922    
+2023-12-02 16:00:49,772 - Epoch: [12][ 6300/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.987566    
+2023-12-02 16:02:26,024 - Epoch: [12][ 6400/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.987174    
+2023-12-02 16:04:19,396 - Epoch: [12][ 6500/12168]    Overall Loss 0.012307    Objective Loss 0.000000    Distill Loss 0.012307                                        LR 0.000500    Time 0.989427    
+2023-12-02 16:06:05,461 - Epoch: [12][ 6600/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.990505    
+2023-12-02 16:07:45,311 - Epoch: [12][ 6700/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.990624    
+2023-12-02 16:09:32,985 - Epoch: [12][ 6800/12168]    Overall Loss 0.012306    Objective Loss 0.000000    Distill Loss 0.012306                                        LR 0.000500    Time 0.991889    
+2023-12-02 16:11:00,392 - Epoch: [12][ 6900/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.990180    
+2023-12-02 16:12:50,616 - Epoch: [12][ 7000/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.991780    
+2023-12-02 16:14:28,828 - Epoch: [12][ 7100/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.991643    
+2023-12-02 16:16:00,519 - Epoch: [12][ 7200/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.990604    
+2023-12-02 16:17:37,414 - Epoch: [12][ 7300/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.990307    
+2023-12-02 16:19:22,679 - Epoch: [12][ 7400/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 0.991148    
+2023-12-02 16:20:57,414 - Epoch: [12][ 7500/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.990563    
+2023-12-02 16:22:43,986 - Epoch: [12][ 7600/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.991551    
+2023-12-02 16:24:32,056 - Epoch: [12][ 7700/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.992708    
+2023-12-02 16:26:07,139 - Epoch: [12][ 7800/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.992170    
+2023-12-02 16:27:58,109 - Epoch: [12][ 7900/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.993657    
+2023-12-02 16:29:43,624 - Epoch: [12][ 8000/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.994425    
+2023-12-02 16:31:15,700 - Epoch: [12][ 8100/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.993514    
+2023-12-02 16:32:58,535 - Epoch: [12][ 8200/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.993938    
+2023-12-02 16:34:44,109 - Epoch: [12][ 8300/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 0.994682    
+2023-12-02 16:36:47,338 - Epoch: [12][ 8400/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.997510    
+2023-12-02 16:38:32,122 - Epoch: [12][ 8500/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 0.998101    
+2023-12-02 16:40:40,875 - Epoch: [12][ 8600/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.001466    
+2023-12-02 16:42:28,225 - Epoch: [12][ 8700/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.002293    
+2023-12-02 16:44:09,125 - Epoch: [12][ 8800/12168]    Overall Loss 0.012302    Objective Loss 0.000000    Distill Loss 0.012302                                        LR 0.000500    Time 1.002368    
+2023-12-02 16:46:00,661 - Epoch: [12][ 8900/12168]    Overall Loss 0.012302    Objective Loss 0.000000    Distill Loss 0.012302                                        LR 0.000500    Time 1.003637    
+2023-12-02 16:47:28,313 - Epoch: [12][ 9000/12168]    Overall Loss 0.012301    Objective Loss 0.000000    Distill Loss 0.012301                                        LR 0.000500    Time 1.002224    
+2023-12-02 16:49:05,663 - Epoch: [12][ 9100/12168]    Overall Loss 0.012302    Objective Loss 0.000000    Distill Loss 0.012302                                        LR 0.000500    Time 1.001908    
+2023-12-02 16:50:55,212 - Epoch: [12][ 9200/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.002924    
+2023-12-02 16:52:28,412 - Epoch: [12][ 9300/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.002161    
+2023-12-02 16:54:14,683 - Epoch: [12][ 9400/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.002804    
+2023-12-02 16:55:57,389 - Epoch: [12][ 9500/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.003059    
+2023-12-02 16:57:39,204 - Epoch: [12][ 9600/12168]    Overall Loss 0.012303    Objective Loss 0.000000    Distill Loss 0.012303                                        LR 0.000500    Time 1.003215    
+2023-12-02 16:59:29,291 - Epoch: [12][ 9700/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.004221    
+2023-12-02 17:01:20,719 - Epoch: [12][ 9800/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.005343    
+2023-12-02 17:03:03,172 - Epoch: [12][ 9900/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.005536    
+2023-12-02 17:04:41,374 - Epoch: [12][10000/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.005301    
+2023-12-02 17:06:29,608 - Epoch: [12][10100/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.006063    
+2023-12-02 17:08:11,150 - Epoch: [12][10200/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.006154    
+2023-12-02 17:09:54,746 - Epoch: [12][10300/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.006442    
+2023-12-02 17:11:46,832 - Epoch: [12][10400/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.007542    
+2023-12-02 17:13:24,676 - Epoch: [12][10500/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.007264    
+2023-12-02 17:15:15,423 - Epoch: [12][10600/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.008208    
+2023-12-02 17:17:08,601 - Epoch: [12][10700/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.009363    
+2023-12-02 17:18:48,653 - Epoch: [12][10800/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.009280    
+2023-12-02 17:20:27,780 - Epoch: [12][10900/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.009114    
+2023-12-02 17:22:05,395 - Epoch: [12][11000/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.008814    
+2023-12-02 17:23:57,992 - Epoch: [12][11100/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.009869    
+2023-12-02 17:25:40,853 - Epoch: [12][11200/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.010036    
+2023-12-02 17:27:19,294 - Epoch: [12][11300/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.009808    
+2023-12-02 17:29:00,417 - Epoch: [12][11400/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.009820    
+2023-12-02 17:30:38,220 - Epoch: [12][11500/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.009543    
+2023-12-02 17:32:34,045 - Epoch: [12][11600/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.010824    
+2023-12-02 17:34:17,675 - Epoch: [12][11700/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.011041    
+2023-12-02 17:36:05,160 - Epoch: [12][11800/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.011582    
+2023-12-02 17:37:51,833 - Epoch: [12][11900/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.012044    
+2023-12-02 17:39:49,935 - Epoch: [12][12000/12168]    Overall Loss 0.012304    Objective Loss 0.000000    Distill Loss 0.012304                                        LR 0.000500    Time 1.013452    
+2023-12-02 17:41:39,397 - Epoch: [12][12100/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.014122    
+2023-12-02 17:42:45,769 - Epoch: [12][12168/12168]    Overall Loss 0.012305    Objective Loss 0.000000    Distill Loss 0.012305                                        LR 0.000500    Time 1.013909    
+2023-12-02 17:42:46,466 - --- validate (epoch=12)-----------
+2023-12-02 17:42:46,467 - 167951 samples (256 per mini-batch)
+2023-12-02 17:43:39,709 - Epoch: [12][  100/  657]    Loss 0.000000    Overall Loss 0.012917    
+2023-12-02 17:44:27,613 - Epoch: [12][  200/  657]    Loss 0.000000    Overall Loss 0.012941    
+2023-12-02 17:45:15,559 - Epoch: [12][  300/  657]    Loss 0.000000    Overall Loss 0.012948    
+2023-12-02 17:46:03,500 - Epoch: [12][  400/  657]    Loss 0.000000    Overall Loss 0.012959    
+2023-12-02 17:46:51,498 - Epoch: [12][  500/  657]    Loss 0.000000    Overall Loss 0.012956    
+2023-12-02 17:47:39,448 - Epoch: [12][  600/  657]    Loss 0.000000    Overall Loss 0.012955    
+2023-12-02 17:48:06,385 - Epoch: [12][  657/  657]    Loss 0.000000    Overall Loss 0.012955    
+2023-12-02 17:48:06,700 - ==> Overall Loss: 0.013
+
+2023-12-02 17:48:06,703 - ==> Best [Overall Loss: 0.012955 on epoch: 12]
+2023-12-02 17:48:06,704 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 17:48:06,730 - 
+
+2023-12-02 17:48:06,730 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 17:49:44,978 - Epoch: [13][  100/12168]    Overall Loss 0.012212    Objective Loss 0.000000    Distill Loss 0.012212                                        LR 0.000500    Time 0.982400    
+2023-12-02 17:51:27,715 - Epoch: [13][  200/12168]    Overall Loss 0.012218    Objective Loss 0.000000    Distill Loss 0.012218                                        LR 0.000500    Time 1.004846    
+2023-12-02 17:52:53,744 - Epoch: [13][  300/12168]    Overall Loss 0.012250    Objective Loss 0.000000    Distill Loss 0.012250                                        LR 0.000500    Time 0.956637    
+2023-12-02 17:54:29,033 - Epoch: [13][  400/12168]    Overall Loss 0.012250    Objective Loss 0.000000    Distill Loss 0.012250                                        LR 0.000500    Time 0.955682    
+2023-12-02 17:56:07,921 - Epoch: [13][  500/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.962307    
+2023-12-02 17:57:35,501 - Epoch: [13][  600/12168]    Overall Loss 0.012243    Objective Loss 0.000000    Distill Loss 0.012243                                        LR 0.000500    Time 0.947878    
+2023-12-02 17:59:07,796 - Epoch: [13][  700/12168]    Overall Loss 0.012251    Objective Loss 0.000000    Distill Loss 0.012251                                        LR 0.000500    Time 0.944305    
+2023-12-02 18:00:48,606 - Epoch: [13][  800/12168]    Overall Loss 0.012250    Objective Loss 0.000000    Distill Loss 0.012250                                        LR 0.000500    Time 0.952271    
+2023-12-02 18:02:22,671 - Epoch: [13][  900/12168]    Overall Loss 0.012263    Objective Loss 0.000000    Distill Loss 0.012263                                        LR 0.000500    Time 0.950972    
+2023-12-02 18:04:04,553 - Epoch: [13][ 1000/12168]    Overall Loss 0.012271    Objective Loss 0.000000    Distill Loss 0.012271                                        LR 0.000500    Time 0.957750    
+2023-12-02 18:05:44,795 - Epoch: [13][ 1100/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.961804    
+2023-12-02 18:07:11,646 - Epoch: [13][ 1200/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.954023    
+2023-12-02 18:08:54,902 - Epoch: [13][ 1300/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.960059    
+2023-12-02 18:10:34,741 - Epoch: [13][ 1400/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.962791    
+2023-12-02 18:12:13,738 - Epoch: [13][ 1500/12168]    Overall Loss 0.012273    Objective Loss 0.000000    Distill Loss 0.012273                                        LR 0.000500    Time 0.964599    
+2023-12-02 18:13:58,753 - Epoch: [13][ 1600/12168]    Overall Loss 0.012272    Objective Loss 0.000000    Distill Loss 0.012272                                        LR 0.000500    Time 0.969941    
+2023-12-02 18:15:28,131 - Epoch: [13][ 1700/12168]    Overall Loss 0.012273    Objective Loss 0.000000    Distill Loss 0.012273                                        LR 0.000500    Time 0.965457    
+2023-12-02 18:17:09,768 - Epoch: [13][ 1800/12168]    Overall Loss 0.012271    Objective Loss 0.000000    Distill Loss 0.012271                                        LR 0.000500    Time 0.968282    
+2023-12-02 18:18:39,673 - Epoch: [13][ 1900/12168]    Overall Loss 0.012272    Objective Loss 0.000000    Distill Loss 0.012272                                        LR 0.000500    Time 0.964634    
+2023-12-02 18:20:07,497 - Epoch: [13][ 2000/12168]    Overall Loss 0.012275    Objective Loss 0.000000    Distill Loss 0.012275                                        LR 0.000500    Time 0.960311    
+2023-12-02 18:21:32,059 - Epoch: [13][ 2100/12168]    Overall Loss 0.012276    Objective Loss 0.000000    Distill Loss 0.012276                                        LR 0.000500    Time 0.954846    
+2023-12-02 18:23:20,963 - Epoch: [13][ 2200/12168]    Overall Loss 0.012278    Objective Loss 0.000000    Distill Loss 0.012278                                        LR 0.000500    Time 0.960942    
+2023-12-02 18:24:48,360 - Epoch: [13][ 2300/12168]    Overall Loss 0.012274    Objective Loss 0.000000    Distill Loss 0.012274                                        LR 0.000500    Time 0.957158    
+2023-12-02 18:26:24,600 - Epoch: [13][ 2400/12168]    Overall Loss 0.012272    Objective Loss 0.000000    Distill Loss 0.012272                                        LR 0.000500    Time 0.957373    
+2023-12-02 18:27:49,715 - Epoch: [13][ 2500/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.953121    
+2023-12-02 18:28:57,688 - Epoch: [13][ 2600/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.942605    
+2023-12-02 18:30:05,405 - Epoch: [13][ 2700/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.932772    
+2023-12-02 18:31:14,370 - Epoch: [13][ 2800/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.924087    
+2023-12-02 18:32:21,987 - Epoch: [13][ 2900/12168]    Overall Loss 0.012272    Objective Loss 0.000000    Distill Loss 0.012272                                        LR 0.000500    Time 0.915537    
+2023-12-02 18:33:24,601 - Epoch: [13][ 3000/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.905888    
+2023-12-02 18:35:02,981 - Epoch: [13][ 3100/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 0.908399    
+2023-12-02 18:36:44,765 - Epoch: [13][ 3200/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.911817    
+2023-12-02 18:38:35,085 - Epoch: [13][ 3300/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.917614    
+2023-12-02 18:40:15,347 - Epoch: [13][ 3400/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.920112    
+2023-12-02 18:42:16,174 - Epoch: [13][ 3500/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 0.928343    
+2023-12-02 18:44:08,895 - Epoch: [13][ 3600/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.933865    
+2023-12-02 18:45:43,983 - Epoch: [13][ 3700/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 0.934323    
+2023-12-02 18:47:26,023 - Epoch: [13][ 3800/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.936586    
+2023-12-02 18:49:06,334 - Epoch: [13][ 3900/12168]    Overall Loss 0.012270    Objective Loss 0.000000    Distill Loss 0.012270                                        LR 0.000500    Time 0.938290    
+2023-12-02 18:50:48,476 - Epoch: [13][ 4000/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 0.940367    
+2023-12-02 18:52:33,441 - Epoch: [13][ 4100/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.943030    
+2023-12-02 18:54:19,769 - Epoch: [13][ 4200/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.945892    
+2023-12-02 18:55:55,906 - Epoch: [13][ 4300/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.946250    
+2023-12-02 18:57:20,702 - Epoch: [13][ 4400/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.944014    
+2023-12-02 18:59:10,917 - Epoch: [13][ 4500/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.947527    
+2023-12-02 19:00:51,513 - Epoch: [13][ 4600/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.948795    
+2023-12-02 19:02:30,687 - Epoch: [13][ 4700/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.949707    
+2023-12-02 19:04:13,645 - Epoch: [13][ 4800/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.951370    
+2023-12-02 19:06:03,682 - Epoch: [13][ 4900/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.954409    
+2023-12-02 19:07:58,549 - Epoch: [13][ 5000/12168]    Overall Loss 0.012263    Objective Loss 0.000000    Distill Loss 0.012263                                        LR 0.000500    Time 0.958293    
+2023-12-02 19:09:47,140 - Epoch: [13][ 5100/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.960794    
+2023-12-02 19:11:29,664 - Epoch: [13][ 5200/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.962032    
+2023-12-02 19:13:04,683 - Epoch: [13][ 5300/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.961807    
+2023-12-02 19:14:40,927 - Epoch: [13][ 5400/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.961817    
+2023-12-02 19:16:29,147 - Epoch: [13][ 5500/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.964005    
+2023-12-02 19:18:07,086 - Epoch: [13][ 5600/12168]    Overall Loss 0.012263    Objective Loss 0.000000    Distill Loss 0.012263                                        LR 0.000500    Time 0.964278    
+2023-12-02 19:20:04,142 - Epoch: [13][ 5700/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.967896    
+2023-12-02 19:21:50,139 - Epoch: [13][ 5800/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.969482    
+2023-12-02 19:23:36,585 - Epoch: [13][ 5900/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.971090    
+2023-12-02 19:25:18,185 - Epoch: [13][ 6000/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.971838    
+2023-12-02 19:27:01,142 - Epoch: [13][ 6100/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.972783    
+2023-12-02 19:28:36,842 - Epoch: [13][ 6200/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.972527    
+2023-12-02 19:30:34,464 - Epoch: [13][ 6300/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.975759    
+2023-12-02 19:32:03,156 - Epoch: [13][ 6400/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.974370    
+2023-12-02 19:33:45,154 - Epoch: [13][ 6500/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.975070    
+2023-12-02 19:35:22,105 - Epoch: [13][ 6600/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.974985    
+2023-12-02 19:37:05,142 - Epoch: [13][ 6700/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.975811    
+2023-12-02 19:38:46,750 - Epoch: [13][ 6800/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.976402    
+2023-12-02 19:40:25,572 - Epoch: [13][ 6900/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.976572    
+2023-12-02 19:41:54,430 - Epoch: [13][ 7000/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.975314    
+2023-12-02 19:43:42,211 - Epoch: [13][ 7100/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.976757    
+2023-12-02 19:45:32,403 - Epoch: [13][ 7200/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.978494    
+2023-12-02 19:47:18,040 - Epoch: [13][ 7300/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.979560    
+2023-12-02 19:48:48,914 - Epoch: [13][ 7400/12168]    Overall Loss 0.012263    Objective Loss 0.000000    Distill Loss 0.012263                                        LR 0.000500    Time 0.978602    
+2023-12-02 19:50:44,107 - Epoch: [13][ 7500/12168]    Overall Loss 0.012263    Objective Loss 0.000000    Distill Loss 0.012263                                        LR 0.000500    Time 0.980912    
+2023-12-02 19:52:25,745 - Epoch: [13][ 7600/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.981378    
+2023-12-02 19:54:12,274 - Epoch: [13][ 7700/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.982466    
+2023-12-02 19:56:03,093 - Epoch: [13][ 7800/12168]    Overall Loss 0.012264    Objective Loss 0.000000    Distill Loss 0.012264                                        LR 0.000500    Time 0.984077    
+2023-12-02 19:57:45,359 - Epoch: [13][ 7900/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.984565    
+2023-12-02 19:59:27,561 - Epoch: [13][ 8000/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.985032    
+2023-12-02 20:01:05,728 - Epoch: [13][ 8100/12168]    Overall Loss 0.012265    Objective Loss 0.000000    Distill Loss 0.012265                                        LR 0.000500    Time 0.984990    
+2023-12-02 20:02:39,034 - Epoch: [13][ 8200/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.984356    
+2023-12-02 20:04:30,190 - Epoch: [13][ 8300/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.985887    
+2023-12-02 20:06:14,264 - Epoch: [13][ 8400/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.986540    
+2023-12-02 20:08:01,647 - Epoch: [13][ 8500/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.987566    
+2023-12-02 20:09:42,378 - Epoch: [13][ 8600/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.987794    
+2023-12-02 20:11:31,250 - Epoch: [13][ 8700/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.988953    
+2023-12-02 20:13:00,318 - Epoch: [13][ 8800/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.987836    
+2023-12-02 20:14:56,271 - Epoch: [13][ 8900/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.989764    
+2023-12-02 20:16:40,322 - Epoch: [13][ 9000/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.990327    
+2023-12-02 20:18:25,561 - Epoch: [13][ 9100/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.991009    
+2023-12-02 20:20:08,594 - Epoch: [13][ 9200/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.991435    
+2023-12-02 20:21:56,274 - Epoch: [13][ 9300/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.992352    
+2023-12-02 20:23:41,546 - Epoch: [13][ 9400/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.992994    
+2023-12-02 20:25:21,090 - Epoch: [13][ 9500/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.993019    
+2023-12-02 20:27:05,368 - Epoch: [13][ 9600/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.993536    
+2023-12-02 20:28:58,780 - Epoch: [13][ 9700/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.994985    
+2023-12-02 20:30:39,458 - Epoch: [13][ 9800/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.995105    
+2023-12-02 20:32:22,774 - Epoch: [13][ 9900/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.995488    
+2023-12-02 20:34:18,789 - Epoch: [13][10000/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.997134    
+2023-12-02 20:35:59,525 - Epoch: [13][10100/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.997235    
+2023-12-02 20:37:41,518 - Epoch: [13][10200/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.997456    
+2023-12-02 20:39:24,430 - Epoch: [13][10300/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.997763    
+2023-12-02 20:41:07,152 - Epoch: [13][10400/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.998046    
+2023-12-02 20:42:44,285 - Epoch: [13][10500/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.997791    
+2023-12-02 20:44:29,653 - Epoch: [13][10600/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.998317    
+2023-12-02 20:46:15,903 - Epoch: [13][10700/12168]    Overall Loss 0.012266    Objective Loss 0.000000    Distill Loss 0.012266                                        LR 0.000500    Time 0.998917    
+2023-12-02 20:48:04,618 - Epoch: [13][10800/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.999733    
+2023-12-02 20:49:36,661 - Epoch: [13][10900/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.999005    
+2023-12-02 20:51:21,287 - Epoch: [13][11000/12168]    Overall Loss 0.012267    Objective Loss 0.000000    Distill Loss 0.012267                                        LR 0.000500    Time 0.999434    
+2023-12-02 20:53:05,776 - Epoch: [13][11100/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.999842    
+2023-12-02 20:54:55,491 - Epoch: [13][11200/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 1.000711    
+2023-12-02 20:56:36,214 - Epoch: [13][11300/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 1.000768    
+2023-12-02 20:58:06,724 - Epoch: [13][11400/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 0.999928    
+2023-12-02 20:59:56,517 - Epoch: [13][11500/12168]    Overall Loss 0.012268    Objective Loss 0.000000    Distill Loss 0.012268                                        LR 0.000500    Time 1.000779    
+2023-12-02 21:01:41,219 - Epoch: [13][11600/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001177    
+2023-12-02 21:03:29,429 - Epoch: [13][11700/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001868    
+2023-12-02 21:05:04,340 - Epoch: [13][11800/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001421    
+2023-12-02 21:06:45,490 - Epoch: [13][11900/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001505    
+2023-12-02 21:08:27,327 - Epoch: [13][12000/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001645    
+2023-12-02 21:10:06,493 - Epoch: [13][12100/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001562    
+2023-12-02 21:11:10,917 - Epoch: [13][12168/12168]    Overall Loss 0.012269    Objective Loss 0.000000    Distill Loss 0.012269                                        LR 0.000500    Time 1.001259    
+2023-12-02 21:11:11,836 - --- validate (epoch=13)-----------
+2023-12-02 21:11:11,837 - 167951 samples (256 per mini-batch)
+2023-12-02 21:12:05,669 - Epoch: [13][  100/  657]    Loss 0.000000    Overall Loss 0.012973    
+2023-12-02 21:12:53,695 - Epoch: [13][  200/  657]    Loss 0.000000    Overall Loss 0.012960    
+2023-12-02 21:13:41,707 - Epoch: [13][  300/  657]    Loss 0.000000    Overall Loss 0.012935    
+2023-12-02 21:14:29,671 - Epoch: [13][  400/  657]    Loss 0.000000    Overall Loss 0.012946    
+2023-12-02 21:15:17,633 - Epoch: [13][  500/  657]    Loss 0.000000    Overall Loss 0.012940    
+2023-12-02 21:16:05,603 - Epoch: [13][  600/  657]    Loss 0.000000    Overall Loss 0.012949    
+2023-12-02 21:16:32,543 - Epoch: [13][  657/  657]    Loss 0.000000    Overall Loss 0.012948    
+2023-12-02 21:16:32,947 - ==> Overall Loss: 0.013
+
+2023-12-02 21:16:32,950 - ==> Best [Overall Loss: 0.012948 on epoch: 13]
+2023-12-02 21:16:32,950 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-02 21:16:32,990 - 
+
+2023-12-02 21:16:32,990 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-02 21:18:42,134 - Epoch: [14][  100/12168]    Overall Loss 0.012203    Objective Loss 0.000000    Distill Loss 0.012203                                        LR 0.000500    Time 1.291363    
+2023-12-02 21:20:13,153 - Epoch: [14][  200/12168]    Overall Loss 0.012206    Objective Loss 0.000000    Distill Loss 0.012206                                        LR 0.000500    Time 1.100738    
+2023-12-02 21:21:58,765 - Epoch: [14][  300/12168]    Overall Loss 0.012221    Objective Loss 0.000000    Distill Loss 0.012221                                        LR 0.000500    Time 1.085841    
+2023-12-02 21:23:36,467 - Epoch: [14][  400/12168]    Overall Loss 0.012228    Objective Loss 0.000000    Distill Loss 0.012228                                        LR 0.000500    Time 1.058619    
+2023-12-02 21:25:04,995 - Epoch: [14][  500/12168]    Overall Loss 0.012219    Objective Loss 0.000000    Distill Loss 0.012219                                        LR 0.000500    Time 1.023937    
+2023-12-02 21:26:55,409 - Epoch: [14][  600/12168]    Overall Loss 0.012218    Objective Loss 0.000000    Distill Loss 0.012218                                        LR 0.000500    Time 1.037292    
+2023-12-02 21:28:31,488 - Epoch: [14][  700/12168]    Overall Loss 0.012224    Objective Loss 0.000000    Distill Loss 0.012224                                        LR 0.000500    Time 1.026353    
+2023-12-02 21:30:17,047 - Epoch: [14][  800/12168]    Overall Loss 0.012222    Objective Loss 0.000000    Distill Loss 0.012222                                        LR 0.000500    Time 1.029997    
+2023-12-02 21:31:48,448 - Epoch: [14][  900/12168]    Overall Loss 0.012226    Objective Loss 0.000000    Distill Loss 0.012226                                        LR 0.000500    Time 1.017103    
+2023-12-02 21:33:30,771 - Epoch: [14][ 1000/12168]    Overall Loss 0.012243    Objective Loss 0.000000    Distill Loss 0.012243                                        LR 0.000500    Time 1.017708    
+2023-12-02 21:34:53,605 - Epoch: [14][ 1100/12168]    Overall Loss 0.012245    Objective Loss 0.000000    Distill Loss 0.012245                                        LR 0.000500    Time 1.000486    
+2023-12-02 21:36:26,453 - Epoch: [14][ 1200/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.994480    
+2023-12-02 21:38:06,015 - Epoch: [14][ 1300/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.994562    
+2023-12-02 21:39:43,973 - Epoch: [14][ 1400/12168]    Overall Loss 0.012243    Objective Loss 0.000000    Distill Loss 0.012243                                        LR 0.000500    Time 0.993487    
+2023-12-02 21:41:01,087 - Epoch: [14][ 1500/12168]    Overall Loss 0.012248    Objective Loss 0.000000    Distill Loss 0.012248                                        LR 0.000500    Time 0.978658    
+2023-12-02 21:42:22,722 - Epoch: [14][ 1600/12168]    Overall Loss 0.012247    Objective Loss 0.000000    Distill Loss 0.012247                                        LR 0.000500    Time 0.968510    
+2023-12-02 21:44:13,328 - Epoch: [14][ 1700/12168]    Overall Loss 0.012250    Objective Loss 0.000000    Distill Loss 0.012250                                        LR 0.000500    Time 0.976597    
+2023-12-02 21:45:48,130 - Epoch: [14][ 1800/12168]    Overall Loss 0.012250    Objective Loss 0.000000    Distill Loss 0.012250                                        LR 0.000500    Time 0.975005    
+2023-12-02 21:47:31,121 - Epoch: [14][ 1900/12168]    Overall Loss 0.012252    Objective Loss 0.000000    Distill Loss 0.012252                                        LR 0.000500    Time 0.977891    
+2023-12-02 21:48:51,571 - Epoch: [14][ 2000/12168]    Overall Loss 0.012252    Objective Loss 0.000000    Distill Loss 0.012252                                        LR 0.000500    Time 0.969218    
+2023-12-02 21:50:35,178 - Epoch: [14][ 2100/12168]    Overall Loss 0.012252    Objective Loss 0.000000    Distill Loss 0.012252                                        LR 0.000500    Time 0.972398    
+2023-12-02 21:52:07,956 - Epoch: [14][ 2200/12168]    Overall Loss 0.012252    Objective Loss 0.000000    Distill Loss 0.012252                                        LR 0.000500    Time 0.970366    
+2023-12-02 21:53:49,060 - Epoch: [14][ 2300/12168]    Overall Loss 0.012247    Objective Loss 0.000000    Distill Loss 0.012247                                        LR 0.000500    Time 0.972131    
+2023-12-02 21:55:20,682 - Epoch: [14][ 2400/12168]    Overall Loss 0.012243    Objective Loss 0.000000    Distill Loss 0.012243                                        LR 0.000500    Time 0.969799    
+2023-12-02 21:57:03,684 - Epoch: [14][ 2500/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 0.972205    
+2023-12-02 21:58:55,746 - Epoch: [14][ 2600/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.977910    
+2023-12-02 22:00:27,719 - Epoch: [14][ 2700/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.975753    
+2023-12-02 22:02:14,954 - Epoch: [14][ 2800/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.979200    
+2023-12-02 22:03:37,847 - Epoch: [14][ 2900/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 0.974016    
+2023-12-02 22:05:23,111 - Epoch: [14][ 3000/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.976635    
+2023-12-02 22:07:01,262 - Epoch: [14][ 3100/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.976790    
+2023-12-02 22:08:25,003 - Epoch: [14][ 3200/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.972432    
+2023-12-02 22:10:04,753 - Epoch: [14][ 3300/12168]    Overall Loss 0.012235    Objective Loss 0.000000    Distill Loss 0.012235                                        LR 0.000500    Time 0.973190    
+2023-12-02 22:11:35,995 - Epoch: [14][ 3400/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.971400    
+2023-12-02 22:13:19,477 - Epoch: [14][ 3500/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.973210    
+2023-12-02 22:14:56,338 - Epoch: [14][ 3600/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.973080    
+2023-12-02 22:16:32,400 - Epoch: [14][ 3700/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.972741    
+2023-12-02 22:18:07,936 - Epoch: [14][ 3800/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.972282    
+2023-12-02 22:19:36,475 - Epoch: [14][ 3900/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.970052    
+2023-12-02 22:21:13,874 - Epoch: [14][ 4000/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.970149    
+2023-12-02 22:22:50,758 - Epoch: [14][ 4100/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.970116    
+2023-12-02 22:24:33,118 - Epoch: [14][ 4200/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.971387    
+2023-12-02 22:26:18,706 - Epoch: [14][ 4300/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.973351    
+2023-12-02 22:27:59,837 - Epoch: [14][ 4400/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.974212    
+2023-12-02 22:29:28,855 - Epoch: [14][ 4500/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.972343    
+2023-12-02 22:30:38,496 - Epoch: [14][ 4600/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.966343    
+2023-12-02 22:31:46,688 - Epoch: [14][ 4700/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.960291    
+2023-12-02 22:32:54,377 - Epoch: [14][ 4800/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.954386    
+2023-12-02 22:34:02,248 - Epoch: [14][ 4900/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.948759    
+2023-12-02 22:35:10,130 - Epoch: [14][ 5000/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.943359    
+2023-12-02 22:36:52,335 - Epoch: [14][ 5100/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.944900    
+2023-12-02 22:38:37,574 - Epoch: [14][ 5200/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.946966    
+2023-12-02 22:40:07,208 - Epoch: [14][ 5300/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.946009    
+2023-12-02 22:41:44,376 - Epoch: [14][ 5400/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.946483    
+2023-12-02 22:43:15,086 - Epoch: [14][ 5500/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.945766    
+2023-12-02 22:44:53,209 - Epoch: [14][ 5600/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.946398    
+2023-12-02 22:46:24,539 - Epoch: [14][ 5700/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.945816    
+2023-12-02 22:48:12,629 - Epoch: [14][ 5800/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.948144    
+2023-12-02 22:49:50,498 - Epoch: [14][ 5900/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.948660    
+2023-12-02 22:51:37,967 - Epoch: [14][ 6000/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 0.950760    
+2023-12-02 22:53:13,807 - Epoch: [14][ 6100/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.950884    
+2023-12-02 22:54:54,015 - Epoch: [14][ 6200/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.951708    
+2023-12-02 22:56:43,380 - Epoch: [14][ 6300/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.953960    
+2023-12-02 22:58:13,582 - Epoch: [14][ 6400/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.953148    
+2023-12-02 23:00:10,373 - Epoch: [14][ 6500/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.956450    
+2023-12-02 23:01:48,196 - Epoch: [14][ 6600/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.956779    
+2023-12-02 23:03:27,843 - Epoch: [14][ 6700/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.957371    
+2023-12-02 23:05:29,250 - Epoch: [14][ 6800/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.961145    
+2023-12-02 23:07:22,556 - Epoch: [14][ 6900/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.963635    
+2023-12-02 23:09:12,969 - Epoch: [14][ 7000/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.965641    
+2023-12-02 23:10:46,229 - Epoch: [14][ 7100/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.965175    
+2023-12-02 23:12:43,647 - Epoch: [14][ 7200/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.968077    
+2023-12-02 23:14:25,658 - Epoch: [14][ 7300/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.968788    
+2023-12-02 23:16:10,364 - Epoch: [14][ 7400/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.969845    
+2023-12-02 23:17:44,224 - Epoch: [14][ 7500/12168]    Overall Loss 0.012235    Objective Loss 0.000000    Distill Loss 0.012235                                        LR 0.000500    Time 0.969427    
+2023-12-02 23:19:18,390 - Epoch: [14][ 7600/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.969061    
+2023-12-02 23:21:10,569 - Epoch: [14][ 7700/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.971043    
+2023-12-02 23:22:48,991 - Epoch: [14][ 7800/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.971212    
+2023-12-02 23:25:04,482 - Epoch: [14][ 7900/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.976068    
+2023-12-02 23:26:52,147 - Epoch: [14][ 8000/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.977324    
+2023-12-02 23:28:38,527 - Epoch: [14][ 8100/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.978391    
+2023-12-02 23:30:32,175 - Epoch: [14][ 8200/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.980318    
+2023-12-02 23:32:25,405 - Epoch: [14][ 8300/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.982148    
+2023-12-02 23:34:20,569 - Epoch: [14][ 8400/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.984165    
+2023-12-02 23:36:01,438 - Epoch: [14][ 8500/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.984453    
+2023-12-02 23:37:44,491 - Epoch: [14][ 8600/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.984987    
+2023-12-02 23:39:38,593 - Epoch: [14][ 8700/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.986780    
+2023-12-02 23:41:21,919 - Epoch: [14][ 8800/12168]    Overall Loss 0.012236    Objective Loss 0.000000    Distill Loss 0.012236                                        LR 0.000500    Time 0.987307    
+2023-12-02 23:43:12,698 - Epoch: [14][ 8900/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.988660    
+2023-12-02 23:44:58,474 - Epoch: [14][ 9000/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.989427    
+2023-12-02 23:46:32,759 - Epoch: [14][ 9100/12168]    Overall Loss 0.012237    Objective Loss 0.000000    Distill Loss 0.012237                                        LR 0.000500    Time 0.988915    
+2023-12-02 23:48:13,160 - Epoch: [14][ 9200/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.989078    
+2023-12-02 23:50:00,170 - Epoch: [14][ 9300/12168]    Overall Loss 0.012238    Objective Loss 0.000000    Distill Loss 0.012238                                        LR 0.000500    Time 0.989948    
+2023-12-02 23:51:54,078 - Epoch: [14][ 9400/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.991534    
+2023-12-02 23:53:26,873 - Epoch: [14][ 9500/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.990864    
+2023-12-02 23:55:09,137 - Epoch: [14][ 9600/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.991194    
+2023-12-02 23:56:47,735 - Epoch: [14][ 9700/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.991140    
+2023-12-02 23:58:35,772 - Epoch: [14][ 9800/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.992050    
+2023-12-03 00:00:21,882 - Epoch: [14][ 9900/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.992746    
+2023-12-03 00:02:09,896 - Epoch: [14][10000/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.993620    
+2023-12-03 00:04:01,571 - Epoch: [14][10100/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.994838    
+2023-12-03 00:05:43,325 - Epoch: [14][10200/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 0.995060    
+2023-12-03 00:07:31,584 - Epoch: [14][10300/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.995909    
+2023-12-03 00:09:04,731 - Epoch: [14][10400/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.995289    
+2023-12-03 00:11:05,865 - Epoch: [14][10500/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 0.997346    
+2023-12-03 00:13:02,666 - Epoch: [14][10600/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.998955    
+2023-12-03 00:14:45,783 - Epoch: [14][10700/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.999255    
+2023-12-03 00:16:30,636 - Epoch: [14][10800/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 0.999711    
+2023-12-03 00:18:15,896 - Epoch: [14][10900/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.000196    
+2023-12-03 00:20:02,665 - Epoch: [14][11000/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 1.000809    
+2023-12-03 00:21:51,810 - Epoch: [14][11100/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 1.001625    
+2023-12-03 00:23:47,646 - Epoch: [14][11200/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 1.003023    
+2023-12-03 00:25:26,381 - Epoch: [14][11300/12168]    Overall Loss 0.012239    Objective Loss 0.000000    Distill Loss 0.012239                                        LR 0.000500    Time 1.002884    
+2023-12-03 00:27:21,022 - Epoch: [14][11400/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.004142    
+2023-12-03 00:28:52,417 - Epoch: [14][11500/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.003358    
+2023-12-03 00:31:05,997 - Epoch: [14][11600/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.006223    
+2023-12-03 00:32:55,214 - Epoch: [14][11700/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.006957    
+2023-12-03 00:34:37,608 - Epoch: [14][11800/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 1.007100    
+2023-12-03 00:36:29,125 - Epoch: [14][11900/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.008008    
+2023-12-03 00:38:21,468 - Epoch: [14][12000/12168]    Overall Loss 0.012240    Objective Loss 0.000000    Distill Loss 0.012240                                        LR 0.000500    Time 1.008969    
+2023-12-03 00:39:48,323 - Epoch: [14][12100/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 1.007808    
+2023-12-03 00:40:51,716 - Epoch: [14][12168/12168]    Overall Loss 0.012241    Objective Loss 0.000000    Distill Loss 0.012241                                        LR 0.000500    Time 1.007385    
+2023-12-03 00:40:52,404 - --- validate (epoch=14)-----------
+2023-12-03 00:40:52,404 - 167951 samples (256 per mini-batch)
+2023-12-03 00:41:45,921 - Epoch: [14][  100/  657]    Loss 0.000000    Overall Loss 0.012881    
+2023-12-03 00:42:33,882 - Epoch: [14][  200/  657]    Loss 0.000000    Overall Loss 0.012917    
+2023-12-03 00:43:21,916 - Epoch: [14][  300/  657]    Loss 0.000000    Overall Loss 0.012911    
+2023-12-03 00:44:09,889 - Epoch: [14][  400/  657]    Loss 0.000000    Overall Loss 0.012915    
+2023-12-03 00:44:57,863 - Epoch: [14][  500/  657]    Loss 0.000000    Overall Loss 0.012913    
+2023-12-03 00:45:45,826 - Epoch: [14][  600/  657]    Loss 0.000000    Overall Loss 0.012910    
+2023-12-03 00:46:12,747 - Epoch: [14][  657/  657]    Loss 0.000000    Overall Loss 0.012907    
+2023-12-03 00:46:13,063 - ==> Overall Loss: 0.013
+
+2023-12-03 00:46:13,066 - ==> Best [Overall Loss: 0.012907 on epoch: 14]
+2023-12-03 00:46:13,066 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 00:46:13,106 - 
+
+2023-12-03 00:46:13,106 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 00:48:21,683 - Epoch: [15][  100/12168]    Overall Loss 0.012096    Objective Loss 0.000000    Distill Loss 0.012096                                        LR 0.000250    Time 1.285696    
+2023-12-03 00:49:57,683 - Epoch: [15][  200/12168]    Overall Loss 0.012047    Objective Loss 0.000000    Distill Loss 0.012047                                        LR 0.000250    Time 1.122812    
+2023-12-03 00:51:29,574 - Epoch: [15][  300/12168]    Overall Loss 0.012074    Objective Loss 0.000000    Distill Loss 0.012074                                        LR 0.000250    Time 1.054823    
+2023-12-03 00:53:04,578 - Epoch: [15][  400/12168]    Overall Loss 0.012073    Objective Loss 0.000000    Distill Loss 0.012073                                        LR 0.000250    Time 1.028609    
+2023-12-03 00:54:29,607 - Epoch: [15][  500/12168]    Overall Loss 0.012063    Objective Loss 0.000000    Distill Loss 0.012063                                        LR 0.000250    Time 0.992931    
+2023-12-03 00:56:06,489 - Epoch: [15][  600/12168]    Overall Loss 0.012071    Objective Loss 0.000000    Distill Loss 0.012071                                        LR 0.000250    Time 0.988901    
+2023-12-03 00:57:39,624 - Epoch: [15][  700/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.980668    
+2023-12-03 00:59:31,643 - Epoch: [15][  800/12168]    Overall Loss 0.012087    Objective Loss 0.000000    Distill Loss 0.012087                                        LR 0.000250    Time 0.998099    
+2023-12-03 01:01:07,840 - Epoch: [15][  900/12168]    Overall Loss 0.012094    Objective Loss 0.000000    Distill Loss 0.012094                                        LR 0.000250    Time 0.994077    
+2023-12-03 01:02:34,760 - Epoch: [15][ 1000/12168]    Overall Loss 0.012097    Objective Loss 0.000000    Distill Loss 0.012097                                        LR 0.000250    Time 0.981582    
+2023-12-03 01:04:15,379 - Epoch: [15][ 1100/12168]    Overall Loss 0.012102    Objective Loss 0.000000    Distill Loss 0.012102                                        LR 0.000250    Time 0.983812    
+2023-12-03 01:05:48,012 - Epoch: [15][ 1200/12168]    Overall Loss 0.012100    Objective Loss 0.000000    Distill Loss 0.012100                                        LR 0.000250    Time 0.979016    
+2023-12-03 01:07:32,091 - Epoch: [15][ 1300/12168]    Overall Loss 0.012102    Objective Loss 0.000000    Distill Loss 0.012102                                        LR 0.000250    Time 0.983763    
+2023-12-03 01:09:07,474 - Epoch: [15][ 1400/12168]    Overall Loss 0.012102    Objective Loss 0.000000    Distill Loss 0.012102                                        LR 0.000250    Time 0.981620    
+2023-12-03 01:10:42,403 - Epoch: [15][ 1500/12168]    Overall Loss 0.012107    Objective Loss 0.000000    Distill Loss 0.012107                                        LR 0.000250    Time 0.979459    
+2023-12-03 01:12:21,492 - Epoch: [15][ 1600/12168]    Overall Loss 0.012107    Objective Loss 0.000000    Distill Loss 0.012107                                        LR 0.000250    Time 0.980169    
+2023-12-03 01:13:59,040 - Epoch: [15][ 1700/12168]    Overall Loss 0.012111    Objective Loss 0.000000    Distill Loss 0.012111                                        LR 0.000250    Time 0.979889    
+2023-12-03 01:15:42,831 - Epoch: [15][ 1800/12168]    Overall Loss 0.012108    Objective Loss 0.000000    Distill Loss 0.012108                                        LR 0.000250    Time 0.983108    
+2023-12-03 01:17:13,544 - Epoch: [15][ 1900/12168]    Overall Loss 0.012107    Objective Loss 0.000000    Distill Loss 0.012107                                        LR 0.000250    Time 0.979105    
+2023-12-03 01:18:57,096 - Epoch: [15][ 2000/12168]    Overall Loss 0.012107    Objective Loss 0.000000    Distill Loss 0.012107                                        LR 0.000250    Time 0.981922    
+2023-12-03 01:20:34,450 - Epoch: [15][ 2100/12168]    Overall Loss 0.012106    Objective Loss 0.000000    Distill Loss 0.012106                                        LR 0.000250    Time 0.981520    
+2023-12-03 01:22:06,173 - Epoch: [15][ 2200/12168]    Overall Loss 0.012107    Objective Loss 0.000000    Distill Loss 0.012107                                        LR 0.000250    Time 0.978594    
+2023-12-03 01:23:38,221 - Epoch: [15][ 2300/12168]    Overall Loss 0.012103    Objective Loss 0.000000    Distill Loss 0.012103                                        LR 0.000250    Time 0.976065    
+2023-12-03 01:25:18,461 - Epoch: [15][ 2400/12168]    Overall Loss 0.012100    Objective Loss 0.000000    Distill Loss 0.012100                                        LR 0.000250    Time 0.977159    
+2023-12-03 01:27:07,261 - Epoch: [15][ 2500/12168]    Overall Loss 0.012097    Objective Loss 0.000000    Distill Loss 0.012097                                        LR 0.000250    Time 0.981589    
+2023-12-03 01:28:53,768 - Epoch: [15][ 2600/12168]    Overall Loss 0.012094    Objective Loss 0.000000    Distill Loss 0.012094                                        LR 0.000250    Time 0.984797    
+2023-12-03 01:30:27,319 - Epoch: [15][ 2700/12168]    Overall Loss 0.012094    Objective Loss 0.000000    Distill Loss 0.012094                                        LR 0.000250    Time 0.982969    
+2023-12-03 01:32:08,496 - Epoch: [15][ 2800/12168]    Overall Loss 0.012093    Objective Loss 0.000000    Distill Loss 0.012093                                        LR 0.000250    Time 0.983995    
+2023-12-03 01:33:50,720 - Epoch: [15][ 2900/12168]    Overall Loss 0.012096    Objective Loss 0.000000    Distill Loss 0.012096                                        LR 0.000250    Time 0.985311    
+2023-12-03 01:35:27,299 - Epoch: [15][ 3000/12168]    Overall Loss 0.012093    Objective Loss 0.000000    Distill Loss 0.012093                                        LR 0.000250    Time 0.984658    
+2023-12-03 01:37:05,405 - Epoch: [15][ 3100/12168]    Overall Loss 0.012089    Objective Loss 0.000000    Distill Loss 0.012089                                        LR 0.000250    Time 0.984540    
+2023-12-03 01:38:53,114 - Epoch: [15][ 3200/12168]    Overall Loss 0.012088    Objective Loss 0.000000    Distill Loss 0.012088                                        LR 0.000250    Time 0.987430    
+2023-12-03 01:40:33,102 - Epoch: [15][ 3300/12168]    Overall Loss 0.012087    Objective Loss 0.000000    Distill Loss 0.012087                                        LR 0.000250    Time 0.987805    
+2023-12-03 01:42:07,423 - Epoch: [15][ 3400/12168]    Overall Loss 0.012087    Objective Loss 0.000000    Distill Loss 0.012087                                        LR 0.000250    Time 0.986491    
+2023-12-03 01:43:47,656 - Epoch: [15][ 3500/12168]    Overall Loss 0.012087    Objective Loss 0.000000    Distill Loss 0.012087                                        LR 0.000250    Time 0.986941    
+2023-12-03 01:45:09,263 - Epoch: [15][ 3600/12168]    Overall Loss 0.012086    Objective Loss 0.000000    Distill Loss 0.012086                                        LR 0.000250    Time 0.982193    
+2023-12-03 01:46:54,103 - Epoch: [15][ 3700/12168]    Overall Loss 0.012086    Objective Loss 0.000000    Distill Loss 0.012086                                        LR 0.000250    Time 0.983981    
+2023-12-03 01:48:33,074 - Epoch: [15][ 3800/12168]    Overall Loss 0.012087    Objective Loss 0.000000    Distill Loss 0.012087                                        LR 0.000250    Time 0.984130    
+2023-12-03 01:49:56,882 - Epoch: [15][ 3900/12168]    Overall Loss 0.012084    Objective Loss 0.000000    Distill Loss 0.012084                                        LR 0.000250    Time 0.980383    
+2023-12-03 01:51:34,820 - Epoch: [15][ 4000/12168]    Overall Loss 0.012082    Objective Loss 0.000000    Distill Loss 0.012082                                        LR 0.000250    Time 0.980356    
+2023-12-03 01:53:13,888 - Epoch: [15][ 4100/12168]    Overall Loss 0.012083    Objective Loss 0.000000    Distill Loss 0.012083                                        LR 0.000250    Time 0.980606    
+2023-12-03 01:54:51,965 - Epoch: [15][ 4200/12168]    Overall Loss 0.012082    Objective Loss 0.000000    Distill Loss 0.012082                                        LR 0.000250    Time 0.980608    
+2023-12-03 01:56:22,210 - Epoch: [15][ 4300/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.978789    
+2023-12-03 01:58:12,206 - Epoch: [15][ 4400/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.981541    
+2023-12-03 02:00:02,619 - Epoch: [15][ 4500/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.984264    
+2023-12-03 02:01:39,888 - Epoch: [15][ 4600/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.984011    
+2023-12-03 02:03:16,338 - Epoch: [15][ 4700/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.983594    
+2023-12-03 02:04:52,539 - Epoch: [15][ 4800/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.983143    
+2023-12-03 02:06:17,771 - Epoch: [15][ 4900/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.980472    
+2023-12-03 02:07:57,833 - Epoch: [15][ 5000/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.980873    
+2023-12-03 02:09:40,361 - Epoch: [15][ 5100/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.981743    
+2023-12-03 02:11:22,312 - Epoch: [15][ 5200/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.982468    
+2023-12-03 02:12:54,820 - Epoch: [15][ 5300/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.981384    
+2023-12-03 02:14:22,306 - Epoch: [15][ 5400/12168]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                                        LR 0.000250    Time 0.979409    
+2023-12-03 02:15:59,215 - Epoch: [15][ 5500/12168]    Overall Loss 0.012082    Objective Loss 0.000000    Distill Loss 0.012082                                        LR 0.000250    Time 0.979220    
+2023-12-03 02:17:35,130 - Epoch: [15][ 5600/12168]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                                        LR 0.000250    Time 0.978861    
+2023-12-03 02:19:19,724 - Epoch: [15][ 5700/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.980036    
+2023-12-03 02:21:07,822 - Epoch: [15][ 5800/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.981775    
+2023-12-03 02:22:47,063 - Epoch: [15][ 5900/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.981954    
+2023-12-03 02:24:34,656 - Epoch: [15][ 6000/12168]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                                        LR 0.000250    Time 0.983519    
+2023-12-03 02:26:05,675 - Epoch: [15][ 6100/12168]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                                        LR 0.000250    Time 0.982316    
+2023-12-03 02:27:46,329 - Epoch: [15][ 6200/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.982706    
+2023-12-03 02:29:25,196 - Epoch: [15][ 6300/12168]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                                        LR 0.000250    Time 0.982799    
+2023-12-03 02:30:34,960 - Epoch: [15][ 6400/12168]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                                        LR 0.000250    Time 0.978343    
+2023-12-03 02:31:43,103 - Epoch: [15][ 6500/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.973774    
+2023-12-03 02:32:51,398 - Epoch: [15][ 6600/12168]    Overall Loss 0.012080    Objective Loss 0.000000    Distill Loss 0.012080                                        LR 0.000250    Time 0.969367    
+2023-12-03 02:34:01,775 - Epoch: [15][ 6700/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.965402    
+2023-12-03 02:35:06,549 - Epoch: [15][ 6800/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.960730    
+2023-12-03 02:37:03,491 - Epoch: [15][ 6900/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.963754    
+2023-12-03 02:39:03,794 - Epoch: [15][ 7000/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.967171    
+2023-12-03 02:40:58,168 - Epoch: [15][ 7100/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.969657    
+2023-12-03 02:42:36,706 - Epoch: [15][ 7200/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.969874    
+2023-12-03 02:44:37,176 - Epoch: [15][ 7300/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.973090    
+2023-12-03 02:46:30,043 - Epoch: [15][ 7400/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.975191    
+2023-12-03 02:48:19,560 - Epoch: [15][ 7500/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.976790    
+2023-12-03 02:50:14,188 - Epoch: [15][ 7600/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.979019    
+2023-12-03 02:52:01,200 - Epoch: [15][ 7700/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.980201    
+2023-12-03 02:53:50,051 - Epoch: [15][ 7800/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.981589    
+2023-12-03 02:55:39,729 - Epoch: [15][ 7900/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.983046    
+2023-12-03 02:57:34,444 - Epoch: [15][ 8000/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.985096    
+2023-12-03 02:59:18,770 - Epoch: [15][ 8100/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.985814    
+2023-12-03 03:01:13,607 - Epoch: [15][ 8200/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.987795    
+2023-12-03 03:03:05,846 - Epoch: [15][ 8300/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.989416    
+2023-12-03 03:04:55,156 - Epoch: [15][ 8400/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.990649    
+2023-12-03 03:06:48,278 - Epoch: [15][ 8500/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.992302    
+2023-12-03 03:08:32,947 - Epoch: [15][ 8600/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.992934    
+2023-12-03 03:10:06,766 - Epoch: [15][ 8700/12168]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                                        LR 0.000250    Time 0.992304    
+2023-12-03 03:12:11,434 - Epoch: [15][ 8800/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.995193    
+2023-12-03 03:13:49,408 - Epoch: [15][ 8900/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.995019    
+2023-12-03 03:15:36,184 - Epoch: [15][ 9000/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.995826    
+2023-12-03 03:17:27,697 - Epoch: [15][ 9100/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.997137    
+2023-12-03 03:19:10,469 - Epoch: [15][ 9200/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.997468    
+2023-12-03 03:20:45,104 - Epoch: [15][ 9300/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.996918    
+2023-12-03 03:22:36,742 - Epoch: [15][ 9400/12168]    Overall Loss 0.012078    Objective Loss 0.000000    Distill Loss 0.012078                                        LR 0.000250    Time 0.998188    
+2023-12-03 03:24:18,646 - Epoch: [15][ 9500/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.998407    
+2023-12-03 03:26:04,844 - Epoch: [15][ 9600/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.999068    
+2023-12-03 03:27:37,223 - Epoch: [15][ 9700/12168]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                                        LR 0.000250    Time 0.998291    
+2023-12-03 03:29:23,993 - Epoch: [15][ 9800/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.998999    
+2023-12-03 03:31:15,858 - Epoch: [15][ 9900/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.000207    
+2023-12-03 03:32:47,500 - Epoch: [15][10000/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.999368    
+2023-12-03 03:34:28,269 - Epoch: [15][10100/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 0.999450    
+2023-12-03 03:36:15,941 - Epoch: [15][10200/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.000207    
+2023-12-03 03:38:03,249 - Epoch: [15][10300/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.000913    
+2023-12-03 03:39:49,763 - Epoch: [15][10400/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.001530    
+2023-12-03 03:41:36,432 - Epoch: [15][10500/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.002150    
+2023-12-03 03:43:19,720 - Epoch: [15][10600/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.002439    
+2023-12-03 03:45:10,638 - Epoch: [15][10700/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.003436    
+2023-12-03 03:46:56,248 - Epoch: [15][10800/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.003923    
+2023-12-03 03:48:41,736 - Epoch: [15][10900/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.004390    
+2023-12-03 03:50:39,490 - Epoch: [15][11000/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.005964    
+2023-12-03 03:52:36,217 - Epoch: [15][11100/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.007416    
+2023-12-03 03:54:12,510 - Epoch: [15][11200/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.007018    
+2023-12-03 03:56:11,002 - Epoch: [15][11300/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.008592    
+2023-12-03 03:57:56,875 - Epoch: [15][11400/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.009031    
+2023-12-03 03:59:41,208 - Epoch: [15][11500/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.009329    
+2023-12-03 04:01:19,230 - Epoch: [15][11600/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.009077    
+2023-12-03 04:03:26,421 - Epoch: [15][11700/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.011323    
+2023-12-03 04:05:30,857 - Epoch: [15][11800/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.013297    
+2023-12-03 04:07:17,471 - Epoch: [15][11900/12168]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                                        LR 0.000250    Time 1.013741    
+2023-12-03 04:08:55,464 - Epoch: [15][12000/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.013459    
+2023-12-03 04:10:35,735 - Epoch: [15][12100/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.013369    
+2023-12-03 04:11:44,360 - Epoch: [15][12168/12168]    Overall Loss 0.012075    Objective Loss 0.000000    Distill Loss 0.012075                                        LR 0.000250    Time 1.013346    
+2023-12-03 04:11:45,045 - --- validate (epoch=15)-----------
+2023-12-03 04:11:45,046 - 167951 samples (256 per mini-batch)
+2023-12-03 04:12:38,156 - Epoch: [15][  100/  657]    Loss 0.000000    Overall Loss 0.012746    
+2023-12-03 04:13:26,083 - Epoch: [15][  200/  657]    Loss 0.000000    Overall Loss 0.012769    
+2023-12-03 04:14:14,018 - Epoch: [15][  300/  657]    Loss 0.000000    Overall Loss 0.012777    
+2023-12-03 04:15:01,933 - Epoch: [15][  400/  657]    Loss 0.000000    Overall Loss 0.012778    
+2023-12-03 04:15:49,877 - Epoch: [15][  500/  657]    Loss 0.000000    Overall Loss 0.012769    
+2023-12-03 04:16:37,787 - Epoch: [15][  600/  657]    Loss 0.000000    Overall Loss 0.012769    
+2023-12-03 04:17:04,741 - Epoch: [15][  657/  657]    Loss 0.000000    Overall Loss 0.012768    
+2023-12-03 04:17:05,103 - ==> Overall Loss: 0.013
+
+2023-12-03 04:17:05,105 - ==> Best [Overall Loss: 0.012768 on epoch: 15]
+2023-12-03 04:17:05,106 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 04:17:05,131 - 
+
+2023-12-03 04:17:05,131 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 04:18:59,401 - Epoch: [16][  100/12168]    Overall Loss 0.012023    Objective Loss 0.000000    Distill Loss 0.012023                                        LR 0.000250    Time 1.142622    
+2023-12-03 04:20:40,595 - Epoch: [16][  200/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.077248    
+2023-12-03 04:22:14,211 - Epoch: [16][  300/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 1.030192    
+2023-12-03 04:23:39,755 - Epoch: [16][  400/12168]    Overall Loss 0.012054    Objective Loss 0.000000    Distill Loss 0.012054                                        LR 0.000250    Time 0.986486    
+2023-12-03 04:25:20,156 - Epoch: [16][  500/12168]    Overall Loss 0.012041    Objective Loss 0.000000    Distill Loss 0.012041                                        LR 0.000250    Time 0.989974    
+2023-12-03 04:26:57,075 - Epoch: [16][  600/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.986498    
+2023-12-03 04:28:26,298 - Epoch: [16][  700/12168]    Overall Loss 0.012053    Objective Loss 0.000000    Distill Loss 0.012053                                        LR 0.000250    Time 0.973021    
+2023-12-03 04:30:12,956 - Epoch: [16][  800/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.984706    
+2023-12-03 04:32:01,207 - Epoch: [16][  900/12168]    Overall Loss 0.012058    Objective Loss 0.000000    Distill Loss 0.012058                                        LR 0.000250    Time 0.995566    
+2023-12-03 04:33:27,850 - Epoch: [16][ 1000/12168]    Overall Loss 0.012061    Objective Loss 0.000000    Distill Loss 0.012061                                        LR 0.000250    Time 0.982645    
+2023-12-03 04:35:04,749 - Epoch: [16][ 1100/12168]    Overall Loss 0.012062    Objective Loss 0.000000    Distill Loss 0.012062                                        LR 0.000250    Time 0.981397    
+2023-12-03 04:36:57,837 - Epoch: [16][ 1200/12168]    Overall Loss 0.012058    Objective Loss 0.000000    Distill Loss 0.012058                                        LR 0.000250    Time 0.993848    
+2023-12-03 04:38:35,256 - Epoch: [16][ 1300/12168]    Overall Loss 0.012054    Objective Loss 0.000000    Distill Loss 0.012054                                        LR 0.000250    Time 0.992330    
+2023-12-03 04:40:06,217 - Epoch: [16][ 1400/12168]    Overall Loss 0.012057    Objective Loss 0.000000    Distill Loss 0.012057                                        LR 0.000250    Time 0.986416    
+2023-12-03 04:41:46,489 - Epoch: [16][ 1500/12168]    Overall Loss 0.012059    Objective Loss 0.000000    Distill Loss 0.012059                                        LR 0.000250    Time 0.987498    
+2023-12-03 04:43:16,336 - Epoch: [16][ 1600/12168]    Overall Loss 0.012061    Objective Loss 0.000000    Distill Loss 0.012061                                        LR 0.000250    Time 0.981929    
+2023-12-03 04:44:47,383 - Epoch: [16][ 1700/12168]    Overall Loss 0.012062    Objective Loss 0.000000    Distill Loss 0.012062                                        LR 0.000250    Time 0.977721    
+2023-12-03 04:46:20,356 - Epoch: [16][ 1800/12168]    Overall Loss 0.012062    Objective Loss 0.000000    Distill Loss 0.012062                                        LR 0.000250    Time 0.975051    
+2023-12-03 04:48:00,353 - Epoch: [16][ 1900/12168]    Overall Loss 0.012064    Objective Loss 0.000000    Distill Loss 0.012064                                        LR 0.000250    Time 0.976359    
+2023-12-03 04:49:37,316 - Epoch: [16][ 2000/12168]    Overall Loss 0.012063    Objective Loss 0.000000    Distill Loss 0.012063                                        LR 0.000250    Time 0.976018    
+2023-12-03 04:51:18,164 - Epoch: [16][ 2100/12168]    Overall Loss 0.012065    Objective Loss 0.000000    Distill Loss 0.012065                                        LR 0.000250    Time 0.977561    
+2023-12-03 04:53:07,312 - Epoch: [16][ 2200/12168]    Overall Loss 0.012065    Objective Loss 0.000000    Distill Loss 0.012065                                        LR 0.000250    Time 0.982735    
+2023-12-03 04:54:52,122 - Epoch: [16][ 2300/12168]    Overall Loss 0.012063    Objective Loss 0.000000    Distill Loss 0.012063                                        LR 0.000250    Time 0.985574    
+2023-12-03 04:56:34,631 - Epoch: [16][ 2400/12168]    Overall Loss 0.012060    Objective Loss 0.000000    Distill Loss 0.012060                                        LR 0.000250    Time 0.987218    
+2023-12-03 04:58:40,909 - Epoch: [16][ 2500/12168]    Overall Loss 0.012057    Objective Loss 0.000000    Distill Loss 0.012057                                        LR 0.000250    Time 0.998237    
+2023-12-03 05:00:25,803 - Epoch: [16][ 2600/12168]    Overall Loss 0.012055    Objective Loss 0.000000    Distill Loss 0.012055                                        LR 0.000250    Time 1.000185    
+2023-12-03 05:01:59,020 - Epoch: [16][ 2700/12168]    Overall Loss 0.012056    Objective Loss 0.000000    Distill Loss 0.012056                                        LR 0.000250    Time 0.997663    
+2023-12-03 05:03:25,219 - Epoch: [16][ 2800/12168]    Overall Loss 0.012054    Objective Loss 0.000000    Distill Loss 0.012054                                        LR 0.000250    Time 0.992815    
+2023-12-03 05:05:12,736 - Epoch: [16][ 2900/12168]    Overall Loss 0.012057    Objective Loss 0.000000    Distill Loss 0.012057                                        LR 0.000250    Time 0.995653    
+2023-12-03 05:06:42,744 - Epoch: [16][ 3000/12168]    Overall Loss 0.012054    Objective Loss 0.000000    Distill Loss 0.012054                                        LR 0.000250    Time 0.992464    
+2023-12-03 05:08:21,196 - Epoch: [16][ 3100/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.992206    
+2023-12-03 05:10:05,138 - Epoch: [16][ 3200/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.993679    
+2023-12-03 05:11:48,547 - Epoch: [16][ 3300/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.994901    
+2023-12-03 05:13:24,213 - Epoch: [16][ 3400/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.993775    
+2023-12-03 05:15:08,652 - Epoch: [16][ 3500/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.995218    
+2023-12-03 05:16:52,204 - Epoch: [16][ 3600/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.996336    
+2023-12-03 05:18:32,649 - Epoch: [16][ 3700/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.996554    
+2023-12-03 05:20:11,381 - Epoch: [16][ 3800/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.996309    
+2023-12-03 05:21:40,449 - Epoch: [16][ 3900/12168]    Overall Loss 0.012047    Objective Loss 0.000000    Distill Loss 0.012047                                        LR 0.000250    Time 0.993598    
+2023-12-03 05:23:22,820 - Epoch: [16][ 4000/12168]    Overall Loss 0.012046    Objective Loss 0.000000    Distill Loss 0.012046                                        LR 0.000250    Time 0.994349    
+2023-12-03 05:24:58,996 - Epoch: [16][ 4100/12168]    Overall Loss 0.012046    Objective Loss 0.000000    Distill Loss 0.012046                                        LR 0.000250    Time 0.993552    
+2023-12-03 05:27:00,527 - Epoch: [16][ 4200/12168]    Overall Loss 0.012047    Objective Loss 0.000000    Distill Loss 0.012047                                        LR 0.000250    Time 0.998831    
+2023-12-03 05:28:24,128 - Epoch: [16][ 4300/12168]    Overall Loss 0.012046    Objective Loss 0.000000    Distill Loss 0.012046                                        LR 0.000250    Time 0.995043    
+2023-12-03 05:29:50,069 - Epoch: [16][ 4400/12168]    Overall Loss 0.012045    Objective Loss 0.000000    Distill Loss 0.012045                                        LR 0.000250    Time 0.991958    
+2023-12-03 05:31:16,774 - Epoch: [16][ 4500/12168]    Overall Loss 0.012047    Objective Loss 0.000000    Distill Loss 0.012047                                        LR 0.000250    Time 0.989181    
+2023-12-03 05:33:03,534 - Epoch: [16][ 4600/12168]    Overall Loss 0.012045    Objective Loss 0.000000    Distill Loss 0.012045                                        LR 0.000250    Time 0.990884    
+2023-12-03 05:34:39,436 - Epoch: [16][ 4700/12168]    Overall Loss 0.012045    Objective Loss 0.000000    Distill Loss 0.012045                                        LR 0.000250    Time 0.990205    
+2023-12-03 05:36:16,417 - Epoch: [16][ 4800/12168]    Overall Loss 0.012046    Objective Loss 0.000000    Distill Loss 0.012046                                        LR 0.000250    Time 0.989778    
+2023-12-03 05:38:02,143 - Epoch: [16][ 4900/12168]    Overall Loss 0.012046    Objective Loss 0.000000    Distill Loss 0.012046                                        LR 0.000250    Time 0.991154    
+2023-12-03 05:39:40,261 - Epoch: [16][ 5000/12168]    Overall Loss 0.012046    Objective Loss 0.000000    Distill Loss 0.012046                                        LR 0.000250    Time 0.990953    
+2023-12-03 05:41:36,416 - Epoch: [16][ 5100/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.994297    
+2023-12-03 05:43:10,038 - Epoch: [16][ 5200/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.993178    
+2023-12-03 05:44:53,748 - Epoch: [16][ 5300/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.994006    
+2023-12-03 05:46:42,188 - Epoch: [16][ 5400/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.995678    
+2023-12-03 05:48:16,999 - Epoch: [16][ 5500/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.994812    
+2023-12-03 05:50:03,029 - Epoch: [16][ 5600/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.995980    
+2023-12-03 05:51:52,648 - Epoch: [16][ 5700/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.997737    
+2023-12-03 05:53:32,189 - Epoch: [16][ 5800/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.997696    
+2023-12-03 05:55:23,847 - Epoch: [16][ 5900/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.999709    
+2023-12-03 05:56:54,005 - Epoch: [16][ 6000/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.998073    
+2023-12-03 05:58:38,559 - Epoch: [16][ 6100/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.998850    
+2023-12-03 06:00:12,732 - Epoch: [16][ 6200/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.997927    
+2023-12-03 06:01:49,213 - Epoch: [16][ 6300/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.997401    
+2023-12-03 06:03:24,660 - Epoch: [16][ 6400/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.996729    
+2023-12-03 06:04:56,496 - Epoch: [16][ 6500/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.995522    
+2023-12-03 06:06:42,422 - Epoch: [16][ 6600/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.996486    
+2023-12-03 06:08:17,064 - Epoch: [16][ 6700/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.995738    
+2023-12-03 06:09:59,138 - Epoch: [16][ 6800/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.996105    
+2023-12-03 06:11:44,950 - Epoch: [16][ 6900/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.997003    
+2023-12-03 06:13:18,308 - Epoch: [16][ 7000/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.996095    
+2023-12-03 06:14:52,603 - Epoch: [16][ 7100/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.995346    
+2023-12-03 06:16:28,229 - Epoch: [16][ 7200/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.994802    
+2023-12-03 06:18:12,417 - Epoch: [16][ 7300/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.995446    
+2023-12-03 06:19:55,125 - Epoch: [16][ 7400/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.995872    
+2023-12-03 06:21:26,867 - Epoch: [16][ 7500/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.994825    
+2023-12-03 06:23:15,799 - Epoch: [16][ 7600/12168]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                                        LR 0.000250    Time 0.996068    
+2023-12-03 06:24:51,782 - Epoch: [16][ 7700/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.995596    
+2023-12-03 06:26:20,820 - Epoch: [16][ 7800/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.994247    
+2023-12-03 06:27:30,942 - Epoch: [16][ 7900/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.990537    
+2023-12-03 06:28:39,034 - Epoch: [16][ 8000/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.986666    
+2023-12-03 06:29:44,581 - Epoch: [16][ 8100/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.982577    
+2023-12-03 06:30:56,656 - Epoch: [16][ 8200/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.979383    
+2023-12-03 06:32:10,804 - Epoch: [16][ 8300/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.976516    
+2023-12-03 06:33:38,186 - Epoch: [16][ 8400/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.975292    
+2023-12-03 06:35:17,420 - Epoch: [16][ 8500/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.975492    
+2023-12-03 06:36:58,363 - Epoch: [16][ 8600/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.975886    
+2023-12-03 06:38:44,767 - Epoch: [16][ 8700/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.976898    
+2023-12-03 06:40:15,693 - Epoch: [16][ 8800/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.976129    
+2023-12-03 06:42:10,093 - Epoch: [16][ 8900/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.978014    
+2023-12-03 06:43:56,492 - Epoch: [16][ 9000/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.978969    
+2023-12-03 06:45:41,827 - Epoch: [16][ 9100/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.979785    
+2023-12-03 06:47:22,929 - Epoch: [16][ 9200/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.980124    
+2023-12-03 06:48:54,334 - Epoch: [16][ 9300/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.979413    
+2023-12-03 06:50:33,859 - Epoch: [16][ 9400/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.979580    
+2023-12-03 06:52:12,542 - Epoch: [16][ 9500/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.979656    
+2023-12-03 06:53:59,996 - Epoch: [16][ 9600/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.980644    
+2023-12-03 06:55:50,053 - Epoch: [16][ 9700/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.981879    
+2023-12-03 06:57:39,227 - Epoch: [16][ 9800/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.983000    
+2023-12-03 06:59:24,959 - Epoch: [16][ 9900/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.983749    
+2023-12-03 07:01:07,928 - Epoch: [16][10000/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.984208    
+2023-12-03 07:02:55,489 - Epoch: [16][10100/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.985112    
+2023-12-03 07:04:33,050 - Epoch: [16][10200/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.985019    
+2023-12-03 07:06:24,664 - Epoch: [16][10300/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.986291    
+2023-12-03 07:08:10,620 - Epoch: [16][10400/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.986995    
+2023-12-03 07:09:56,917 - Epoch: [16][10500/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.987718    
+2023-12-03 07:11:42,326 - Epoch: [16][10600/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.988343    
+2023-12-03 07:13:23,497 - Epoch: [16][10700/12168]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                                        LR 0.000250    Time 0.988561    
+2023-12-03 07:15:03,532 - Epoch: [16][10800/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.988669    
+2023-12-03 07:16:45,663 - Epoch: [16][10900/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.988968    
+2023-12-03 07:18:24,780 - Epoch: [16][11000/12168]    Overall Loss 0.012050    Objective Loss 0.000000    Distill Loss 0.012050                                        LR 0.000250    Time 0.988987    
+2023-12-03 07:20:12,867 - Epoch: [16][11100/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.989814    
+2023-12-03 07:22:12,343 - Epoch: [16][11200/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.991644    
+2023-12-03 07:24:01,543 - Epoch: [16][11300/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.992531    
+2023-12-03 07:25:59,117 - Epoch: [16][11400/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.994138    
+2023-12-03 07:27:46,976 - Epoch: [16][11500/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.994871    
+2023-12-03 07:29:33,076 - Epoch: [16][11600/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.995441    
+2023-12-03 07:31:20,316 - Epoch: [16][11700/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.996098    
+2023-12-03 07:33:10,181 - Epoch: [16][11800/12168]    Overall Loss 0.012052    Objective Loss 0.000000    Distill Loss 0.012052                                        LR 0.000250    Time 0.996966    
+2023-12-03 07:34:54,842 - Epoch: [16][11900/12168]    Overall Loss 0.012052    Objective Loss 0.000000    Distill Loss 0.012052                                        LR 0.000250    Time 0.997383    
+2023-12-03 07:36:50,899 - Epoch: [16][12000/12168]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                                        LR 0.000250    Time 0.998742    
+2023-12-03 07:38:30,772 - Epoch: [16][12100/12168]    Overall Loss 0.012052    Objective Loss 0.000000    Distill Loss 0.012052                                        LR 0.000250    Time 0.998742    
+2023-12-03 07:39:39,592 - Epoch: [16][12168/12168]    Overall Loss 0.012052    Objective Loss 0.000000    Distill Loss 0.012052                                        LR 0.000250    Time 0.998816    
+2023-12-03 07:39:40,119 - --- validate (epoch=16)-----------
+2023-12-03 07:39:40,119 - 167951 samples (256 per mini-batch)
+2023-12-03 07:40:35,269 - Epoch: [16][  100/  657]    Loss 0.000000    Overall Loss 0.012739    
+2023-12-03 07:41:23,173 - Epoch: [16][  200/  657]    Loss 0.000000    Overall Loss 0.012761    
+2023-12-03 07:42:11,034 - Epoch: [16][  300/  657]    Loss 0.000000    Overall Loss 0.012752    
+2023-12-03 07:42:58,928 - Epoch: [16][  400/  657]    Loss 0.000000    Overall Loss 0.012748    
+2023-12-03 07:43:46,821 - Epoch: [16][  500/  657]    Loss 0.000000    Overall Loss 0.012744    
+2023-12-03 07:44:34,750 - Epoch: [16][  600/  657]    Loss 0.000000    Overall Loss 0.012744    
+2023-12-03 07:45:01,669 - Epoch: [16][  657/  657]    Loss 0.000000    Overall Loss 0.012744    
+2023-12-03 07:45:02,087 - ==> Overall Loss: 0.013
+
+2023-12-03 07:45:02,090 - ==> Best [Overall Loss: 0.012744 on epoch: 16]
+2023-12-03 07:45:02,090 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 07:45:02,120 - 
+
+2023-12-03 07:45:02,121 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 07:47:06,114 - Epoch: [17][  100/12168]    Overall Loss 0.011989    Objective Loss 0.000000    Distill Loss 0.011989                                        LR 0.000250    Time 1.239864    
+2023-12-03 07:49:00,931 - Epoch: [17][  200/12168]    Overall Loss 0.012009    Objective Loss 0.000000    Distill Loss 0.012009                                        LR 0.000250    Time 1.193981    
+2023-12-03 07:50:49,275 - Epoch: [17][  300/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.157108    
+2023-12-03 07:52:21,237 - Epoch: [17][  400/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 1.097720    
+2023-12-03 07:54:07,200 - Epoch: [17][  500/12168]    Overall Loss 0.012022    Objective Loss 0.000000    Distill Loss 0.012022                                        LR 0.000250    Time 1.090088    
+2023-12-03 07:55:38,533 - Epoch: [17][  600/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 1.060617    
+2023-12-03 07:57:08,040 - Epoch: [17][  700/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.036956    
+2023-12-03 07:58:51,683 - Epoch: [17][  800/12168]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                                        LR 0.000250    Time 1.036881    
+2023-12-03 08:00:20,732 - Epoch: [17][  900/12168]    Overall Loss 0.012036    Objective Loss 0.000000    Distill Loss 0.012036                                        LR 0.000250    Time 1.020607    
+2023-12-03 08:01:51,982 - Epoch: [17][ 1000/12168]    Overall Loss 0.012036    Objective Loss 0.000000    Distill Loss 0.012036                                        LR 0.000250    Time 1.009789    
+2023-12-03 08:03:23,100 - Epoch: [17][ 1100/12168]    Overall Loss 0.012037    Objective Loss 0.000000    Distill Loss 0.012037                                        LR 0.000250    Time 1.000817    
+2023-12-03 08:04:54,818 - Epoch: [17][ 1200/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 0.993842    
+2023-12-03 08:06:36,633 - Epoch: [17][ 1300/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 0.995705    
+2023-12-03 08:08:12,542 - Epoch: [17][ 1400/12168]    Overall Loss 0.012035    Objective Loss 0.000000    Distill Loss 0.012035                                        LR 0.000250    Time 0.993085    
+2023-12-03 08:09:36,211 - Epoch: [17][ 1500/12168]    Overall Loss 0.012037    Objective Loss 0.000000    Distill Loss 0.012037                                        LR 0.000250    Time 0.982654    
+2023-12-03 08:11:32,439 - Epoch: [17][ 1600/12168]    Overall Loss 0.012035    Objective Loss 0.000000    Distill Loss 0.012035                                        LR 0.000250    Time 0.993877    
+2023-12-03 08:13:11,821 - Epoch: [17][ 1700/12168]    Overall Loss 0.012039    Objective Loss 0.000000    Distill Loss 0.012039                                        LR 0.000250    Time 0.993869    
+2023-12-03 08:14:47,420 - Epoch: [17][ 1800/12168]    Overall Loss 0.012037    Objective Loss 0.000000    Distill Loss 0.012037                                        LR 0.000250    Time 0.991760    
+2023-12-03 08:16:38,765 - Epoch: [17][ 1900/12168]    Overall Loss 0.012037    Objective Loss 0.000000    Distill Loss 0.012037                                        LR 0.000250    Time 0.998161    
+2023-12-03 08:18:22,964 - Epoch: [17][ 2000/12168]    Overall Loss 0.012036    Objective Loss 0.000000    Distill Loss 0.012036                                        LR 0.000250    Time 1.000350    
+2023-12-03 08:20:14,962 - Epoch: [17][ 2100/12168]    Overall Loss 0.012038    Objective Loss 0.000000    Distill Loss 0.012038                                        LR 0.000250    Time 1.006043    
+2023-12-03 08:21:53,889 - Epoch: [17][ 2200/12168]    Overall Loss 0.012039    Objective Loss 0.000000    Distill Loss 0.012039                                        LR 0.000250    Time 1.005277    
+2023-12-03 08:23:29,443 - Epoch: [17][ 2300/12168]    Overall Loss 0.012037    Objective Loss 0.000000    Distill Loss 0.012037                                        LR 0.000250    Time 1.003111    
+2023-12-03 08:25:03,354 - Epoch: [17][ 2400/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.000441    
+2023-12-03 08:26:49,923 - Epoch: [17][ 2500/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.003048    
+2023-12-03 08:28:15,345 - Epoch: [17][ 2600/12168]    Overall Loss 0.012030    Objective Loss 0.000000    Distill Loss 0.012030                                        LR 0.000250    Time 0.997321    
+2023-12-03 08:29:54,247 - Epoch: [17][ 2700/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 0.997011    
+2023-12-03 08:31:37,888 - Epoch: [17][ 2800/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 0.998416    
+2023-12-03 08:33:10,913 - Epoch: [17][ 2900/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 0.996063    
+2023-12-03 08:34:38,525 - Epoch: [17][ 3000/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 0.992062    
+2023-12-03 08:36:16,849 - Epoch: [17][ 3100/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 0.991776    
+2023-12-03 08:38:03,372 - Epoch: [17][ 3200/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 0.994069    
+2023-12-03 08:39:41,013 - Epoch: [17][ 3300/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 0.993524    
+2023-12-03 08:41:26,431 - Epoch: [17][ 3400/12168]    Overall Loss 0.012030    Objective Loss 0.000000    Distill Loss 0.012030                                        LR 0.000250    Time 0.995306    
+2023-12-03 08:43:08,272 - Epoch: [17][ 3500/12168]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                                        LR 0.000250    Time 0.995964    
+2023-12-03 08:44:46,591 - Epoch: [17][ 3600/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 0.995607    
+2023-12-03 08:46:40,305 - Epoch: [17][ 3700/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 0.999431    
+2023-12-03 08:48:22,639 - Epoch: [17][ 3800/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 1.000058    
+2023-12-03 08:49:53,478 - Epoch: [17][ 3900/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 0.997706    
+2023-12-03 08:51:37,794 - Epoch: [17][ 4000/12168]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                                        LR 0.000250    Time 0.998840    
+2023-12-03 08:53:18,432 - Epoch: [17][ 4100/12168]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                                        LR 0.000250    Time 0.999022    
+2023-12-03 08:55:03,562 - Epoch: [17][ 4200/12168]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                                        LR 0.000250    Time 1.000265    
+2023-12-03 08:56:47,066 - Epoch: [17][ 4300/12168]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                                        LR 0.000250    Time 1.001073    
+2023-12-03 08:58:23,275 - Epoch: [17][ 4400/12168]    Overall Loss 0.012025    Objective Loss 0.000000    Distill Loss 0.012025                                        LR 0.000250    Time 1.000185    
+2023-12-03 08:59:56,969 - Epoch: [17][ 4500/12168]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                                        LR 0.000250    Time 0.998778    
+2023-12-03 09:01:38,187 - Epoch: [17][ 4600/12168]    Overall Loss 0.012025    Objective Loss 0.000000    Distill Loss 0.012025                                        LR 0.000250    Time 0.999068    
+2023-12-03 09:03:32,557 - Epoch: [17][ 4700/12168]    Overall Loss 0.012025    Objective Loss 0.000000    Distill Loss 0.012025                                        LR 0.000250    Time 1.002143    
+2023-12-03 09:05:14,037 - Epoch: [17][ 4800/12168]    Overall Loss 0.012025    Objective Loss 0.000000    Distill Loss 0.012025                                        LR 0.000250    Time 1.002406    
+2023-12-03 09:06:58,721 - Epoch: [17][ 4900/12168]    Overall Loss 0.012025    Objective Loss 0.000000    Distill Loss 0.012025                                        LR 0.000250    Time 1.003311    
+2023-12-03 09:08:55,691 - Epoch: [17][ 5000/12168]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                                        LR 0.000250    Time 1.006637    
+2023-12-03 09:10:38,403 - Epoch: [17][ 5100/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 1.007038    
+2023-12-03 09:12:29,970 - Epoch: [17][ 5200/12168]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                                        LR 0.000250    Time 1.009126    
+2023-12-03 09:14:13,227 - Epoch: [17][ 5300/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 1.009567    
+2023-12-03 09:15:57,416 - Epoch: [17][ 5400/12168]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                                        LR 0.000250    Time 1.010164    
+2023-12-03 09:17:25,818 - Epoch: [17][ 5500/12168]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                                        LR 0.000250    Time 1.007869    
+2023-12-03 09:19:17,866 - Epoch: [17][ 5600/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 1.009879    
+2023-12-03 09:21:00,247 - Epoch: [17][ 5700/12168]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                                        LR 0.000250    Time 1.010122    
+2023-12-03 09:22:33,269 - Epoch: [17][ 5800/12168]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                                        LR 0.000250    Time 1.008743    
+2023-12-03 09:24:12,737 - Epoch: [17][ 5900/12168]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                                        LR 0.000250    Time 1.008503    
+2023-12-03 09:25:54,837 - Epoch: [17][ 6000/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.008711    
+2023-12-03 09:27:29,579 - Epoch: [17][ 6100/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.007704    
+2023-12-03 09:29:02,938 - Epoch: [17][ 6200/12168]    Overall Loss 0.012030    Objective Loss 0.000000    Distill Loss 0.012030                                        LR 0.000250    Time 1.006508    
+2023-12-03 09:30:51,313 - Epoch: [17][ 6300/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.007733    
+2023-12-03 09:32:31,860 - Epoch: [17][ 6400/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.007696    
+2023-12-03 09:34:28,709 - Epoch: [17][ 6500/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.010169    
+2023-12-03 09:36:11,647 - Epoch: [17][ 6600/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.010459    
+2023-12-03 09:37:40,218 - Epoch: [17][ 6700/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.008596    
+2023-12-03 09:39:40,285 - Epoch: [17][ 6800/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.011420    
+2023-12-03 09:41:19,340 - Epoch: [17][ 6900/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.011116    
+2023-12-03 09:42:47,820 - Epoch: [17][ 7000/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.009311    
+2023-12-03 09:44:39,302 - Epoch: [17][ 7100/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.010796    
+2023-12-03 09:46:22,240 - Epoch: [17][ 7200/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.011053    
+2023-12-03 09:47:45,390 - Epoch: [17][ 7300/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.008592    
+2023-12-03 09:49:26,131 - Epoch: [17][ 7400/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.008576    
+2023-12-03 09:51:03,825 - Epoch: [17][ 7500/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.008153    
+2023-12-03 09:52:53,986 - Epoch: [17][ 7600/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.009382    
+2023-12-03 09:54:42,470 - Epoch: [17][ 7700/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.010361    
+2023-12-03 09:56:24,715 - Epoch: [17][ 7800/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.010515    
+2023-12-03 09:58:07,900 - Epoch: [17][ 7900/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.010784    
+2023-12-03 09:59:53,477 - Epoch: [17][ 8000/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.011345    
+2023-12-03 10:01:37,810 - Epoch: [17][ 8100/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.011740    
+2023-12-03 10:03:21,431 - Epoch: [17][ 8200/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.012037    
+2023-12-03 10:05:09,526 - Epoch: [17][ 8300/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.012866    
+2023-12-03 10:06:50,794 - Epoch: [17][ 8400/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.012863    
+2023-12-03 10:08:31,485 - Epoch: [17][ 8500/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.012793    
+2023-12-03 10:10:06,470 - Epoch: [17][ 8600/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.012060    
+2023-12-03 10:11:56,808 - Epoch: [17][ 8700/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.013109    
+2023-12-03 10:13:43,538 - Epoch: [17][ 8800/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.013724    
+2023-12-03 10:15:40,177 - Epoch: [17][ 8900/12168]    Overall Loss 0.012031    Objective Loss 0.000000    Distill Loss 0.012031                                        LR 0.000250    Time 1.015438    
+2023-12-03 10:17:13,997 - Epoch: [17][ 9000/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.014579    
+2023-12-03 10:18:52,012 - Epoch: [17][ 9100/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.014200    
+2023-12-03 10:20:28,547 - Epoch: [17][ 9200/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.013668    
+2023-12-03 10:22:23,402 - Epoch: [17][ 9300/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.015118    
+2023-12-03 10:24:06,397 - Epoch: [17][ 9400/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.015275    
+2023-12-03 10:25:25,130 - Epoch: [17][ 9500/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.012875    
+2023-12-03 10:26:34,149 - Epoch: [17][ 9600/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.009513    
+2023-12-03 10:27:43,389 - Epoch: [17][ 9700/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.006244    
+2023-12-03 10:28:52,467 - Epoch: [17][ 9800/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.003024    
+2023-12-03 10:30:01,956 - Epoch: [17][ 9900/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 0.999911    
+2023-12-03 10:31:28,614 - Epoch: [17][10000/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 0.998577    
+2023-12-03 10:33:33,346 - Epoch: [17][10100/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.001039    
+2023-12-03 10:35:10,556 - Epoch: [17][10200/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.000755    
+2023-12-03 10:37:09,479 - Epoch: [17][10300/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.002584    
+2023-12-03 10:39:06,782 - Epoch: [17][10400/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.004222    
+2023-12-03 10:40:40,905 - Epoch: [17][10500/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.003621    
+2023-12-03 10:42:20,259 - Epoch: [17][10600/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.003526    
+2023-12-03 10:44:03,682 - Epoch: [17][10700/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.003812    
+2023-12-03 10:46:10,313 - Epoch: [17][10800/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.006242    
+2023-12-03 10:48:02,806 - Epoch: [17][10900/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.007330    
+2023-12-03 10:49:50,748 - Epoch: [17][11000/12168]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                                        LR 0.000250    Time 1.007985    
+2023-12-03 10:51:48,927 - Epoch: [17][11100/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.009550    
+2023-12-03 10:53:18,771 - Epoch: [17][11200/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.008557    
+2023-12-03 10:55:19,356 - Epoch: [17][11300/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.010303    
+2023-12-03 10:56:57,877 - Epoch: [17][11400/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.010082    
+2023-12-03 10:58:54,549 - Epoch: [17][11500/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.011443    
+2023-12-03 11:00:54,884 - Epoch: [17][11600/12168]    Overall Loss 0.012033    Objective Loss 0.000000    Distill Loss 0.012033                                        LR 0.000250    Time 1.013097    
+2023-12-03 11:02:57,196 - Epoch: [17][11700/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.014891    
+2023-12-03 11:04:51,951 - Epoch: [17][11800/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.016015    
+2023-12-03 11:06:48,544 - Epoch: [17][11900/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.017274    
+2023-12-03 11:08:47,095 - Epoch: [17][12000/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.018676    
+2023-12-03 11:10:33,901 - Epoch: [17][12100/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.019083    
+2023-12-03 11:11:42,259 - Epoch: [17][12168/12168]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                                        LR 0.000250    Time 1.019006    
+2023-12-03 11:11:42,942 - --- validate (epoch=17)-----------
+2023-12-03 11:11:42,942 - 167951 samples (256 per mini-batch)
+2023-12-03 11:12:37,349 - Epoch: [17][  100/  657]    Loss 0.000000    Overall Loss 0.012685    
+2023-12-03 11:13:25,254 - Epoch: [17][  200/  657]    Loss 0.000000    Overall Loss 0.012688    
+2023-12-03 11:14:13,176 - Epoch: [17][  300/  657]    Loss 0.000000    Overall Loss 0.012697    
+2023-12-03 11:15:01,107 - Epoch: [17][  400/  657]    Loss 0.000000    Overall Loss 0.012707    
+2023-12-03 11:15:49,079 - Epoch: [17][  500/  657]    Loss 0.000000    Overall Loss 0.012707    
+2023-12-03 11:16:37,013 - Epoch: [17][  600/  657]    Loss 0.000000    Overall Loss 0.012705    
+2023-12-03 11:17:03,978 - Epoch: [17][  657/  657]    Loss 0.000000    Overall Loss 0.012711    
+2023-12-03 11:17:04,342 - ==> Overall Loss: 0.013
+
+2023-12-03 11:17:04,344 - ==> Best [Overall Loss: 0.012711 on epoch: 17]
+2023-12-03 11:17:04,344 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 11:17:04,372 - 
+
+2023-12-03 11:17:04,372 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 11:19:20,933 - Epoch: [18][  100/12168]    Overall Loss 0.011966    Objective Loss 0.000000    Distill Loss 0.011966                                        LR 0.000250    Time 1.365537    
+2023-12-03 11:21:05,172 - Epoch: [18][  200/12168]    Overall Loss 0.011963    Objective Loss 0.000000    Distill Loss 0.011963                                        LR 0.000250    Time 1.203923    
+2023-12-03 11:22:38,366 - Epoch: [18][  300/12168]    Overall Loss 0.011987    Objective Loss 0.000000    Distill Loss 0.011987                                        LR 0.000250    Time 1.113239    
+2023-12-03 11:24:14,363 - Epoch: [18][  400/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.074902    
+2023-12-03 11:25:45,617 - Epoch: [18][  500/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.042416    
+2023-12-03 11:27:35,765 - Epoch: [18][  600/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.052247    
+2023-12-03 11:29:20,677 - Epoch: [18][  700/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.051790    
+2023-12-03 11:30:53,830 - Epoch: [18][  800/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 1.036748    
+2023-12-03 11:32:31,824 - Epoch: [18][  900/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.030428    
+2023-12-03 11:34:16,278 - Epoch: [18][ 1000/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 1.031831    
+2023-12-03 11:35:47,748 - Epoch: [18][ 1100/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.021177    
+2023-12-03 11:37:15,343 - Epoch: [18][ 1200/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 1.009068    
+2023-12-03 11:38:45,904 - Epoch: [18][ 1300/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.001105    
+2023-12-03 11:40:19,566 - Epoch: [18][ 1400/12168]    Overall Loss 0.012009    Objective Loss 0.000000    Distill Loss 0.012009                                        LR 0.000250    Time 0.996493    
+2023-12-03 11:42:05,620 - Epoch: [18][ 1500/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 1.000757    
+2023-12-03 11:43:41,335 - Epoch: [18][ 1600/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 0.998028    
+2023-12-03 11:45:25,258 - Epoch: [18][ 1700/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.000447    
+2023-12-03 11:46:52,711 - Epoch: [18][ 1800/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.993448    
+2023-12-03 11:48:31,766 - Epoch: [18][ 1900/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 0.993291    
+2023-12-03 11:50:04,200 - Epoch: [18][ 2000/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 0.989839    
+2023-12-03 11:51:34,602 - Epoch: [18][ 2100/12168]    Overall Loss 0.012019    Objective Loss 0.000000    Distill Loss 0.012019                                        LR 0.000250    Time 0.985750    
+2023-12-03 11:53:00,700 - Epoch: [18][ 2200/12168]    Overall Loss 0.012021    Objective Loss 0.000000    Distill Loss 0.012021                                        LR 0.000250    Time 0.980075    
+2023-12-03 11:54:49,520 - Epoch: [18][ 2300/12168]    Overall Loss 0.012019    Objective Loss 0.000000    Distill Loss 0.012019                                        LR 0.000250    Time 0.984773    
+2023-12-03 11:56:37,285 - Epoch: [18][ 2400/12168]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                                        LR 0.000250    Time 0.988639    
+2023-12-03 11:58:04,985 - Epoch: [18][ 2500/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.984171    
+2023-12-03 11:59:33,127 - Epoch: [18][ 2600/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.980216    
+2023-12-03 12:01:20,649 - Epoch: [18][ 2700/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.983732    
+2023-12-03 12:03:10,302 - Epoch: [18][ 2800/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 0.987758    
+2023-12-03 12:04:46,996 - Epoch: [18][ 2900/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.987038    
+2023-12-03 12:06:42,617 - Epoch: [18][ 3000/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.992674    
+2023-12-03 12:08:18,944 - Epoch: [18][ 3100/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.991724    
+2023-12-03 12:10:10,881 - Epoch: [18][ 3200/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.995710    
+2023-12-03 12:11:55,455 - Epoch: [18][ 3300/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.997224    
+2023-12-03 12:13:17,041 - Epoch: [18][ 3400/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.991888    
+2023-12-03 12:15:01,892 - Epoch: [18][ 3500/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 0.993503    
+2023-12-03 12:16:45,880 - Epoch: [18][ 3600/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.994790    
+2023-12-03 12:18:21,948 - Epoch: [18][ 3700/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.993866    
+2023-12-03 12:20:09,208 - Epoch: [18][ 3800/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 0.995936    
+2023-12-03 12:21:51,050 - Epoch: [18][ 3900/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 0.996511    
+2023-12-03 12:23:37,476 - Epoch: [18][ 4000/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.998203    
+2023-12-03 12:25:10,603 - Epoch: [18][ 4100/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.996568    
+2023-12-03 12:26:51,780 - Epoch: [18][ 4200/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.996929    
+2023-12-03 12:28:36,448 - Epoch: [18][ 4300/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.998084    
+2023-12-03 12:30:12,801 - Epoch: [18][ 4400/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.997297    
+2023-12-03 12:31:51,565 - Epoch: [18][ 4500/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.997081    
+2023-12-03 12:33:38,016 - Epoch: [18][ 4600/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.998545    
+2023-12-03 12:35:21,207 - Epoch: [18][ 4700/12168]    Overall Loss 0.012011    Objective Loss 0.000000    Distill Loss 0.012011                                        LR 0.000250    Time 0.999254    
+2023-12-03 12:36:54,383 - Epoch: [18][ 4800/12168]    Overall Loss 0.012010    Objective Loss 0.000000    Distill Loss 0.012010                                        LR 0.000250    Time 0.997846    
+2023-12-03 12:38:34,414 - Epoch: [18][ 4900/12168]    Overall Loss 0.012009    Objective Loss 0.000000    Distill Loss 0.012009                                        LR 0.000250    Time 0.997895    
+2023-12-03 12:40:14,387 - Epoch: [18][ 5000/12168]    Overall Loss 0.012010    Objective Loss 0.000000    Distill Loss 0.012010                                        LR 0.000250    Time 0.997930    
+2023-12-03 12:41:53,524 - Epoch: [18][ 5100/12168]    Overall Loss 0.012011    Objective Loss 0.000000    Distill Loss 0.012011                                        LR 0.000250    Time 0.997800    
+2023-12-03 12:43:28,861 - Epoch: [18][ 5200/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 0.996944    
+2023-12-03 12:45:09,561 - Epoch: [18][ 5300/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.997133    
+2023-12-03 12:46:50,229 - Epoch: [18][ 5400/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 0.997308    
+2023-12-03 12:48:14,842 - Epoch: [18][ 5500/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.994558    
+2023-12-03 12:50:01,841 - Epoch: [18][ 5600/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 0.995904    
+2023-12-03 12:51:34,620 - Epoch: [18][ 5700/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 0.994708    
+2023-12-03 12:53:24,136 - Epoch: [18][ 5800/12168]    Overall Loss 0.012011    Objective Loss 0.000000    Distill Loss 0.012011                                        LR 0.000250    Time 0.996438    
+2023-12-03 12:55:04,216 - Epoch: [18][ 5900/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.996511    
+2023-12-03 12:56:47,696 - Epoch: [18][ 6000/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.997148    
+2023-12-03 12:58:30,940 - Epoch: [18][ 6100/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.997725    
+2023-12-03 12:59:59,940 - Epoch: [18][ 6200/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 0.995986    
+2023-12-03 13:01:53,901 - Epoch: [18][ 6300/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.998265    
+2023-12-03 13:03:36,957 - Epoch: [18][ 6400/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.998769    
+2023-12-03 13:05:27,090 - Epoch: [18][ 6500/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.000345    
+2023-12-03 13:06:59,902 - Epoch: [18][ 6600/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.999250    
+2023-12-03 13:08:37,076 - Epoch: [18][ 6700/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 0.998838    
+2023-12-03 13:10:23,328 - Epoch: [18][ 6800/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 0.999774    
+2023-12-03 13:12:08,191 - Epoch: [18][ 6900/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.000481    
+2023-12-03 13:14:11,923 - Epoch: [18][ 7000/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.003863    
+2023-12-03 13:15:50,948 - Epoch: [18][ 7100/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 1.003671    
+2023-12-03 13:17:27,306 - Epoch: [18][ 7200/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.003113    
+2023-12-03 13:19:03,335 - Epoch: [18][ 7300/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.002525    
+2023-12-03 13:20:36,261 - Epoch: [18][ 7400/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.001534    
+2023-12-03 13:22:14,928 - Epoch: [18][ 7500/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.001335    
+2023-12-03 13:24:18,650 - Epoch: [18][ 7600/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.004438    
+2023-12-03 13:26:07,101 - Epoch: [18][ 7700/12168]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                                        LR 0.000250    Time 1.005477    
+2023-12-03 13:27:50,341 - Epoch: [18][ 7800/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.005821    
+2023-12-03 13:29:30,916 - Epoch: [18][ 7900/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.005819    
+2023-12-03 13:31:11,741 - Epoch: [18][ 8000/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.005849    
+2023-12-03 13:32:45,401 - Epoch: [18][ 8100/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.004993    
+2023-12-03 13:34:27,951 - Epoch: [18][ 8200/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.005242    
+2023-12-03 13:36:07,887 - Epoch: [18][ 8300/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.005170    
+2023-12-03 13:37:55,316 - Epoch: [18][ 8400/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.005992    
+2023-12-03 13:39:32,287 - Epoch: [18][ 8500/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.005565    
+2023-12-03 13:41:25,455 - Epoch: [18][ 8600/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.007030    
+2023-12-03 13:43:10,357 - Epoch: [18][ 8700/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.007512    
+2023-12-03 13:45:04,218 - Epoch: [18][ 8800/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.009001    
+2023-12-03 13:46:42,351 - Epoch: [18][ 8900/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.008689    
+2023-12-03 13:48:17,569 - Epoch: [18][ 9000/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.008061    
+2023-12-03 13:50:06,716 - Epoch: [18][ 9100/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.008977    
+2023-12-03 13:51:44,916 - Epoch: [18][ 9200/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.008683    
+2023-12-03 13:53:24,978 - Epoch: [18][ 9300/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.008595    
+2023-12-03 13:55:07,084 - Epoch: [18][ 9400/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.008727    
+2023-12-03 13:56:48,913 - Epoch: [18][ 9500/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.008827    
+2023-12-03 13:58:23,287 - Epoch: [18][ 9600/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.008148    
+2023-12-03 14:00:04,173 - Epoch: [18][ 9700/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 1.008155    
+2023-12-03 14:01:48,087 - Epoch: [18][ 9800/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.008470    
+2023-12-03 14:03:35,443 - Epoch: [18][ 9900/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009127    
+2023-12-03 14:05:19,859 - Epoch: [18][10000/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009477    
+2023-12-03 14:07:05,884 - Epoch: [18][10100/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009979    
+2023-12-03 14:08:54,158 - Epoch: [18][10200/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.010691    
+2023-12-03 14:10:29,410 - Epoch: [18][10300/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.010126    
+2023-12-03 14:12:10,818 - Epoch: [18][10400/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.010163    
+2023-12-03 14:13:50,089 - Epoch: [18][10500/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009996    
+2023-12-03 14:15:26,710 - Epoch: [18][10600/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009583    
+2023-12-03 14:17:13,276 - Epoch: [18][10700/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.010106    
+2023-12-03 14:18:59,328 - Epoch: [18][10800/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.010572    
+2023-12-03 14:20:27,127 - Epoch: [18][10900/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009355    
+2023-12-03 14:22:05,876 - Epoch: [18][11000/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.009156    
+2023-12-03 14:23:13,618 - Epoch: [18][11100/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 1.006167    
+2023-12-03 14:24:23,939 - Epoch: [18][11200/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 1.003462    
+2023-12-03 14:25:32,214 - Epoch: [18][11300/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 1.000623    
+2023-12-03 14:26:43,574 - Epoch: [18][11400/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.998105    
+2023-12-03 14:27:57,062 - Epoch: [18][11500/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.995815    
+2023-12-03 14:29:36,588 - Epoch: [18][11600/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.995810    
+2023-12-03 14:31:30,303 - Epoch: [18][11700/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 0.997017    
+2023-12-03 14:33:11,876 - Epoch: [18][11800/12168]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                                        LR 0.000250    Time 0.997175    
+2023-12-03 14:35:09,275 - Epoch: [18][11900/12168]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                                        LR 0.000250    Time 0.998661    
+2023-12-03 14:37:00,498 - Epoch: [18][12000/12168]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                                        LR 0.000250    Time 0.999606    
+2023-12-03 14:38:47,266 - Epoch: [18][12100/12168]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                                        LR 0.000250    Time 1.000168    
+2023-12-03 14:39:48,578 - Epoch: [18][12168/12168]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                                        LR 0.000250    Time 0.999618    
+2023-12-03 14:39:49,336 - --- validate (epoch=18)-----------
+2023-12-03 14:39:49,337 - 167951 samples (256 per mini-batch)
+2023-12-03 14:40:42,064 - Epoch: [18][  100/  657]    Loss 0.000000    Overall Loss 0.012701    
+2023-12-03 14:41:29,939 - Epoch: [18][  200/  657]    Loss 0.000000    Overall Loss 0.012692    
+2023-12-03 14:42:17,836 - Epoch: [18][  300/  657]    Loss 0.000000    Overall Loss 0.012704    
+2023-12-03 14:43:05,777 - Epoch: [18][  400/  657]    Loss 0.000000    Overall Loss 0.012696    
+2023-12-03 14:43:53,683 - Epoch: [18][  500/  657]    Loss 0.000000    Overall Loss 0.012700    
+2023-12-03 14:44:41,654 - Epoch: [18][  600/  657]    Loss 0.000000    Overall Loss 0.012699    
+2023-12-03 14:45:08,573 - Epoch: [18][  657/  657]    Loss 0.000000    Overall Loss 0.012698    
+2023-12-03 14:45:08,974 - ==> Overall Loss: 0.013
+
+2023-12-03 14:45:08,976 - ==> Best [Overall Loss: 0.012698 on epoch: 18]
+2023-12-03 14:45:08,976 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 14:45:09,001 - 
+
+2023-12-03 14:45:09,001 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 14:47:14,159 - Epoch: [19][  100/12168]    Overall Loss 0.011959    Objective Loss 0.000000    Distill Loss 0.011959                                        LR 0.000250    Time 1.251504    
+2023-12-03 14:48:58,791 - Epoch: [19][  200/12168]    Overall Loss 0.011986    Objective Loss 0.000000    Distill Loss 0.011986                                        LR 0.000250    Time 1.148877    
+2023-12-03 14:50:30,927 - Epoch: [19][  300/12168]    Overall Loss 0.011999    Objective Loss 0.000000    Distill Loss 0.011999                                        LR 0.000250    Time 1.073015    
+2023-12-03 14:52:27,927 - Epoch: [19][  400/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.097241    
+2023-12-03 14:54:04,419 - Epoch: [19][  500/12168]    Overall Loss 0.012000    Objective Loss 0.000000    Distill Loss 0.012000                                        LR 0.000250    Time 1.070763    
+2023-12-03 14:55:57,697 - Epoch: [19][  600/12168]    Overall Loss 0.011993    Objective Loss 0.000000    Distill Loss 0.011993                                        LR 0.000250    Time 1.081088    
+2023-12-03 14:57:33,420 - Epoch: [19][  700/12168]    Overall Loss 0.011997    Objective Loss 0.000000    Distill Loss 0.011997                                        LR 0.000250    Time 1.063384    
+2023-12-03 14:59:08,541 - Epoch: [19][  800/12168]    Overall Loss 0.011998    Objective Loss 0.000000    Distill Loss 0.011998                                        LR 0.000250    Time 1.049353    
+2023-12-03 15:00:58,540 - Epoch: [19][  900/12168]    Overall Loss 0.011999    Objective Loss 0.000000    Distill Loss 0.011999                                        LR 0.000250    Time 1.054972    
+2023-12-03 15:02:41,440 - Epoch: [19][ 1000/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.052368    
+2023-12-03 15:04:15,847 - Epoch: [19][ 1100/12168]    Overall Loss 0.012010    Objective Loss 0.000000    Distill Loss 0.012010                                        LR 0.000250    Time 1.042516    
+2023-12-03 15:05:55,123 - Epoch: [19][ 1200/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 1.038363    
+2023-12-03 15:07:21,295 - Epoch: [19][ 1300/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.024770    
+2023-12-03 15:08:53,051 - Epoch: [19][ 1400/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.017107    
+2023-12-03 15:10:35,020 - Epoch: [19][ 1500/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.017274    
+2023-12-03 15:12:17,821 - Epoch: [19][ 1600/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.017940    
+2023-12-03 15:13:46,350 - Epoch: [19][ 1700/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.010133    
+2023-12-03 15:15:34,230 - Epoch: [19][ 1800/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.013943    
+2023-12-03 15:17:17,604 - Epoch: [19][ 1900/12168]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                                        LR 0.000250    Time 1.014981    
+2023-12-03 15:19:02,165 - Epoch: [19][ 2000/12168]    Overall Loss 0.012015    Objective Loss 0.000000    Distill Loss 0.012015                                        LR 0.000250    Time 1.016509    
+2023-12-03 15:20:39,219 - Epoch: [19][ 2100/12168]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                                        LR 0.000250    Time 1.014315    
+2023-12-03 15:22:08,576 - Epoch: [19][ 2200/12168]    Overall Loss 0.012019    Objective Loss 0.000000    Distill Loss 0.012019                                        LR 0.000250    Time 1.008824    
+2023-12-03 15:23:53,899 - Epoch: [19][ 2300/12168]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                                        LR 0.000250    Time 1.010751    
+2023-12-03 15:25:37,259 - Epoch: [19][ 2400/12168]    Overall Loss 0.012012    Objective Loss 0.000000    Distill Loss 0.012012                                        LR 0.000250    Time 1.011700    
+2023-12-03 15:27:05,491 - Epoch: [19][ 2500/12168]    Overall Loss 0.012009    Objective Loss 0.000000    Distill Loss 0.012009                                        LR 0.000250    Time 1.006522    
+2023-12-03 15:28:49,192 - Epoch: [19][ 2600/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.007692    
+2023-12-03 15:30:16,055 - Epoch: [19][ 2700/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.002539    
+2023-12-03 15:31:51,526 - Epoch: [19][ 2800/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.000828    
+2023-12-03 15:33:20,070 - Epoch: [19][ 2900/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 0.996847    
+2023-12-03 15:35:07,652 - Epoch: [19][ 3000/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 0.999477    
+2023-12-03 15:37:02,350 - Epoch: [19][ 3100/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.004232    
+2023-12-03 15:38:43,371 - Epoch: [19][ 3200/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.004417    
+2023-12-03 15:40:10,645 - Epoch: [19][ 3300/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.000424    
+2023-12-03 15:41:59,036 - Epoch: [19][ 3400/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.002877    
+2023-12-03 15:43:36,681 - Epoch: [19][ 3500/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.002120    
+2023-12-03 15:45:11,785 - Epoch: [19][ 3600/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.000700    
+2023-12-03 15:46:53,982 - Epoch: [19][ 3700/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.001273    
+2023-12-03 15:48:25,696 - Epoch: [19][ 3800/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 0.999057    
+2023-12-03 15:50:10,849 - Epoch: [19][ 3900/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.000400    
+2023-12-03 15:51:48,512 - Epoch: [19][ 4000/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 0.999804    
+2023-12-03 15:53:23,589 - Epoch: [19][ 4100/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 0.998607    
+2023-12-03 15:55:10,534 - Epoch: [19][ 4200/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.000292    
+2023-12-03 15:56:40,200 - Epoch: [19][ 4300/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 0.997880    
+2023-12-03 15:58:33,699 - Epoch: [19][ 4400/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 1.000994    
+2023-12-03 16:00:23,620 - Epoch: [19][ 4500/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.003175    
+2023-12-03 16:02:03,529 - Epoch: [19][ 4600/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.003085    
+2023-12-03 16:03:45,064 - Epoch: [19][ 4700/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 1.003345    
+2023-12-03 16:05:15,913 - Epoch: [19][ 4800/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 1.001367    
+2023-12-03 16:06:51,573 - Epoch: [19][ 4900/12168]    Overall Loss 0.012001    Objective Loss 0.000000    Distill Loss 0.012001                                        LR 0.000250    Time 1.000452    
+2023-12-03 16:08:40,737 - Epoch: [19][ 5000/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.002274    
+2023-12-03 16:10:17,538 - Epoch: [19][ 5100/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.001601    
+2023-12-03 16:11:49,541 - Epoch: [19][ 5200/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.000031    
+2023-12-03 16:13:51,017 - Epoch: [19][ 5300/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.004081    
+2023-12-03 16:15:32,437 - Epoch: [19][ 5400/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.004267    
+2023-12-03 16:17:17,653 - Epoch: [19][ 5500/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.005137    
+2023-12-03 16:18:52,736 - Epoch: [19][ 5600/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.004166    
+2023-12-03 16:20:32,146 - Epoch: [19][ 5700/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.003988    
+2023-12-03 16:22:08,853 - Epoch: [19][ 5800/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.003350    
+2023-12-03 16:23:49,535 - Epoch: [19][ 5900/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.003408    
+2023-12-03 16:25:31,645 - Epoch: [19][ 6000/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.003701    
+2023-12-03 16:27:14,414 - Epoch: [19][ 6100/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.004093    
+2023-12-03 16:29:01,272 - Epoch: [19][ 6200/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.005132    
+2023-12-03 16:30:32,735 - Epoch: [19][ 6300/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.003695    
+2023-12-03 16:32:25,826 - Epoch: [19][ 6400/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.005681    
+2023-12-03 16:34:05,246 - Epoch: [19][ 6500/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.005504    
+2023-12-03 16:35:51,992 - Epoch: [19][ 6600/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.006441    
+2023-12-03 16:37:24,410 - Epoch: [19][ 6700/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.005212    
+2023-12-03 16:39:19,973 - Epoch: [19][ 6800/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.007423    
+2023-12-03 16:41:10,356 - Epoch: [19][ 6900/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.008820    
+2023-12-03 16:42:55,974 - Epoch: [19][ 7000/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.009495    
+2023-12-03 16:44:44,420 - Epoch: [19][ 7100/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.010550    
+2023-12-03 16:46:26,907 - Epoch: [19][ 7200/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.010748    
+2023-12-03 16:48:10,564 - Epoch: [19][ 7300/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.011101    
+2023-12-03 16:49:51,769 - Epoch: [19][ 7400/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.011113    
+2023-12-03 16:51:25,062 - Epoch: [19][ 7500/12168]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                                        LR 0.000250    Time 1.010069    
+2023-12-03 16:53:20,699 - Epoch: [19][ 7600/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.011993    
+2023-12-03 16:54:59,412 - Epoch: [19][ 7700/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.011670    
+2023-12-03 16:56:35,536 - Epoch: [19][ 7800/12168]    Overall Loss 0.012003    Objective Loss 0.000000    Distill Loss 0.012003                                        LR 0.000250    Time 1.011022    
+2023-12-03 16:58:21,354 - Epoch: [19][ 7900/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.011618    
+2023-12-03 17:00:12,613 - Epoch: [19][ 8000/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.012879    
+2023-12-03 17:01:49,464 - Epoch: [19][ 8100/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.012331    
+2023-12-03 17:03:33,220 - Epoch: [19][ 8200/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.012638    
+2023-12-03 17:05:18,810 - Epoch: [19][ 8300/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.013158    
+2023-12-03 17:06:56,147 - Epoch: [19][ 8400/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.012684    
+2023-12-03 17:08:35,775 - Epoch: [19][ 8500/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.012490    
+2023-12-03 17:10:18,126 - Epoch: [19][ 8600/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.012617    
+2023-12-03 17:11:53,489 - Epoch: [19][ 8700/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.011938    
+2023-12-03 17:13:35,005 - Epoch: [19][ 8800/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.011974    
+2023-12-03 17:15:23,726 - Epoch: [19][ 8900/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.012819    
+2023-12-03 17:17:16,016 - Epoch: [19][ 9000/12168]    Overall Loss 0.012004    Objective Loss 0.000000    Distill Loss 0.012004                                        LR 0.000250    Time 1.014041    
+2023-12-03 17:19:01,348 - Epoch: [19][ 9100/12168]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                                        LR 0.000250    Time 1.014472    
+2023-12-03 17:20:44,257 - Epoch: [19][ 9200/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.014630    
+2023-12-03 17:22:27,146 - Epoch: [19][ 9300/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.014783    
+2023-12-03 17:24:07,418 - Epoch: [19][ 9400/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.014654    
+2023-12-03 17:25:41,878 - Epoch: [19][ 9500/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.013915    
+2023-12-03 17:27:28,178 - Epoch: [19][ 9600/12168]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                                        LR 0.000250    Time 1.014426    
+2023-12-03 17:29:10,630 - Epoch: [19][ 9700/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.014529    
+2023-12-03 17:30:53,686 - Epoch: [19][ 9800/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014692    
+2023-12-03 17:32:39,494 - Epoch: [19][ 9900/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.015130    
+2023-12-03 17:34:16,219 - Epoch: [19][10000/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014650    
+2023-12-03 17:35:53,294 - Epoch: [19][10100/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014215    
+2023-12-03 17:37:39,404 - Epoch: [19][10200/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014674    
+2023-12-03 17:39:19,420 - Epoch: [19][10300/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014532    
+2023-12-03 17:41:06,465 - Epoch: [19][10400/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.015069    
+2023-12-03 17:42:40,028 - Epoch: [19][10500/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014312    
+2023-12-03 17:44:32,244 - Epoch: [19][10600/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.015329    
+2023-12-03 17:46:34,636 - Epoch: [19][10700/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.017277    
+2023-12-03 17:48:17,740 - Epoch: [19][10800/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.017404    
+2023-12-03 17:49:55,262 - Epoch: [19][10900/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.017017    
+2023-12-03 17:51:38,270 - Epoch: [19][11000/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.017135    
+2023-12-03 17:53:03,311 - Epoch: [19][11100/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.015632    
+2023-12-03 17:54:29,480 - Epoch: [19][11200/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.014257    
+2023-12-03 17:56:20,633 - Epoch: [19][11300/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.015117    
+2023-12-03 17:57:53,423 - Epoch: [19][11400/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.014351    
+2023-12-03 17:59:33,761 - Epoch: [19][11500/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014255    
+2023-12-03 18:01:19,789 - Epoch: [19][11600/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014652    
+2023-12-03 18:02:52,092 - Epoch: [19][11700/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.013868    
+2023-12-03 18:04:35,840 - Epoch: [19][11800/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.014067    
+2023-12-03 18:06:11,537 - Epoch: [19][11900/12168]    Overall Loss 0.012008    Objective Loss 0.000000    Distill Loss 0.012008                                        LR 0.000250    Time 1.013587    
+2023-12-03 18:08:04,816 - Epoch: [19][12000/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014580    
+2023-12-03 18:09:53,416 - Epoch: [19][12100/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.015169    
+2023-12-03 18:10:57,408 - Epoch: [19][12168/12168]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                                        LR 0.000250    Time 1.014755    
+2023-12-03 18:10:58,157 - --- validate (epoch=19)-----------
+2023-12-03 18:10:58,157 - 167951 samples (256 per mini-batch)
+2023-12-03 18:11:51,097 - Epoch: [19][  100/  657]    Loss 0.000000    Overall Loss 0.012697    
+2023-12-03 18:12:39,008 - Epoch: [19][  200/  657]    Loss 0.000000    Overall Loss 0.012716    
+2023-12-03 18:13:26,903 - Epoch: [19][  300/  657]    Loss 0.000000    Overall Loss 0.012712    
+2023-12-03 18:14:14,908 - Epoch: [19][  400/  657]    Loss 0.000000    Overall Loss 0.012709    
+2023-12-03 18:15:02,861 - Epoch: [19][  500/  657]    Loss 0.000000    Overall Loss 0.012702    
+2023-12-03 18:15:50,862 - Epoch: [19][  600/  657]    Loss 0.000000    Overall Loss 0.012698    
+2023-12-03 18:16:17,793 - Epoch: [19][  657/  657]    Loss 0.000000    Overall Loss 0.012703    
+2023-12-03 18:16:18,136 - ==> Overall Loss: 0.013
+
+2023-12-03 18:16:18,139 - ==> Best [Overall Loss: 0.012698 on epoch: 18]
+2023-12-03 18:16:18,139 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 18:16:18,158 - 
+
+2023-12-03 18:16:18,159 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 18:18:16,028 - Epoch: [20][  100/12168]    Overall Loss 0.011873    Objective Loss 0.000000    Distill Loss 0.011873                                        LR 0.000125    Time 1.178625    
+2023-12-03 18:19:29,937 - Epoch: [20][  200/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.958831    
+2023-12-03 18:20:39,131 - Epoch: [20][  300/12168]    Overall Loss 0.011914    Objective Loss 0.000000    Distill Loss 0.011914                                        LR 0.000125    Time 0.869852    
+2023-12-03 18:21:49,300 - Epoch: [20][  400/12168]    Overall Loss 0.011912    Objective Loss 0.000000    Distill Loss 0.011912                                        LR 0.000125    Time 0.827803    
+2023-12-03 18:22:56,752 - Epoch: [20][  500/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 0.797137    
+2023-12-03 18:23:58,938 - Epoch: [20][  600/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.767915    
+2023-12-03 18:25:31,812 - Epoch: [20][  700/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.790881    
+2023-12-03 18:27:21,154 - Epoch: [20][  800/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.828688    
+2023-12-03 18:29:08,988 - Epoch: [20][  900/12168]    Overall Loss 0.011910    Objective Loss 0.000000    Distill Loss 0.011910                                        LR 0.000125    Time 0.856419    
+2023-12-03 18:31:05,410 - Epoch: [20][ 1000/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.887193    
+2023-12-03 18:32:59,431 - Epoch: [20][ 1100/12168]    Overall Loss 0.011921    Objective Loss 0.000000    Distill Loss 0.011921                                        LR 0.000125    Time 0.910188    
+2023-12-03 18:34:37,890 - Epoch: [20][ 1200/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 0.916383    
+2023-12-03 18:36:26,868 - Epoch: [20][ 1300/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.929715    
+2023-12-03 18:38:09,873 - Epoch: [20][ 1400/12168]    Overall Loss 0.011921    Objective Loss 0.000000    Distill Loss 0.011921                                        LR 0.000125    Time 0.936877    
+2023-12-03 18:39:40,605 - Epoch: [20][ 1500/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.934902    
+2023-12-03 18:41:22,024 - Epoch: [20][ 1600/12168]    Overall Loss 0.011925    Objective Loss 0.000000    Distill Loss 0.011925                                        LR 0.000125    Time 0.939852    
+2023-12-03 18:42:56,907 - Epoch: [20][ 1700/12168]    Overall Loss 0.011928    Objective Loss 0.000000    Distill Loss 0.011928                                        LR 0.000125    Time 0.940376    
+2023-12-03 18:44:35,957 - Epoch: [20][ 1800/12168]    Overall Loss 0.011929    Objective Loss 0.000000    Distill Loss 0.011929                                        LR 0.000125    Time 0.943157    
+2023-12-03 18:46:13,918 - Epoch: [20][ 1900/12168]    Overall Loss 0.011931    Objective Loss 0.000000    Distill Loss 0.011931                                        LR 0.000125    Time 0.945072    
+2023-12-03 18:47:55,125 - Epoch: [20][ 2000/12168]    Overall Loss 0.011930    Objective Loss 0.000000    Distill Loss 0.011930                                        LR 0.000125    Time 0.948418    
+2023-12-03 18:49:31,614 - Epoch: [20][ 2100/12168]    Overall Loss 0.011931    Objective Loss 0.000000    Distill Loss 0.011931                                        LR 0.000125    Time 0.949199    
+2023-12-03 18:51:18,859 - Epoch: [20][ 2200/12168]    Overall Loss 0.011932    Objective Loss 0.000000    Distill Loss 0.011932                                        LR 0.000125    Time 0.954797    
+2023-12-03 18:52:54,825 - Epoch: [20][ 2300/12168]    Overall Loss 0.011930    Objective Loss 0.000000    Distill Loss 0.011930                                        LR 0.000125    Time 0.955006    
+2023-12-03 18:54:34,460 - Epoch: [20][ 2400/12168]    Overall Loss 0.011927    Objective Loss 0.000000    Distill Loss 0.011927                                        LR 0.000125    Time 0.956725    
+2023-12-03 18:56:06,854 - Epoch: [20][ 2500/12168]    Overall Loss 0.011927    Objective Loss 0.000000    Distill Loss 0.011927                                        LR 0.000125    Time 0.955411    
+2023-12-03 18:57:50,779 - Epoch: [20][ 2600/12168]    Overall Loss 0.011925    Objective Loss 0.000000    Distill Loss 0.011925                                        LR 0.000125    Time 0.958632    
+2023-12-03 18:59:38,433 - Epoch: [20][ 2700/12168]    Overall Loss 0.011926    Objective Loss 0.000000    Distill Loss 0.011926                                        LR 0.000125    Time 0.962997    
+2023-12-03 19:01:16,712 - Epoch: [20][ 2800/12168]    Overall Loss 0.011926    Objective Loss 0.000000    Distill Loss 0.011926                                        LR 0.000125    Time 0.963701    
+2023-12-03 19:02:52,021 - Epoch: [20][ 2900/12168]    Overall Loss 0.011928    Objective Loss 0.000000    Distill Loss 0.011928                                        LR 0.000125    Time 0.963333    
+2023-12-03 19:04:35,579 - Epoch: [20][ 3000/12168]    Overall Loss 0.011926    Objective Loss 0.000000    Distill Loss 0.011926                                        LR 0.000125    Time 0.965739    
+2023-12-03 19:06:13,079 - Epoch: [20][ 3100/12168]    Overall Loss 0.011924    Objective Loss 0.000000    Distill Loss 0.011924                                        LR 0.000125    Time 0.966035    
+2023-12-03 19:08:02,617 - Epoch: [20][ 3200/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.970075    
+2023-12-03 19:09:41,274 - Epoch: [20][ 3300/12168]    Overall Loss 0.011924    Objective Loss 0.000000    Distill Loss 0.011924                                        LR 0.000125    Time 0.970572    
+2023-12-03 19:11:13,420 - Epoch: [20][ 3400/12168]    Overall Loss 0.011925    Objective Loss 0.000000    Distill Loss 0.011925                                        LR 0.000125    Time 0.969126    
+2023-12-03 19:12:46,755 - Epoch: [20][ 3500/12168]    Overall Loss 0.011925    Objective Loss 0.000000    Distill Loss 0.011925                                        LR 0.000125    Time 0.968102    
+2023-12-03 19:14:29,036 - Epoch: [20][ 3600/12168]    Overall Loss 0.011924    Objective Loss 0.000000    Distill Loss 0.011924                                        LR 0.000125    Time 0.969619    
+2023-12-03 19:16:13,411 - Epoch: [20][ 3700/12168]    Overall Loss 0.011924    Objective Loss 0.000000    Distill Loss 0.011924                                        LR 0.000125    Time 0.971621    
+2023-12-03 19:17:43,540 - Epoch: [20][ 3800/12168]    Overall Loss 0.011926    Objective Loss 0.000000    Distill Loss 0.011926                                        LR 0.000125    Time 0.969768    
+2023-12-03 19:19:23,121 - Epoch: [20][ 3900/12168]    Overall Loss 0.011926    Objective Loss 0.000000    Distill Loss 0.011926                                        LR 0.000125    Time 0.970434    
+2023-12-03 19:21:03,449 - Epoch: [20][ 4000/12168]    Overall Loss 0.011924    Objective Loss 0.000000    Distill Loss 0.011924                                        LR 0.000125    Time 0.971253    
+2023-12-03 19:22:44,799 - Epoch: [20][ 4100/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.972282    
+2023-12-03 19:24:17,044 - Epoch: [20][ 4200/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.971094    
+2023-12-03 19:26:03,726 - Epoch: [20][ 4300/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.973318    
+2023-12-03 19:27:46,716 - Epoch: [20][ 4400/12168]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                                        LR 0.000125    Time 0.974602    
+2023-12-03 19:29:25,672 - Epoch: [20][ 4500/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.974933    
+2023-12-03 19:31:18,047 - Epoch: [20][ 4600/12168]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                                        LR 0.000125    Time 0.978167    
+2023-12-03 19:32:50,608 - Epoch: [20][ 4700/12168]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                                        LR 0.000125    Time 0.977047    
+2023-12-03 19:34:27,093 - Epoch: [20][ 4800/12168]    Overall Loss 0.011921    Objective Loss 0.000000    Distill Loss 0.011921                                        LR 0.000125    Time 0.976792    
+2023-12-03 19:36:03,286 - Epoch: [20][ 4900/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 0.976487    
+2023-12-03 19:37:44,180 - Epoch: [20][ 5000/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 0.977135    
+2023-12-03 19:39:33,252 - Epoch: [20][ 5100/12168]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                                        LR 0.000125    Time 0.979361    
+2023-12-03 19:41:34,248 - Epoch: [20][ 5200/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.983793    
+2023-12-03 19:43:03,348 - Epoch: [20][ 5300/12168]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                                        LR 0.000125    Time 0.982041    
+2023-12-03 19:44:50,961 - Epoch: [20][ 5400/12168]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                                        LR 0.000125    Time 0.983782    
+2023-12-03 19:46:17,578 - Epoch: [20][ 5500/12168]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                                        LR 0.000125    Time 0.981643    
+2023-12-03 19:47:56,788 - Epoch: [20][ 5600/12168]    Overall Loss 0.011921    Objective Loss 0.000000    Distill Loss 0.011921                                        LR 0.000125    Time 0.981828    
+2023-12-03 19:49:38,642 - Epoch: [20][ 5700/12168]    Overall Loss 0.011921    Objective Loss 0.000000    Distill Loss 0.011921                                        LR 0.000125    Time 0.982471    
+2023-12-03 19:51:15,191 - Epoch: [20][ 5800/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 0.982177    
+2023-12-03 19:53:08,670 - Epoch: [20][ 5900/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 0.984762    
+2023-12-03 19:54:59,921 - Epoch: [20][ 6000/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 0.986890    
+2023-12-03 19:56:27,260 - Epoch: [20][ 6100/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.985028    
+2023-12-03 19:58:04,383 - Epoch: [20][ 6200/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.984805    
+2023-12-03 19:59:52,441 - Epoch: [20][ 6300/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.986324    
+2023-12-03 20:01:52,874 - Epoch: [20][ 6400/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.989729    
+2023-12-03 20:03:33,309 - Epoch: [20][ 6500/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.989953    
+2023-12-03 20:05:05,385 - Epoch: [20][ 6600/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 0.988904    
+2023-12-03 20:06:56,632 - Epoch: [20][ 6700/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.990746    
+2023-12-03 20:08:38,473 - Epoch: [20][ 6800/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.991152    
+2023-12-03 20:10:23,494 - Epoch: [20][ 6900/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.992007    
+2023-12-03 20:12:01,719 - Epoch: [20][ 7000/12168]    Overall Loss 0.011916    Objective Loss 0.000000    Distill Loss 0.011916                                        LR 0.000125    Time 0.991866    
+2023-12-03 20:13:41,409 - Epoch: [20][ 7100/12168]    Overall Loss 0.011916    Objective Loss 0.000000    Distill Loss 0.011916                                        LR 0.000125    Time 0.991936    
+2023-12-03 20:15:30,827 - Epoch: [20][ 7200/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.993355    
+2023-12-03 20:17:05,536 - Epoch: [20][ 7300/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.992721    
+2023-12-03 20:19:05,653 - Epoch: [20][ 7400/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.995537    
+2023-12-03 20:20:43,142 - Epoch: [20][ 7500/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.995260    
+2023-12-03 20:22:16,728 - Epoch: [20][ 7600/12168]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                                        LR 0.000125    Time 0.994478    
+2023-12-03 20:24:02,348 - Epoch: [20][ 7700/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 0.995279    
+2023-12-03 20:26:06,256 - Epoch: [20][ 7800/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 0.998403    
+2023-12-03 20:27:47,611 - Epoch: [20][ 7900/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.998594    
+2023-12-03 20:29:32,549 - Epoch: [20][ 8000/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.999228    
+2023-12-03 20:31:10,621 - Epoch: [20][ 8100/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 0.998999    
+2023-12-03 20:32:53,517 - Epoch: [20][ 8200/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.999363    
+2023-12-03 20:34:38,167 - Epoch: [20][ 8300/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.999930    
+2023-12-03 20:36:20,250 - Epoch: [20][ 8400/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.000178    
+2023-12-03 20:38:00,094 - Epoch: [20][ 8500/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.000157    
+2023-12-03 20:39:43,116 - Epoch: [20][ 8600/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.000506    
+2023-12-03 20:41:15,524 - Epoch: [20][ 8700/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 0.999627    
+2023-12-03 20:43:00,283 - Epoch: [20][ 8800/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.000171    
+2023-12-03 20:44:52,677 - Epoch: [20][ 8900/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 1.001560    
+2023-12-03 20:46:36,201 - Epoch: [20][ 9000/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 1.001934    
+2023-12-03 20:48:26,127 - Epoch: [20][ 9100/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 1.003003    
+2023-12-03 20:50:08,229 - Epoch: [20][ 9200/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.003198    
+2023-12-03 20:52:04,072 - Epoch: [20][ 9300/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.004866    
+2023-12-03 20:53:50,425 - Epoch: [20][ 9400/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.005490    
+2023-12-03 20:55:31,860 - Epoch: [20][ 9500/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.005582    
+2023-12-03 20:57:17,945 - Epoch: [20][ 9600/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.006157    
+2023-12-03 20:59:04,355 - Epoch: [20][ 9700/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.006754    
+2023-12-03 21:00:37,509 - Epoch: [20][ 9800/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.005986    
+2023-12-03 21:02:17,051 - Epoch: [20][ 9900/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.005878    
+2023-12-03 21:04:08,187 - Epoch: [20][10000/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.006932    
+2023-12-03 21:05:54,592 - Epoch: [20][10100/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.007497    
+2023-12-03 21:07:43,178 - Epoch: [20][10200/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.008265    
+2023-12-03 21:09:29,527 - Epoch: [20][10300/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.008800    
+2023-12-03 21:11:13,834 - Epoch: [20][10400/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.009129    
+2023-12-03 21:12:52,535 - Epoch: [20][10500/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.008918    
+2023-12-03 21:14:44,212 - Epoch: [20][10600/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.009935    
+2023-12-03 21:16:30,468 - Epoch: [20][10700/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.010426    
+2023-12-03 21:18:20,727 - Epoch: [20][10800/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011278    
+2023-12-03 21:19:47,552 - Epoch: [20][10900/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.009966    
+2023-12-03 21:21:29,841 - Epoch: [20][11000/12168]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                                        LR 0.000125    Time 1.010082    
+2023-12-03 21:23:25,700 - Epoch: [20][11100/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011420    
+2023-12-03 21:25:08,897 - Epoch: [20][11200/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011603    
+2023-12-03 21:26:43,497 - Epoch: [20][11300/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011021    
+2023-12-03 21:28:37,148 - Epoch: [20][11400/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.012122    
+2023-12-03 21:30:09,895 - Epoch: [20][11500/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011385    
+2023-12-03 21:31:52,897 - Epoch: [20][11600/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011545    
+2023-12-03 21:33:35,953 - Epoch: [20][11700/12168]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                                        LR 0.000125    Time 1.011707    
+2023-12-03 21:35:15,719 - Epoch: [20][11800/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.011587    
+2023-12-03 21:37:05,933 - Epoch: [20][11900/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.012348    
+2023-12-03 21:38:48,844 - Epoch: [20][12000/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.012487    
+2023-12-03 21:40:38,316 - Epoch: [20][12100/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.013166    
+2023-12-03 21:41:37,139 - Epoch: [20][12168/12168]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                                        LR 0.000125    Time 1.012338    
+2023-12-03 21:41:37,778 - --- validate (epoch=20)-----------
+2023-12-03 21:41:37,778 - 167951 samples (256 per mini-batch)
+2023-12-03 21:42:30,327 - Epoch: [20][  100/  657]    Loss 0.000000    Overall Loss 0.012559    
+2023-12-03 21:43:18,135 - Epoch: [20][  200/  657]    Loss 0.000000    Overall Loss 0.012593    
+2023-12-03 21:44:06,003 - Epoch: [20][  300/  657]    Loss 0.000000    Overall Loss 0.012590    
+2023-12-03 21:44:53,812 - Epoch: [20][  400/  657]    Loss 0.000000    Overall Loss 0.012597    
+2023-12-03 21:45:41,656 - Epoch: [20][  500/  657]    Loss 0.000000    Overall Loss 0.012599    
+2023-12-03 21:46:29,497 - Epoch: [20][  600/  657]    Loss 0.000000    Overall Loss 0.012607    
+2023-12-03 21:46:56,378 - Epoch: [20][  657/  657]    Loss 0.000000    Overall Loss 0.012611    
+2023-12-03 21:46:56,735 - ==> Overall Loss: 0.013
+
+2023-12-03 21:46:56,738 - ==> Best [Overall Loss: 0.012611 on epoch: 20]
+2023-12-03 21:46:56,738 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-03 21:46:56,776 - 
+
+2023-12-03 21:46:56,776 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-03 21:48:50,470 - Epoch: [21][  100/12168]    Overall Loss 0.011845    Objective Loss 0.000000    Distill Loss 0.011845                                        LR 0.000125    Time 1.136869    
+2023-12-03 21:50:27,581 - Epoch: [21][  200/12168]    Overall Loss 0.011871    Objective Loss 0.000000    Distill Loss 0.011871                                        LR 0.000125    Time 1.053951    
+2023-12-03 21:51:53,166 - Epoch: [21][  300/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.987894    
+2023-12-03 21:53:36,111 - Epoch: [21][  400/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.998265    
+2023-12-03 21:55:25,130 - Epoch: [21][  500/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 1.016636    
+2023-12-03 21:57:02,918 - Epoch: [21][  600/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 1.010164    
+2023-12-03 21:58:56,220 - Epoch: [21][  700/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 1.027705    
+2023-12-03 22:00:19,182 - Epoch: [21][  800/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 1.002935    
+2023-12-03 22:01:52,116 - Epoch: [21][  900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.994750    
+2023-12-03 22:03:31,708 - Epoch: [21][ 1000/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.994859    
+2023-12-03 22:05:06,905 - Epoch: [21][ 1100/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 0.990955    
+2023-12-03 22:06:58,137 - Epoch: [21][ 1200/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 1.001062    
+2023-12-03 22:08:29,511 - Epoch: [21][ 1300/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.994339    
+2023-12-03 22:10:05,436 - Epoch: [21][ 1400/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.991828    
+2023-12-03 22:11:46,718 - Epoch: [21][ 1500/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.993222    
+2023-12-03 22:13:20,376 - Epoch: [21][ 1600/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.989677    
+2023-12-03 22:14:52,628 - Epoch: [21][ 1700/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 0.985723    
+2023-12-03 22:16:29,821 - Epoch: [21][ 1800/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 0.984952    
+2023-12-03 22:18:09,055 - Epoch: [21][ 1900/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 0.985337    
+2023-12-03 22:19:19,524 - Epoch: [21][ 2000/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 0.971303    
+2023-12-03 22:20:25,548 - Epoch: [21][ 2100/12168]    Overall Loss 0.011909    Objective Loss 0.000000    Distill Loss 0.011909                                        LR 0.000125    Time 0.956487    
+2023-12-03 22:21:30,745 - Epoch: [21][ 2200/12168]    Overall Loss 0.011909    Objective Loss 0.000000    Distill Loss 0.011909                                        LR 0.000125    Time 0.942643    
+2023-12-03 22:22:36,100 - Epoch: [21][ 2300/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 0.930072    
+2023-12-03 22:23:40,437 - Epoch: [21][ 2400/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.918124    
+2023-12-03 22:24:47,740 - Epoch: [21][ 2500/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.908318    
+2023-12-03 22:26:14,053 - Epoch: [21][ 2600/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.906578    
+2023-12-03 22:27:43,707 - Epoch: [21][ 2700/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.906204    
+2023-12-03 22:29:23,270 - Epoch: [21][ 2800/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.909395    
+2023-12-03 22:30:52,331 - Epoch: [21][ 2900/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.908745    
+2023-12-03 22:32:33,086 - Epoch: [21][ 3000/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.912036    
+2023-12-03 22:34:11,133 - Epoch: [21][ 3100/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.914241    
+2023-12-03 22:35:49,189 - Epoch: [21][ 3200/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.916311    
+2023-12-03 22:37:42,107 - Epoch: [21][ 3300/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.922759    
+2023-12-03 22:39:28,994 - Epoch: [21][ 3400/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.927055    
+2023-12-03 22:41:22,904 - Epoch: [21][ 3500/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.933111    
+2023-12-03 22:43:00,797 - Epoch: [21][ 3600/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.934382    
+2023-12-03 22:44:52,734 - Epoch: [21][ 3700/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.939379    
+2023-12-03 22:46:26,707 - Epoch: [21][ 3800/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.939387    
+2023-12-03 22:48:10,101 - Epoch: [21][ 3900/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.941809    
+2023-12-03 22:49:48,011 - Epoch: [21][ 4000/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.942740    
+2023-12-03 22:51:28,686 - Epoch: [21][ 4100/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.944299    
+2023-12-03 22:53:14,105 - Epoch: [21][ 4200/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.946914    
+2023-12-03 22:55:04,329 - Epoch: [21][ 4300/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.950525    
+2023-12-03 22:56:43,417 - Epoch: [21][ 4400/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.951440    
+2023-12-03 22:58:28,105 - Epoch: [21][ 4500/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.953559    
+2023-12-03 23:00:05,596 - Epoch: [21][ 4600/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.954022    
+2023-12-03 23:01:47,742 - Epoch: [21][ 4700/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.955455    
+2023-12-03 23:03:45,477 - Epoch: [21][ 4800/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.960077    
+2023-12-03 23:05:41,985 - Epoch: [21][ 4900/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.964259    
+2023-12-03 23:07:17,575 - Epoch: [21][ 5000/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.964090    
+2023-12-03 23:08:58,696 - Epoch: [21][ 5100/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.965013    
+2023-12-03 23:10:35,932 - Epoch: [21][ 5200/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.965153    
+2023-12-03 23:12:16,753 - Epoch: [21][ 5300/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.965964    
+2023-12-03 23:13:59,876 - Epoch: [21][ 5400/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.967171    
+2023-12-03 23:15:56,777 - Epoch: [21][ 5500/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.970840    
+2023-12-03 23:17:23,555 - Epoch: [21][ 5600/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.968998    
+2023-12-03 23:19:13,798 - Epoch: [21][ 5700/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.971338    
+2023-12-03 23:21:00,392 - Epoch: [21][ 5800/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.972968    
+2023-12-03 23:22:49,155 - Epoch: [21][ 5900/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.974910    
+2023-12-03 23:24:46,684 - Epoch: [21][ 6000/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.978248    
+2023-12-03 23:26:40,133 - Epoch: [21][ 6100/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.980809    
+2023-12-03 23:28:26,033 - Epoch: [21][ 6200/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.982069    
+2023-12-03 23:30:11,377 - Epoch: [21][ 6300/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.983200    
+2023-12-03 23:31:52,888 - Epoch: [21][ 6400/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.983698    
+2023-12-03 23:33:28,717 - Epoch: [21][ 6500/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.983306    
+2023-12-03 23:35:05,636 - Epoch: [21][ 6600/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.983091    
+2023-12-03 23:36:45,716 - Epoch: [21][ 6700/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.983354    
+2023-12-03 23:38:22,376 - Epoch: [21][ 6800/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.983107    
+2023-12-03 23:40:09,307 - Epoch: [21][ 6900/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.984355    
+2023-12-03 23:41:51,295 - Epoch: [21][ 7000/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.984862    
+2023-12-03 23:43:31,109 - Epoch: [21][ 7100/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.985048    
+2023-12-03 23:45:17,825 - Epoch: [21][ 7200/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.986187    
+2023-12-03 23:46:57,981 - Epoch: [21][ 7300/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.986397    
+2023-12-03 23:48:36,210 - Epoch: [21][ 7400/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.986340    
+2023-12-03 23:50:22,937 - Epoch: [21][ 7500/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.987418    
+2023-12-03 23:52:08,070 - Epoch: [21][ 7600/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.988259    
+2023-12-03 23:53:47,379 - Epoch: [21][ 7700/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.988320    
+2023-12-03 23:55:32,298 - Epoch: [21][ 7800/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.989100    
+2023-12-03 23:57:01,393 - Epoch: [21][ 7900/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.987857    
+2023-12-03 23:58:45,864 - Epoch: [21][ 8000/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.988566    
+2023-12-04 00:00:31,947 - Epoch: [21][ 8100/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.989458    
+2023-12-04 00:02:04,867 - Epoch: [21][ 8200/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.988722    
+2023-12-04 00:03:48,286 - Epoch: [21][ 8300/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.989269    
+2023-12-04 00:05:28,540 - Epoch: [21][ 8400/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.989426    
+2023-12-04 00:07:22,593 - Epoch: [21][ 8500/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.991203    
+2023-12-04 00:09:11,833 - Epoch: [21][ 8600/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.992379    
+2023-12-04 00:11:00,193 - Epoch: [21][ 8700/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.993427    
+2023-12-04 00:12:52,520 - Epoch: [21][ 8800/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.994901    
+2023-12-04 00:14:35,108 - Epoch: [21][ 8900/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.995249    
+2023-12-04 00:16:18,846 - Epoch: [21][ 9000/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 0.995716    
+2023-12-04 00:18:11,061 - Epoch: [21][ 9100/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.997105    
+2023-12-04 00:19:49,503 - Epoch: [21][ 9200/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.996966    
+2023-12-04 00:21:39,062 - Epoch: [21][ 9300/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.998026    
+2023-12-04 00:23:19,946 - Epoch: [21][ 9400/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.998140    
+2023-12-04 00:25:09,924 - Epoch: [21][ 9500/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.999209    
+2023-12-04 00:26:46,867 - Epoch: [21][ 9600/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 0.998898    
+2023-12-04 00:28:37,730 - Epoch: [21][ 9700/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.000029    
+2023-12-04 00:30:18,751 - Epoch: [21][ 9800/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.000132    
+2023-12-04 00:31:57,552 - Epoch: [21][ 9900/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 1.000009    
+2023-12-04 00:33:49,883 - Epoch: [21][10000/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.001241    
+2023-12-04 00:35:32,386 - Epoch: [21][10100/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.001476    
+2023-12-04 00:37:22,288 - Epoch: [21][10200/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.002432    
+2023-12-04 00:38:56,666 - Epoch: [21][10300/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.001861    
+2023-12-04 00:40:37,665 - Epoch: [21][10400/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.001939    
+2023-12-04 00:42:23,413 - Epoch: [21][10500/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.002467    
+2023-12-04 00:44:10,887 - Epoch: [21][10600/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.003148    
+2023-12-04 00:45:58,648 - Epoch: [21][10700/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.003844    
+2023-12-04 00:47:43,352 - Epoch: [21][10800/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.004243    
+2023-12-04 00:49:39,207 - Epoch: [21][10900/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.005658    
+2023-12-04 00:51:19,857 - Epoch: [21][11000/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.005665    
+2023-12-04 00:53:08,276 - Epoch: [21][11100/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.006372    
+2023-12-04 00:54:50,569 - Epoch: [21][11200/12168]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                                        LR 0.000125    Time 1.006519    
+2023-12-04 00:56:45,500 - Epoch: [21][11300/12168]    Overall Loss 0.011907    Objective Loss 0.000000    Distill Loss 0.011907                                        LR 0.000125    Time 1.007782    
+2023-12-04 00:58:28,111 - Epoch: [21][11400/12168]    Overall Loss 0.011907    Objective Loss 0.000000    Distill Loss 0.011907                                        LR 0.000125    Time 1.007942    
+2023-12-04 01:00:16,816 - Epoch: [21][11500/12168]    Overall Loss 0.011907    Objective Loss 0.000000    Distill Loss 0.011907                                        LR 0.000125    Time 1.008630    
+2023-12-04 01:01:45,412 - Epoch: [21][11600/12168]    Overall Loss 0.011907    Objective Loss 0.000000    Distill Loss 0.011907                                        LR 0.000125    Time 1.007571    
+2023-12-04 01:03:28,673 - Epoch: [21][11700/12168]    Overall Loss 0.011907    Objective Loss 0.000000    Distill Loss 0.011907                                        LR 0.000125    Time 1.007785    
+2023-12-04 01:05:09,415 - Epoch: [21][11800/12168]    Overall Loss 0.011908    Objective Loss 0.000000    Distill Loss 0.011908                                        LR 0.000125    Time 1.007781    
+2023-12-04 01:06:52,345 - Epoch: [21][11900/12168]    Overall Loss 0.011908    Objective Loss 0.000000    Distill Loss 0.011908                                        LR 0.000125    Time 1.007961    
+2023-12-04 01:08:38,251 - Epoch: [21][12000/12168]    Overall Loss 0.011908    Objective Loss 0.000000    Distill Loss 0.011908                                        LR 0.000125    Time 1.008387    
+2023-12-04 01:10:25,099 - Epoch: [21][12100/12168]    Overall Loss 0.011908    Objective Loss 0.000000    Distill Loss 0.011908                                        LR 0.000125    Time 1.008883    
+2023-12-04 01:11:29,272 - Epoch: [21][12168/12168]    Overall Loss 0.011908    Objective Loss 0.000000    Distill Loss 0.011908                                        LR 0.000125    Time 1.008518    
+2023-12-04 01:11:29,851 - --- validate (epoch=21)-----------
+2023-12-04 01:11:29,852 - 167951 samples (256 per mini-batch)
+2023-12-04 01:12:23,812 - Epoch: [21][  100/  657]    Loss 0.000000    Overall Loss 0.012599    
+2023-12-04 01:13:11,682 - Epoch: [21][  200/  657]    Loss 0.000000    Overall Loss 0.012617    
+2023-12-04 01:13:59,529 - Epoch: [21][  300/  657]    Loss 0.000000    Overall Loss 0.012619    
+2023-12-04 01:14:47,382 - Epoch: [21][  400/  657]    Loss 0.000000    Overall Loss 0.012618    
+2023-12-04 01:15:35,223 - Epoch: [21][  500/  657]    Loss 0.000000    Overall Loss 0.012614    
+2023-12-04 01:16:23,097 - Epoch: [21][  600/  657]    Loss 0.000000    Overall Loss 0.012610    
+2023-12-04 01:16:49,949 - Epoch: [21][  657/  657]    Loss 0.000000    Overall Loss 0.012614    
+2023-12-04 01:16:50,244 - ==> Overall Loss: 0.013
+
+2023-12-04 01:16:50,247 - ==> Best [Overall Loss: 0.012611 on epoch: 20]
+2023-12-04 01:16:50,247 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-04 01:16:50,279 - 
+
+2023-12-04 01:16:50,279 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 01:18:57,829 - Epoch: [22][  100/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 1.275421    
+2023-12-04 01:20:40,567 - Epoch: [22][  200/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 1.151366    
+2023-12-04 01:22:22,659 - Epoch: [22][  300/12168]    Overall Loss 0.011886    Objective Loss 0.000000    Distill Loss 0.011886                                        LR 0.000125    Time 1.107862    
+2023-12-04 01:23:44,924 - Epoch: [22][  400/12168]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                                        LR 0.000125    Time 1.036541    
+2023-12-04 01:25:24,964 - Epoch: [22][  500/12168]    Overall Loss 0.011873    Objective Loss 0.000000    Distill Loss 0.011873                                        LR 0.000125    Time 1.029298    
+2023-12-04 01:27:11,761 - Epoch: [22][  600/12168]    Overall Loss 0.011874    Objective Loss 0.000000    Distill Loss 0.011874                                        LR 0.000125    Time 1.035732    
+2023-12-04 01:28:40,623 - Epoch: [22][  700/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 1.014705    
+2023-12-04 01:30:29,518 - Epoch: [22][  800/12168]    Overall Loss 0.011888    Objective Loss 0.000000    Distill Loss 0.011888                                        LR 0.000125    Time 1.023978    
+2023-12-04 01:32:15,186 - Epoch: [22][  900/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 1.027604    
+2023-12-04 01:33:43,793 - Epoch: [22][ 1000/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 1.013444    
+2023-12-04 01:35:10,995 - Epoch: [22][ 1100/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.000580    
+2023-12-04 01:36:38,040 - Epoch: [22][ 1200/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.989730    
+2023-12-04 01:38:15,857 - Epoch: [22][ 1300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.988835    
+2023-12-04 01:39:55,647 - Epoch: [22][ 1400/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.989477    
+2023-12-04 01:41:33,715 - Epoch: [22][ 1500/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.988886    
+2023-12-04 01:43:03,185 - Epoch: [22][ 1600/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.982996    
+2023-12-04 01:44:44,819 - Epoch: [22][ 1700/12168]    Overall Loss 0.011902    Objective Loss 0.000000    Distill Loss 0.011902                                        LR 0.000125    Time 0.984953    
+2023-12-04 01:46:27,154 - Epoch: [22][ 1800/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.987082    
+2023-12-04 01:48:13,094 - Epoch: [22][ 1900/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.990884    
+2023-12-04 01:49:42,357 - Epoch: [22][ 2000/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.985969    
+2023-12-04 01:51:20,957 - Epoch: [22][ 2100/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.985967    
+2023-12-04 01:52:56,315 - Epoch: [22][ 2200/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.984492    
+2023-12-04 01:54:30,803 - Epoch: [22][ 2300/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.982766    
+2023-12-04 01:56:13,833 - Epoch: [22][ 2400/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.984744    
+2023-12-04 01:57:51,238 - Epoch: [22][ 2500/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.984313    
+2023-12-04 01:59:34,136 - Epoch: [22][ 2600/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.986029    
+2023-12-04 02:01:00,588 - Epoch: [22][ 2700/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.981526    
+2023-12-04 02:02:40,295 - Epoch: [22][ 2800/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.982078    
+2023-12-04 02:04:20,277 - Epoch: [22][ 2900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.982687    
+2023-12-04 02:05:43,665 - Epoch: [22][ 3000/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.977725    
+2023-12-04 02:07:30,153 - Epoch: [22][ 3100/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.980534    
+2023-12-04 02:09:08,254 - Epoch: [22][ 3200/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.980547    
+2023-12-04 02:10:43,529 - Epoch: [22][ 3300/12168]    Overall Loss 0.011889    Objective Loss 0.000000    Distill Loss 0.011889                                        LR 0.000125    Time 0.979703    
+2023-12-04 02:12:16,218 - Epoch: [22][ 3400/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.978147    
+2023-12-04 02:13:46,970 - Epoch: [22][ 3500/12168]    Overall Loss 0.011889    Objective Loss 0.000000    Distill Loss 0.011889                                        LR 0.000125    Time 0.976128    
+2023-12-04 02:15:29,525 - Epoch: [22][ 3600/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.977498    
+2023-12-04 02:17:04,051 - Epoch: [22][ 3700/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.976625    
+2023-12-04 02:18:32,953 - Epoch: [22][ 3800/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.974318    
+2023-12-04 02:19:39,341 - Epoch: [22][ 3900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.966357    
+2023-12-04 02:20:44,084 - Epoch: [22][ 4000/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.958383    
+2023-12-04 02:21:51,950 - Epoch: [22][ 4100/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.951559    
+2023-12-04 02:23:00,697 - Epoch: [22][ 4200/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.945270    
+2023-12-04 02:24:04,340 - Epoch: [22][ 4300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.938087    
+2023-12-04 02:25:12,431 - Epoch: [22][ 4400/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.932241    
+2023-12-04 02:26:48,172 - Epoch: [22][ 4500/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.932799    
+2023-12-04 02:28:18,274 - Epoch: [22][ 4600/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.932106    
+2023-12-04 02:29:57,937 - Epoch: [22][ 4700/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.933478    
+2023-12-04 02:31:44,530 - Epoch: [22][ 4800/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.936236    
+2023-12-04 02:33:27,996 - Epoch: [22][ 4900/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.938243    
+2023-12-04 02:35:01,625 - Epoch: [22][ 5000/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.938202    
+2023-12-04 02:36:44,099 - Epoch: [22][ 5100/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.939898    
+2023-12-04 02:38:19,380 - Epoch: [22][ 5200/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.940145    
+2023-12-04 02:40:05,775 - Epoch: [22][ 5300/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.942479    
+2023-12-04 02:41:44,319 - Epoch: [22][ 5400/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.943274    
+2023-12-04 02:43:32,137 - Epoch: [22][ 5500/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.945725    
+2023-12-04 02:45:09,818 - Epoch: [22][ 5600/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.946279    
+2023-12-04 02:46:53,759 - Epoch: [22][ 5700/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.947912    
+2023-12-04 02:48:27,348 - Epoch: [22][ 5800/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.947703    
+2023-12-04 02:50:06,895 - Epoch: [22][ 5900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.948512    
+2023-12-04 02:51:59,395 - Epoch: [22][ 6000/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.951452    
+2023-12-04 02:53:48,258 - Epoch: [22][ 6100/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.953700    
+2023-12-04 02:55:23,022 - Epoch: [22][ 6200/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.953601    
+2023-12-04 02:57:26,342 - Epoch: [22][ 6300/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.958038    
+2023-12-04 02:59:12,582 - Epoch: [22][ 6400/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.959667    
+2023-12-04 03:01:04,905 - Epoch: [22][ 6500/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.962183    
+2023-12-04 03:02:51,797 - Epoch: [22][ 6600/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.963799    
+2023-12-04 03:04:33,651 - Epoch: [22][ 6700/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.964615    
+2023-12-04 03:06:17,127 - Epoch: [22][ 6800/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.965645    
+2023-12-04 03:08:17,387 - Epoch: [22][ 6900/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.969079    
+2023-12-04 03:10:04,846 - Epoch: [22][ 7000/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.970585    
+2023-12-04 03:11:35,120 - Epoch: [22][ 7100/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.969628    
+2023-12-04 03:13:21,548 - Epoch: [22][ 7200/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.970942    
+2023-12-04 03:14:58,603 - Epoch: [22][ 7300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.970936    
+2023-12-04 03:16:45,841 - Epoch: [22][ 7400/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.972306    
+2023-12-04 03:18:34,266 - Epoch: [22][ 7500/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.973797    
+2023-12-04 03:20:26,607 - Epoch: [22][ 7600/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.975765    
+2023-12-04 03:22:19,547 - Epoch: [22][ 7700/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.977759    
+2023-12-04 03:23:45,841 - Epoch: [22][ 7800/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.976286    
+2023-12-04 03:25:36,488 - Epoch: [22][ 7900/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.977933    
+2023-12-04 03:27:21,661 - Epoch: [22][ 8000/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.978855    
+2023-12-04 03:29:14,821 - Epoch: [22][ 8100/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.980740    
+2023-12-04 03:30:48,957 - Epoch: [22][ 8200/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.980259    
+2023-12-04 03:32:40,470 - Epoch: [22][ 8300/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.981883    
+2023-12-04 03:34:27,319 - Epoch: [22][ 8400/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.982913    
+2023-12-04 03:36:28,267 - Epoch: [22][ 8500/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.985578    
+2023-12-04 03:38:06,825 - Epoch: [22][ 8600/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.985577    
+2023-12-04 03:39:47,142 - Epoch: [22][ 8700/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.985779    
+2023-12-04 03:41:26,182 - Epoch: [22][ 8800/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.985830    
+2023-12-04 03:43:16,488 - Epoch: [22][ 8900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.987147    
+2023-12-04 03:45:05,466 - Epoch: [22][ 9000/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.988286    
+2023-12-04 03:46:48,530 - Epoch: [22][ 9100/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.988751    
+2023-12-04 03:48:32,798 - Epoch: [22][ 9200/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.989336    
+2023-12-04 03:50:25,447 - Epoch: [22][ 9300/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.990810    
+2023-12-04 03:52:13,650 - Epoch: [22][ 9400/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.991780    
+2023-12-04 03:54:04,733 - Epoch: [22][ 9500/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.993033    
+2023-12-04 03:55:47,161 - Epoch: [22][ 9600/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.993357    
+2023-12-04 03:57:33,748 - Epoch: [22][ 9700/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.994104    
+2023-12-04 03:59:19,372 - Epoch: [22][ 9800/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.994738    
+2023-12-04 04:01:06,261 - Epoch: [22][ 9900/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.995486    
+2023-12-04 04:02:47,304 - Epoch: [22][10000/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.995635    
+2023-12-04 04:04:32,633 - Epoch: [22][10100/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.996205    
+2023-12-04 04:06:11,409 - Epoch: [22][10200/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.996121    
+2023-12-04 04:07:49,622 - Epoch: [22][10300/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.995985    
+2023-12-04 04:09:47,910 - Epoch: [22][10400/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.997781    
+2023-12-04 04:11:11,835 - Epoch: [22][10500/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.996271    
+2023-12-04 04:13:01,022 - Epoch: [22][10600/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.997172    
+2023-12-04 04:14:52,250 - Epoch: [22][10700/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.998247    
+2023-12-04 04:16:29,880 - Epoch: [22][10800/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.998043    
+2023-12-04 04:18:14,362 - Epoch: [22][10900/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.998472    
+2023-12-04 04:20:04,692 - Epoch: [22][11000/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 0.999424    
+2023-12-04 04:21:45,937 - Epoch: [22][11100/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.999541    
+2023-12-04 04:23:29,650 - Epoch: [22][11200/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.999876    
+2023-12-04 04:25:09,282 - Epoch: [22][11300/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.999844    
+2023-12-04 04:27:00,769 - Epoch: [22][11400/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.000852    
+2023-12-04 04:28:36,684 - Epoch: [22][11500/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.000489    
+2023-12-04 04:30:38,494 - Epoch: [22][11600/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.002364    
+2023-12-04 04:32:31,484 - Epoch: [22][11700/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.003454    
+2023-12-04 04:34:18,717 - Epoch: [22][11800/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.004037    
+2023-12-04 04:36:05,272 - Epoch: [22][11900/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.004553    
+2023-12-04 04:38:01,157 - Epoch: [22][12000/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.005839    
+2023-12-04 04:39:54,682 - Epoch: [22][12100/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.006908    
+2023-12-04 04:41:11,469 - Epoch: [22][12168/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 1.007591    
+2023-12-04 04:41:12,142 - --- validate (epoch=22)-----------
+2023-12-04 04:41:12,143 - 167951 samples (256 per mini-batch)
+2023-12-04 04:42:04,533 - Epoch: [22][  100/  657]    Loss 0.000000    Overall Loss 0.012597    
+2023-12-04 04:42:52,363 - Epoch: [22][  200/  657]    Loss 0.000000    Overall Loss 0.012603    
+2023-12-04 04:43:40,213 - Epoch: [22][  300/  657]    Loss 0.000000    Overall Loss 0.012599    
+2023-12-04 04:44:28,114 - Epoch: [22][  400/  657]    Loss 0.000000    Overall Loss 0.012600    
+2023-12-04 04:45:16,027 - Epoch: [22][  500/  657]    Loss 0.000000    Overall Loss 0.012596    
+2023-12-04 04:46:03,898 - Epoch: [22][  600/  657]    Loss 0.000000    Overall Loss 0.012598    
+2023-12-04 04:46:30,758 - Epoch: [22][  657/  657]    Loss 0.000000    Overall Loss 0.012598    
+2023-12-04 04:46:31,084 - ==> Overall Loss: 0.013
+
+2023-12-04 04:46:31,086 - ==> Best [Overall Loss: 0.012598 on epoch: 22]
+2023-12-04 04:46:31,086 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-04 04:46:31,125 - 
+
+2023-12-04 04:46:31,125 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 04:48:51,941 - Epoch: [23][  100/12168]    Overall Loss 0.011931    Objective Loss 0.000000    Distill Loss 0.011931                                        LR 0.000125    Time 1.408087    
+2023-12-04 04:50:37,879 - Epoch: [23][  200/12168]    Overall Loss 0.011909    Objective Loss 0.000000    Distill Loss 0.011909                                        LR 0.000125    Time 1.233698    
+2023-12-04 04:52:22,996 - Epoch: [23][  300/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.172830    
+2023-12-04 04:54:01,652 - Epoch: [23][  400/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 1.126246    
+2023-12-04 04:55:55,325 - Epoch: [23][  500/12168]    Overall Loss 0.011889    Objective Loss 0.000000    Distill Loss 0.011889                                        LR 0.000125    Time 1.128329    
+2023-12-04 04:57:35,834 - Epoch: [23][  600/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.107778    
+2023-12-04 04:59:21,348 - Epoch: [23][  700/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 1.100248    
+2023-12-04 05:01:12,053 - Epoch: [23][  800/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 1.101089    
+2023-12-04 05:03:00,963 - Epoch: [23][  900/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 1.099751    
+2023-12-04 05:04:40,679 - Epoch: [23][ 1000/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 1.089484    
+2023-12-04 05:06:23,586 - Epoch: [23][ 1100/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 1.083986    
+2023-12-04 05:07:51,097 - Epoch: [23][ 1200/12168]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                                        LR 0.000125    Time 1.066574    
+2023-12-04 05:09:22,554 - Epoch: [23][ 1300/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 1.054875    
+2023-12-04 05:10:50,353 - Epoch: [23][ 1400/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 1.042235    
+2023-12-04 05:12:20,302 - Epoch: [23][ 1500/12168]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                                        LR 0.000125    Time 1.032714    
+2023-12-04 05:13:40,074 - Epoch: [23][ 1600/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 1.018023    
+2023-12-04 05:15:11,522 - Epoch: [23][ 1700/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 1.011928    
+2023-12-04 05:16:54,306 - Epoch: [23][ 1800/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 1.012808    
+2023-12-04 05:18:33,687 - Epoch: [23][ 1900/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 1.011804    
+2023-12-04 05:20:06,955 - Epoch: [23][ 2000/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.007845    
+2023-12-04 05:21:46,680 - Epoch: [23][ 2100/12168]    Overall Loss 0.011909    Objective Loss 0.000000    Distill Loss 0.011909                                        LR 0.000125    Time 1.007337    
+2023-12-04 05:23:19,462 - Epoch: [23][ 2200/12168]    Overall Loss 0.011910    Objective Loss 0.000000    Distill Loss 0.011910                                        LR 0.000125    Time 1.003719    
+2023-12-04 05:24:51,756 - Epoch: [23][ 2300/12168]    Overall Loss 0.011905    Objective Loss 0.000000    Distill Loss 0.011905                                        LR 0.000125    Time 1.000204    
+2023-12-04 05:26:32,652 - Epoch: [23][ 2400/12168]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                                        LR 0.000125    Time 1.000566    
+2023-12-04 05:28:09,049 - Epoch: [23][ 2500/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.999099    
+2023-12-04 05:29:43,413 - Epoch: [23][ 2600/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.996963    
+2023-12-04 05:31:22,519 - Epoch: [23][ 2700/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.996742    
+2023-12-04 05:32:50,956 - Epoch: [23][ 2800/12168]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                                        LR 0.000125    Time 0.992726    
+2023-12-04 05:34:26,449 - Epoch: [23][ 2900/12168]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                                        LR 0.000125    Time 0.991421    
+2023-12-04 05:35:58,043 - Epoch: [23][ 3000/12168]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                                        LR 0.000125    Time 0.988902    
+2023-12-04 05:37:44,132 - Epoch: [23][ 3100/12168]    Overall Loss 0.011898    Objective Loss 0.000000    Distill Loss 0.011898                                        LR 0.000125    Time 0.991222    
+2023-12-04 05:39:31,345 - Epoch: [23][ 3200/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.993748    
+2023-12-04 05:41:07,102 - Epoch: [23][ 3300/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.992650    
+2023-12-04 05:42:56,793 - Epoch: [23][ 3400/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.995714    
+2023-12-04 05:44:21,834 - Epoch: [23][ 3500/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.991561    
+2023-12-04 05:46:08,199 - Epoch: [23][ 3600/12168]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                                        LR 0.000125    Time 0.993561    
+2023-12-04 05:47:35,753 - Epoch: [23][ 3700/12168]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                                        LR 0.000125    Time 0.990369    
+2023-12-04 05:49:08,994 - Epoch: [23][ 3800/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.988843    
+2023-12-04 05:50:46,288 - Epoch: [23][ 3900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 0.988433    
+2023-12-04 05:52:47,429 - Epoch: [23][ 4000/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.994006    
+2023-12-04 05:54:24,951 - Epoch: [23][ 4100/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.993546    
+2023-12-04 05:56:06,913 - Epoch: [23][ 4200/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.994165    
+2023-12-04 05:57:48,226 - Epoch: [23][ 4300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.994604    
+2023-12-04 05:59:30,868 - Epoch: [23][ 4400/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.995326    
+2023-12-04 06:01:14,981 - Epoch: [23][ 4500/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.996342    
+2023-12-04 06:03:07,813 - Epoch: [23][ 4600/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.999210    
+2023-12-04 06:04:38,540 - Epoch: [23][ 4700/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.997252    
+2023-12-04 06:06:17,397 - Epoch: [23][ 4800/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.997070    
+2023-12-04 06:07:57,201 - Epoch: [23][ 4900/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.997088    
+2023-12-04 06:09:48,009 - Epoch: [23][ 5000/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.999307    
+2023-12-04 06:11:30,402 - Epoch: [23][ 5100/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.999788    
+2023-12-04 06:13:20,065 - Epoch: [23][ 5200/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 1.001649    
+2023-12-04 06:14:49,736 - Epoch: [23][ 5300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.999668    
+2023-12-04 06:15:56,276 - Epoch: [23][ 5400/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.993477    
+2023-12-04 06:17:04,753 - Epoch: [23][ 5500/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.987863    
+2023-12-04 06:18:09,511 - Epoch: [23][ 5600/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.981786    
+2023-12-04 06:19:14,913 - Epoch: [23][ 5700/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.976035    
+2023-12-04 06:20:21,808 - Epoch: [23][ 5800/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.970739    
+2023-12-04 06:21:33,146 - Epoch: [23][ 5900/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.966377    
+2023-12-04 06:23:25,864 - Epoch: [23][ 6000/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.969056    
+2023-12-04 06:25:14,217 - Epoch: [23][ 6100/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.970931    
+2023-12-04 06:27:16,191 - Epoch: [23][ 6200/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.974943    
+2023-12-04 06:29:03,209 - Epoch: [23][ 6300/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.976454    
+2023-12-04 06:30:47,089 - Epoch: [23][ 6400/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.977427    
+2023-12-04 06:32:28,790 - Epoch: [23][ 6500/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.978035    
+2023-12-04 06:33:59,380 - Epoch: [23][ 6600/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.976940    
+2023-12-04 06:35:52,078 - Epoch: [23][ 6700/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.979179    
+2023-12-04 06:37:31,875 - Epoch: [23][ 6800/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.979454    
+2023-12-04 06:39:19,615 - Epoch: [23][ 6900/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.980873    
+2023-12-04 06:41:02,336 - Epoch: [23][ 7000/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.981534    
+2023-12-04 06:42:53,792 - Epoch: [23][ 7100/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.983406    
+2023-12-04 06:44:38,786 - Epoch: [23][ 7200/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.984329    
+2023-12-04 06:46:20,225 - Epoch: [23][ 7300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.984740    
+2023-12-04 06:48:00,721 - Epoch: [23][ 7400/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.985013    
+2023-12-04 06:49:40,334 - Epoch: [23][ 7500/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.985160    
+2023-12-04 06:51:25,004 - Epoch: [23][ 7600/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.985969    
+2023-12-04 06:53:04,317 - Epoch: [23][ 7700/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.986061    
+2023-12-04 06:55:01,609 - Epoch: [23][ 7800/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.988455    
+2023-12-04 06:57:12,597 - Epoch: [23][ 7900/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.992523    
+2023-12-04 06:58:58,773 - Epoch: [23][ 8000/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.993388    
+2023-12-04 07:00:32,584 - Epoch: [23][ 8100/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.992704    
+2023-12-04 07:02:08,794 - Epoch: [23][ 8200/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.992330    
+2023-12-04 07:03:42,008 - Epoch: [23][ 8300/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.991604    
+2023-12-04 07:05:30,358 - Epoch: [23][ 8400/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.992697    
+2023-12-04 07:07:18,937 - Epoch: [23][ 8500/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.993792    
+2023-12-04 07:08:58,719 - Epoch: [23][ 8600/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.993838    
+2023-12-04 07:10:43,931 - Epoch: [23][ 8700/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.994507    
+2023-12-04 07:12:31,895 - Epoch: [23][ 8800/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.995474    
+2023-12-04 07:14:10,878 - Epoch: [23][ 8900/12168]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                                        LR 0.000125    Time 0.995410    
+2023-12-04 07:15:54,403 - Epoch: [23][ 9000/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.995851    
+2023-12-04 07:17:40,219 - Epoch: [23][ 9100/12168]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                                        LR 0.000125    Time 0.996535    
+2023-12-04 07:19:27,145 - Epoch: [23][ 9200/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.997325    
+2023-12-04 07:21:05,321 - Epoch: [23][ 9300/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.997157    
+2023-12-04 07:22:50,220 - Epoch: [23][ 9400/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.997708    
+2023-12-04 07:24:51,328 - Epoch: [23][ 9500/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.999953    
+2023-12-04 07:26:26,509 - Epoch: [23][ 9600/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.999451    
+2023-12-04 07:28:08,832 - Epoch: [23][ 9700/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.999695    
+2023-12-04 07:29:51,496 - Epoch: [23][ 9800/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 0.999969    
+2023-12-04 07:31:46,437 - Epoch: [23][ 9900/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.001478    
+2023-12-04 07:33:12,658 - Epoch: [23][10000/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.000085    
+2023-12-04 07:35:19,593 - Epoch: [23][10100/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.002750    
+2023-12-04 07:36:55,846 - Epoch: [23][10200/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.002355    
+2023-12-04 07:38:49,303 - Epoch: [23][10300/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.003638    
+2023-12-04 07:40:36,323 - Epoch: [23][10400/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.004278    
+2023-12-04 07:42:14,979 - Epoch: [23][10500/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.004108    
+2023-12-04 07:43:55,555 - Epoch: [23][10600/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.004123    
+2023-12-04 07:45:54,605 - Epoch: [23][10700/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.005864    
+2023-12-04 07:47:36,308 - Epoch: [23][10800/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.005967    
+2023-12-04 07:49:31,351 - Epoch: [23][10900/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.007292    
+2023-12-04 07:51:23,617 - Epoch: [23][11000/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.008340    
+2023-12-04 07:53:26,260 - Epoch: [23][11100/12168]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                                        LR 0.000125    Time 1.010304    
+2023-12-04 07:55:13,740 - Epoch: [23][11200/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.010879    
+2023-12-04 07:57:05,178 - Epoch: [23][11300/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.011795    
+2023-12-04 07:58:46,549 - Epoch: [23][11400/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.011811    
+2023-12-04 08:00:36,491 - Epoch: [23][11500/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.012572    
+2023-12-04 08:02:26,866 - Epoch: [23][11600/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.013358    
+2023-12-04 08:04:27,653 - Epoch: [23][11700/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.015019    
+2023-12-04 08:06:04,231 - Epoch: [23][11800/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.014602    
+2023-12-04 08:07:55,044 - Epoch: [23][11900/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.015387    
+2023-12-04 08:09:41,529 - Epoch: [23][12000/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.015799    
+2023-12-04 08:11:27,989 - Epoch: [23][12100/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.016201    
+2023-12-04 08:12:33,312 - Epoch: [23][12168/12168]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                                        LR 0.000125    Time 1.015890    
+2023-12-04 08:12:33,946 - --- validate (epoch=23)-----------
+2023-12-04 08:12:33,946 - 167951 samples (256 per mini-batch)
+2023-12-04 08:13:26,983 - Epoch: [23][  100/  657]    Loss 0.000000    Overall Loss 0.012565    
+2023-12-04 08:14:14,783 - Epoch: [23][  200/  657]    Loss 0.000000    Overall Loss 0.012586    
+2023-12-04 08:15:02,685 - Epoch: [23][  300/  657]    Loss 0.000000    Overall Loss 0.012580    
+2023-12-04 08:15:50,484 - Epoch: [23][  400/  657]    Loss 0.000000    Overall Loss 0.012585    
+2023-12-04 08:16:38,350 - Epoch: [23][  500/  657]    Loss 0.000000    Overall Loss 0.012582    
+2023-12-04 08:17:26,223 - Epoch: [23][  600/  657]    Loss 0.000000    Overall Loss 0.012581    
+2023-12-04 08:17:53,091 - Epoch: [23][  657/  657]    Loss 0.000000    Overall Loss 0.012579    
+2023-12-04 08:17:53,439 - ==> Overall Loss: 0.013
+
+2023-12-04 08:17:53,443 - ==> Best [Overall Loss: 0.012579 on epoch: 23]
+2023-12-04 08:17:53,443 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-04 08:17:53,486 - 
+
+2023-12-04 08:17:53,486 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 08:19:53,518 - Epoch: [24][  100/12168]    Overall Loss 0.011857    Objective Loss 0.000000    Distill Loss 0.011857                                        LR 0.000125    Time 1.200239    
+2023-12-04 08:21:37,556 - Epoch: [24][  200/12168]    Overall Loss 0.011869    Objective Loss 0.000000    Distill Loss 0.011869                                        LR 0.000125    Time 1.120275    
+2023-12-04 08:23:12,579 - Epoch: [24][  300/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 1.063570    
+2023-12-04 08:24:33,402 - Epoch: [24][  400/12168]    Overall Loss 0.011873    Objective Loss 0.000000    Distill Loss 0.011873                                        LR 0.000125    Time 0.999717    
+2023-12-04 08:26:11,950 - Epoch: [24][  500/12168]    Overall Loss 0.011859    Objective Loss 0.000000    Distill Loss 0.011859                                        LR 0.000125    Time 0.996856    
+2023-12-04 08:27:51,295 - Epoch: [24][  600/12168]    Overall Loss 0.011863    Objective Loss 0.000000    Distill Loss 0.011863                                        LR 0.000125    Time 0.996277    
+2023-12-04 08:29:28,787 - Epoch: [24][  700/12168]    Overall Loss 0.011862    Objective Loss 0.000000    Distill Loss 0.011862                                        LR 0.000125    Time 0.993215    
+2023-12-04 08:30:57,299 - Epoch: [24][  800/12168]    Overall Loss 0.011859    Objective Loss 0.000000    Distill Loss 0.011859                                        LR 0.000125    Time 0.979694    
+2023-12-04 08:32:35,051 - Epoch: [24][  900/12168]    Overall Loss 0.011873    Objective Loss 0.000000    Distill Loss 0.011873                                        LR 0.000125    Time 0.979445    
+2023-12-04 08:34:13,665 - Epoch: [24][ 1000/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.980108    
+2023-12-04 08:35:43,445 - Epoch: [24][ 1100/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.972619    
+2023-12-04 08:37:21,003 - Epoch: [24][ 1200/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.972861    
+2023-12-04 08:39:05,757 - Epoch: [24][ 1300/12168]    Overall Loss 0.011876    Objective Loss 0.000000    Distill Loss 0.011876                                        LR 0.000125    Time 0.978599    
+2023-12-04 08:40:22,765 - Epoch: [24][ 1400/12168]    Overall Loss 0.011876    Objective Loss 0.000000    Distill Loss 0.011876                                        LR 0.000125    Time 0.963700    
+2023-12-04 08:42:10,592 - Epoch: [24][ 1500/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.971333    
+2023-12-04 08:43:48,355 - Epoch: [24][ 1600/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.971722    
+2023-12-04 08:45:26,980 - Epoch: [24][ 1700/12168]    Overall Loss 0.011886    Objective Loss 0.000000    Distill Loss 0.011886                                        LR 0.000125    Time 0.972573    
+2023-12-04 08:47:02,149 - Epoch: [24][ 1800/12168]    Overall Loss 0.011888    Objective Loss 0.000000    Distill Loss 0.011888                                        LR 0.000125    Time 0.971409    
+2023-12-04 08:48:37,593 - Epoch: [24][ 1900/12168]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                                        LR 0.000125    Time 0.970512    
+2023-12-04 08:50:24,273 - Epoch: [24][ 2000/12168]    Overall Loss 0.011887    Objective Loss 0.000000    Distill Loss 0.011887                                        LR 0.000125    Time 0.975322    
+2023-12-04 08:51:56,901 - Epoch: [24][ 2100/12168]    Overall Loss 0.011889    Objective Loss 0.000000    Distill Loss 0.011889                                        LR 0.000125    Time 0.972984    
+2023-12-04 08:53:24,140 - Epoch: [24][ 2200/12168]    Overall Loss 0.011889    Objective Loss 0.000000    Distill Loss 0.011889                                        LR 0.000125    Time 0.968408    
+2023-12-04 08:55:02,828 - Epoch: [24][ 2300/12168]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                                        LR 0.000125    Time 0.969208    
+2023-12-04 08:56:45,773 - Epoch: [24][ 2400/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 0.971716    
+2023-12-04 08:58:29,545 - Epoch: [24][ 2500/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.974353    
+2023-12-04 09:00:06,699 - Epoch: [24][ 2600/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.974242    
+2023-12-04 09:01:34,243 - Epoch: [24][ 2700/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.970580    
+2023-12-04 09:03:13,256 - Epoch: [24][ 2800/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.971276    
+2023-12-04 09:04:56,395 - Epoch: [24][ 2900/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 0.973346    
+2023-12-04 09:06:40,924 - Epoch: [24][ 3000/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 0.975742    
+2023-12-04 09:08:05,269 - Epoch: [24][ 3100/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.971472    
+2023-12-04 09:09:38,900 - Epoch: [24][ 3200/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.970371    
+2023-12-04 09:11:15,920 - Epoch: [24][ 3300/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.970364    
+2023-12-04 09:13:00,592 - Epoch: [24][ 3400/12168]    Overall Loss 0.011876    Objective Loss 0.000000    Distill Loss 0.011876                                        LR 0.000125    Time 0.972608    
+2023-12-04 09:14:33,749 - Epoch: [24][ 3500/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.971433    
+2023-12-04 09:16:18,528 - Epoch: [24][ 3600/12168]    Overall Loss 0.011876    Objective Loss 0.000000    Distill Loss 0.011876                                        LR 0.000125    Time 0.973552    
+2023-12-04 09:17:49,226 - Epoch: [24][ 3700/12168]    Overall Loss 0.011876    Objective Loss 0.000000    Distill Loss 0.011876                                        LR 0.000125    Time 0.971751    
+2023-12-04 09:19:30,696 - Epoch: [24][ 3800/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.972880    
+2023-12-04 09:21:04,610 - Epoch: [24][ 3900/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.972013    
+2023-12-04 09:22:44,224 - Epoch: [24][ 4000/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.972614    
+2023-12-04 09:24:26,323 - Epoch: [24][ 4100/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.973793    
+2023-12-04 09:26:06,794 - Epoch: [24][ 4200/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.974527    
+2023-12-04 09:27:47,393 - Epoch: [24][ 4300/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.975257    
+2023-12-04 09:29:32,881 - Epoch: [24][ 4400/12168]    Overall Loss 0.011876    Objective Loss 0.000000    Distill Loss 0.011876                                        LR 0.000125    Time 0.977065    
+2023-12-04 09:31:20,894 - Epoch: [24][ 4500/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.979354    
+2023-12-04 09:33:04,435 - Epoch: [24][ 4600/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.980571    
+2023-12-04 09:34:38,295 - Epoch: [24][ 4700/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.979676    
+2023-12-04 09:36:19,745 - Epoch: [24][ 4800/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.980401    
+2023-12-04 09:38:02,198 - Epoch: [24][ 4900/12168]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                                        LR 0.000125    Time 0.981300    
+2023-12-04 09:39:50,662 - Epoch: [24][ 5000/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.983365    
+2023-12-04 09:41:39,128 - Epoch: [24][ 5100/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.985350    
+2023-12-04 09:43:28,229 - Epoch: [24][ 5200/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.987380    
+2023-12-04 09:45:06,434 - Epoch: [24][ 5300/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.987278    
+2023-12-04 09:46:54,955 - Epoch: [24][ 5400/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.989091    
+2023-12-04 09:48:41,553 - Epoch: [24][ 5500/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.990487    
+2023-12-04 09:50:18,110 - Epoch: [24][ 5600/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.990041    
+2023-12-04 09:52:12,202 - Epoch: [24][ 5700/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.992687    
+2023-12-04 09:53:55,432 - Epoch: [24][ 5800/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.993369    
+2023-12-04 09:55:42,074 - Epoch: [24][ 5900/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.994606    
+2023-12-04 09:57:27,563 - Epoch: [24][ 6000/12168]    Overall Loss 0.011882    Objective Loss 0.000000    Distill Loss 0.011882                                        LR 0.000125    Time 0.995609    
+2023-12-04 09:59:12,543 - Epoch: [24][ 6100/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.996497    
+2023-12-04 10:00:55,933 - Epoch: [24][ 6200/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.997099    
+2023-12-04 10:02:31,950 - Epoch: [24][ 6300/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.996512    
+2023-12-04 10:04:22,759 - Epoch: [24][ 6400/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.998254    
+2023-12-04 10:06:10,101 - Epoch: [24][ 6500/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.999409    
+2023-12-04 10:07:47,176 - Epoch: [24][ 6600/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.998974    
+2023-12-04 10:09:42,733 - Epoch: [24][ 6700/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 1.001310    
+2023-12-04 10:11:19,047 - Epoch: [24][ 6800/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 1.000748    
+2023-12-04 10:12:35,135 - Epoch: [24][ 6900/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.997271    
+2023-12-04 10:13:39,874 - Epoch: [24][ 7000/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.992272    
+2023-12-04 10:14:46,392 - Epoch: [24][ 7100/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.987664    
+2023-12-04 10:15:52,037 - Epoch: [24][ 7200/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.983063    
+2023-12-04 10:16:58,573 - Epoch: [24][ 7300/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.978711    
+2023-12-04 10:18:03,233 - Epoch: [24][ 7400/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.974222    
+2023-12-04 10:19:16,531 - Epoch: [24][ 7500/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.971005    
+2023-12-04 10:20:59,697 - Epoch: [24][ 7600/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.971802    
+2023-12-04 10:22:42,894 - Epoch: [24][ 7700/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.972582    
+2023-12-04 10:24:33,862 - Epoch: [24][ 7800/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.974339    
+2023-12-04 10:26:26,918 - Epoch: [24][ 7900/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.976316    
+2023-12-04 10:28:03,620 - Epoch: [24][ 8000/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.976199    
+2023-12-04 10:29:46,719 - Epoch: [24][ 8100/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.976874    
+2023-12-04 10:31:39,294 - Epoch: [24][ 8200/12168]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                                        LR 0.000125    Time 0.978689    
+2023-12-04 10:33:32,775 - Epoch: [24][ 8300/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.980569    
+2023-12-04 10:35:27,939 - Epoch: [24][ 8400/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.982605    
+2023-12-04 10:37:07,731 - Epoch: [24][ 8500/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.982784    
+2023-12-04 10:39:08,106 - Epoch: [24][ 8600/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.985353    
+2023-12-04 10:40:50,893 - Epoch: [24][ 8700/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.985841    
+2023-12-04 10:42:40,832 - Epoch: [24][ 8800/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.987130    
+2023-12-04 10:44:37,944 - Epoch: [24][ 8900/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.989197    
+2023-12-04 10:46:30,205 - Epoch: [24][ 9000/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.990678    
+2023-12-04 10:48:16,981 - Epoch: [24][ 9100/12168]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                                        LR 0.000125    Time 0.991525    
+2023-12-04 10:50:01,622 - Epoch: [24][ 9200/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.992120    
+2023-12-04 10:51:46,201 - Epoch: [24][ 9300/12168]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                                        LR 0.000125    Time 0.992697    
+2023-12-04 10:53:43,588 - Epoch: [24][ 9400/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.994624    
+2023-12-04 10:55:37,288 - Epoch: [24][ 9500/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.996121    
+2023-12-04 10:57:15,458 - Epoch: [24][ 9600/12168]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                                        LR 0.000125    Time 0.995971    
+2023-12-04 10:59:03,751 - Epoch: [24][ 9700/12168]    Overall Loss 0.011882    Objective Loss 0.000000    Distill Loss 0.011882                                        LR 0.000125    Time 0.996866    
+2023-12-04 11:00:58,566 - Epoch: [24][ 9800/12168]    Overall Loss 0.011882    Objective Loss 0.000000    Distill Loss 0.011882                                        LR 0.000125    Time 0.998409    
+2023-12-04 11:02:39,712 - Epoch: [24][ 9900/12168]    Overall Loss 0.011882    Objective Loss 0.000000    Distill Loss 0.011882                                        LR 0.000125    Time 0.998541    
+2023-12-04 11:04:36,356 - Epoch: [24][10000/12168]    Overall Loss 0.011882    Objective Loss 0.000000    Distill Loss 0.011882                                        LR 0.000125    Time 1.000219    
+2023-12-04 11:06:22,903 - Epoch: [24][10100/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.000864    
+2023-12-04 11:07:54,327 - Epoch: [24][10200/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.000014    
+2023-12-04 11:09:44,956 - Epoch: [24][10300/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.001046    
+2023-12-04 11:11:42,626 - Epoch: [24][10400/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.002734    
+2023-12-04 11:13:22,546 - Epoch: [24][10500/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.002700    
+2023-12-04 11:15:12,461 - Epoch: [24][10600/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.003609    
+2023-12-04 11:16:53,119 - Epoch: [24][10700/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.003636    
+2023-12-04 11:18:49,523 - Epoch: [24][10800/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.005121    
+2023-12-04 11:20:30,424 - Epoch: [24][10900/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.005156    
+2023-12-04 11:22:15,909 - Epoch: [24][11000/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.005607    
+2023-12-04 11:24:03,420 - Epoch: [24][11100/12168]    Overall Loss 0.011883    Objective Loss 0.000000    Distill Loss 0.011883                                        LR 0.000125    Time 1.006232    
+2023-12-04 11:25:53,635 - Epoch: [24][11200/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.007088    
+2023-12-04 11:27:46,969 - Epoch: [24][11300/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.008205    
+2023-12-04 11:29:25,277 - Epoch: [24][11400/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.007984    
+2023-12-04 11:31:28,481 - Epoch: [24][11500/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.009932    
+2023-12-04 11:33:22,652 - Epoch: [24][11600/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.011067    
+2023-12-04 11:35:02,716 - Epoch: [24][11700/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.010977    
+2023-12-04 11:36:47,827 - Epoch: [24][11800/12168]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                                        LR 0.000125    Time 1.011317    
+2023-12-04 11:38:30,866 - Epoch: [24][11900/12168]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                                        LR 0.000125    Time 1.011476    
+2023-12-04 11:40:29,944 - Epoch: [24][12000/12168]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                                        LR 0.000125    Time 1.012970    
+2023-12-04 11:42:21,124 - Epoch: [24][12100/12168]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                                        LR 0.000125    Time 1.013786    
+2023-12-04 11:43:40,869 - Epoch: [24][12168/12168]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                                        LR 0.000125    Time 1.014674    
+2023-12-04 11:43:41,448 - --- validate (epoch=24)-----------
+2023-12-04 11:43:41,449 - 167951 samples (256 per mini-batch)
+2023-12-04 11:44:34,197 - Epoch: [24][  100/  657]    Loss 0.000000    Overall Loss 0.012584    
+2023-12-04 11:45:21,971 - Epoch: [24][  200/  657]    Loss 0.000000    Overall Loss 0.012599    
+2023-12-04 11:46:09,781 - Epoch: [24][  300/  657]    Loss 0.000000    Overall Loss 0.012599    
+2023-12-04 11:46:57,589 - Epoch: [24][  400/  657]    Loss 0.000000    Overall Loss 0.012594    
+2023-12-04 11:47:45,419 - Epoch: [24][  500/  657]    Loss 0.000000    Overall Loss 0.012592    
+2023-12-04 11:48:33,208 - Epoch: [24][  600/  657]    Loss 0.000000    Overall Loss 0.012593    
+2023-12-04 11:49:00,047 - Epoch: [24][  657/  657]    Loss 0.000000    Overall Loss 0.012594    
+2023-12-04 11:49:00,350 - ==> Overall Loss: 0.013
+
+2023-12-04 11:49:00,353 - ==> Best [Overall Loss: 0.012579 on epoch: 23]
+2023-12-04 11:49:00,353 - Saving checkpoint to: logs/2023.11.30-202919/checkpoint.pth.tar
+2023-12-04 11:49:00,380 - 
+
+2023-12-04 11:49:00,380 - Initiating quantization aware training (QAT)...
+2023-12-04 11:49:00,397 - 
+
+2023-12-04 11:49:00,397 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 11:50:46,594 - Epoch: [25][  100/12168]    Overall Loss 0.030771    Objective Loss 0.000000    Distill Loss 0.030771                                        LR 0.000063    Time 1.061905    
+2023-12-04 11:52:24,096 - Epoch: [25][  200/12168]    Overall Loss 0.030565    Objective Loss 0.000000    Distill Loss 0.030565                                        LR 0.000063    Time 1.018425    
+2023-12-04 11:53:59,573 - Epoch: [25][  300/12168]    Overall Loss 0.030459    Objective Loss 0.000000    Distill Loss 0.030459                                        LR 0.000063    Time 0.997180    
+2023-12-04 11:55:34,811 - Epoch: [25][  400/12168]    Overall Loss 0.030389    Objective Loss 0.000000    Distill Loss 0.030389                                        LR 0.000063    Time 0.985964    
+2023-12-04 11:57:22,565 - Epoch: [25][  500/12168]    Overall Loss 0.030325    Objective Loss 0.000000    Distill Loss 0.030325                                        LR 0.000063    Time 1.004266    
+2023-12-04 11:59:00,652 - Epoch: [25][  600/12168]    Overall Loss 0.030254    Objective Loss 0.000000    Distill Loss 0.030254                                        LR 0.000063    Time 1.000356    
+2023-12-04 12:00:27,847 - Epoch: [25][  700/12168]    Overall Loss 0.030169    Objective Loss 0.000000    Distill Loss 0.030169                                        LR 0.000063    Time 0.982003    
+2023-12-04 12:02:13,368 - Epoch: [25][  800/12168]    Overall Loss 0.030070    Objective Loss 0.000000    Distill Loss 0.030070                                        LR 0.000063    Time 0.991146    
+2023-12-04 12:03:59,776 - Epoch: [25][  900/12168]    Overall Loss 0.029973    Objective Loss 0.000000    Distill Loss 0.029973                                        LR 0.000063    Time 0.999241    
+2023-12-04 12:05:38,399 - Epoch: [25][ 1000/12168]    Overall Loss 0.029885    Objective Loss 0.000000    Distill Loss 0.029885                                        LR 0.000063    Time 0.997934    
+2023-12-04 12:07:16,189 - Epoch: [25][ 1100/12168]    Overall Loss 0.029799    Objective Loss 0.000000    Distill Loss 0.029799                                        LR 0.000063    Time 0.996107    
+2023-12-04 12:08:46,414 - Epoch: [25][ 1200/12168]    Overall Loss 0.029716    Objective Loss 0.000000    Distill Loss 0.029716                                        LR 0.000063    Time 0.988279    
+2023-12-04 12:10:21,702 - Epoch: [25][ 1300/12168]    Overall Loss 0.029640    Objective Loss 0.000000    Distill Loss 0.029640                                        LR 0.000063    Time 0.985551    
+2023-12-04 12:11:47,481 - Epoch: [25][ 1400/12168]    Overall Loss 0.029566    Objective Loss 0.000000    Distill Loss 0.029566                                        LR 0.000063    Time 0.976420    
+2023-12-04 12:13:28,301 - Epoch: [25][ 1500/12168]    Overall Loss 0.029493    Objective Loss 0.000000    Distill Loss 0.029493                                        LR 0.000063    Time 0.978534    
+2023-12-04 12:15:10,489 - Epoch: [25][ 1600/12168]    Overall Loss 0.029425    Objective Loss 0.000000    Distill Loss 0.029425                                        LR 0.000063    Time 0.981239    
+2023-12-04 12:16:48,447 - Epoch: [25][ 1700/12168]    Overall Loss 0.029360    Objective Loss 0.000000    Distill Loss 0.029360                                        LR 0.000063    Time 0.981137    
+2023-12-04 12:18:21,696 - Epoch: [25][ 1800/12168]    Overall Loss 0.029296    Objective Loss 0.000000    Distill Loss 0.029296                                        LR 0.000063    Time 0.978431    
+2023-12-04 12:20:08,562 - Epoch: [25][ 1900/12168]    Overall Loss 0.029234    Objective Loss 0.000000    Distill Loss 0.029234                                        LR 0.000063    Time 0.983176    
+2023-12-04 12:21:41,872 - Epoch: [25][ 2000/12168]    Overall Loss 0.029173    Objective Loss 0.000000    Distill Loss 0.029173                                        LR 0.000063    Time 0.980669    
+2023-12-04 12:23:18,370 - Epoch: [25][ 2100/12168]    Overall Loss 0.029113    Objective Loss 0.000000    Distill Loss 0.029113                                        LR 0.000063    Time 0.979915    
+2023-12-04 12:24:47,440 - Epoch: [25][ 2200/12168]    Overall Loss 0.029056    Objective Loss 0.000000    Distill Loss 0.029056                                        LR 0.000063    Time 0.975857    
+2023-12-04 12:26:26,008 - Epoch: [25][ 2300/12168]    Overall Loss 0.028997    Objective Loss 0.000000    Distill Loss 0.028997                                        LR 0.000063    Time 0.976281    
+2023-12-04 12:27:54,447 - Epoch: [25][ 2400/12168]    Overall Loss 0.028940    Objective Loss 0.000000    Distill Loss 0.028940                                        LR 0.000063    Time 0.972449    
+2023-12-04 12:29:29,689 - Epoch: [25][ 2500/12168]    Overall Loss 0.028884    Objective Loss 0.000000    Distill Loss 0.028884                                        LR 0.000063    Time 0.971645    
+2023-12-04 12:30:59,069 - Epoch: [25][ 2600/12168]    Overall Loss 0.028828    Objective Loss 0.000000    Distill Loss 0.028828                                        LR 0.000063    Time 0.968649    
+2023-12-04 12:32:37,508 - Epoch: [25][ 2700/12168]    Overall Loss 0.028772    Objective Loss 0.000000    Distill Loss 0.028772                                        LR 0.000063    Time 0.969229    
+2023-12-04 12:34:02,458 - Epoch: [25][ 2800/12168]    Overall Loss 0.028718    Objective Loss 0.000000    Distill Loss 0.028718                                        LR 0.000063    Time 0.964951    
+2023-12-04 12:35:38,873 - Epoch: [25][ 2900/12168]    Overall Loss 0.028664    Objective Loss 0.000000    Distill Loss 0.028664                                        LR 0.000063    Time 0.964921    
+2023-12-04 12:37:20,071 - Epoch: [25][ 3000/12168]    Overall Loss 0.028611    Objective Loss 0.000000    Distill Loss 0.028611                                        LR 0.000063    Time 0.966488    
+2023-12-04 12:38:47,559 - Epoch: [25][ 3100/12168]    Overall Loss 0.028555    Objective Loss 0.000000    Distill Loss 0.028555                                        LR 0.000063    Time 0.963530    
+2023-12-04 12:40:27,814 - Epoch: [25][ 3200/12168]    Overall Loss 0.028500    Objective Loss 0.000000    Distill Loss 0.028500                                        LR 0.000063    Time 0.964747    
+2023-12-04 12:42:10,252 - Epoch: [25][ 3300/12168]    Overall Loss 0.028447    Objective Loss 0.000000    Distill Loss 0.028447                                        LR 0.000063    Time 0.966552    
+2023-12-04 12:43:46,895 - Epoch: [25][ 3400/12168]    Overall Loss 0.028395    Objective Loss 0.000000    Distill Loss 0.028395                                        LR 0.000063    Time 0.966547    
+2023-12-04 12:45:17,704 - Epoch: [25][ 3500/12168]    Overall Loss 0.028343    Objective Loss 0.000000    Distill Loss 0.028343                                        LR 0.000063    Time 0.964875    
+2023-12-04 12:46:52,509 - Epoch: [25][ 3600/12168]    Overall Loss 0.028292    Objective Loss 0.000000    Distill Loss 0.028292                                        LR 0.000063    Time 0.964406    
+2023-12-04 12:48:27,567 - Epoch: [25][ 3700/12168]    Overall Loss 0.028242    Objective Loss 0.000000    Distill Loss 0.028242                                        LR 0.000063    Time 0.964030    
+2023-12-04 12:50:02,702 - Epoch: [25][ 3800/12168]    Overall Loss 0.028191    Objective Loss 0.000000    Distill Loss 0.028191                                        LR 0.000063    Time 0.963695    
+2023-12-04 12:51:43,874 - Epoch: [25][ 3900/12168]    Overall Loss 0.028141    Objective Loss 0.000000    Distill Loss 0.028141                                        LR 0.000063    Time 0.964924    
+2023-12-04 12:53:26,357 - Epoch: [25][ 4000/12168]    Overall Loss 0.028090    Objective Loss 0.000000    Distill Loss 0.028090                                        LR 0.000063    Time 0.966420    
+2023-12-04 12:54:58,499 - Epoch: [25][ 4100/12168]    Overall Loss 0.028040    Objective Loss 0.000000    Distill Loss 0.028040                                        LR 0.000063    Time 0.965321    
+2023-12-04 12:56:37,295 - Epoch: [25][ 4200/12168]    Overall Loss 0.027990    Objective Loss 0.000000    Distill Loss 0.027990                                        LR 0.000063    Time 0.965859    
+2023-12-04 12:58:25,675 - Epoch: [25][ 4300/12168]    Overall Loss 0.027941    Objective Loss 0.000000    Distill Loss 0.027941                                        LR 0.000063    Time 0.968600    
+2023-12-04 13:00:08,380 - Epoch: [25][ 4400/12168]    Overall Loss 0.027891    Objective Loss 0.000000    Distill Loss 0.027891                                        LR 0.000063    Time 0.969927    
+2023-12-04 13:01:52,435 - Epoch: [25][ 4500/12168]    Overall Loss 0.027842    Objective Loss 0.000000    Distill Loss 0.027842                                        LR 0.000063    Time 0.971495    
+2023-12-04 13:03:41,899 - Epoch: [25][ 4600/12168]    Overall Loss 0.027794    Objective Loss 0.000000    Distill Loss 0.027794                                        LR 0.000063    Time 0.974170    
+2023-12-04 13:05:12,394 - Epoch: [25][ 4700/12168]    Overall Loss 0.027745    Objective Loss 0.000000    Distill Loss 0.027745                                        LR 0.000063    Time 0.972696    
+2023-12-04 13:06:44,484 - Epoch: [25][ 4800/12168]    Overall Loss 0.027697    Objective Loss 0.000000    Distill Loss 0.027697                                        LR 0.000063    Time 0.971616    
+2023-12-04 13:08:22,908 - Epoch: [25][ 4900/12168]    Overall Loss 0.027650    Objective Loss 0.000000    Distill Loss 0.027650                                        LR 0.000063    Time 0.971872    
+2023-12-04 13:10:02,519 - Epoch: [25][ 5000/12168]    Overall Loss 0.027605    Objective Loss 0.000000    Distill Loss 0.027605                                        LR 0.000063    Time 0.972355    
+2023-12-04 13:11:45,439 - Epoch: [25][ 5100/12168]    Overall Loss 0.027559    Objective Loss 0.000000    Distill Loss 0.027559                                        LR 0.000063    Time 0.973469    
+2023-12-04 13:13:21,877 - Epoch: [25][ 5200/12168]    Overall Loss 0.027512    Objective Loss 0.000000    Distill Loss 0.027512                                        LR 0.000063    Time 0.973293    
+2023-12-04 13:15:21,935 - Epoch: [25][ 5300/12168]    Overall Loss 0.027466    Objective Loss 0.000000    Distill Loss 0.027466                                        LR 0.000063    Time 0.977580    
+2023-12-04 13:16:55,758 - Epoch: [25][ 5400/12168]    Overall Loss 0.027420    Objective Loss 0.000000    Distill Loss 0.027420                                        LR 0.000063    Time 0.976850    
+2023-12-04 13:18:23,076 - Epoch: [25][ 5500/12168]    Overall Loss 0.027384    Objective Loss 0.000000    Distill Loss 0.027384                                        LR 0.000063    Time 0.974964    
+2023-12-04 13:20:04,779 - Epoch: [25][ 5600/12168]    Overall Loss 0.027339    Objective Loss 0.000000    Distill Loss 0.027339                                        LR 0.000063    Time 0.975714    
+2023-12-04 13:21:39,280 - Epoch: [25][ 5700/12168]    Overall Loss 0.027294    Objective Loss 0.000000    Distill Loss 0.027294                                        LR 0.000063    Time 0.975174    
+2023-12-04 13:23:20,829 - Epoch: [25][ 5800/12168]    Overall Loss 0.027249    Objective Loss 0.000000    Distill Loss 0.027249                                        LR 0.000063    Time 0.975868    
+2023-12-04 13:24:52,219 - Epoch: [25][ 5900/12168]    Overall Loss 0.027204    Objective Loss 0.000000    Distill Loss 0.027204                                        LR 0.000063    Time 0.974817    
+2023-12-04 13:26:28,188 - Epoch: [25][ 6000/12168]    Overall Loss 0.027161    Objective Loss 0.000000    Distill Loss 0.027161                                        LR 0.000063    Time 0.974563    
+2023-12-04 13:28:08,052 - Epoch: [25][ 6100/12168]    Overall Loss 0.027116    Objective Loss 0.000000    Distill Loss 0.027116                                        LR 0.000063    Time 0.974957    
+2023-12-04 13:29:46,506 - Epoch: [25][ 6200/12168]    Overall Loss 0.027073    Objective Loss 0.000000    Distill Loss 0.027073                                        LR 0.000063    Time 0.975111    
+2023-12-04 13:31:32,686 - Epoch: [25][ 6300/12168]    Overall Loss 0.027029    Objective Loss 0.000000    Distill Loss 0.027029                                        LR 0.000063    Time 0.976486    
+2023-12-04 13:33:19,317 - Epoch: [25][ 6400/12168]    Overall Loss 0.026988    Objective Loss 0.000000    Distill Loss 0.026988                                        LR 0.000063    Time 0.977888    
+2023-12-04 13:35:03,177 - Epoch: [25][ 6500/12168]    Overall Loss 0.026945    Objective Loss 0.000000    Distill Loss 0.026945                                        LR 0.000063    Time 0.978821    
+2023-12-04 13:36:32,703 - Epoch: [25][ 6600/12168]    Overall Loss 0.026903    Objective Loss 0.000000    Distill Loss 0.026903                                        LR 0.000063    Time 0.977554    
+2023-12-04 13:38:09,786 - Epoch: [25][ 6700/12168]    Overall Loss 0.026860    Objective Loss 0.000000    Distill Loss 0.026860                                        LR 0.000063    Time 0.977453    
+2023-12-04 13:39:50,726 - Epoch: [25][ 6800/12168]    Overall Loss 0.026818    Objective Loss 0.000000    Distill Loss 0.026818                                        LR 0.000063    Time 0.977921    
+2023-12-04 13:41:18,747 - Epoch: [25][ 6900/12168]    Overall Loss 0.026776    Objective Loss 0.000000    Distill Loss 0.026776                                        LR 0.000063    Time 0.976504    
+2023-12-04 13:42:51,486 - Epoch: [25][ 7000/12168]    Overall Loss 0.026733    Objective Loss 0.000000    Distill Loss 0.026733                                        LR 0.000063    Time 0.975802    
+2023-12-04 13:44:26,339 - Epoch: [25][ 7100/12168]    Overall Loss 0.026694    Objective Loss 0.000000    Distill Loss 0.026694                                        LR 0.000063    Time 0.975417    
+2023-12-04 13:46:08,523 - Epoch: [25][ 7200/12168]    Overall Loss 0.026655    Objective Loss 0.000000    Distill Loss 0.026655                                        LR 0.000063    Time 0.976061    
+2023-12-04 13:47:51,880 - Epoch: [25][ 7300/12168]    Overall Loss 0.026613    Objective Loss 0.000000    Distill Loss 0.026613                                        LR 0.000063    Time 0.976847    
+2023-12-04 13:49:39,482 - Epoch: [25][ 7400/12168]    Overall Loss 0.026572    Objective Loss 0.000000    Distill Loss 0.026572                                        LR 0.000063    Time 0.978187    
+2023-12-04 13:51:07,591 - Epoch: [25][ 7500/12168]    Overall Loss 0.026529    Objective Loss 0.000000    Distill Loss 0.026529                                        LR 0.000063    Time 0.976891    
+2023-12-04 13:52:45,499 - Epoch: [25][ 7600/12168]    Overall Loss 0.026487    Objective Loss 0.000000    Distill Loss 0.026487                                        LR 0.000063    Time 0.976919    
+2023-12-04 13:54:27,630 - Epoch: [25][ 7700/12168]    Overall Loss 0.026444    Objective Loss 0.000000    Distill Loss 0.026444                                        LR 0.000063    Time 0.977495    
+2023-12-04 13:56:07,287 - Epoch: [25][ 7800/12168]    Overall Loss 0.026402    Objective Loss 0.000000    Distill Loss 0.026402                                        LR 0.000063    Time 0.977738    
+2023-12-04 13:57:40,243 - Epoch: [25][ 7900/12168]    Overall Loss 0.026359    Objective Loss 0.000000    Distill Loss 0.026359                                        LR 0.000063    Time 0.977128    
+2023-12-04 13:59:37,323 - Epoch: [25][ 8000/12168]    Overall Loss 0.026317    Objective Loss 0.000000    Distill Loss 0.026317                                        LR 0.000063    Time 0.979548    
+2023-12-04 14:01:07,170 - Epoch: [25][ 8100/12168]    Overall Loss 0.026274    Objective Loss 0.000000    Distill Loss 0.026274                                        LR 0.000063    Time 0.978546    
+2023-12-04 14:02:41,790 - Epoch: [25][ 8200/12168]    Overall Loss 0.026230    Objective Loss 0.000000    Distill Loss 0.026230                                        LR 0.000063    Time 0.978151    
+2023-12-04 14:04:26,838 - Epoch: [25][ 8300/12168]    Overall Loss 0.026186    Objective Loss 0.000000    Distill Loss 0.026186                                        LR 0.000063    Time 0.979021    
+2023-12-04 14:06:11,343 - Epoch: [25][ 8400/12168]    Overall Loss 0.026142    Objective Loss 0.000000    Distill Loss 0.026142                                        LR 0.000063    Time 0.979807    
+2023-12-04 14:08:01,329 - Epoch: [25][ 8500/12168]    Overall Loss 0.026097    Objective Loss 0.000000    Distill Loss 0.026097                                        LR 0.000063    Time 0.981218    
+2023-12-04 14:09:20,249 - Epoch: [25][ 8600/12168]    Overall Loss 0.026052    Objective Loss 0.000000    Distill Loss 0.026052                                        LR 0.000063    Time 0.978985    
+2023-12-04 14:10:30,843 - Epoch: [25][ 8700/12168]    Overall Loss 0.026007    Objective Loss 0.000000    Distill Loss 0.026007                                        LR 0.000063    Time 0.975846    
+2023-12-04 14:11:34,529 - Epoch: [25][ 8800/12168]    Overall Loss 0.025961    Objective Loss 0.000000    Distill Loss 0.025961                                        LR 0.000063    Time 0.971993    
+2023-12-04 14:12:39,169 - Epoch: [25][ 8900/12168]    Overall Loss 0.025914    Objective Loss 0.000000    Distill Loss 0.025914                                        LR 0.000063    Time 0.968334    
+2023-12-04 14:13:45,487 - Epoch: [25][ 9000/12168]    Overall Loss 0.025867    Objective Loss 0.000000    Distill Loss 0.025867                                        LR 0.000063    Time 0.964943    
+2023-12-04 14:14:51,348 - Epoch: [25][ 9100/12168]    Overall Loss 0.025820    Objective Loss 0.000000    Distill Loss 0.025820                                        LR 0.000063    Time 0.961576    
+2023-12-04 14:15:53,631 - Epoch: [25][ 9200/12168]    Overall Loss 0.025771    Objective Loss 0.000000    Distill Loss 0.025771                                        LR 0.000063    Time 0.957894    
+2023-12-04 14:17:37,945 - Epoch: [25][ 9300/12168]    Overall Loss 0.025724    Objective Loss 0.000000    Distill Loss 0.025724                                        LR 0.000063    Time 0.958810    
+2023-12-04 14:19:14,717 - Epoch: [25][ 9400/12168]    Overall Loss 0.025676    Objective Loss 0.000000    Distill Loss 0.025676                                        LR 0.000063    Time 0.958904    
+2023-12-04 14:21:02,883 - Epoch: [25][ 9500/12168]    Overall Loss 0.025626    Objective Loss 0.000000    Distill Loss 0.025626                                        LR 0.000063    Time 0.960195    
+2023-12-04 14:23:01,353 - Epoch: [25][ 9600/12168]    Overall Loss 0.025576    Objective Loss 0.000000    Distill Loss 0.025576                                        LR 0.000063    Time 0.962533    
+2023-12-04 14:24:55,249 - Epoch: [25][ 9700/12168]    Overall Loss 0.025526    Objective Loss 0.000000    Distill Loss 0.025526                                        LR 0.000063    Time 0.964351    
+2023-12-04 14:26:33,064 - Epoch: [25][ 9800/12168]    Overall Loss 0.025475    Objective Loss 0.000000    Distill Loss 0.025475                                        LR 0.000063    Time 0.964491    
+2023-12-04 14:28:13,730 - Epoch: [25][ 9900/12168]    Overall Loss 0.025423    Objective Loss 0.000000    Distill Loss 0.025423                                        LR 0.000063    Time 0.964917    
+2023-12-04 14:29:58,582 - Epoch: [25][10000/12168]    Overall Loss 0.025371    Objective Loss 0.000000    Distill Loss 0.025371                                        LR 0.000063    Time 0.965752    
+2023-12-04 14:31:39,221 - Epoch: [25][10100/12168]    Overall Loss 0.025319    Objective Loss 0.000000    Distill Loss 0.025319                                        LR 0.000063    Time 0.966154    
+2023-12-04 14:33:45,262 - Epoch: [25][10200/12168]    Overall Loss 0.025267    Objective Loss 0.000000    Distill Loss 0.025267                                        LR 0.000063    Time 0.969038    
+2023-12-04 14:35:32,774 - Epoch: [25][10300/12168]    Overall Loss 0.025214    Objective Loss 0.000000    Distill Loss 0.025214                                        LR 0.000063    Time 0.970067    
+2023-12-04 14:37:23,347 - Epoch: [25][10400/12168]    Overall Loss 0.025160    Objective Loss 0.000000    Distill Loss 0.025160                                        LR 0.000063    Time 0.971371    
+2023-12-04 14:39:24,835 - Epoch: [25][10500/12168]    Overall Loss 0.025107    Objective Loss 0.000000    Distill Loss 0.025107                                        LR 0.000063    Time 0.973690    
+2023-12-04 14:41:19,428 - Epoch: [25][10600/12168]    Overall Loss 0.025053    Objective Loss 0.000000    Distill Loss 0.025053                                        LR 0.000063    Time 0.975314    
+2023-12-04 14:43:02,392 - Epoch: [25][10700/12168]    Overall Loss 0.024998    Objective Loss 0.000000    Distill Loss 0.024998                                        LR 0.000063    Time 0.975821    
+2023-12-04 14:44:48,810 - Epoch: [25][10800/12168]    Overall Loss 0.024945    Objective Loss 0.000000    Distill Loss 0.024945                                        LR 0.000063    Time 0.976638    
+2023-12-04 14:46:42,692 - Epoch: [25][10900/12168]    Overall Loss 0.024890    Objective Loss 0.000000    Distill Loss 0.024890                                        LR 0.000063    Time 0.978126    
+2023-12-04 14:48:33,220 - Epoch: [25][11000/12168]    Overall Loss 0.024836    Objective Loss 0.000000    Distill Loss 0.024836                                        LR 0.000063    Time 0.979281    
+2023-12-04 14:50:25,413 - Epoch: [25][11100/12168]    Overall Loss 0.024782    Objective Loss 0.000000    Distill Loss 0.024782                                        LR 0.000063    Time 0.980566    
+2023-12-04 14:52:26,045 - Epoch: [25][11200/12168]    Overall Loss 0.024728    Objective Loss 0.000000    Distill Loss 0.024728                                        LR 0.000063    Time 0.982581    
+2023-12-04 14:54:06,128 - Epoch: [25][11300/12168]    Overall Loss 0.024674    Objective Loss 0.000000    Distill Loss 0.024674                                        LR 0.000063    Time 0.982741    
+2023-12-04 14:55:38,494 - Epoch: [25][11400/12168]    Overall Loss 0.024620    Objective Loss 0.000000    Distill Loss 0.024620                                        LR 0.000063    Time 0.982223    
+2023-12-04 14:57:40,205 - Epoch: [25][11500/12168]    Overall Loss 0.024567    Objective Loss 0.000000    Distill Loss 0.024567                                        LR 0.000063    Time 0.984265    
+2023-12-04 14:59:22,404 - Epoch: [25][11600/12168]    Overall Loss 0.024513    Objective Loss 0.000000    Distill Loss 0.024513                                        LR 0.000063    Time 0.984589    
+2023-12-04 15:01:09,673 - Epoch: [25][11700/12168]    Overall Loss 0.024459    Objective Loss 0.000000    Distill Loss 0.024459                                        LR 0.000063    Time 0.985342    
+2023-12-04 15:02:56,323 - Epoch: [25][11800/12168]    Overall Loss 0.024406    Objective Loss 0.000000    Distill Loss 0.024406                                        LR 0.000063    Time 0.986029    
+2023-12-04 15:04:48,208 - Epoch: [25][11900/12168]    Overall Loss 0.024353    Objective Loss 0.000000    Distill Loss 0.024353                                        LR 0.000063    Time 0.987144    
+2023-12-04 15:06:37,093 - Epoch: [25][12000/12168]    Overall Loss 0.024299    Objective Loss 0.000000    Distill Loss 0.024299                                        LR 0.000063    Time 0.987991    
+2023-12-04 15:08:33,789 - Epoch: [25][12100/12168]    Overall Loss 0.024247    Objective Loss 0.000000    Distill Loss 0.024247                                        LR 0.000063    Time 0.989470    
+2023-12-04 15:09:47,759 - Epoch: [25][12168/12168]    Overall Loss 0.024212    Objective Loss 0.000000    Distill Loss 0.024212                                        LR 0.000063    Time 0.990019    
+2023-12-04 15:09:48,436 - --- validate (epoch=25)-----------
+2023-12-04 15:09:48,436 - 167951 samples (256 per mini-batch)
+2023-12-04 15:10:43,385 - Epoch: [25][  100/  657]    Loss 0.000000    Overall Loss 0.017871    
+2023-12-04 15:11:32,362 - Epoch: [25][  200/  657]    Loss 0.000000    Overall Loss 0.017857    
+2023-12-04 15:12:21,400 - Epoch: [25][  300/  657]    Loss 0.000000    Overall Loss 0.017865    
+2023-12-04 15:13:10,481 - Epoch: [25][  400/  657]    Loss 0.000000    Overall Loss 0.017867    
+2023-12-04 15:13:59,566 - Epoch: [25][  500/  657]    Loss 0.000000    Overall Loss 0.017870    
+2023-12-04 15:14:48,626 - Epoch: [25][  600/  657]    Loss 0.000000    Overall Loss 0.017864    
+2023-12-04 15:15:16,104 - Epoch: [25][  657/  657]    Loss 0.000000    Overall Loss 0.017866    
+2023-12-04 15:15:16,399 - ==> Overall Loss: 0.018
+
+2023-12-04 15:15:16,401 - ==> Best [Overall Loss: 0.017866 on epoch: 25]
+2023-12-04 15:15:16,401 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-04 15:15:16,429 - 
+
+2023-12-04 15:15:16,429 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 15:17:21,777 - Epoch: [26][  100/12168]    Overall Loss 0.017823    Objective Loss 0.000000    Distill Loss 0.017823                                        LR 0.000063    Time 1.253405    
+2023-12-04 15:19:04,823 - Epoch: [26][  200/12168]    Overall Loss 0.017741    Objective Loss 0.000000    Distill Loss 0.017741                                        LR 0.000063    Time 1.141899    
+2023-12-04 15:20:35,616 - Epoch: [26][  300/12168]    Overall Loss 0.017724    Objective Loss 0.000000    Distill Loss 0.017724                                        LR 0.000063    Time 1.063890    
+2023-12-04 15:22:18,402 - Epoch: [26][  400/12168]    Overall Loss 0.017686    Objective Loss 0.000000    Distill Loss 0.017686                                        LR 0.000063    Time 1.054865    
+2023-12-04 15:24:06,716 - Epoch: [26][  500/12168]    Overall Loss 0.017641    Objective Loss 0.000000    Distill Loss 0.017641                                        LR 0.000063    Time 1.060505    
+2023-12-04 15:25:51,708 - Epoch: [26][  600/12168]    Overall Loss 0.017606    Objective Loss 0.000000    Distill Loss 0.017606                                        LR 0.000063    Time 1.058730    
+2023-12-04 15:27:43,865 - Epoch: [26][  700/12168]    Overall Loss 0.017582    Objective Loss 0.000000    Distill Loss 0.017582                                        LR 0.000063    Time 1.067698    
+2023-12-04 15:29:21,401 - Epoch: [26][  800/12168]    Overall Loss 0.017555    Objective Loss 0.000000    Distill Loss 0.017555                                        LR 0.000063    Time 1.056146    
+2023-12-04 15:30:55,563 - Epoch: [26][  900/12168]    Overall Loss 0.017536    Objective Loss 0.000000    Distill Loss 0.017536                                        LR 0.000063    Time 1.043414    
+2023-12-04 15:32:30,798 - Epoch: [26][ 1000/12168]    Overall Loss 0.017512    Objective Loss 0.000000    Distill Loss 0.017512                                        LR 0.000063    Time 1.034300    
+2023-12-04 15:34:03,148 - Epoch: [26][ 1100/12168]    Overall Loss 0.017483    Objective Loss 0.000000    Distill Loss 0.017483                                        LR 0.000063    Time 1.024222    
+2023-12-04 15:35:55,616 - Epoch: [26][ 1200/12168]    Overall Loss 0.017452    Objective Loss 0.000000    Distill Loss 0.017452                                        LR 0.000063    Time 1.032588    
+2023-12-04 15:37:23,654 - Epoch: [26][ 1300/12168]    Overall Loss 0.017421    Objective Loss 0.000000    Distill Loss 0.017421                                        LR 0.000063    Time 1.020873    
+2023-12-04 15:39:14,903 - Epoch: [26][ 1400/12168]    Overall Loss 0.017390    Objective Loss 0.000000    Distill Loss 0.017390                                        LR 0.000063    Time 1.027412    
+2023-12-04 15:40:59,832 - Epoch: [26][ 1500/12168]    Overall Loss 0.017369    Objective Loss 0.000000    Distill Loss 0.017369                                        LR 0.000063    Time 1.028866    
+2023-12-04 15:42:45,993 - Epoch: [26][ 1600/12168]    Overall Loss 0.017342    Objective Loss 0.000000    Distill Loss 0.017342                                        LR 0.000063    Time 1.030908    
+2023-12-04 15:44:15,687 - Epoch: [26][ 1700/12168]    Overall Loss 0.017319    Objective Loss 0.000000    Distill Loss 0.017319                                        LR 0.000063    Time 1.023024    
+2023-12-04 15:45:37,869 - Epoch: [26][ 1800/12168]    Overall Loss 0.017291    Objective Loss 0.000000    Distill Loss 0.017291                                        LR 0.000063    Time 1.011842    
+2023-12-04 15:47:32,602 - Epoch: [26][ 1900/12168]    Overall Loss 0.017265    Objective Loss 0.000000    Distill Loss 0.017265                                        LR 0.000063    Time 1.018969    
+2023-12-04 15:49:16,701 - Epoch: [26][ 2000/12168]    Overall Loss 0.017243    Objective Loss 0.000000    Distill Loss 0.017243                                        LR 0.000063    Time 1.020067    
+2023-12-04 15:50:57,905 - Epoch: [26][ 2100/12168]    Overall Loss 0.017221    Objective Loss 0.000000    Distill Loss 0.017221                                        LR 0.000063    Time 1.019681    
+2023-12-04 15:52:39,767 - Epoch: [26][ 2200/12168]    Overall Loss 0.017200    Objective Loss 0.000000    Distill Loss 0.017200                                        LR 0.000063    Time 1.019630    
+2023-12-04 15:54:29,662 - Epoch: [26][ 2300/12168]    Overall Loss 0.017172    Objective Loss 0.000000    Distill Loss 0.017172                                        LR 0.000063    Time 1.023076    
+2023-12-04 15:56:01,792 - Epoch: [26][ 2400/12168]    Overall Loss 0.017193    Objective Loss 0.000000    Distill Loss 0.017193                                        LR 0.000063    Time 1.018832    
+2023-12-04 15:57:34,589 - Epoch: [26][ 2500/12168]    Overall Loss 0.017160    Objective Loss 0.000000    Distill Loss 0.017160                                        LR 0.000063    Time 1.015195    
+2023-12-04 15:59:03,431 - Epoch: [26][ 2600/12168]    Overall Loss 0.017124    Objective Loss 0.000000    Distill Loss 0.017124                                        LR 0.000063    Time 1.010316    
+2023-12-04 16:00:37,065 - Epoch: [26][ 2700/12168]    Overall Loss 0.017091    Objective Loss 0.000000    Distill Loss 0.017091                                        LR 0.000063    Time 1.007574    
+2023-12-04 16:02:14,442 - Epoch: [26][ 2800/12168]    Overall Loss 0.017058    Objective Loss 0.000000    Distill Loss 0.017058                                        LR 0.000063    Time 1.006364    
+2023-12-04 16:03:59,447 - Epoch: [26][ 2900/12168]    Overall Loss 0.017027    Objective Loss 0.000000    Distill Loss 0.017027                                        LR 0.000063    Time 1.007868    
+2023-12-04 16:05:41,393 - Epoch: [26][ 3000/12168]    Overall Loss 0.016993    Objective Loss 0.000000    Distill Loss 0.016993                                        LR 0.000063    Time 1.008253    
+2023-12-04 16:07:16,612 - Epoch: [26][ 3100/12168]    Overall Loss 0.016959    Objective Loss 0.000000    Distill Loss 0.016959                                        LR 0.000063    Time 1.006442    
+2023-12-04 16:08:59,251 - Epoch: [26][ 3200/12168]    Overall Loss 0.016927    Objective Loss 0.000000    Distill Loss 0.016927                                        LR 0.000063    Time 1.007063    
+2023-12-04 16:10:44,502 - Epoch: [26][ 3300/12168]    Overall Loss 0.016898    Objective Loss 0.000000    Distill Loss 0.016898                                        LR 0.000063    Time 1.008438    
+2023-12-04 16:12:14,258 - Epoch: [26][ 3400/12168]    Overall Loss 0.016870    Objective Loss 0.000000    Distill Loss 0.016870                                        LR 0.000063    Time 1.005175    
+2023-12-04 16:13:44,620 - Epoch: [26][ 3500/12168]    Overall Loss 0.016842    Objective Loss 0.000000    Distill Loss 0.016842                                        LR 0.000063    Time 1.002272    
+2023-12-04 16:15:28,336 - Epoch: [26][ 3600/12168]    Overall Loss 0.016816    Objective Loss 0.000000    Distill Loss 0.016816                                        LR 0.000063    Time 1.003239    
+2023-12-04 16:17:04,331 - Epoch: [26][ 3700/12168]    Overall Loss 0.016792    Objective Loss 0.000000    Distill Loss 0.016792                                        LR 0.000063    Time 1.002067    
+2023-12-04 16:18:43,263 - Epoch: [26][ 3800/12168]    Overall Loss 0.016767    Objective Loss 0.000000    Distill Loss 0.016767                                        LR 0.000063    Time 1.001730    
+2023-12-04 16:20:24,929 - Epoch: [26][ 3900/12168]    Overall Loss 0.016740    Objective Loss 0.000000    Distill Loss 0.016740                                        LR 0.000063    Time 1.002111    
+2023-12-04 16:22:05,156 - Epoch: [26][ 4000/12168]    Overall Loss 0.016713    Objective Loss 0.000000    Distill Loss 0.016713                                        LR 0.000063    Time 1.002113    
+2023-12-04 16:23:50,725 - Epoch: [26][ 4100/12168]    Overall Loss 0.016689    Objective Loss 0.000000    Distill Loss 0.016689                                        LR 0.000063    Time 1.003418    
+2023-12-04 16:25:30,288 - Epoch: [26][ 4200/12168]    Overall Loss 0.016665    Objective Loss 0.000000    Distill Loss 0.016665                                        LR 0.000063    Time 1.003231    
+2023-12-04 16:27:13,336 - Epoch: [26][ 4300/12168]    Overall Loss 0.016643    Objective Loss 0.000000    Distill Loss 0.016643                                        LR 0.000063    Time 1.003864    
+2023-12-04 16:28:58,747 - Epoch: [26][ 4400/12168]    Overall Loss 0.016620    Objective Loss 0.000000    Distill Loss 0.016620                                        LR 0.000063    Time 1.005004    
+2023-12-04 16:30:33,081 - Epoch: [26][ 4500/12168]    Overall Loss 0.016599    Objective Loss 0.000000    Distill Loss 0.016599                                        LR 0.000063    Time 1.003632    
+2023-12-04 16:32:11,523 - Epoch: [26][ 4600/12168]    Overall Loss 0.016578    Objective Loss 0.000000    Distill Loss 0.016578                                        LR 0.000063    Time 1.003213    
+2023-12-04 16:34:01,525 - Epoch: [26][ 4700/12168]    Overall Loss 0.016556    Objective Loss 0.000000    Distill Loss 0.016556                                        LR 0.000063    Time 1.005271    
+2023-12-04 16:35:43,043 - Epoch: [26][ 4800/12168]    Overall Loss 0.016544    Objective Loss 0.000000    Distill Loss 0.016544                                        LR 0.000063    Time 1.005476    
+2023-12-04 16:37:30,497 - Epoch: [26][ 4900/12168]    Overall Loss 0.016535    Objective Loss 0.000000    Distill Loss 0.016535                                        LR 0.000063    Time 1.006884    
+2023-12-04 16:39:12,591 - Epoch: [26][ 5000/12168]    Overall Loss 0.016521    Objective Loss 0.000000    Distill Loss 0.016521                                        LR 0.000063    Time 1.007164    
+2023-12-04 16:40:57,533 - Epoch: [26][ 5100/12168]    Overall Loss 0.016509    Objective Loss 0.000000    Distill Loss 0.016509                                        LR 0.000063    Time 1.007992    
+2023-12-04 16:42:22,123 - Epoch: [26][ 5200/12168]    Overall Loss 0.016494    Objective Loss 0.000000    Distill Loss 0.016494                                        LR 0.000063    Time 1.004873    
+2023-12-04 16:44:03,327 - Epoch: [26][ 5300/12168]    Overall Loss 0.016474    Objective Loss 0.000000    Distill Loss 0.016474                                        LR 0.000063    Time 1.005007    
+2023-12-04 16:45:45,382 - Epoch: [26][ 5400/12168]    Overall Loss 0.016453    Objective Loss 0.000000    Distill Loss 0.016453                                        LR 0.000063    Time 1.005294    
+2023-12-04 16:47:17,402 - Epoch: [26][ 5500/12168]    Overall Loss 0.016432    Objective Loss 0.000000    Distill Loss 0.016432                                        LR 0.000063    Time 1.003745    
+2023-12-04 16:49:02,347 - Epoch: [26][ 5600/12168]    Overall Loss 0.016409    Objective Loss 0.000000    Distill Loss 0.016409                                        LR 0.000063    Time 1.004560    
+2023-12-04 16:50:38,546 - Epoch: [26][ 5700/12168]    Overall Loss 0.016388    Objective Loss 0.000000    Distill Loss 0.016388                                        LR 0.000063    Time 1.003812    
+2023-12-04 16:51:59,787 - Epoch: [26][ 5800/12168]    Overall Loss 0.016366    Objective Loss 0.000000    Distill Loss 0.016366                                        LR 0.000063    Time 1.000511    
+2023-12-04 16:53:55,505 - Epoch: [26][ 5900/12168]    Overall Loss 0.016347    Objective Loss 0.000000    Distill Loss 0.016347                                        LR 0.000063    Time 1.003165    
+2023-12-04 16:55:34,887 - Epoch: [26][ 6000/12168]    Overall Loss 0.016327    Objective Loss 0.000000    Distill Loss 0.016327                                        LR 0.000063    Time 1.003008    
+2023-12-04 16:57:18,357 - Epoch: [26][ 6100/12168]    Overall Loss 0.016306    Objective Loss 0.000000    Distill Loss 0.016306                                        LR 0.000063    Time 1.003527    
+2023-12-04 16:59:08,925 - Epoch: [26][ 6200/12168]    Overall Loss 0.016287    Objective Loss 0.000000    Distill Loss 0.016287                                        LR 0.000063    Time 1.005173    
+2023-12-04 17:00:50,503 - Epoch: [26][ 6300/12168]    Overall Loss 0.016268    Objective Loss 0.000000    Distill Loss 0.016268                                        LR 0.000063    Time 1.005340    
+2023-12-04 17:02:29,916 - Epoch: [26][ 6400/12168]    Overall Loss 0.016250    Objective Loss 0.000000    Distill Loss 0.016250                                        LR 0.000063    Time 1.005164    
+2023-12-04 17:04:15,774 - Epoch: [26][ 6500/12168]    Overall Loss 0.016231    Objective Loss 0.000000    Distill Loss 0.016231                                        LR 0.000063    Time 1.005985    
+2023-12-04 17:05:55,068 - Epoch: [26][ 6600/12168]    Overall Loss 0.016212    Objective Loss 0.000000    Distill Loss 0.016212                                        LR 0.000063    Time 1.005786    
+2023-12-04 17:07:28,583 - Epoch: [26][ 6700/12168]    Overall Loss 0.016193    Objective Loss 0.000000    Distill Loss 0.016193                                        LR 0.000063    Time 1.004731    
+2023-12-04 17:09:08,901 - Epoch: [26][ 6800/12168]    Overall Loss 0.016176    Objective Loss 0.000000    Distill Loss 0.016176                                        LR 0.000063    Time 1.004707    
+2023-12-04 17:11:04,239 - Epoch: [26][ 6900/12168]    Overall Loss 0.016158    Objective Loss 0.000000    Distill Loss 0.016158                                        LR 0.000063    Time 1.006861    
+2023-12-04 17:12:48,364 - Epoch: [26][ 7000/12168]    Overall Loss 0.016141    Objective Loss 0.000000    Distill Loss 0.016141                                        LR 0.000063    Time 1.007351    
+2023-12-04 17:14:32,648 - Epoch: [26][ 7100/12168]    Overall Loss 0.016123    Objective Loss 0.000000    Distill Loss 0.016123                                        LR 0.000063    Time 1.007850    
+2023-12-04 17:16:04,267 - Epoch: [26][ 7200/12168]    Overall Loss 0.016108    Objective Loss 0.000000    Distill Loss 0.016108                                        LR 0.000063    Time 1.006576    
+2023-12-04 17:17:56,909 - Epoch: [26][ 7300/12168]    Overall Loss 0.016091    Objective Loss 0.000000    Distill Loss 0.016091                                        LR 0.000063    Time 1.008217    
+2023-12-04 17:19:55,554 - Epoch: [26][ 7400/12168]    Overall Loss 0.016074    Objective Loss 0.000000    Distill Loss 0.016074                                        LR 0.000063    Time 1.010625    
+2023-12-04 17:21:51,061 - Epoch: [26][ 7500/12168]    Overall Loss 0.016058    Objective Loss 0.000000    Distill Loss 0.016058                                        LR 0.000063    Time 1.012550    
+2023-12-04 17:23:24,824 - Epoch: [26][ 7600/12168]    Overall Loss 0.016043    Objective Loss 0.000000    Distill Loss 0.016043                                        LR 0.000063    Time 1.011563    
+2023-12-04 17:25:04,567 - Epoch: [26][ 7700/12168]    Overall Loss 0.016028    Objective Loss 0.000000    Distill Loss 0.016028                                        LR 0.000063    Time 1.011379    
+2023-12-04 17:26:36,112 - Epoch: [26][ 7800/12168]    Overall Loss 0.016013    Objective Loss 0.000000    Distill Loss 0.016013                                        LR 0.000063    Time 1.010148    
+2023-12-04 17:28:20,571 - Epoch: [26][ 7900/12168]    Overall Loss 0.015999    Objective Loss 0.000000    Distill Loss 0.015999                                        LR 0.000063    Time 1.010583    
+2023-12-04 17:30:01,123 - Epoch: [26][ 8000/12168]    Overall Loss 0.015983    Objective Loss 0.000000    Distill Loss 0.015983                                        LR 0.000063    Time 1.010519    
+2023-12-04 17:31:41,654 - Epoch: [26][ 8100/12168]    Overall Loss 0.015968    Objective Loss 0.000000    Distill Loss 0.015968                                        LR 0.000063    Time 1.010454    
+2023-12-04 17:33:21,876 - Epoch: [26][ 8200/12168]    Overall Loss 0.015954    Objective Loss 0.000000    Distill Loss 0.015954                                        LR 0.000063    Time 1.010353    
+2023-12-04 17:35:05,734 - Epoch: [26][ 8300/12168]    Overall Loss 0.015941    Objective Loss 0.000000    Distill Loss 0.015941                                        LR 0.000063    Time 1.010692    
+2023-12-04 17:36:44,250 - Epoch: [26][ 8400/12168]    Overall Loss 0.015927    Objective Loss 0.000000    Distill Loss 0.015927                                        LR 0.000063    Time 1.010387    
+2023-12-04 17:38:34,208 - Epoch: [26][ 8500/12168]    Overall Loss 0.015914    Objective Loss 0.000000    Distill Loss 0.015914                                        LR 0.000063    Time 1.011436    
+2023-12-04 17:40:18,181 - Epoch: [26][ 8600/12168]    Overall Loss 0.015901    Objective Loss 0.000000    Distill Loss 0.015901                                        LR 0.000063    Time 1.011764    
+2023-12-04 17:42:14,315 - Epoch: [26][ 8700/12168]    Overall Loss 0.015889    Objective Loss 0.000000    Distill Loss 0.015889                                        LR 0.000063    Time 1.013483    
+2023-12-04 17:44:03,104 - Epoch: [26][ 8800/12168]    Overall Loss 0.015875    Objective Loss 0.000000    Distill Loss 0.015875                                        LR 0.000063    Time 1.014328    
+2023-12-04 17:45:49,349 - Epoch: [26][ 8900/12168]    Overall Loss 0.015862    Objective Loss 0.000000    Distill Loss 0.015862                                        LR 0.000063    Time 1.014868    
+2023-12-04 17:47:32,301 - Epoch: [26][ 9000/12168]    Overall Loss 0.015849    Objective Loss 0.000000    Distill Loss 0.015849                                        LR 0.000063    Time 1.015030    
+2023-12-04 17:49:16,307 - Epoch: [26][ 9100/12168]    Overall Loss 0.015838    Objective Loss 0.000000    Distill Loss 0.015838                                        LR 0.000063    Time 1.015304    
+2023-12-04 17:51:15,615 - Epoch: [26][ 9200/12168]    Overall Loss 0.015825    Objective Loss 0.000000    Distill Loss 0.015825                                        LR 0.000063    Time 1.017236    
+2023-12-04 17:53:02,589 - Epoch: [26][ 9300/12168]    Overall Loss 0.015814    Objective Loss 0.000000    Distill Loss 0.015814                                        LR 0.000063    Time 1.017800    
+2023-12-04 17:55:26,978 - Epoch: [26][ 9400/12168]    Overall Loss 0.015802    Objective Loss 0.000000    Distill Loss 0.015802                                        LR 0.000063    Time 1.022332    
+2023-12-04 17:57:32,217 - Epoch: [26][ 9500/12168]    Overall Loss 0.015790    Objective Loss 0.000000    Distill Loss 0.015790                                        LR 0.000063    Time 1.024753    
+2023-12-04 17:59:07,393 - Epoch: [26][ 9600/12168]    Overall Loss 0.015779    Objective Loss 0.000000    Distill Loss 0.015779                                        LR 0.000063    Time 1.023992    
+2023-12-04 18:01:00,293 - Epoch: [26][ 9700/12168]    Overall Loss 0.015768    Objective Loss 0.000000    Distill Loss 0.015768                                        LR 0.000063    Time 1.025074    
+2023-12-04 18:02:41,425 - Epoch: [26][ 9800/12168]    Overall Loss 0.015756    Objective Loss 0.000000    Distill Loss 0.015756                                        LR 0.000063    Time 1.024933    
+2023-12-04 18:04:26,281 - Epoch: [26][ 9900/12168]    Overall Loss 0.015745    Objective Loss 0.000000    Distill Loss 0.015745                                        LR 0.000063    Time 1.025171    
+2023-12-04 18:06:05,512 - Epoch: [26][10000/12168]    Overall Loss 0.015734    Objective Loss 0.000000    Distill Loss 0.015734                                        LR 0.000063    Time 1.024842    
+2023-12-04 18:07:51,169 - Epoch: [26][10100/12168]    Overall Loss 0.015724    Objective Loss 0.000000    Distill Loss 0.015724                                        LR 0.000063    Time 1.025155    
+2023-12-04 18:09:12,228 - Epoch: [26][10200/12168]    Overall Loss 0.015713    Objective Loss 0.000000    Distill Loss 0.015713                                        LR 0.000063    Time 1.023051    
+2023-12-04 18:10:25,301 - Epoch: [26][10300/12168]    Overall Loss 0.015702    Objective Loss 0.000000    Distill Loss 0.015702                                        LR 0.000063    Time 1.020212    
+2023-12-04 18:11:35,443 - Epoch: [26][10400/12168]    Overall Loss 0.015692    Objective Loss 0.000000    Distill Loss 0.015692                                        LR 0.000063    Time 1.017147    
+2023-12-04 18:12:48,634 - Epoch: [26][10500/12168]    Overall Loss 0.015683    Objective Loss 0.000000    Distill Loss 0.015683                                        LR 0.000063    Time 1.014430    
+2023-12-04 18:13:56,520 - Epoch: [26][10600/12168]    Overall Loss 0.015672    Objective Loss 0.000000    Distill Loss 0.015672                                        LR 0.000063    Time 1.011264    
+2023-12-04 18:15:06,523 - Epoch: [26][10700/12168]    Overall Loss 0.015662    Objective Loss 0.000000    Distill Loss 0.015662                                        LR 0.000063    Time 1.008354    
+2023-12-04 18:16:15,088 - Epoch: [26][10800/12168]    Overall Loss 0.015653    Objective Loss 0.000000    Distill Loss 0.015653                                        LR 0.000063    Time 1.005366    
+2023-12-04 18:18:19,056 - Epoch: [26][10900/12168]    Overall Loss 0.015643    Objective Loss 0.000000    Distill Loss 0.015643                                        LR 0.000063    Time 1.007515    
+2023-12-04 18:20:11,404 - Epoch: [26][11000/12168]    Overall Loss 0.015632    Objective Loss 0.000000    Distill Loss 0.015632                                        LR 0.000063    Time 1.008569    
+2023-12-04 18:21:49,799 - Epoch: [26][11100/12168]    Overall Loss 0.015623    Objective Loss 0.000000    Distill Loss 0.015623                                        LR 0.000063    Time 1.008346    
+2023-12-04 18:23:38,013 - Epoch: [26][11200/12168]    Overall Loss 0.015614    Objective Loss 0.000000    Distill Loss 0.015614                                        LR 0.000063    Time 1.009005    
+2023-12-04 18:25:27,875 - Epoch: [26][11300/12168]    Overall Loss 0.015604    Objective Loss 0.000000    Distill Loss 0.015604                                        LR 0.000063    Time 1.009797    
+2023-12-04 18:27:13,439 - Epoch: [26][11400/12168]    Overall Loss 0.015595    Objective Loss 0.000000    Distill Loss 0.015595                                        LR 0.000063    Time 1.010199    
+2023-12-04 18:28:55,400 - Epoch: [26][11500/12168]    Overall Loss 0.015586    Objective Loss 0.000000    Distill Loss 0.015586                                        LR 0.000063    Time 1.010280    
+2023-12-04 18:30:38,061 - Epoch: [26][11600/12168]    Overall Loss 0.015576    Objective Loss 0.000000    Distill Loss 0.015576                                        LR 0.000063    Time 1.010420    
+2023-12-04 18:32:22,050 - Epoch: [26][11700/12168]    Overall Loss 0.015568    Objective Loss 0.000000    Distill Loss 0.015568                                        LR 0.000063    Time 1.010671    
+2023-12-04 18:34:06,146 - Epoch: [26][11800/12168]    Overall Loss 0.015560    Objective Loss 0.000000    Distill Loss 0.015560                                        LR 0.000063    Time 1.010928    
+2023-12-04 18:35:54,027 - Epoch: [26][11900/12168]    Overall Loss 0.015551    Objective Loss 0.000000    Distill Loss 0.015551                                        LR 0.000063    Time 1.011497    
+2023-12-04 18:37:31,396 - Epoch: [26][12000/12168]    Overall Loss 0.015542    Objective Loss 0.000000    Distill Loss 0.015542                                        LR 0.000063    Time 1.011182    
+2023-12-04 18:39:22,309 - Epoch: [26][12100/12168]    Overall Loss 0.015534    Objective Loss 0.000000    Distill Loss 0.015534                                        LR 0.000063    Time 1.011991    
+2023-12-04 18:40:25,827 - Epoch: [26][12168/12168]    Overall Loss 0.015529    Objective Loss 0.000000    Distill Loss 0.015529                                        LR 0.000063    Time 1.011555    
+2023-12-04 18:40:26,503 - --- validate (epoch=26)-----------
+2023-12-04 18:40:26,503 - 167951 samples (256 per mini-batch)
+2023-12-04 18:41:19,907 - Epoch: [26][  100/  657]    Loss 0.000000    Overall Loss 0.014818    
+2023-12-04 18:42:08,951 - Epoch: [26][  200/  657]    Loss 0.000000    Overall Loss 0.014817    
+2023-12-04 18:42:57,998 - Epoch: [26][  300/  657]    Loss 0.000000    Overall Loss 0.014813    
+2023-12-04 18:43:47,085 - Epoch: [26][  400/  657]    Loss 0.000000    Overall Loss 0.014814    
+2023-12-04 18:44:36,145 - Epoch: [26][  500/  657]    Loss 0.000000    Overall Loss 0.014814    
+2023-12-04 18:45:25,204 - Epoch: [26][  600/  657]    Loss 0.000000    Overall Loss 0.014815    
+2023-12-04 18:45:52,782 - Epoch: [26][  657/  657]    Loss 0.000000    Overall Loss 0.014813    
+2023-12-04 18:45:53,100 - ==> Overall Loss: 0.015
+
+2023-12-04 18:45:53,102 - ==> Best [Overall Loss: 0.014813 on epoch: 26]
+2023-12-04 18:45:53,102 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-04 18:45:53,127 - 
+
+2023-12-04 18:45:53,127 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 18:47:56,911 - Epoch: [27][  100/12168]    Overall Loss 0.014463    Objective Loss 0.000000    Distill Loss 0.014463                                        LR 0.000063    Time 1.237778    
+2023-12-04 18:49:23,047 - Epoch: [27][  200/12168]    Overall Loss 0.014470    Objective Loss 0.000000    Distill Loss 0.014470                                        LR 0.000063    Time 1.049534    
+2023-12-04 18:51:02,199 - Epoch: [27][  300/12168]    Overall Loss 0.014501    Objective Loss 0.000000    Distill Loss 0.014501                                        LR 0.000063    Time 1.030172    
+2023-12-04 18:52:51,761 - Epoch: [27][  400/12168]    Overall Loss 0.014485    Objective Loss 0.000000    Distill Loss 0.014485                                        LR 0.000063    Time 1.046518    
+2023-12-04 18:54:21,405 - Epoch: [27][  500/12168]    Overall Loss 0.014480    Objective Loss 0.000000    Distill Loss 0.014480                                        LR 0.000063    Time 1.016488    
+2023-12-04 18:56:23,936 - Epoch: [27][  600/12168]    Overall Loss 0.014477    Objective Loss 0.000000    Distill Loss 0.014477                                        LR 0.000063    Time 1.051281    
+2023-12-04 18:58:03,319 - Epoch: [27][  700/12168]    Overall Loss 0.014480    Objective Loss 0.000000    Distill Loss 0.014480                                        LR 0.000063    Time 1.043064    
+2023-12-04 18:59:37,799 - Epoch: [27][  800/12168]    Overall Loss 0.014479    Objective Loss 0.000000    Distill Loss 0.014479                                        LR 0.000063    Time 1.030772    
+2023-12-04 19:01:24,330 - Epoch: [27][  900/12168]    Overall Loss 0.014477    Objective Loss 0.000000    Distill Loss 0.014477                                        LR 0.000063    Time 1.034602    
+2023-12-04 19:03:15,900 - Epoch: [27][ 1000/12168]    Overall Loss 0.014475    Objective Loss 0.000000    Distill Loss 0.014475                                        LR 0.000063    Time 1.042705    
+2023-12-04 19:05:08,388 - Epoch: [27][ 1100/12168]    Overall Loss 0.014472    Objective Loss 0.000000    Distill Loss 0.014472                                        LR 0.000063    Time 1.050169    
+2023-12-04 19:06:46,196 - Epoch: [27][ 1200/12168]    Overall Loss 0.014465    Objective Loss 0.000000    Distill Loss 0.014465                                        LR 0.000063    Time 1.044156    
+2023-12-04 19:08:28,528 - Epoch: [27][ 1300/12168]    Overall Loss 0.014466    Objective Loss 0.000000    Distill Loss 0.014466                                        LR 0.000063    Time 1.042549    
+2023-12-04 19:10:05,763 - Epoch: [27][ 1400/12168]    Overall Loss 0.014466    Objective Loss 0.000000    Distill Loss 0.014466                                        LR 0.000063    Time 1.037529    
+2023-12-04 19:11:41,477 - Epoch: [27][ 1500/12168]    Overall Loss 0.014464    Objective Loss 0.000000    Distill Loss 0.014464                                        LR 0.000063    Time 1.032166    
+2023-12-04 19:13:26,428 - Epoch: [27][ 1600/12168]    Overall Loss 0.014461    Objective Loss 0.000000    Distill Loss 0.014461                                        LR 0.000063    Time 1.033246    
+2023-12-04 19:15:09,440 - Epoch: [27][ 1700/12168]    Overall Loss 0.014459    Objective Loss 0.000000    Distill Loss 0.014459                                        LR 0.000063    Time 1.033057    
+2023-12-04 19:16:58,186 - Epoch: [27][ 1800/12168]    Overall Loss 0.014452    Objective Loss 0.000000    Distill Loss 0.014452                                        LR 0.000063    Time 1.036076    
+2023-12-04 19:18:37,010 - Epoch: [27][ 1900/12168]    Overall Loss 0.014450    Objective Loss 0.000000    Distill Loss 0.014450                                        LR 0.000063    Time 1.033555    
+2023-12-04 19:20:26,769 - Epoch: [27][ 2000/12168]    Overall Loss 0.014451    Objective Loss 0.000000    Distill Loss 0.014451                                        LR 0.000063    Time 1.036753    
+2023-12-04 19:22:10,614 - Epoch: [27][ 2100/12168]    Overall Loss 0.014448    Objective Loss 0.000000    Distill Loss 0.014448                                        LR 0.000063    Time 1.036831    
+2023-12-04 19:23:50,577 - Epoch: [27][ 2200/12168]    Overall Loss 0.014449    Objective Loss 0.000000    Distill Loss 0.014449                                        LR 0.000063    Time 1.035137    
+2023-12-04 19:25:22,295 - Epoch: [27][ 2300/12168]    Overall Loss 0.014442    Objective Loss 0.000000    Distill Loss 0.014442                                        LR 0.000063    Time 1.030006    
+2023-12-04 19:27:11,314 - Epoch: [27][ 2400/12168]    Overall Loss 0.014440    Objective Loss 0.000000    Distill Loss 0.014440                                        LR 0.000063    Time 1.032511    
+2023-12-04 19:28:51,736 - Epoch: [27][ 2500/12168]    Overall Loss 0.014436    Objective Loss 0.000000    Distill Loss 0.014436                                        LR 0.000063    Time 1.031376    
+2023-12-04 19:30:37,570 - Epoch: [27][ 2600/12168]    Overall Loss 0.014434    Objective Loss 0.000000    Distill Loss 0.014434                                        LR 0.000063    Time 1.032411    
+2023-12-04 19:32:26,680 - Epoch: [27][ 2700/12168]    Overall Loss 0.014433    Objective Loss 0.000000    Distill Loss 0.014433                                        LR 0.000063    Time 1.034582    
+2023-12-04 19:34:06,378 - Epoch: [27][ 2800/12168]    Overall Loss 0.014430    Objective Loss 0.000000    Distill Loss 0.014430                                        LR 0.000063    Time 1.033237    
+2023-12-04 19:35:41,632 - Epoch: [27][ 2900/12168]    Overall Loss 0.014429    Objective Loss 0.000000    Distill Loss 0.014429                                        LR 0.000063    Time 1.030452    
+2023-12-04 19:37:24,720 - Epoch: [27][ 3000/12168]    Overall Loss 0.014426    Objective Loss 0.000000    Distill Loss 0.014426                                        LR 0.000063    Time 1.030464    
+2023-12-04 19:38:58,596 - Epoch: [27][ 3100/12168]    Overall Loss 0.014418    Objective Loss 0.000000    Distill Loss 0.014418                                        LR 0.000063    Time 1.027503    
+2023-12-04 19:40:37,869 - Epoch: [27][ 3200/12168]    Overall Loss 0.014415    Objective Loss 0.000000    Distill Loss 0.014415                                        LR 0.000063    Time 1.026415    
+2023-12-04 19:42:19,811 - Epoch: [27][ 3300/12168]    Overall Loss 0.014413    Objective Loss 0.000000    Distill Loss 0.014413                                        LR 0.000063    Time 1.026200    
+2023-12-04 19:43:56,869 - Epoch: [27][ 3400/12168]    Overall Loss 0.014410    Objective Loss 0.000000    Distill Loss 0.014410                                        LR 0.000063    Time 1.024562    
+2023-12-04 19:45:39,726 - Epoch: [27][ 3500/12168]    Overall Loss 0.014410    Objective Loss 0.000000    Distill Loss 0.014410                                        LR 0.000063    Time 1.024675    
+2023-12-04 19:47:18,131 - Epoch: [27][ 3600/12168]    Overall Loss 0.014407    Objective Loss 0.000000    Distill Loss 0.014407                                        LR 0.000063    Time 1.023545    
+2023-12-04 19:48:59,647 - Epoch: [27][ 3700/12168]    Overall Loss 0.014405    Objective Loss 0.000000    Distill Loss 0.014405                                        LR 0.000063    Time 1.023316    
+2023-12-04 19:50:47,874 - Epoch: [27][ 3800/12168]    Overall Loss 0.014405    Objective Loss 0.000000    Distill Loss 0.014405                                        LR 0.000063    Time 1.024866    
+2023-12-04 19:52:28,426 - Epoch: [27][ 3900/12168]    Overall Loss 0.014402    Objective Loss 0.000000    Distill Loss 0.014402                                        LR 0.000063    Time 1.024368    
+2023-12-04 19:54:06,508 - Epoch: [27][ 4000/12168]    Overall Loss 0.014398    Objective Loss 0.000000    Distill Loss 0.014398                                        LR 0.000063    Time 1.023278    
+2023-12-04 19:55:55,146 - Epoch: [27][ 4100/12168]    Overall Loss 0.014396    Objective Loss 0.000000    Distill Loss 0.014396                                        LR 0.000063    Time 1.024815    
+2023-12-04 19:57:39,567 - Epoch: [27][ 4200/12168]    Overall Loss 0.014394    Objective Loss 0.000000    Distill Loss 0.014394                                        LR 0.000063    Time 1.025275    
+2023-12-04 19:59:04,165 - Epoch: [27][ 4300/12168]    Overall Loss 0.014392    Objective Loss 0.000000    Distill Loss 0.014392                                        LR 0.000063    Time 1.021104    
+2023-12-04 20:00:37,929 - Epoch: [27][ 4400/12168]    Overall Loss 0.014389    Objective Loss 0.000000    Distill Loss 0.014389                                        LR 0.000063    Time 1.019206    
+2023-12-04 20:02:29,390 - Epoch: [27][ 4500/12168]    Overall Loss 0.014387    Objective Loss 0.000000    Distill Loss 0.014387                                        LR 0.000063    Time 1.021324    
+2023-12-04 20:04:11,228 - Epoch: [27][ 4600/12168]    Overall Loss 0.014385    Objective Loss 0.000000    Distill Loss 0.014385                                        LR 0.000063    Time 1.021259    
+2023-12-04 20:05:59,868 - Epoch: [27][ 4700/12168]    Overall Loss 0.014384    Objective Loss 0.000000    Distill Loss 0.014384                                        LR 0.000063    Time 1.022643    
+2023-12-04 20:07:35,220 - Epoch: [27][ 4800/12168]    Overall Loss 0.014380    Objective Loss 0.000000    Distill Loss 0.014380                                        LR 0.000063    Time 1.021202    
+2023-12-04 20:09:17,269 - Epoch: [27][ 4900/12168]    Overall Loss 0.014378    Objective Loss 0.000000    Distill Loss 0.014378                                        LR 0.000063    Time 1.021186    
+2023-12-04 20:10:52,483 - Epoch: [27][ 5000/12168]    Overall Loss 0.014377    Objective Loss 0.000000    Distill Loss 0.014377                                        LR 0.000063    Time 1.019804    
+2023-12-04 20:12:33,360 - Epoch: [27][ 5100/12168]    Overall Loss 0.014377    Objective Loss 0.000000    Distill Loss 0.014377                                        LR 0.000063    Time 1.019586    
+2023-12-04 20:14:14,028 - Epoch: [27][ 5200/12168]    Overall Loss 0.014376    Objective Loss 0.000000    Distill Loss 0.014376                                        LR 0.000063    Time 1.019337    
+2023-12-04 20:16:04,084 - Epoch: [27][ 5300/12168]    Overall Loss 0.014374    Objective Loss 0.000000    Distill Loss 0.014374                                        LR 0.000063    Time 1.020868    
+2023-12-04 20:17:42,931 - Epoch: [27][ 5400/12168]    Overall Loss 0.014371    Objective Loss 0.000000    Distill Loss 0.014371                                        LR 0.000063    Time 1.020267    
+2023-12-04 20:19:28,171 - Epoch: [27][ 5500/12168]    Overall Loss 0.014369    Objective Loss 0.000000    Distill Loss 0.014369                                        LR 0.000063    Time 1.020850    
+2023-12-04 20:21:02,587 - Epoch: [27][ 5600/12168]    Overall Loss 0.014366    Objective Loss 0.000000    Distill Loss 0.014366                                        LR 0.000063    Time 1.019479    
+2023-12-04 20:22:36,016 - Epoch: [27][ 5700/12168]    Overall Loss 0.014364    Objective Loss 0.000000    Distill Loss 0.014364                                        LR 0.000063    Time 1.017984    
+2023-12-04 20:24:24,880 - Epoch: [27][ 5800/12168]    Overall Loss 0.014360    Objective Loss 0.000000    Distill Loss 0.014360                                        LR 0.000063    Time 1.019201    
+2023-12-04 20:25:58,440 - Epoch: [27][ 5900/12168]    Overall Loss 0.014360    Objective Loss 0.000000    Distill Loss 0.014360                                        LR 0.000063    Time 1.017783    
+2023-12-04 20:27:38,651 - Epoch: [27][ 6000/12168]    Overall Loss 0.014358    Objective Loss 0.000000    Distill Loss 0.014358                                        LR 0.000063    Time 1.017520    
+2023-12-04 20:29:18,284 - Epoch: [27][ 6100/12168]    Overall Loss 0.014354    Objective Loss 0.000000    Distill Loss 0.014354                                        LR 0.000063    Time 1.017172    
+2023-12-04 20:31:06,850 - Epoch: [27][ 6200/12168]    Overall Loss 0.014353    Objective Loss 0.000000    Distill Loss 0.014353                                        LR 0.000063    Time 1.018275    
+2023-12-04 20:32:53,604 - Epoch: [27][ 6300/12168]    Overall Loss 0.014351    Objective Loss 0.000000    Distill Loss 0.014351                                        LR 0.000063    Time 1.019056    
+2023-12-04 20:34:38,026 - Epoch: [27][ 6400/12168]    Overall Loss 0.014350    Objective Loss 0.000000    Distill Loss 0.014350                                        LR 0.000063    Time 1.019448    
+2023-12-04 20:36:11,314 - Epoch: [27][ 6500/12168]    Overall Loss 0.014347    Objective Loss 0.000000    Distill Loss 0.014347                                        LR 0.000063    Time 1.018115    
+2023-12-04 20:37:56,782 - Epoch: [27][ 6600/12168]    Overall Loss 0.014345    Objective Loss 0.000000    Distill Loss 0.014345                                        LR 0.000063    Time 1.018668    
+2023-12-04 20:39:42,993 - Epoch: [27][ 6700/12168]    Overall Loss 0.014343    Objective Loss 0.000000    Distill Loss 0.014343                                        LR 0.000063    Time 1.019316    
+2023-12-04 20:41:29,412 - Epoch: [27][ 6800/12168]    Overall Loss 0.014341    Objective Loss 0.000000    Distill Loss 0.014341                                        LR 0.000063    Time 1.019975    
+2023-12-04 20:43:07,053 - Epoch: [27][ 6900/12168]    Overall Loss 0.014339    Objective Loss 0.000000    Distill Loss 0.014339                                        LR 0.000063    Time 1.019342    
+2023-12-04 20:44:48,689 - Epoch: [27][ 7000/12168]    Overall Loss 0.014337    Objective Loss 0.000000    Distill Loss 0.014337                                        LR 0.000063    Time 1.019299    
+2023-12-04 20:46:36,581 - Epoch: [27][ 7100/12168]    Overall Loss 0.014335    Objective Loss 0.000000    Distill Loss 0.014335                                        LR 0.000063    Time 1.020137    
+2023-12-04 20:48:19,542 - Epoch: [27][ 7200/12168]    Overall Loss 0.014335    Objective Loss 0.000000    Distill Loss 0.014335                                        LR 0.000063    Time 1.020268    
+2023-12-04 20:49:57,236 - Epoch: [27][ 7300/12168]    Overall Loss 0.014332    Objective Loss 0.000000    Distill Loss 0.014332                                        LR 0.000063    Time 1.019674    
+2023-12-04 20:51:31,006 - Epoch: [27][ 7400/12168]    Overall Loss 0.014330    Objective Loss 0.000000    Distill Loss 0.014330                                        LR 0.000063    Time 1.018565    
+2023-12-04 20:53:06,142 - Epoch: [27][ 7500/12168]    Overall Loss 0.014327    Objective Loss 0.000000    Distill Loss 0.014327                                        LR 0.000063    Time 1.017668    
+2023-12-04 20:55:03,371 - Epoch: [27][ 7600/12168]    Overall Loss 0.014327    Objective Loss 0.000000    Distill Loss 0.014327                                        LR 0.000063    Time 1.019702    
+2023-12-04 20:56:40,798 - Epoch: [27][ 7700/12168]    Overall Loss 0.014326    Objective Loss 0.000000    Distill Loss 0.014326                                        LR 0.000063    Time 1.019111    
+2023-12-04 20:58:24,674 - Epoch: [27][ 7800/12168]    Overall Loss 0.014325    Objective Loss 0.000000    Distill Loss 0.014325                                        LR 0.000063    Time 1.019362    
+2023-12-04 21:00:10,791 - Epoch: [27][ 7900/12168]    Overall Loss 0.014324    Objective Loss 0.000000    Distill Loss 0.014324                                        LR 0.000063    Time 1.019890    
+2023-12-04 21:01:51,523 - Epoch: [27][ 8000/12168]    Overall Loss 0.014322    Objective Loss 0.000000    Distill Loss 0.014322                                        LR 0.000063    Time 1.019732    
+2023-12-04 21:03:31,117 - Epoch: [27][ 8100/12168]    Overall Loss 0.014321    Objective Loss 0.000000    Distill Loss 0.014321                                        LR 0.000063    Time 1.019438    
+2023-12-04 21:05:10,112 - Epoch: [27][ 8200/12168]    Overall Loss 0.014320    Objective Loss 0.000000    Distill Loss 0.014320                                        LR 0.000063    Time 1.019077    
+2023-12-04 21:06:59,152 - Epoch: [27][ 8300/12168]    Overall Loss 0.014320    Objective Loss 0.000000    Distill Loss 0.014320                                        LR 0.000063    Time 1.019936    
+2023-12-04 21:08:49,245 - Epoch: [27][ 8400/12168]    Overall Loss 0.014318    Objective Loss 0.000000    Distill Loss 0.014318                                        LR 0.000063    Time 1.020899    
+2023-12-04 21:10:33,582 - Epoch: [27][ 8500/12168]    Overall Loss 0.014317    Objective Loss 0.000000    Distill Loss 0.014317                                        LR 0.000063    Time 1.021163    
+2023-12-04 21:12:11,191 - Epoch: [27][ 8600/12168]    Overall Loss 0.014315    Objective Loss 0.000000    Distill Loss 0.014315                                        LR 0.000063    Time 1.020638    
+2023-12-04 21:13:44,972 - Epoch: [27][ 8700/12168]    Overall Loss 0.014314    Objective Loss 0.000000    Distill Loss 0.014314                                        LR 0.000063    Time 1.019685    
+2023-12-04 21:15:22,779 - Epoch: [27][ 8800/12168]    Overall Loss 0.014312    Objective Loss 0.000000    Distill Loss 0.014312                                        LR 0.000063    Time 1.019211    
+2023-12-04 21:17:12,053 - Epoch: [27][ 8900/12168]    Overall Loss 0.014310    Objective Loss 0.000000    Distill Loss 0.014310                                        LR 0.000063    Time 1.020037    
+2023-12-04 21:18:55,077 - Epoch: [27][ 9000/12168]    Overall Loss 0.014308    Objective Loss 0.000000    Distill Loss 0.014308                                        LR 0.000063    Time 1.020149    
+2023-12-04 21:20:40,829 - Epoch: [27][ 9100/12168]    Overall Loss 0.014307    Objective Loss 0.000000    Distill Loss 0.014307                                        LR 0.000063    Time 1.020559    
+2023-12-04 21:22:20,029 - Epoch: [27][ 9200/12168]    Overall Loss 0.014305    Objective Loss 0.000000    Distill Loss 0.014305                                        LR 0.000063    Time 1.020248    
+2023-12-04 21:24:01,778 - Epoch: [27][ 9300/12168]    Overall Loss 0.014304    Objective Loss 0.000000    Distill Loss 0.014304                                        LR 0.000063    Time 1.020218    
+2023-12-04 21:25:53,154 - Epoch: [27][ 9400/12168]    Overall Loss 0.014303    Objective Loss 0.000000    Distill Loss 0.014303                                        LR 0.000063    Time 1.021212    
+2023-12-04 21:27:26,948 - Epoch: [27][ 9500/12168]    Overall Loss 0.014302    Objective Loss 0.000000    Distill Loss 0.014302                                        LR 0.000063    Time 1.020335    
+2023-12-04 21:29:00,411 - Epoch: [27][ 9600/12168]    Overall Loss 0.014301    Objective Loss 0.000000    Distill Loss 0.014301                                        LR 0.000063    Time 1.019442    
+2023-12-04 21:30:41,543 - Epoch: [27][ 9700/12168]    Overall Loss 0.014299    Objective Loss 0.000000    Distill Loss 0.014299                                        LR 0.000063    Time 1.019355    
+2023-12-04 21:32:29,989 - Epoch: [27][ 9800/12168]    Overall Loss 0.014298    Objective Loss 0.000000    Distill Loss 0.014298                                        LR 0.000063    Time 1.020019    
+2023-12-04 21:34:14,547 - Epoch: [27][ 9900/12168]    Overall Loss 0.014296    Objective Loss 0.000000    Distill Loss 0.014296                                        LR 0.000063    Time 1.020277    
+2023-12-04 21:35:56,252 - Epoch: [27][10000/12168]    Overall Loss 0.014295    Objective Loss 0.000000    Distill Loss 0.014295                                        LR 0.000063    Time 1.020244    
+2023-12-04 21:37:26,052 - Epoch: [27][10100/12168]    Overall Loss 0.014294    Objective Loss 0.000000    Distill Loss 0.014294                                        LR 0.000063    Time 1.019033    
+2023-12-04 21:39:12,418 - Epoch: [27][10200/12168]    Overall Loss 0.014293    Objective Loss 0.000000    Distill Loss 0.014293                                        LR 0.000063    Time 1.019470    
+2023-12-04 21:40:49,904 - Epoch: [27][10300/12168]    Overall Loss 0.014291    Objective Loss 0.000000    Distill Loss 0.014291                                        LR 0.000063    Time 1.019036    
+2023-12-04 21:42:31,493 - Epoch: [27][10400/12168]    Overall Loss 0.014290    Objective Loss 0.000000    Distill Loss 0.014290                                        LR 0.000063    Time 1.019005    
+2023-12-04 21:44:18,971 - Epoch: [27][10500/12168]    Overall Loss 0.014290    Objective Loss 0.000000    Distill Loss 0.014290                                        LR 0.000063    Time 1.019535    
+2023-12-04 21:46:02,034 - Epoch: [27][10600/12168]    Overall Loss 0.014288    Objective Loss 0.000000    Distill Loss 0.014288                                        LR 0.000063    Time 1.019639    
+2023-12-04 21:47:44,790 - Epoch: [27][10700/12168]    Overall Loss 0.014287    Objective Loss 0.000000    Distill Loss 0.014287                                        LR 0.000063    Time 1.019713    
+2023-12-04 21:49:21,994 - Epoch: [27][10800/12168]    Overall Loss 0.014286    Objective Loss 0.000000    Distill Loss 0.014286                                        LR 0.000063    Time 1.019271    
+2023-12-04 21:51:13,613 - Epoch: [27][10900/12168]    Overall Loss 0.014285    Objective Loss 0.000000    Distill Loss 0.014285                                        LR 0.000063    Time 1.020159    
+2023-12-04 21:52:51,924 - Epoch: [27][11000/12168]    Overall Loss 0.014283    Objective Loss 0.000000    Distill Loss 0.014283                                        LR 0.000063    Time 1.019822    
+2023-12-04 21:54:35,694 - Epoch: [27][11100/12168]    Overall Loss 0.014283    Objective Loss 0.000000    Distill Loss 0.014283                                        LR 0.000063    Time 1.019982    
+2023-12-04 21:56:15,089 - Epoch: [27][11200/12168]    Overall Loss 0.014282    Objective Loss 0.000000    Distill Loss 0.014282                                        LR 0.000063    Time 1.019749    
+2023-12-04 21:57:51,544 - Epoch: [27][11300/12168]    Overall Loss 0.014282    Objective Loss 0.000000    Distill Loss 0.014282                                        LR 0.000063    Time 1.019260    
+2023-12-04 21:59:28,837 - Epoch: [27][11400/12168]    Overall Loss 0.014281    Objective Loss 0.000000    Distill Loss 0.014281                                        LR 0.000063    Time 1.018853    
+2023-12-04 22:01:09,659 - Epoch: [27][11500/12168]    Overall Loss 0.014279    Objective Loss 0.000000    Distill Loss 0.014279                                        LR 0.000063    Time 1.018760    
+2023-12-04 22:02:45,999 - Epoch: [27][11600/12168]    Overall Loss 0.014278    Objective Loss 0.000000    Distill Loss 0.014278                                        LR 0.000063    Time 1.018282    
+2023-12-04 22:04:46,587 - Epoch: [27][11700/12168]    Overall Loss 0.014277    Objective Loss 0.000000    Distill Loss 0.014277                                        LR 0.000063    Time 1.019885    
+2023-12-04 22:06:36,407 - Epoch: [27][11800/12168]    Overall Loss 0.014277    Objective Loss 0.000000    Distill Loss 0.014277                                        LR 0.000063    Time 1.020548    
+2023-12-04 22:07:41,981 - Epoch: [27][11900/12168]    Overall Loss 0.014275    Objective Loss 0.000000    Distill Loss 0.014275                                        LR 0.000063    Time 1.017482    
+2023-12-04 22:08:54,282 - Epoch: [27][12000/12168]    Overall Loss 0.014274    Objective Loss 0.000000    Distill Loss 0.014274                                        LR 0.000063    Time 1.015028    
+2023-12-04 22:09:56,704 - Epoch: [27][12100/12168]    Overall Loss 0.014273    Objective Loss 0.000000    Distill Loss 0.014273                                        LR 0.000063    Time 1.011798    
+2023-12-04 22:10:41,048 - Epoch: [27][12168/12168]    Overall Loss 0.014273    Objective Loss 0.000000    Distill Loss 0.014273                                        LR 0.000063    Time 1.009788    
+2023-12-04 22:10:41,490 - --- validate (epoch=27)-----------
+2023-12-04 22:10:41,490 - 167951 samples (256 per mini-batch)
+2023-12-04 22:11:33,734 - Epoch: [27][  100/  657]    Loss 0.000000    Overall Loss 0.014647    
+2023-12-04 22:12:22,657 - Epoch: [27][  200/  657]    Loss 0.000000    Overall Loss 0.014632    
+2023-12-04 22:13:11,568 - Epoch: [27][  300/  657]    Loss 0.000000    Overall Loss 0.014644    
+2023-12-04 22:14:00,638 - Epoch: [27][  400/  657]    Loss 0.000000    Overall Loss 0.014644    
+2023-12-04 22:14:49,666 - Epoch: [27][  500/  657]    Loss 0.000000    Overall Loss 0.014649    
+2023-12-04 22:15:38,750 - Epoch: [27][  600/  657]    Loss 0.000000    Overall Loss 0.014646    
+2023-12-04 22:16:06,334 - Epoch: [27][  657/  657]    Loss 0.000000    Overall Loss 0.014646    
+2023-12-04 22:16:06,717 - ==> Overall Loss: 0.015
+
+2023-12-04 22:16:06,720 - ==> Best [Overall Loss: 0.014646 on epoch: 27]
+2023-12-04 22:16:06,720 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-04 22:16:06,747 - 
+
+2023-12-04 22:16:06,748 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-04 22:17:59,978 - Epoch: [28][  100/12168]    Overall Loss 0.014088    Objective Loss 0.000000    Distill Loss 0.014088                                        LR 0.000063    Time 1.132230    
+2023-12-04 22:19:40,053 - Epoch: [28][  200/12168]    Overall Loss 0.014109    Objective Loss 0.000000    Distill Loss 0.014109                                        LR 0.000063    Time 1.066455    
+2023-12-04 22:21:31,079 - Epoch: [28][  300/12168]    Overall Loss 0.014109    Objective Loss 0.000000    Distill Loss 0.014109                                        LR 0.000063    Time 1.081036    
+2023-12-04 22:23:10,836 - Epoch: [28][  400/12168]    Overall Loss 0.014108    Objective Loss 0.000000    Distill Loss 0.014108                                        LR 0.000063    Time 1.060151    
+2023-12-04 22:24:48,975 - Epoch: [28][  500/12168]    Overall Loss 0.014104    Objective Loss 0.000000    Distill Loss 0.014104                                        LR 0.000063    Time 1.044385    
+2023-12-04 22:26:32,674 - Epoch: [28][  600/12168]    Overall Loss 0.014108    Objective Loss 0.000000    Distill Loss 0.014108                                        LR 0.000063    Time 1.043141    
+2023-12-04 22:28:19,422 - Epoch: [28][  700/12168]    Overall Loss 0.014102    Objective Loss 0.000000    Distill Loss 0.014102                                        LR 0.000063    Time 1.046608    
+2023-12-04 22:30:01,478 - Epoch: [28][  800/12168]    Overall Loss 0.014093    Objective Loss 0.000000    Distill Loss 0.014093                                        LR 0.000063    Time 1.043344    
+2023-12-04 22:31:32,295 - Epoch: [28][  900/12168]    Overall Loss 0.014099    Objective Loss 0.000000    Distill Loss 0.014099                                        LR 0.000063    Time 1.028316    
+2023-12-04 22:33:13,738 - Epoch: [28][ 1000/12168]    Overall Loss 0.014107    Objective Loss 0.000000    Distill Loss 0.014107                                        LR 0.000063    Time 1.026922    
+2023-12-04 22:34:46,279 - Epoch: [28][ 1100/12168]    Overall Loss 0.014104    Objective Loss 0.000000    Distill Loss 0.014104                                        LR 0.000063    Time 1.017687    
+2023-12-04 22:36:22,425 - Epoch: [28][ 1200/12168]    Overall Loss 0.014106    Objective Loss 0.000000    Distill Loss 0.014106                                        LR 0.000063    Time 1.012995    
+2023-12-04 22:38:04,270 - Epoch: [28][ 1300/12168]    Overall Loss 0.014105    Objective Loss 0.000000    Distill Loss 0.014105                                        LR 0.000063    Time 1.013410    
+2023-12-04 22:39:46,400 - Epoch: [28][ 1400/12168]    Overall Loss 0.014109    Objective Loss 0.000000    Distill Loss 0.014109                                        LR 0.000063    Time 1.013968    
+2023-12-04 22:41:28,746 - Epoch: [28][ 1500/12168]    Overall Loss 0.014109    Objective Loss 0.000000    Distill Loss 0.014109                                        LR 0.000063    Time 1.014596    
+2023-12-04 22:43:23,727 - Epoch: [28][ 1600/12168]    Overall Loss 0.014108    Objective Loss 0.000000    Distill Loss 0.014108                                        LR 0.000063    Time 1.023043    
+2023-12-04 22:45:07,283 - Epoch: [28][ 1700/12168]    Overall Loss 0.014108    Objective Loss 0.000000    Distill Loss 0.014108                                        LR 0.000063    Time 1.023775    
+2023-12-04 22:46:47,622 - Epoch: [28][ 1800/12168]    Overall Loss 0.014102    Objective Loss 0.000000    Distill Loss 0.014102                                        LR 0.000063    Time 1.022638    
+2023-12-04 22:48:41,458 - Epoch: [28][ 1900/12168]    Overall Loss 0.014105    Objective Loss 0.000000    Distill Loss 0.014105                                        LR 0.000063    Time 1.028726    
+2023-12-04 22:50:25,574 - Epoch: [28][ 2000/12168]    Overall Loss 0.014105    Objective Loss 0.000000    Distill Loss 0.014105                                        LR 0.000063    Time 1.029344    
+2023-12-04 22:52:08,653 - Epoch: [28][ 2100/12168]    Overall Loss 0.014107    Objective Loss 0.000000    Distill Loss 0.014107                                        LR 0.000063    Time 1.029409    
+2023-12-04 22:53:55,519 - Epoch: [28][ 2200/12168]    Overall Loss 0.014108    Objective Loss 0.000000    Distill Loss 0.014108                                        LR 0.000063    Time 1.031191    
+2023-12-04 22:55:43,271 - Epoch: [28][ 2300/12168]    Overall Loss 0.014101    Objective Loss 0.000000    Distill Loss 0.014101                                        LR 0.000063    Time 1.033202    
+2023-12-04 22:57:16,220 - Epoch: [28][ 2400/12168]    Overall Loss 0.014098    Objective Loss 0.000000    Distill Loss 0.014098                                        LR 0.000063    Time 1.028877    
+2023-12-04 22:58:51,764 - Epoch: [28][ 2500/12168]    Overall Loss 0.014097    Objective Loss 0.000000    Distill Loss 0.014097                                        LR 0.000063    Time 1.025937    
+2023-12-04 23:00:38,325 - Epoch: [28][ 2600/12168]    Overall Loss 0.014095    Objective Loss 0.000000    Distill Loss 0.014095                                        LR 0.000063    Time 1.027460    
+2023-12-04 23:02:17,635 - Epoch: [28][ 2700/12168]    Overall Loss 0.014096    Objective Loss 0.000000    Distill Loss 0.014096                                        LR 0.000063    Time 1.026185    
+2023-12-04 23:04:09,066 - Epoch: [28][ 2800/12168]    Overall Loss 0.014095    Objective Loss 0.000000    Distill Loss 0.014095                                        LR 0.000063    Time 1.029330    
+2023-12-04 23:05:52,250 - Epoch: [28][ 2900/12168]    Overall Loss 0.014095    Objective Loss 0.000000    Distill Loss 0.014095                                        LR 0.000063    Time 1.029414    
+2023-12-04 23:07:31,803 - Epoch: [28][ 3000/12168]    Overall Loss 0.014091    Objective Loss 0.000000    Distill Loss 0.014091                                        LR 0.000063    Time 1.028282    
+2023-12-04 23:09:10,548 - Epoch: [28][ 3100/12168]    Overall Loss 0.014087    Objective Loss 0.000000    Distill Loss 0.014087                                        LR 0.000063    Time 1.026962    
+2023-12-04 23:10:32,598 - Epoch: [28][ 3200/12168]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                                        LR 0.000063    Time 1.020508    
+2023-12-04 23:12:21,770 - Epoch: [28][ 3300/12168]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                                        LR 0.000063    Time 1.022664    
+2023-12-04 23:14:08,627 - Epoch: [28][ 3400/12168]    Overall Loss 0.014086    Objective Loss 0.000000    Distill Loss 0.014086                                        LR 0.000063    Time 1.024012    
+2023-12-04 23:15:54,493 - Epoch: [28][ 3500/12168]    Overall Loss 0.014087    Objective Loss 0.000000    Distill Loss 0.014087                                        LR 0.000063    Time 1.025000    
+2023-12-04 23:17:40,507 - Epoch: [28][ 3600/12168]    Overall Loss 0.014086    Objective Loss 0.000000    Distill Loss 0.014086                                        LR 0.000063    Time 1.025975    
+2023-12-04 23:19:18,550 - Epoch: [28][ 3700/12168]    Overall Loss 0.014086    Objective Loss 0.000000    Distill Loss 0.014086                                        LR 0.000063    Time 1.024742    
+2023-12-04 23:21:02,507 - Epoch: [28][ 3800/12168]    Overall Loss 0.014088    Objective Loss 0.000000    Distill Loss 0.014088                                        LR 0.000063    Time 1.025130    
+2023-12-04 23:22:34,701 - Epoch: [28][ 3900/12168]    Overall Loss 0.014088    Objective Loss 0.000000    Distill Loss 0.014088                                        LR 0.000063    Time 1.022482    
+2023-12-04 23:24:08,767 - Epoch: [28][ 4000/12168]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                                        LR 0.000063    Time 1.020435    
+2023-12-04 23:25:48,510 - Epoch: [28][ 4100/12168]    Overall Loss 0.014086    Objective Loss 0.000000    Distill Loss 0.014086                                        LR 0.000063    Time 1.019872    
+2023-12-04 23:27:45,044 - Epoch: [28][ 4200/12168]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                                        LR 0.000063    Time 1.023334    
+2023-12-04 23:29:36,729 - Epoch: [28][ 4300/12168]    Overall Loss 0.014083    Objective Loss 0.000000    Distill Loss 0.014083                                        LR 0.000063    Time 1.025507    
+2023-12-04 23:31:11,121 - Epoch: [28][ 4400/12168]    Overall Loss 0.014081    Objective Loss 0.000000    Distill Loss 0.014081                                        LR 0.000063    Time 1.023651    
+2023-12-04 23:32:36,568 - Epoch: [28][ 4500/12168]    Overall Loss 0.014082    Objective Loss 0.000000    Distill Loss 0.014082                                        LR 0.000063    Time 1.019890    
+2023-12-04 23:34:19,330 - Epoch: [28][ 4600/12168]    Overall Loss 0.014082    Objective Loss 0.000000    Distill Loss 0.014082                                        LR 0.000063    Time 1.020057    
+2023-12-04 23:36:19,821 - Epoch: [28][ 4700/12168]    Overall Loss 0.014081    Objective Loss 0.000000    Distill Loss 0.014081                                        LR 0.000063    Time 1.023988    
+2023-12-04 23:38:01,732 - Epoch: [28][ 4800/12168]    Overall Loss 0.014080    Objective Loss 0.000000    Distill Loss 0.014080                                        LR 0.000063    Time 1.023885    
+2023-12-04 23:39:51,847 - Epoch: [28][ 4900/12168]    Overall Loss 0.014077    Objective Loss 0.000000    Distill Loss 0.014077                                        LR 0.000063    Time 1.025461    
+2023-12-04 23:41:32,099 - Epoch: [28][ 5000/12168]    Overall Loss 0.014077    Objective Loss 0.000000    Distill Loss 0.014077                                        LR 0.000063    Time 1.025000    
+2023-12-04 23:43:24,207 - Epoch: [28][ 5100/12168]    Overall Loss 0.014076    Objective Loss 0.000000    Distill Loss 0.014076                                        LR 0.000063    Time 1.026883    
+2023-12-04 23:45:04,467 - Epoch: [28][ 5200/12168]    Overall Loss 0.014076    Objective Loss 0.000000    Distill Loss 0.014076                                        LR 0.000063    Time 1.026415    
+2023-12-04 23:46:45,743 - Epoch: [28][ 5300/12168]    Overall Loss 0.014075    Objective Loss 0.000000    Distill Loss 0.014075                                        LR 0.000063    Time 1.026156    
+2023-12-04 23:48:28,262 - Epoch: [28][ 5400/12168]    Overall Loss 0.014075    Objective Loss 0.000000    Distill Loss 0.014075                                        LR 0.000063    Time 1.026137    
+2023-12-04 23:50:17,724 - Epoch: [28][ 5500/12168]    Overall Loss 0.014075    Objective Loss 0.000000    Distill Loss 0.014075                                        LR 0.000063    Time 1.027380    
+2023-12-04 23:51:58,331 - Epoch: [28][ 5600/12168]    Overall Loss 0.014072    Objective Loss 0.000000    Distill Loss 0.014072                                        LR 0.000063    Time 1.026999    
+2023-12-04 23:53:43,959 - Epoch: [28][ 5700/12168]    Overall Loss 0.014073    Objective Loss 0.000000    Distill Loss 0.014073                                        LR 0.000063    Time 1.027511    
+2023-12-04 23:55:33,334 - Epoch: [28][ 5800/12168]    Overall Loss 0.014071    Objective Loss 0.000000    Distill Loss 0.014071                                        LR 0.000063    Time 1.028652    
+2023-12-04 23:57:18,769 - Epoch: [28][ 5900/12168]    Overall Loss 0.014072    Objective Loss 0.000000    Distill Loss 0.014072                                        LR 0.000063    Time 1.029086    
+2023-12-04 23:59:05,431 - Epoch: [28][ 6000/12168]    Overall Loss 0.014072    Objective Loss 0.000000    Distill Loss 0.014072                                        LR 0.000063    Time 1.029711    
+2023-12-05 00:00:54,844 - Epoch: [28][ 6100/12168]    Overall Loss 0.014072    Objective Loss 0.000000    Distill Loss 0.014072                                        LR 0.000063    Time 1.030766    
+2023-12-05 00:02:35,248 - Epoch: [28][ 6200/12168]    Overall Loss 0.014071    Objective Loss 0.000000    Distill Loss 0.014071                                        LR 0.000063    Time 1.030334    
+2023-12-05 00:04:11,665 - Epoch: [28][ 6300/12168]    Overall Loss 0.014072    Objective Loss 0.000000    Distill Loss 0.014072                                        LR 0.000063    Time 1.029282    
+2023-12-05 00:05:59,059 - Epoch: [28][ 6400/12168]    Overall Loss 0.014071    Objective Loss 0.000000    Distill Loss 0.014071                                        LR 0.000063    Time 1.029979    
+2023-12-05 00:07:41,003 - Epoch: [28][ 6500/12168]    Overall Loss 0.014070    Objective Loss 0.000000    Distill Loss 0.014070                                        LR 0.000063    Time 1.029816    
+2023-12-05 00:09:23,306 - Epoch: [28][ 6600/12168]    Overall Loss 0.014069    Objective Loss 0.000000    Distill Loss 0.014069                                        LR 0.000063    Time 1.029712    
+2023-12-05 00:10:58,174 - Epoch: [28][ 6700/12168]    Overall Loss 0.014068    Objective Loss 0.000000    Distill Loss 0.014068                                        LR 0.000063    Time 1.028502    
+2023-12-05 00:12:44,644 - Epoch: [28][ 6800/12168]    Overall Loss 0.014067    Objective Loss 0.000000    Distill Loss 0.014067                                        LR 0.000063    Time 1.029033    
+2023-12-05 00:14:22,070 - Epoch: [28][ 6900/12168]    Overall Loss 0.014065    Objective Loss 0.000000    Distill Loss 0.014065                                        LR 0.000063    Time 1.028238    
+2023-12-05 00:16:09,367 - Epoch: [28][ 7000/12168]    Overall Loss 0.014064    Objective Loss 0.000000    Distill Loss 0.014064                                        LR 0.000063    Time 1.028876    
+2023-12-05 00:17:45,509 - Epoch: [28][ 7100/12168]    Overall Loss 0.014062    Objective Loss 0.000000    Distill Loss 0.014062                                        LR 0.000063    Time 1.027925    
+2023-12-05 00:19:23,330 - Epoch: [28][ 7200/12168]    Overall Loss 0.014062    Objective Loss 0.000000    Distill Loss 0.014062                                        LR 0.000063    Time 1.027234    
+2023-12-05 00:21:09,909 - Epoch: [28][ 7300/12168]    Overall Loss 0.014060    Objective Loss 0.000000    Distill Loss 0.014060                                        LR 0.000063    Time 1.027761    
+2023-12-05 00:22:41,842 - Epoch: [28][ 7400/12168]    Overall Loss 0.014058    Objective Loss 0.000000    Distill Loss 0.014058                                        LR 0.000063    Time 1.026295    
+2023-12-05 00:24:21,929 - Epoch: [28][ 7500/12168]    Overall Loss 0.014058    Objective Loss 0.000000    Distill Loss 0.014058                                        LR 0.000063    Time 1.025955    
+2023-12-05 00:26:06,160 - Epoch: [28][ 7600/12168]    Overall Loss 0.014057    Objective Loss 0.000000    Distill Loss 0.014057                                        LR 0.000063    Time 1.026169    
+2023-12-05 00:27:57,764 - Epoch: [28][ 7700/12168]    Overall Loss 0.014057    Objective Loss 0.000000    Distill Loss 0.014057                                        LR 0.000063    Time 1.027335    
+2023-12-05 00:29:47,308 - Epoch: [28][ 7800/12168]    Overall Loss 0.014057    Objective Loss 0.000000    Distill Loss 0.014057                                        LR 0.000063    Time 1.028208    
+2023-12-05 00:31:16,677 - Epoch: [28][ 7900/12168]    Overall Loss 0.014056    Objective Loss 0.000000    Distill Loss 0.014056                                        LR 0.000063    Time 1.026504    
+2023-12-05 00:33:01,387 - Epoch: [28][ 8000/12168]    Overall Loss 0.014055    Objective Loss 0.000000    Distill Loss 0.014055                                        LR 0.000063    Time 1.026761    
+2023-12-05 00:34:49,284 - Epoch: [28][ 8100/12168]    Overall Loss 0.014054    Objective Loss 0.000000    Distill Loss 0.014054                                        LR 0.000063    Time 1.027404    
+2023-12-05 00:36:34,729 - Epoch: [28][ 8200/12168]    Overall Loss 0.014053    Objective Loss 0.000000    Distill Loss 0.014053                                        LR 0.000063    Time 1.027733    
+2023-12-05 00:38:23,101 - Epoch: [28][ 8300/12168]    Overall Loss 0.014053    Objective Loss 0.000000    Distill Loss 0.014053                                        LR 0.000063    Time 1.028407    
+2023-12-05 00:40:05,885 - Epoch: [28][ 8400/12168]    Overall Loss 0.014052    Objective Loss 0.000000    Distill Loss 0.014052                                        LR 0.000063    Time 1.028400    
+2023-12-05 00:41:48,024 - Epoch: [28][ 8500/12168]    Overall Loss 0.014051    Objective Loss 0.000000    Distill Loss 0.014051                                        LR 0.000063    Time 1.028316    
+2023-12-05 00:43:23,405 - Epoch: [28][ 8600/12168]    Overall Loss 0.014051    Objective Loss 0.000000    Distill Loss 0.014051                                        LR 0.000063    Time 1.027449    
+2023-12-05 00:45:07,436 - Epoch: [28][ 8700/12168]    Overall Loss 0.014051    Objective Loss 0.000000    Distill Loss 0.014051                                        LR 0.000063    Time 1.027596    
+2023-12-05 00:46:48,505 - Epoch: [28][ 8800/12168]    Overall Loss 0.014054    Objective Loss 0.000000    Distill Loss 0.014054                                        LR 0.000063    Time 1.027403    
+2023-12-05 00:48:42,160 - Epoch: [28][ 8900/12168]    Overall Loss 0.014054    Objective Loss 0.000000    Distill Loss 0.014054                                        LR 0.000063    Time 1.028629    
+2023-12-05 00:50:21,935 - Epoch: [28][ 9000/12168]    Overall Loss 0.014053    Objective Loss 0.000000    Distill Loss 0.014053                                        LR 0.000063    Time 1.028285    
+2023-12-05 00:52:00,537 - Epoch: [28][ 9100/12168]    Overall Loss 0.014052    Objective Loss 0.000000    Distill Loss 0.014052                                        LR 0.000063    Time 1.027820    
+2023-12-05 00:53:37,950 - Epoch: [28][ 9200/12168]    Overall Loss 0.014051    Objective Loss 0.000000    Distill Loss 0.014051                                        LR 0.000063    Time 1.027235    
+2023-12-05 00:55:35,132 - Epoch: [28][ 9300/12168]    Overall Loss 0.014049    Objective Loss 0.000000    Distill Loss 0.014049                                        LR 0.000063    Time 1.028789    
+2023-12-05 00:57:27,083 - Epoch: [28][ 9400/12168]    Overall Loss 0.014048    Objective Loss 0.000000    Distill Loss 0.014048                                        LR 0.000063    Time 1.029754    
+2023-12-05 00:58:59,018 - Epoch: [28][ 9500/12168]    Overall Loss 0.014047    Objective Loss 0.000000    Distill Loss 0.014047                                        LR 0.000063    Time 1.028591    
+2023-12-05 01:00:32,934 - Epoch: [28][ 9600/12168]    Overall Loss 0.014046    Objective Loss 0.000000    Distill Loss 0.014046                                        LR 0.000063    Time 1.027659    
+2023-12-05 01:02:11,592 - Epoch: [28][ 9700/12168]    Overall Loss 0.014045    Objective Loss 0.000000    Distill Loss 0.014045                                        LR 0.000063    Time 1.027234    
+2023-12-05 01:03:51,771 - Epoch: [28][ 9800/12168]    Overall Loss 0.014042    Objective Loss 0.000000    Distill Loss 0.014042                                        LR 0.000063    Time 1.026974    
+2023-12-05 01:05:26,941 - Epoch: [28][ 9900/12168]    Overall Loss 0.014041    Objective Loss 0.000000    Distill Loss 0.014041                                        LR 0.000063    Time 1.026213    
+2023-12-05 01:06:56,681 - Epoch: [28][10000/12168]    Overall Loss 0.014040    Objective Loss 0.000000    Distill Loss 0.014040                                        LR 0.000063    Time 1.024924    
+2023-12-05 01:08:42,358 - Epoch: [28][10100/12168]    Overall Loss 0.014039    Objective Loss 0.000000    Distill Loss 0.014039                                        LR 0.000063    Time 1.025239    
+2023-12-05 01:10:27,650 - Epoch: [28][10200/12168]    Overall Loss 0.014038    Objective Loss 0.000000    Distill Loss 0.014038                                        LR 0.000063    Time 1.025510    
+2023-12-05 01:12:06,789 - Epoch: [28][10300/12168]    Overall Loss 0.014036    Objective Loss 0.000000    Distill Loss 0.014036                                        LR 0.000063    Time 1.025178    
+2023-12-05 01:13:38,762 - Epoch: [28][10400/12168]    Overall Loss 0.014036    Objective Loss 0.000000    Distill Loss 0.014036                                        LR 0.000063    Time 1.024163    
+2023-12-05 01:15:20,553 - Epoch: [28][10500/12168]    Overall Loss 0.014035    Objective Loss 0.000000    Distill Loss 0.014035                                        LR 0.000063    Time 1.024103    
+2023-12-05 01:17:03,908 - Epoch: [28][10600/12168]    Overall Loss 0.014033    Objective Loss 0.000000    Distill Loss 0.014033                                        LR 0.000063    Time 1.024191    
+2023-12-05 01:18:51,951 - Epoch: [28][10700/12168]    Overall Loss 0.014031    Objective Loss 0.000000    Distill Loss 0.014031                                        LR 0.000063    Time 1.024716    
+2023-12-05 01:20:23,387 - Epoch: [28][10800/12168]    Overall Loss 0.014031    Objective Loss 0.000000    Distill Loss 0.014031                                        LR 0.000063    Time 1.023694    
+2023-12-05 01:21:58,450 - Epoch: [28][10900/12168]    Overall Loss 0.014029    Objective Loss 0.000000    Distill Loss 0.014029                                        LR 0.000063    Time 1.023023    
+2023-12-05 01:23:35,804 - Epoch: [28][11000/12168]    Overall Loss 0.014027    Objective Loss 0.000000    Distill Loss 0.014027                                        LR 0.000063    Time 1.022573    
+2023-12-05 01:25:18,356 - Epoch: [28][11100/12168]    Overall Loss 0.014026    Objective Loss 0.000000    Distill Loss 0.014026                                        LR 0.000063    Time 1.022598    
+2023-12-05 01:26:52,070 - Epoch: [28][11200/12168]    Overall Loss 0.014025    Objective Loss 0.000000    Distill Loss 0.014025                                        LR 0.000063    Time 1.021835    
+2023-12-05 01:28:26,307 - Epoch: [28][11300/12168]    Overall Loss 0.014025    Objective Loss 0.000000    Distill Loss 0.014025                                        LR 0.000063    Time 1.021131    
+2023-12-05 01:29:58,286 - Epoch: [28][11400/12168]    Overall Loss 0.014023    Objective Loss 0.000000    Distill Loss 0.014023                                        LR 0.000063    Time 1.020241    
+2023-12-05 01:31:35,790 - Epoch: [28][11500/12168]    Overall Loss 0.014023    Objective Loss 0.000000    Distill Loss 0.014023                                        LR 0.000063    Time 1.019848    
+2023-12-05 01:33:11,589 - Epoch: [28][11600/12168]    Overall Loss 0.014022    Objective Loss 0.000000    Distill Loss 0.014022                                        LR 0.000063    Time 1.019314    
+2023-12-05 01:34:52,892 - Epoch: [28][11700/12168]    Overall Loss 0.014021    Objective Loss 0.000000    Distill Loss 0.014021                                        LR 0.000063    Time 1.019260    
+2023-12-05 01:36:26,749 - Epoch: [28][11800/12168]    Overall Loss 0.014020    Objective Loss 0.000000    Distill Loss 0.014020                                        LR 0.000063    Time 1.018575    
+2023-12-05 01:38:04,656 - Epoch: [28][11900/12168]    Overall Loss 0.014019    Objective Loss 0.000000    Distill Loss 0.014019                                        LR 0.000063    Time 1.018243    
+2023-12-05 01:39:32,373 - Epoch: [28][12000/12168]    Overall Loss 0.014018    Objective Loss 0.000000    Distill Loss 0.014018                                        LR 0.000063    Time 1.017067    
+2023-12-05 01:41:13,060 - Epoch: [28][12100/12168]    Overall Loss 0.014017    Objective Loss 0.000000    Distill Loss 0.014017                                        LR 0.000063    Time 1.016982    
+2023-12-05 01:42:22,403 - Epoch: [28][12168/12168]    Overall Loss 0.014016    Objective Loss 0.000000    Distill Loss 0.014016                                        LR 0.000063    Time 1.016997    
+2023-12-05 01:42:22,927 - --- validate (epoch=28)-----------
+2023-12-05 01:42:22,927 - 167951 samples (256 per mini-batch)
+2023-12-05 01:43:17,603 - Epoch: [28][  100/  657]    Loss 0.000000    Overall Loss 0.014503    
+2023-12-05 01:44:06,777 - Epoch: [28][  200/  657]    Loss 0.000000    Overall Loss 0.014510    
+2023-12-05 01:44:56,051 - Epoch: [28][  300/  657]    Loss 0.000000    Overall Loss 0.014505    
+2023-12-05 01:45:45,242 - Epoch: [28][  400/  657]    Loss 0.000000    Overall Loss 0.014495    
+2023-12-05 01:46:34,387 - Epoch: [28][  500/  657]    Loss 0.000000    Overall Loss 0.014484    
+2023-12-05 01:47:23,575 - Epoch: [28][  600/  657]    Loss 0.000000    Overall Loss 0.014484    
+2023-12-05 01:47:51,166 - Epoch: [28][  657/  657]    Loss 0.000000    Overall Loss 0.014484    
+2023-12-05 01:47:51,475 - ==> Overall Loss: 0.014
+
+2023-12-05 01:47:51,477 - ==> Best [Overall Loss: 0.014484 on epoch: 28]
+2023-12-05 01:47:51,477 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 01:47:51,514 - 
+
+2023-12-05 01:47:51,514 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 01:50:03,607 - Epoch: [29][  100/12168]    Overall Loss 0.013817    Objective Loss 0.000000    Distill Loss 0.013817                                        LR 0.000063    Time 1.320865    
+2023-12-05 01:51:40,302 - Epoch: [29][  200/12168]    Overall Loss 0.013849    Objective Loss 0.000000    Distill Loss 0.013849                                        LR 0.000063    Time 1.143872    
+2023-12-05 01:53:08,672 - Epoch: [29][  300/12168]    Overall Loss 0.013846    Objective Loss 0.000000    Distill Loss 0.013846                                        LR 0.000063    Time 1.057128    
+2023-12-05 01:54:49,816 - Epoch: [29][  400/12168]    Overall Loss 0.013848    Objective Loss 0.000000    Distill Loss 0.013848                                        LR 0.000063    Time 1.045691    
+2023-12-05 01:56:40,756 - Epoch: [29][  500/12168]    Overall Loss 0.013836    Objective Loss 0.000000    Distill Loss 0.013836                                        LR 0.000063    Time 1.058419    
+2023-12-05 01:58:22,556 - Epoch: [29][  600/12168]    Overall Loss 0.013842    Objective Loss 0.000000    Distill Loss 0.013842                                        LR 0.000063    Time 1.051671    
+2023-12-05 01:59:59,323 - Epoch: [29][  700/12168]    Overall Loss 0.013843    Objective Loss 0.000000    Distill Loss 0.013843                                        LR 0.000063    Time 1.039662    
+2023-12-05 02:01:54,451 - Epoch: [29][  800/12168]    Overall Loss 0.013842    Objective Loss 0.000000    Distill Loss 0.013842                                        LR 0.000063    Time 1.053606    
+2023-12-05 02:03:05,526 - Epoch: [29][  900/12168]    Overall Loss 0.013851    Objective Loss 0.000000    Distill Loss 0.013851                                        LR 0.000063    Time 1.015506    
+2023-12-05 02:04:16,146 - Epoch: [29][ 1000/12168]    Overall Loss 0.013853    Objective Loss 0.000000    Distill Loss 0.013853                                        LR 0.000063    Time 0.984571    
+2023-12-05 02:05:23,675 - Epoch: [29][ 1100/12168]    Overall Loss 0.013850    Objective Loss 0.000000    Distill Loss 0.013850                                        LR 0.000063    Time 0.956450    
+2023-12-05 02:06:33,262 - Epoch: [29][ 1200/12168]    Overall Loss 0.013850    Objective Loss 0.000000    Distill Loss 0.013850                                        LR 0.000063    Time 0.934731    
+2023-12-05 02:07:44,474 - Epoch: [29][ 1300/12168]    Overall Loss 0.013847    Objective Loss 0.000000    Distill Loss 0.013847                                        LR 0.000063    Time 0.917604    
+2023-12-05 02:08:53,212 - Epoch: [29][ 1400/12168]    Overall Loss 0.013848    Objective Loss 0.000000    Distill Loss 0.013848                                        LR 0.000063    Time 0.901156    
+2023-12-05 02:10:26,983 - Epoch: [29][ 1500/12168]    Overall Loss 0.013855    Objective Loss 0.000000    Distill Loss 0.013855                                        LR 0.000063    Time 0.903589    
+2023-12-05 02:12:09,076 - Epoch: [29][ 1600/12168]    Overall Loss 0.013855    Objective Loss 0.000000    Distill Loss 0.013855                                        LR 0.000063    Time 0.910918    
+2023-12-05 02:14:06,416 - Epoch: [29][ 1700/12168]    Overall Loss 0.013856    Objective Loss 0.000000    Distill Loss 0.013856                                        LR 0.000063    Time 0.926355    
+2023-12-05 02:15:58,804 - Epoch: [29][ 1800/12168]    Overall Loss 0.013852    Objective Loss 0.000000    Distill Loss 0.013852                                        LR 0.000063    Time 0.937325    
+2023-12-05 02:17:49,895 - Epoch: [29][ 1900/12168]    Overall Loss 0.013852    Objective Loss 0.000000    Distill Loss 0.013852                                        LR 0.000063    Time 0.946458    
+2023-12-05 02:19:18,701 - Epoch: [29][ 2000/12168]    Overall Loss 0.013852    Objective Loss 0.000000    Distill Loss 0.013852                                        LR 0.000063    Time 0.943535    
+2023-12-05 02:21:10,298 - Epoch: [29][ 2100/12168]    Overall Loss 0.013852    Objective Loss 0.000000    Distill Loss 0.013852                                        LR 0.000063    Time 0.951743    
+2023-12-05 02:23:07,723 - Epoch: [29][ 2200/12168]    Overall Loss 0.013851    Objective Loss 0.000000    Distill Loss 0.013851                                        LR 0.000063    Time 0.961854    
+2023-12-05 02:24:56,519 - Epoch: [29][ 2300/12168]    Overall Loss 0.013850    Objective Loss 0.000000    Distill Loss 0.013850                                        LR 0.000063    Time 0.967334    
+2023-12-05 02:26:32,856 - Epoch: [29][ 2400/12168]    Overall Loss 0.013849    Objective Loss 0.000000    Distill Loss 0.013849                                        LR 0.000063    Time 0.967166    
+2023-12-05 02:28:18,477 - Epoch: [29][ 2500/12168]    Overall Loss 0.013847    Objective Loss 0.000000    Distill Loss 0.013847                                        LR 0.000063    Time 0.970725    
+2023-12-05 02:29:58,427 - Epoch: [29][ 2600/12168]    Overall Loss 0.013845    Objective Loss 0.000000    Distill Loss 0.013845                                        LR 0.000063    Time 0.971829    
+2023-12-05 02:31:35,793 - Epoch: [29][ 2700/12168]    Overall Loss 0.013846    Objective Loss 0.000000    Distill Loss 0.013846                                        LR 0.000063    Time 0.971894    
+2023-12-05 02:33:16,069 - Epoch: [29][ 2800/12168]    Overall Loss 0.013848    Objective Loss 0.000000    Distill Loss 0.013848                                        LR 0.000063    Time 0.972994    
+2023-12-05 02:35:06,592 - Epoch: [29][ 2900/12168]    Overall Loss 0.013849    Objective Loss 0.000000    Distill Loss 0.013849                                        LR 0.000063    Time 0.977552    
+2023-12-05 02:36:56,411 - Epoch: [29][ 3000/12168]    Overall Loss 0.013849    Objective Loss 0.000000    Distill Loss 0.013849                                        LR 0.000063    Time 0.981571    
+2023-12-05 02:38:32,995 - Epoch: [29][ 3100/12168]    Overall Loss 0.013845    Objective Loss 0.000000    Distill Loss 0.013845                                        LR 0.000063    Time 0.981061    
+2023-12-05 02:40:32,335 - Epoch: [29][ 3200/12168]    Overall Loss 0.013843    Objective Loss 0.000000    Distill Loss 0.013843                                        LR 0.000063    Time 0.987695    
+2023-12-05 02:42:18,268 - Epoch: [29][ 3300/12168]    Overall Loss 0.013844    Objective Loss 0.000000    Distill Loss 0.013844                                        LR 0.000063    Time 0.989864    
+2023-12-05 02:43:52,934 - Epoch: [29][ 3400/12168]    Overall Loss 0.013845    Objective Loss 0.000000    Distill Loss 0.013845                                        LR 0.000063    Time 0.988591    
+2023-12-05 02:45:29,072 - Epoch: [29][ 3500/12168]    Overall Loss 0.013846    Objective Loss 0.000000    Distill Loss 0.013846                                        LR 0.000063    Time 0.987811    
+2023-12-05 02:47:15,537 - Epoch: [29][ 3600/12168]    Overall Loss 0.013845    Objective Loss 0.000000    Distill Loss 0.013845                                        LR 0.000063    Time 0.989944    
+2023-12-05 02:48:56,482 - Epoch: [29][ 3700/12168]    Overall Loss 0.013846    Objective Loss 0.000000    Distill Loss 0.013846                                        LR 0.000063    Time 0.990469    
+2023-12-05 02:50:29,060 - Epoch: [29][ 3800/12168]    Overall Loss 0.013845    Objective Loss 0.000000    Distill Loss 0.013845                                        LR 0.000063    Time 0.988765    
+2023-12-05 02:52:11,213 - Epoch: [29][ 3900/12168]    Overall Loss 0.013844    Objective Loss 0.000000    Distill Loss 0.013844                                        LR 0.000063    Time 0.989604    
+2023-12-05 02:53:49,055 - Epoch: [29][ 4000/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.989322    
+2023-12-05 02:55:43,011 - Epoch: [29][ 4100/12168]    Overall Loss 0.013842    Objective Loss 0.000000    Distill Loss 0.013842                                        LR 0.000063    Time 0.992985    
+2023-12-05 02:57:16,835 - Epoch: [29][ 4200/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.991680    
+2023-12-05 02:59:08,578 - Epoch: [29][ 4300/12168]    Overall Loss 0.013839    Objective Loss 0.000000    Distill Loss 0.013839                                        LR 0.000063    Time 0.994603    
+2023-12-05 03:00:57,858 - Epoch: [29][ 4400/12168]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                                        LR 0.000063    Time 0.996833    
+2023-12-05 03:02:51,113 - Epoch: [29][ 4500/12168]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                                        LR 0.000063    Time 0.999847    
+2023-12-05 03:04:51,765 - Epoch: [29][ 4600/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 1.004339    
+2023-12-05 03:06:38,061 - Epoch: [29][ 4700/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 1.005584    
+2023-12-05 03:08:09,058 - Epoch: [29][ 4800/12168]    Overall Loss 0.013836    Objective Loss 0.000000    Distill Loss 0.013836                                        LR 0.000063    Time 1.003591    
+2023-12-05 03:10:06,935 - Epoch: [29][ 4900/12168]    Overall Loss 0.013835    Objective Loss 0.000000    Distill Loss 0.013835                                        LR 0.000063    Time 1.007165    
+2023-12-05 03:11:42,406 - Epoch: [29][ 5000/12168]    Overall Loss 0.013835    Objective Loss 0.000000    Distill Loss 0.013835                                        LR 0.000063    Time 1.006114    
+2023-12-05 03:13:21,400 - Epoch: [29][ 5100/12168]    Overall Loss 0.013836    Objective Loss 0.000000    Distill Loss 0.013836                                        LR 0.000063    Time 1.005796    
+2023-12-05 03:15:03,411 - Epoch: [29][ 5200/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 1.006070    
+2023-12-05 03:16:50,241 - Epoch: [29][ 5300/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 1.007243    
+2023-12-05 03:18:28,474 - Epoch: [29][ 5400/12168]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                                        LR 0.000063    Time 1.006780    
+2023-12-05 03:20:11,364 - Epoch: [29][ 5500/12168]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                                        LR 0.000063    Time 1.007181    
+2023-12-05 03:21:54,787 - Epoch: [29][ 5600/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 1.007663    
+2023-12-05 03:23:42,925 - Epoch: [29][ 5700/12168]    Overall Loss 0.013836    Objective Loss 0.000000    Distill Loss 0.013836                                        LR 0.000063    Time 1.008955    
+2023-12-05 03:25:18,510 - Epoch: [29][ 5800/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 1.008038    
+2023-12-05 03:27:08,056 - Epoch: [29][ 5900/12168]    Overall Loss 0.013842    Objective Loss 0.000000    Distill Loss 0.013842                                        LR 0.000063    Time 1.009519    
+2023-12-05 03:28:56,311 - Epoch: [29][ 6000/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 1.010735    
+2023-12-05 03:30:40,623 - Epoch: [29][ 6100/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 1.011264    
+2023-12-05 03:32:16,279 - Epoch: [29][ 6200/12168]    Overall Loss 0.013862    Objective Loss 0.000000    Distill Loss 0.013862                                        LR 0.000063    Time 1.010381    
+2023-12-05 03:33:55,626 - Epoch: [29][ 6300/12168]    Overall Loss 0.013862    Objective Loss 0.000000    Distill Loss 0.013862                                        LR 0.000063    Time 1.010112    
+2023-12-05 03:35:31,014 - Epoch: [29][ 6400/12168]    Overall Loss 0.013862    Objective Loss 0.000000    Distill Loss 0.013862                                        LR 0.000063    Time 1.009232    
+2023-12-05 03:37:13,215 - Epoch: [29][ 6500/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.009427    
+2023-12-05 03:38:43,454 - Epoch: [29][ 6600/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.007805    
+2023-12-05 03:40:32,659 - Epoch: [29][ 6700/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.009061    
+2023-12-05 03:42:13,445 - Epoch: [29][ 6800/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.009042    
+2023-12-05 03:44:00,258 - Epoch: [29][ 6900/12168]    Overall Loss 0.013858    Objective Loss 0.000000    Distill Loss 0.013858                                        LR 0.000063    Time 1.009898    
+2023-12-05 03:45:42,272 - Epoch: [29][ 7000/12168]    Overall Loss 0.013858    Objective Loss 0.000000    Distill Loss 0.013858                                        LR 0.000063    Time 1.010043    
+2023-12-05 03:47:21,650 - Epoch: [29][ 7100/12168]    Overall Loss 0.013863    Objective Loss 0.000000    Distill Loss 0.013863                                        LR 0.000063    Time 1.009813    
+2023-12-05 03:48:59,200 - Epoch: [29][ 7200/12168]    Overall Loss 0.013863    Objective Loss 0.000000    Distill Loss 0.013863                                        LR 0.000063    Time 1.009336    
+2023-12-05 03:50:38,789 - Epoch: [29][ 7300/12168]    Overall Loss 0.013862    Objective Loss 0.000000    Distill Loss 0.013862                                        LR 0.000063    Time 1.009150    
+2023-12-05 03:52:08,752 - Epoch: [29][ 7400/12168]    Overall Loss 0.013862    Objective Loss 0.000000    Distill Loss 0.013862                                        LR 0.000063    Time 1.007670    
+2023-12-05 03:53:50,202 - Epoch: [29][ 7500/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.007760    
+2023-12-05 03:55:39,059 - Epoch: [29][ 7600/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.008822    
+2023-12-05 03:57:14,094 - Epoch: [29][ 7700/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 1.008062    
+2023-12-05 03:58:53,712 - Epoch: [29][ 7800/12168]    Overall Loss 0.013859    Objective Loss 0.000000    Distill Loss 0.013859                                        LR 0.000063    Time 1.007909    
+2023-12-05 04:00:36,629 - Epoch: [29][ 7900/12168]    Overall Loss 0.013859    Objective Loss 0.000000    Distill Loss 0.013859                                        LR 0.000063    Time 1.008177    
+2023-12-05 04:02:16,524 - Epoch: [29][ 8000/12168]    Overall Loss 0.013861    Objective Loss 0.000000    Distill Loss 0.013861                                        LR 0.000063    Time 1.008061    
+2023-12-05 04:03:58,792 - Epoch: [29][ 8100/12168]    Overall Loss 0.013867    Objective Loss 0.000000    Distill Loss 0.013867                                        LR 0.000063    Time 1.008241    
+2023-12-05 04:05:43,501 - Epoch: [29][ 8200/12168]    Overall Loss 0.013866    Objective Loss 0.000000    Distill Loss 0.013866                                        LR 0.000063    Time 1.008713    
+2023-12-05 04:07:24,308 - Epoch: [29][ 8300/12168]    Overall Loss 0.013866    Objective Loss 0.000000    Distill Loss 0.013866                                        LR 0.000063    Time 1.008705    
+2023-12-05 04:08:59,933 - Epoch: [29][ 8400/12168]    Overall Loss 0.013865    Objective Loss 0.000000    Distill Loss 0.013865                                        LR 0.000063    Time 1.008080    
+2023-12-05 04:10:38,955 - Epoch: [29][ 8500/12168]    Overall Loss 0.013869    Objective Loss 0.000000    Distill Loss 0.013869                                        LR 0.000063    Time 1.007869    
+2023-12-05 04:12:26,098 - Epoch: [29][ 8600/12168]    Overall Loss 0.013877    Objective Loss 0.000000    Distill Loss 0.013877                                        LR 0.000063    Time 1.008607    
+2023-12-05 04:13:57,379 - Epoch: [29][ 8700/12168]    Overall Loss 0.013877    Objective Loss 0.000000    Distill Loss 0.013877                                        LR 0.000063    Time 1.007505    
+2023-12-05 04:15:43,433 - Epoch: [29][ 8800/12168]    Overall Loss 0.013876    Objective Loss 0.000000    Distill Loss 0.013876                                        LR 0.000063    Time 1.008107    
+2023-12-05 04:17:25,651 - Epoch: [29][ 8900/12168]    Overall Loss 0.013886    Objective Loss 0.000000    Distill Loss 0.013886                                        LR 0.000063    Time 1.008264    
+2023-12-05 04:19:04,470 - Epoch: [29][ 9000/12168]    Overall Loss 0.013885    Objective Loss 0.000000    Distill Loss 0.013885                                        LR 0.000063    Time 1.008041    
+2023-12-05 04:20:42,737 - Epoch: [29][ 9100/12168]    Overall Loss 0.013886    Objective Loss 0.000000    Distill Loss 0.013886                                        LR 0.000063    Time 1.007761    
+2023-12-05 04:22:29,927 - Epoch: [29][ 9200/12168]    Overall Loss 0.013885    Objective Loss 0.000000    Distill Loss 0.013885                                        LR 0.000063    Time 1.008458    
+2023-12-05 04:24:04,521 - Epoch: [29][ 9300/12168]    Overall Loss 0.013888    Objective Loss 0.000000    Distill Loss 0.013888                                        LR 0.000063    Time 1.007785    
+2023-12-05 04:25:48,865 - Epoch: [29][ 9400/12168]    Overall Loss 0.013888    Objective Loss 0.000000    Distill Loss 0.013888                                        LR 0.000063    Time 1.008163    
+2023-12-05 04:27:30,987 - Epoch: [29][ 9500/12168]    Overall Loss 0.013887    Objective Loss 0.000000    Distill Loss 0.013887                                        LR 0.000063    Time 1.008300    
+2023-12-05 04:29:04,932 - Epoch: [29][ 9600/12168]    Overall Loss 0.013887    Objective Loss 0.000000    Distill Loss 0.013887                                        LR 0.000063    Time 1.007582    
+2023-12-05 04:30:52,017 - Epoch: [29][ 9700/12168]    Overall Loss 0.013886    Objective Loss 0.000000    Distill Loss 0.013886                                        LR 0.000063    Time 1.008234    
+2023-12-05 04:32:39,424 - Epoch: [29][ 9800/12168]    Overall Loss 0.013884    Objective Loss 0.000000    Distill Loss 0.013884                                        LR 0.000063    Time 1.008905    
+2023-12-05 04:34:18,605 - Epoch: [29][ 9900/12168]    Overall Loss 0.013883    Objective Loss 0.000000    Distill Loss 0.013883                                        LR 0.000063    Time 1.008731    
+2023-12-05 04:35:58,233 - Epoch: [29][10000/12168]    Overall Loss 0.013882    Objective Loss 0.000000    Distill Loss 0.013882                                        LR 0.000063    Time 1.008606    
+2023-12-05 04:37:48,403 - Epoch: [29][10100/12168]    Overall Loss 0.013882    Objective Loss 0.000000    Distill Loss 0.013882                                        LR 0.000063    Time 1.009527    
+2023-12-05 04:39:28,996 - Epoch: [29][10200/12168]    Overall Loss 0.013881    Objective Loss 0.000000    Distill Loss 0.013881                                        LR 0.000063    Time 1.009491    
+2023-12-05 04:41:13,315 - Epoch: [29][10300/12168]    Overall Loss 0.013881    Objective Loss 0.000000    Distill Loss 0.013881                                        LR 0.000063    Time 1.009818    
+2023-12-05 04:42:51,496 - Epoch: [29][10400/12168]    Overall Loss 0.013893    Objective Loss 0.000000    Distill Loss 0.013893                                        LR 0.000063    Time 1.009548    
+2023-12-05 04:44:25,383 - Epoch: [29][10500/12168]    Overall Loss 0.013892    Objective Loss 0.000000    Distill Loss 0.013892                                        LR 0.000063    Time 1.008874    
+2023-12-05 04:45:59,796 - Epoch: [29][10600/12168]    Overall Loss 0.013891    Objective Loss 0.000000    Distill Loss 0.013891                                        LR 0.000063    Time 1.008263    
+2023-12-05 04:47:34,985 - Epoch: [29][10700/12168]    Overall Loss 0.013894    Objective Loss 0.000000    Distill Loss 0.013894                                        LR 0.000063    Time 1.007735    
+2023-12-05 04:49:10,984 - Epoch: [29][10800/12168]    Overall Loss 0.013894    Objective Loss 0.000000    Distill Loss 0.013894                                        LR 0.000063    Time 1.007292    
+2023-12-05 04:50:54,415 - Epoch: [29][10900/12168]    Overall Loss 0.013896    Objective Loss 0.000000    Distill Loss 0.013896                                        LR 0.000063    Time 1.007540    
+2023-12-05 04:52:42,242 - Epoch: [29][11000/12168]    Overall Loss 0.013899    Objective Loss 0.000000    Distill Loss 0.013899                                        LR 0.000063    Time 1.008182    
+2023-12-05 04:54:25,584 - Epoch: [29][11100/12168]    Overall Loss 0.013899    Objective Loss 0.000000    Distill Loss 0.013899                                        LR 0.000063    Time 1.008409    
+2023-12-05 04:56:13,304 - Epoch: [29][11200/12168]    Overall Loss 0.013899    Objective Loss 0.000000    Distill Loss 0.013899                                        LR 0.000063    Time 1.009022    
+2023-12-05 04:57:41,540 - Epoch: [29][11300/12168]    Overall Loss 0.013898    Objective Loss 0.000000    Distill Loss 0.013898                                        LR 0.000063    Time 1.007901    
+2023-12-05 04:59:30,876 - Epoch: [29][11400/12168]    Overall Loss 0.013896    Objective Loss 0.000000    Distill Loss 0.013896                                        LR 0.000063    Time 1.008650    
+2023-12-05 05:01:11,829 - Epoch: [29][11500/12168]    Overall Loss 0.013900    Objective Loss 0.000000    Distill Loss 0.013900                                        LR 0.000063    Time 1.008657    
+2023-12-05 05:02:54,503 - Epoch: [29][11600/12168]    Overall Loss 0.013898    Objective Loss 0.000000    Distill Loss 0.013898                                        LR 0.000063    Time 1.008812    
+2023-12-05 05:04:50,941 - Epoch: [29][11700/12168]    Overall Loss 0.013897    Objective Loss 0.000000    Distill Loss 0.013897                                        LR 0.000063    Time 1.010141    
+2023-12-05 05:06:40,655 - Epoch: [29][11800/12168]    Overall Loss 0.013897    Objective Loss 0.000000    Distill Loss 0.013897                                        LR 0.000063    Time 1.010878    
+2023-12-05 05:08:19,801 - Epoch: [29][11900/12168]    Overall Loss 0.013895    Objective Loss 0.000000    Distill Loss 0.013895                                        LR 0.000063    Time 1.010714    
+2023-12-05 05:10:00,459 - Epoch: [29][12000/12168]    Overall Loss 0.013894    Objective Loss 0.000000    Distill Loss 0.013894                                        LR 0.000063    Time 1.010679    
+2023-12-05 05:11:30,691 - Epoch: [29][12100/12168]    Overall Loss 0.013893    Objective Loss 0.000000    Distill Loss 0.013893                                        LR 0.000063    Time 1.009783    
+2023-12-05 05:12:35,380 - Epoch: [29][12168/12168]    Overall Loss 0.013893    Objective Loss 0.000000    Distill Loss 0.013893                                        LR 0.000063    Time 1.009456    
+2023-12-05 05:12:36,079 - --- validate (epoch=29)-----------
+2023-12-05 05:12:36,080 - 167951 samples (256 per mini-batch)
+2023-12-05 05:13:30,013 - Epoch: [29][  100/  657]    Loss 0.000000    Overall Loss 0.014497    
+2023-12-05 05:14:19,111 - Epoch: [29][  200/  657]    Loss 0.000000    Overall Loss 0.014495    
+2023-12-05 05:15:08,177 - Epoch: [29][  300/  657]    Loss 0.000000    Overall Loss 0.014506    
+2023-12-05 05:15:57,276 - Epoch: [29][  400/  657]    Loss 0.000000    Overall Loss 0.014526    
+2023-12-05 05:16:46,415 - Epoch: [29][  500/  657]    Loss 0.000000    Overall Loss 0.014518    
+2023-12-05 05:17:35,728 - Epoch: [29][  600/  657]    Loss 0.000000    Overall Loss 0.014514    
+2023-12-05 05:18:03,264 - Epoch: [29][  657/  657]    Loss 0.000000    Overall Loss 0.014519    
+2023-12-05 05:18:03,582 - ==> Overall Loss: 0.015
+
+2023-12-05 05:18:03,585 - ==> Best [Overall Loss: 0.014484 on epoch: 28]
+2023-12-05 05:18:03,586 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 05:18:03,625 - 
+
+2023-12-05 05:18:03,625 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 05:20:20,807 - Epoch: [30][  100/12168]    Overall Loss 0.013726    Objective Loss 0.000000    Distill Loss 0.013726                                        LR 0.000063    Time 1.371753    
+2023-12-05 05:21:55,249 - Epoch: [30][  200/12168]    Overall Loss 0.013723    Objective Loss 0.000000    Distill Loss 0.013723                                        LR 0.000063    Time 1.158053    
+2023-12-05 05:23:46,666 - Epoch: [30][  300/12168]    Overall Loss 0.013843    Objective Loss 0.000000    Distill Loss 0.013843                                        LR 0.000063    Time 1.143406    
+2023-12-05 05:25:21,517 - Epoch: [30][  400/12168]    Overall Loss 0.013826    Objective Loss 0.000000    Distill Loss 0.013826                                        LR 0.000063    Time 1.094665    
+2023-12-05 05:27:00,860 - Epoch: [30][  500/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 1.074405    
+2023-12-05 05:28:39,061 - Epoch: [30][  600/12168]    Overall Loss 0.013855    Objective Loss 0.000000    Distill Loss 0.013855                                        LR 0.000063    Time 1.058993    
+2023-12-05 05:30:22,335 - Epoch: [30][  700/12168]    Overall Loss 0.014070    Objective Loss 0.000000    Distill Loss 0.014070                                        LR 0.000063    Time 1.055233    
+2023-12-05 05:32:13,090 - Epoch: [30][  800/12168]    Overall Loss 0.014139    Objective Loss 0.000000    Distill Loss 0.014139                                        LR 0.000063    Time 1.061766    
+2023-12-05 05:33:48,943 - Epoch: [30][  900/12168]    Overall Loss 0.014183    Objective Loss 0.000000    Distill Loss 0.014183                                        LR 0.000063    Time 1.050287    
+2023-12-05 05:35:34,016 - Epoch: [30][ 1000/12168]    Overall Loss 0.014179    Objective Loss 0.000000    Distill Loss 0.014179                                        LR 0.000063    Time 1.050324    
+2023-12-05 05:37:11,249 - Epoch: [30][ 1100/12168]    Overall Loss 0.014253    Objective Loss 0.000000    Distill Loss 0.014253                                        LR 0.000063    Time 1.043227    
+2023-12-05 05:38:43,485 - Epoch: [30][ 1200/12168]    Overall Loss 0.014222    Objective Loss 0.000000    Distill Loss 0.014222                                        LR 0.000063    Time 1.033149    
+2023-12-05 05:40:34,323 - Epoch: [30][ 1300/12168]    Overall Loss 0.014202    Objective Loss 0.000000    Distill Loss 0.014202                                        LR 0.000063    Time 1.038931    
+2023-12-05 05:42:05,351 - Epoch: [30][ 1400/12168]    Overall Loss 0.014172    Objective Loss 0.000000    Distill Loss 0.014172                                        LR 0.000063    Time 1.029737    
+2023-12-05 05:43:36,119 - Epoch: [30][ 1500/12168]    Overall Loss 0.014154    Objective Loss 0.000000    Distill Loss 0.014154                                        LR 0.000063    Time 1.021595    
+2023-12-05 05:45:14,197 - Epoch: [30][ 1600/12168]    Overall Loss 0.014184    Objective Loss 0.000000    Distill Loss 0.014184                                        LR 0.000063    Time 1.019040    
+2023-12-05 05:46:54,846 - Epoch: [30][ 1700/12168]    Overall Loss 0.014160    Objective Loss 0.000000    Distill Loss 0.014160                                        LR 0.000063    Time 1.018297    
+2023-12-05 05:48:34,757 - Epoch: [30][ 1800/12168]    Overall Loss 0.014136    Objective Loss 0.000000    Distill Loss 0.014136                                        LR 0.000063    Time 1.017228    
+2023-12-05 05:50:08,579 - Epoch: [30][ 1900/12168]    Overall Loss 0.014119    Objective Loss 0.000000    Distill Loss 0.014119                                        LR 0.000063    Time 1.013066    
+2023-12-05 05:51:46,933 - Epoch: [30][ 2000/12168]    Overall Loss 0.014104    Objective Loss 0.000000    Distill Loss 0.014104                                        LR 0.000063    Time 1.011586    
+2023-12-05 05:53:29,210 - Epoch: [30][ 2100/12168]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                                        LR 0.000063    Time 1.012115    
+2023-12-05 05:55:02,813 - Epoch: [30][ 2200/12168]    Overall Loss 0.014104    Objective Loss 0.000000    Distill Loss 0.014104                                        LR 0.000063    Time 1.008654    
+2023-12-05 05:56:53,239 - Epoch: [30][ 2300/12168]    Overall Loss 0.014082    Objective Loss 0.000000    Distill Loss 0.014082                                        LR 0.000063    Time 1.012808    
+2023-12-05 05:58:24,308 - Epoch: [30][ 2400/12168]    Overall Loss 0.014063    Objective Loss 0.000000    Distill Loss 0.014063                                        LR 0.000063    Time 1.008550    
+2023-12-05 05:59:57,691 - Epoch: [30][ 2500/12168]    Overall Loss 0.014046    Objective Loss 0.000000    Distill Loss 0.014046                                        LR 0.000063    Time 1.005559    
+2023-12-05 06:01:08,074 - Epoch: [30][ 2600/12168]    Overall Loss 0.014030    Objective Loss 0.000000    Distill Loss 0.014030                                        LR 0.000063    Time 0.993952    
+2023-12-05 06:02:10,380 - Epoch: [30][ 2700/12168]    Overall Loss 0.014022    Objective Loss 0.000000    Distill Loss 0.014022                                        LR 0.000063    Time 0.980214    
+2023-12-05 06:03:16,376 - Epoch: [30][ 2800/12168]    Overall Loss 0.014055    Objective Loss 0.000000    Distill Loss 0.014055                                        LR 0.000063    Time 0.968775    
+2023-12-05 06:04:19,316 - Epoch: [30][ 2900/12168]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                                        LR 0.000063    Time 0.957071    
+2023-12-05 06:05:23,901 - Epoch: [30][ 3000/12168]    Overall Loss 0.014082    Objective Loss 0.000000    Distill Loss 0.014082                                        LR 0.000063    Time 0.946695    
+2023-12-05 06:06:24,996 - Epoch: [30][ 3100/12168]    Overall Loss 0.014073    Objective Loss 0.000000    Distill Loss 0.014073                                        LR 0.000063    Time 0.935863    
+2023-12-05 06:07:52,153 - Epoch: [30][ 3200/12168]    Overall Loss 0.014059    Objective Loss 0.000000    Distill Loss 0.014059                                        LR 0.000063    Time 0.933852    
+2023-12-05 06:09:34,003 - Epoch: [30][ 3300/12168]    Overall Loss 0.014052    Objective Loss 0.000000    Distill Loss 0.014052                                        LR 0.000063    Time 0.936415    
+2023-12-05 06:11:30,544 - Epoch: [30][ 3400/12168]    Overall Loss 0.014042    Objective Loss 0.000000    Distill Loss 0.014042                                        LR 0.000063    Time 0.943148    
+2023-12-05 06:13:05,830 - Epoch: [30][ 3500/12168]    Overall Loss 0.014031    Objective Loss 0.000000    Distill Loss 0.014031                                        LR 0.000063    Time 0.943424    
+2023-12-05 06:14:50,114 - Epoch: [30][ 3600/12168]    Overall Loss 0.014019    Objective Loss 0.000000    Distill Loss 0.014019                                        LR 0.000063    Time 0.946184    
+2023-12-05 06:16:33,043 - Epoch: [30][ 3700/12168]    Overall Loss 0.014007    Objective Loss 0.000000    Distill Loss 0.014007                                        LR 0.000063    Time 0.948428    
+2023-12-05 06:18:19,340 - Epoch: [30][ 3800/12168]    Overall Loss 0.013999    Objective Loss 0.000000    Distill Loss 0.013999                                        LR 0.000063    Time 0.951440    
+2023-12-05 06:19:49,597 - Epoch: [30][ 3900/12168]    Overall Loss 0.013989    Objective Loss 0.000000    Distill Loss 0.013989                                        LR 0.000063    Time 0.950185    
+2023-12-05 06:21:26,183 - Epoch: [30][ 4000/12168]    Overall Loss 0.013979    Objective Loss 0.000000    Distill Loss 0.013979                                        LR 0.000063    Time 0.950576    
+2023-12-05 06:23:19,198 - Epoch: [30][ 4100/12168]    Overall Loss 0.013972    Objective Loss 0.000000    Distill Loss 0.013972                                        LR 0.000063    Time 0.954954    
+2023-12-05 06:24:48,192 - Epoch: [30][ 4200/12168]    Overall Loss 0.013964    Objective Loss 0.000000    Distill Loss 0.013964                                        LR 0.000063    Time 0.953404    
+2023-12-05 06:26:46,314 - Epoch: [30][ 4300/12168]    Overall Loss 0.013956    Objective Loss 0.000000    Distill Loss 0.013956                                        LR 0.000063    Time 0.958701    
+2023-12-05 06:28:21,584 - Epoch: [30][ 4400/12168]    Overall Loss 0.013969    Objective Loss 0.000000    Distill Loss 0.013969                                        LR 0.000063    Time 0.958563    
+2023-12-05 06:30:01,002 - Epoch: [30][ 4500/12168]    Overall Loss 0.013998    Objective Loss 0.000000    Distill Loss 0.013998                                        LR 0.000063    Time 0.959353    
+2023-12-05 06:31:54,096 - Epoch: [30][ 4600/12168]    Overall Loss 0.014007    Objective Loss 0.000000    Distill Loss 0.014007                                        LR 0.000063    Time 0.963081    
+2023-12-05 06:33:39,359 - Epoch: [30][ 4700/12168]    Overall Loss 0.013999    Objective Loss 0.000000    Distill Loss 0.013999                                        LR 0.000063    Time 0.964985    
+2023-12-05 06:35:15,270 - Epoch: [30][ 4800/12168]    Overall Loss 0.013991    Objective Loss 0.000000    Distill Loss 0.013991                                        LR 0.000063    Time 0.964861    
+2023-12-05 06:37:03,283 - Epoch: [30][ 4900/12168]    Overall Loss 0.013983    Objective Loss 0.000000    Distill Loss 0.013983                                        LR 0.000063    Time 0.967212    
+2023-12-05 06:38:46,808 - Epoch: [30][ 5000/12168]    Overall Loss 0.013976    Objective Loss 0.000000    Distill Loss 0.013976                                        LR 0.000063    Time 0.968571    
+2023-12-05 06:40:23,411 - Epoch: [30][ 5100/12168]    Overall Loss 0.013971    Objective Loss 0.000000    Distill Loss 0.013971                                        LR 0.000063    Time 0.968520    
+2023-12-05 06:42:07,049 - Epoch: [30][ 5200/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.000063    Time 0.969824    
+2023-12-05 06:43:51,098 - Epoch: [30][ 5300/12168]    Overall Loss 0.013991    Objective Loss 0.000000    Distill Loss 0.013991                                        LR 0.000063    Time 0.971156    
+2023-12-05 06:45:29,825 - Epoch: [30][ 5400/12168]    Overall Loss 0.013986    Objective Loss 0.000000    Distill Loss 0.013986                                        LR 0.000063    Time 0.971453    
+2023-12-05 06:47:08,920 - Epoch: [30][ 5500/12168]    Overall Loss 0.013980    Objective Loss 0.000000    Distill Loss 0.013980                                        LR 0.000063    Time 0.971806    
+2023-12-05 06:48:43,107 - Epoch: [30][ 5600/12168]    Overall Loss 0.013974    Objective Loss 0.000000    Distill Loss 0.013974                                        LR 0.000063    Time 0.971271    
+2023-12-05 06:50:30,651 - Epoch: [30][ 5700/12168]    Overall Loss 0.013968    Objective Loss 0.000000    Distill Loss 0.013968                                        LR 0.000063    Time 0.973097    
+2023-12-05 06:52:21,316 - Epoch: [30][ 5800/12168]    Overall Loss 0.013962    Objective Loss 0.000000    Distill Loss 0.013962                                        LR 0.000063    Time 0.975398    
+2023-12-05 06:53:58,148 - Epoch: [30][ 5900/12168]    Overall Loss 0.013957    Objective Loss 0.000000    Distill Loss 0.013957                                        LR 0.000063    Time 0.975277    
+2023-12-05 06:55:30,098 - Epoch: [30][ 6000/12168]    Overall Loss 0.013952    Objective Loss 0.000000    Distill Loss 0.013952                                        LR 0.000063    Time 0.974347    
+2023-12-05 06:57:12,455 - Epoch: [30][ 6100/12168]    Overall Loss 0.013947    Objective Loss 0.000000    Distill Loss 0.013947                                        LR 0.000063    Time 0.975152    
+2023-12-05 06:59:01,945 - Epoch: [30][ 6200/12168]    Overall Loss 0.013942    Objective Loss 0.000000    Distill Loss 0.013942                                        LR 0.000063    Time 0.977083    
+2023-12-05 07:00:38,226 - Epoch: [30][ 6300/12168]    Overall Loss 0.013938    Objective Loss 0.000000    Distill Loss 0.013938                                        LR 0.000063    Time 0.976855    
+2023-12-05 07:02:30,918 - Epoch: [30][ 6400/12168]    Overall Loss 0.013934    Objective Loss 0.000000    Distill Loss 0.013934                                        LR 0.000063    Time 0.979199    
+2023-12-05 07:04:09,912 - Epoch: [30][ 6500/12168]    Overall Loss 0.013928    Objective Loss 0.000000    Distill Loss 0.013928                                        LR 0.000063    Time 0.979363    
+2023-12-05 07:05:50,562 - Epoch: [30][ 6600/12168]    Overall Loss 0.013923    Objective Loss 0.000000    Distill Loss 0.013923                                        LR 0.000063    Time 0.979773    
+2023-12-05 07:07:23,296 - Epoch: [30][ 6700/12168]    Overall Loss 0.013934    Objective Loss 0.000000    Distill Loss 0.013934                                        LR 0.000063    Time 0.978990    
+2023-12-05 07:08:59,561 - Epoch: [30][ 6800/12168]    Overall Loss 0.013930    Objective Loss 0.000000    Distill Loss 0.013930                                        LR 0.000063    Time 0.978748    
+2023-12-05 07:10:52,712 - Epoch: [30][ 6900/12168]    Overall Loss 0.013925    Objective Loss 0.000000    Distill Loss 0.013925                                        LR 0.000063    Time 0.980961    
+2023-12-05 07:12:38,302 - Epoch: [30][ 7000/12168]    Overall Loss 0.013925    Objective Loss 0.000000    Distill Loss 0.013925                                        LR 0.000063    Time 0.982031    
+2023-12-05 07:14:20,894 - Epoch: [30][ 7100/12168]    Overall Loss 0.013927    Objective Loss 0.000000    Distill Loss 0.013927                                        LR 0.000063    Time 0.982648    
+2023-12-05 07:16:00,027 - Epoch: [30][ 7200/12168]    Overall Loss 0.013924    Objective Loss 0.000000    Distill Loss 0.013924                                        LR 0.000063    Time 0.982768    
+2023-12-05 07:17:57,748 - Epoch: [30][ 7300/12168]    Overall Loss 0.013937    Objective Loss 0.000000    Distill Loss 0.013937                                        LR 0.000063    Time 0.985430    
+2023-12-05 07:19:30,856 - Epoch: [30][ 7400/12168]    Overall Loss 0.013946    Objective Loss 0.000000    Distill Loss 0.013946                                        LR 0.000063    Time 0.984695    
+2023-12-05 07:21:24,393 - Epoch: [30][ 7500/12168]    Overall Loss 0.013953    Objective Loss 0.000000    Distill Loss 0.013953                                        LR 0.000063    Time 0.986703    
+2023-12-05 07:23:12,046 - Epoch: [30][ 7600/12168]    Overall Loss 0.013958    Objective Loss 0.000000    Distill Loss 0.013958                                        LR 0.000063    Time 0.987884    
+2023-12-05 07:24:59,976 - Epoch: [30][ 7700/12168]    Overall Loss 0.013963    Objective Loss 0.000000    Distill Loss 0.013963                                        LR 0.000063    Time 0.989070    
+2023-12-05 07:26:41,840 - Epoch: [30][ 7800/12168]    Overall Loss 0.013967    Objective Loss 0.000000    Distill Loss 0.013967                                        LR 0.000063    Time 0.989448    
+2023-12-05 07:28:18,166 - Epoch: [30][ 7900/12168]    Overall Loss 0.013971    Objective Loss 0.000000    Distill Loss 0.013971                                        LR 0.000063    Time 0.989116    
+2023-12-05 07:29:59,384 - Epoch: [30][ 8000/12168]    Overall Loss 0.013972    Objective Loss 0.000000    Distill Loss 0.013972                                        LR 0.000063    Time 0.989404    
+2023-12-05 07:31:36,105 - Epoch: [30][ 8100/12168]    Overall Loss 0.013974    Objective Loss 0.000000    Distill Loss 0.013974                                        LR 0.000063    Time 0.989129    
+2023-12-05 07:33:19,951 - Epoch: [30][ 8200/12168]    Overall Loss 0.013977    Objective Loss 0.000000    Distill Loss 0.013977                                        LR 0.000063    Time 0.989730    
+2023-12-05 07:34:49,897 - Epoch: [30][ 8300/12168]    Overall Loss 0.013978    Objective Loss 0.000000    Distill Loss 0.013978                                        LR 0.000063    Time 0.988641    
+2023-12-05 07:36:34,692 - Epoch: [30][ 8400/12168]    Overall Loss 0.013979    Objective Loss 0.000000    Distill Loss 0.013979                                        LR 0.000063    Time 0.989347    
+2023-12-05 07:38:19,461 - Epoch: [30][ 8500/12168]    Overall Loss 0.013980    Objective Loss 0.000000    Distill Loss 0.013980                                        LR 0.000063    Time 0.990032    
+2023-12-05 07:39:59,961 - Epoch: [30][ 8600/12168]    Overall Loss 0.013981    Objective Loss 0.000000    Distill Loss 0.013981                                        LR 0.000063    Time 0.990205    
+2023-12-05 07:41:41,853 - Epoch: [30][ 8700/12168]    Overall Loss 0.013982    Objective Loss 0.000000    Distill Loss 0.013982                                        LR 0.000063    Time 0.990535    
+2023-12-05 07:43:30,478 - Epoch: [30][ 8800/12168]    Overall Loss 0.013982    Objective Loss 0.000000    Distill Loss 0.013982                                        LR 0.000063    Time 0.991622    
+2023-12-05 07:45:01,169 - Epoch: [30][ 8900/12168]    Overall Loss 0.013982    Objective Loss 0.000000    Distill Loss 0.013982                                        LR 0.000063    Time 0.990669    
+2023-12-05 07:46:41,497 - Epoch: [30][ 9000/12168]    Overall Loss 0.013982    Objective Loss 0.000000    Distill Loss 0.013982                                        LR 0.000063    Time 0.990808    
+2023-12-05 07:48:28,610 - Epoch: [30][ 9100/12168]    Overall Loss 0.013984    Objective Loss 0.000000    Distill Loss 0.013984                                        LR 0.000063    Time 0.991690    
+2023-12-05 07:50:20,283 - Epoch: [30][ 9200/12168]    Overall Loss 0.013984    Objective Loss 0.000000    Distill Loss 0.013984                                        LR 0.000063    Time 0.993049    
+2023-12-05 07:51:48,120 - Epoch: [30][ 9300/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.000063    Time 0.991815    
+2023-12-05 07:53:13,793 - Epoch: [30][ 9400/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.000063    Time 0.990377    
+2023-12-05 07:55:07,992 - Epoch: [30][ 9500/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.000063    Time 0.991972    
+2023-12-05 07:56:38,638 - Epoch: [30][ 9600/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.000063    Time 0.991081    
+2023-12-05 07:58:16,023 - Epoch: [30][ 9700/12168]    Overall Loss 0.013985    Objective Loss 0.000000    Distill Loss 0.013985                                        LR 0.000063    Time 0.990902    
+2023-12-05 07:59:58,625 - Epoch: [30][ 9800/12168]    Overall Loss 0.013984    Objective Loss 0.000000    Distill Loss 0.013984                                        LR 0.000063    Time 0.991260    
+2023-12-05 08:01:51,389 - Epoch: [30][ 9900/12168]    Overall Loss 0.013983    Objective Loss 0.000000    Distill Loss 0.013983                                        LR 0.000063    Time 0.992637    
+2023-12-05 08:03:37,949 - Epoch: [30][10000/12168]    Overall Loss 0.013983    Objective Loss 0.000000    Distill Loss 0.013983                                        LR 0.000063    Time 0.993366    
+2023-12-05 08:05:18,697 - Epoch: [30][10100/12168]    Overall Loss 0.013983    Objective Loss 0.000000    Distill Loss 0.013983                                        LR 0.000063    Time 0.993505    
+2023-12-05 08:07:06,814 - Epoch: [30][10200/12168]    Overall Loss 0.013983    Objective Loss 0.000000    Distill Loss 0.013983                                        LR 0.000063    Time 0.994364    
+2023-12-05 08:08:40,727 - Epoch: [30][10300/12168]    Overall Loss 0.013982    Objective Loss 0.000000    Distill Loss 0.013982                                        LR 0.000063    Time 0.993827    
+2023-12-05 08:10:27,007 - Epoch: [30][10400/12168]    Overall Loss 0.013982    Objective Loss 0.000000    Distill Loss 0.013982                                        LR 0.000063    Time 0.994489    
+2023-12-05 08:12:14,896 - Epoch: [30][10500/12168]    Overall Loss 0.013981    Objective Loss 0.000000    Distill Loss 0.013981                                        LR 0.000063    Time 0.995292    
+2023-12-05 08:14:12,248 - Epoch: [30][10600/12168]    Overall Loss 0.013980    Objective Loss 0.000000    Distill Loss 0.013980                                        LR 0.000063    Time 0.996973    
+2023-12-05 08:15:48,866 - Epoch: [30][10700/12168]    Overall Loss 0.013980    Objective Loss 0.000000    Distill Loss 0.013980                                        LR 0.000063    Time 0.996685    
+2023-12-05 08:17:32,535 - Epoch: [30][10800/12168]    Overall Loss 0.013980    Objective Loss 0.000000    Distill Loss 0.013980                                        LR 0.000063    Time 0.997055    
+2023-12-05 08:19:26,825 - Epoch: [30][10900/12168]    Overall Loss 0.013979    Objective Loss 0.000000    Distill Loss 0.013979                                        LR 0.000063    Time 0.998392    
+2023-12-05 08:21:04,666 - Epoch: [30][11000/12168]    Overall Loss 0.013978    Objective Loss 0.000000    Distill Loss 0.013978                                        LR 0.000063    Time 0.998210    
+2023-12-05 08:22:49,183 - Epoch: [30][11100/12168]    Overall Loss 0.013978    Objective Loss 0.000000    Distill Loss 0.013978                                        LR 0.000063    Time 0.998632    
+2023-12-05 08:24:36,608 - Epoch: [30][11200/12168]    Overall Loss 0.013978    Objective Loss 0.000000    Distill Loss 0.013978                                        LR 0.000063    Time 0.999307    
+2023-12-05 08:26:15,655 - Epoch: [30][11300/12168]    Overall Loss 0.013977    Objective Loss 0.000000    Distill Loss 0.013977                                        LR 0.000063    Time 0.999228    
+2023-12-05 08:28:00,027 - Epoch: [30][11400/12168]    Overall Loss 0.013977    Objective Loss 0.000000    Distill Loss 0.013977                                        LR 0.000063    Time 0.999618    
+2023-12-05 08:29:39,831 - Epoch: [30][11500/12168]    Overall Loss 0.013976    Objective Loss 0.000000    Distill Loss 0.013976                                        LR 0.000063    Time 0.999603    
+2023-12-05 08:31:28,027 - Epoch: [30][11600/12168]    Overall Loss 0.013975    Objective Loss 0.000000    Distill Loss 0.013975                                        LR 0.000063    Time 1.000313    
+2023-12-05 08:33:00,812 - Epoch: [30][11700/12168]    Overall Loss 0.013975    Objective Loss 0.000000    Distill Loss 0.013975                                        LR 0.000063    Time 0.999693    
+2023-12-05 08:34:45,019 - Epoch: [30][11800/12168]    Overall Loss 0.013975    Objective Loss 0.000000    Distill Loss 0.013975                                        LR 0.000063    Time 1.000051    
+2023-12-05 08:36:34,230 - Epoch: [30][11900/12168]    Overall Loss 0.013975    Objective Loss 0.000000    Distill Loss 0.013975                                        LR 0.000063    Time 1.000824    
+2023-12-05 08:38:29,664 - Epoch: [30][12000/12168]    Overall Loss 0.013973    Objective Loss 0.000000    Distill Loss 0.013973                                        LR 0.000063    Time 1.002103    
+2023-12-05 08:40:12,371 - Epoch: [30][12100/12168]    Overall Loss 0.013973    Objective Loss 0.000000    Distill Loss 0.013973                                        LR 0.000063    Time 1.002309    
+2023-12-05 08:41:11,850 - Epoch: [30][12168/12168]    Overall Loss 0.013972    Objective Loss 0.000000    Distill Loss 0.013972                                        LR 0.000063    Time 1.001595    
+2023-12-05 08:41:12,427 - --- validate (epoch=30)-----------
+2023-12-05 08:41:12,428 - 167951 samples (256 per mini-batch)
+2023-12-05 08:42:06,483 - Epoch: [30][  100/  657]    Loss 0.000000    Overall Loss 0.014666    
+2023-12-05 08:42:55,538 - Epoch: [30][  200/  657]    Loss 0.000000    Overall Loss 0.014689    
+2023-12-05 08:43:44,618 - Epoch: [30][  300/  657]    Loss 0.000000    Overall Loss 0.014707    
+2023-12-05 08:44:33,717 - Epoch: [30][  400/  657]    Loss 0.000000    Overall Loss 0.014707    
+2023-12-05 08:45:22,789 - Epoch: [30][  500/  657]    Loss 0.000000    Overall Loss 0.014706    
+2023-12-05 08:46:11,848 - Epoch: [30][  600/  657]    Loss 0.000000    Overall Loss 0.014703    
+2023-12-05 08:46:39,380 - Epoch: [30][  657/  657]    Loss 0.000000    Overall Loss 0.014703    
+2023-12-05 08:46:39,732 - ==> Overall Loss: 0.015
+
+2023-12-05 08:46:39,735 - ==> Best [Overall Loss: 0.014484 on epoch: 28]
+2023-12-05 08:46:39,735 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 08:46:39,757 - 
+
+2023-12-05 08:46:39,757 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 08:48:31,494 - Epoch: [31][  100/12168]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                                        LR 0.000063    Time 1.117294    
+2023-12-05 08:50:04,928 - Epoch: [31][  200/12168]    Overall Loss 0.013824    Objective Loss 0.000000    Distill Loss 0.013824                                        LR 0.000063    Time 1.025780    
+2023-12-05 08:51:32,960 - Epoch: [31][  300/12168]    Overall Loss 0.013817    Objective Loss 0.000000    Distill Loss 0.013817                                        LR 0.000063    Time 0.977271    
+2023-12-05 08:53:07,493 - Epoch: [31][  400/12168]    Overall Loss 0.013820    Objective Loss 0.000000    Distill Loss 0.013820                                        LR 0.000063    Time 0.969267    
+2023-12-05 08:54:40,386 - Epoch: [31][  500/12168]    Overall Loss 0.013823    Objective Loss 0.000000    Distill Loss 0.013823                                        LR 0.000063    Time 0.961187    
+2023-12-05 08:56:15,778 - Epoch: [31][  600/12168]    Overall Loss 0.013823    Objective Loss 0.000000    Distill Loss 0.013823                                        LR 0.000063    Time 0.959964    
+2023-12-05 08:57:57,165 - Epoch: [31][  700/12168]    Overall Loss 0.013827    Objective Loss 0.000000    Distill Loss 0.013827                                        LR 0.000063    Time 0.967654    
+2023-12-05 08:59:32,654 - Epoch: [31][  800/12168]    Overall Loss 0.013836    Objective Loss 0.000000    Distill Loss 0.013836                                        LR 0.000063    Time 0.966050    
+2023-12-05 09:00:55,912 - Epoch: [31][  900/12168]    Overall Loss 0.013855    Objective Loss 0.000000    Distill Loss 0.013855                                        LR 0.000063    Time 0.951213    
+2023-12-05 09:02:27,881 - Epoch: [31][ 1000/12168]    Overall Loss 0.013866    Objective Loss 0.000000    Distill Loss 0.013866                                        LR 0.000063    Time 0.948054    
+2023-12-05 09:04:08,810 - Epoch: [31][ 1100/12168]    Overall Loss 0.013870    Objective Loss 0.000000    Distill Loss 0.013870                                        LR 0.000063    Time 0.953615    
+2023-12-05 09:05:38,517 - Epoch: [31][ 1200/12168]    Overall Loss 0.013867    Objective Loss 0.000000    Distill Loss 0.013867                                        LR 0.000063    Time 0.948896    
+2023-12-05 09:07:18,552 - Epoch: [31][ 1300/12168]    Overall Loss 0.013862    Objective Loss 0.000000    Distill Loss 0.013862                                        LR 0.000063    Time 0.952849    
+2023-12-05 09:09:03,020 - Epoch: [31][ 1400/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 0.959404    
+2023-12-05 09:10:42,369 - Epoch: [31][ 1500/12168]    Overall Loss 0.013858    Objective Loss 0.000000    Distill Loss 0.013858                                        LR 0.000063    Time 0.961671    
+2023-12-05 09:12:05,373 - Epoch: [31][ 1600/12168]    Overall Loss 0.013857    Objective Loss 0.000000    Distill Loss 0.013857                                        LR 0.000063    Time 0.953440    
+2023-12-05 09:13:37,317 - Epoch: [31][ 1700/12168]    Overall Loss 0.013859    Objective Loss 0.000000    Distill Loss 0.013859                                        LR 0.000063    Time 0.951436    
+2023-12-05 09:15:20,283 - Epoch: [31][ 1800/12168]    Overall Loss 0.013857    Objective Loss 0.000000    Distill Loss 0.013857                                        LR 0.000063    Time 0.955778    
+2023-12-05 09:17:06,246 - Epoch: [31][ 1900/12168]    Overall Loss 0.013857    Objective Loss 0.000000    Distill Loss 0.013857                                        LR 0.000063    Time 0.961240    
+2023-12-05 09:18:48,898 - Epoch: [31][ 2000/12168]    Overall Loss 0.013857    Objective Loss 0.000000    Distill Loss 0.013857                                        LR 0.000063    Time 0.964501    
+2023-12-05 09:20:22,571 - Epoch: [31][ 2100/12168]    Overall Loss 0.013861    Objective Loss 0.000000    Distill Loss 0.013861                                        LR 0.000063    Time 0.963175    
+2023-12-05 09:21:59,699 - Epoch: [31][ 2200/12168]    Overall Loss 0.013860    Objective Loss 0.000000    Distill Loss 0.013860                                        LR 0.000063    Time 0.963540    
+2023-12-05 09:23:43,353 - Epoch: [31][ 2300/12168]    Overall Loss 0.013855    Objective Loss 0.000000    Distill Loss 0.013855                                        LR 0.000063    Time 0.966711    
+2023-12-05 09:25:29,248 - Epoch: [31][ 2400/12168]    Overall Loss 0.013852    Objective Loss 0.000000    Distill Loss 0.013852                                        LR 0.000063    Time 0.970552    
+2023-12-05 09:27:03,858 - Epoch: [31][ 2500/12168]    Overall Loss 0.013848    Objective Loss 0.000000    Distill Loss 0.013848                                        LR 0.000063    Time 0.969571    
+2023-12-05 09:28:47,581 - Epoch: [31][ 2600/12168]    Overall Loss 0.013848    Objective Loss 0.000000    Distill Loss 0.013848                                        LR 0.000063    Time 0.972169    
+2023-12-05 09:30:35,079 - Epoch: [31][ 2700/12168]    Overall Loss 0.013848    Objective Loss 0.000000    Distill Loss 0.013848                                        LR 0.000063    Time 0.975974    
+2023-12-05 09:32:07,492 - Epoch: [31][ 2800/12168]    Overall Loss 0.013847    Objective Loss 0.000000    Distill Loss 0.013847                                        LR 0.000063    Time 0.974120    
+2023-12-05 09:33:43,251 - Epoch: [31][ 2900/12168]    Overall Loss 0.013847    Objective Loss 0.000000    Distill Loss 0.013847                                        LR 0.000063    Time 0.973548    
+2023-12-05 09:35:22,009 - Epoch: [31][ 3000/12168]    Overall Loss 0.013849    Objective Loss 0.000000    Distill Loss 0.013849                                        LR 0.000063    Time 0.974014    
+2023-12-05 09:37:06,126 - Epoch: [31][ 3100/12168]    Overall Loss 0.013844    Objective Loss 0.000000    Distill Loss 0.013844                                        LR 0.000063    Time 0.976178    
+2023-12-05 09:38:39,774 - Epoch: [31][ 3200/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.974935    
+2023-12-05 09:40:20,848 - Epoch: [31][ 3300/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.976018    
+2023-12-05 09:41:56,293 - Epoch: [31][ 3400/12168]    Overall Loss 0.013842    Objective Loss 0.000000    Distill Loss 0.013842                                        LR 0.000063    Time 0.975382    
+2023-12-05 09:43:26,252 - Epoch: [31][ 3500/12168]    Overall Loss 0.013842    Objective Loss 0.000000    Distill Loss 0.013842                                        LR 0.000063    Time 0.973214    
+2023-12-05 09:45:17,061 - Epoch: [31][ 3600/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.976959    
+2023-12-05 09:47:02,759 - Epoch: [31][ 3700/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.979120    
+2023-12-05 09:48:47,098 - Epoch: [31][ 3800/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.980809    
+2023-12-05 09:50:25,652 - Epoch: [31][ 3900/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.980929    
+2023-12-05 09:52:14,257 - Epoch: [31][ 4000/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.983555    
+2023-12-05 09:53:55,695 - Epoch: [31][ 4100/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.984305    
+2023-12-05 09:55:43,688 - Epoch: [31][ 4200/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.986581    
+2023-12-05 09:57:25,323 - Epoch: [31][ 4300/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.987271    
+2023-12-05 09:58:41,887 - Epoch: [31][ 4400/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.982233    
+2023-12-05 09:59:45,373 - Epoch: [31][ 4500/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.974513    
+2023-12-05 10:00:51,578 - Epoch: [31][ 4600/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.967719    
+2023-12-05 10:01:56,366 - Epoch: [31][ 4700/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.960913    
+2023-12-05 10:03:01,772 - Epoch: [31][ 4800/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.954519    
+2023-12-05 10:04:06,352 - Epoch: [31][ 4900/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.948218    
+2023-12-05 10:05:09,867 - Epoch: [31][ 5000/12168]    Overall Loss 0.013839    Objective Loss 0.000000    Distill Loss 0.013839                                        LR 0.000063    Time 0.941956    
+2023-12-05 10:06:16,855 - Epoch: [31][ 5100/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.936620    
+2023-12-05 10:07:21,496 - Epoch: [31][ 5200/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.931038    
+2023-12-05 10:08:26,509 - Epoch: [31][ 5300/12168]    Overall Loss 0.013841    Objective Loss 0.000000    Distill Loss 0.013841                                        LR 0.000063    Time 0.925737    
+2023-12-05 10:09:33,637 - Epoch: [31][ 5400/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.921024    
+2023-12-05 10:10:35,434 - Epoch: [31][ 5500/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.915513    
+2023-12-05 10:11:31,084 - Epoch: [31][ 5600/12168]    Overall Loss 0.013839    Objective Loss 0.000000    Distill Loss 0.013839                                        LR 0.000063    Time 0.909101    
+2023-12-05 10:12:23,574 - Epoch: [31][ 5700/12168]    Overall Loss 0.013839    Objective Loss 0.000000    Distill Loss 0.013839                                        LR 0.000063    Time 0.902360    
+2023-12-05 10:13:16,073 - Epoch: [31][ 5800/12168]    Overall Loss 0.013839    Objective Loss 0.000000    Distill Loss 0.013839                                        LR 0.000063    Time 0.895854    
+2023-12-05 10:14:08,545 - Epoch: [31][ 5900/12168]    Overall Loss 0.013840    Objective Loss 0.000000    Distill Loss 0.013840                                        LR 0.000063    Time 0.889563    
+2023-12-05 10:15:01,004 - Epoch: [31][ 6000/12168]    Overall Loss 0.013839    Objective Loss 0.000000    Distill Loss 0.013839                                        LR 0.000063    Time 0.883479    
+2023-12-05 10:15:53,432 - Epoch: [31][ 6100/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 0.877590    
+2023-12-05 10:16:45,818 - Epoch: [31][ 6200/12168]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                                        LR 0.000063    Time 0.871884    
+2023-12-05 10:17:38,320 - Epoch: [31][ 6300/12168]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                                        LR 0.000063    Time 0.866378    
+2023-12-05 10:18:30,718 - Epoch: [31][ 6400/12168]    Overall Loss 0.013837    Objective Loss 0.000000    Distill Loss 0.013837                                        LR 0.000063    Time 0.861028    
+2023-12-05 10:19:23,215 - Epoch: [31][ 6500/12168]    Overall Loss 0.013836    Objective Loss 0.000000    Distill Loss 0.013836                                        LR 0.000063    Time 0.855857    
+2023-12-05 10:20:15,729 - Epoch: [31][ 6600/12168]    Overall Loss 0.013835    Objective Loss 0.000000    Distill Loss 0.013835                                        LR 0.000063    Time 0.850846    
+2023-12-05 10:21:08,195 - Epoch: [31][ 6700/12168]    Overall Loss 0.013834    Objective Loss 0.000000    Distill Loss 0.013834                                        LR 0.000063    Time 0.845977    
+2023-12-05 10:22:00,641 - Epoch: [31][ 6800/12168]    Overall Loss 0.013834    Objective Loss 0.000000    Distill Loss 0.013834                                        LR 0.000063    Time 0.841248    
+2023-12-05 10:22:53,027 - Epoch: [31][ 6900/12168]    Overall Loss 0.013832    Objective Loss 0.000000    Distill Loss 0.013832                                        LR 0.000063    Time 0.836648    
+2023-12-05 10:23:45,443 - Epoch: [31][ 7000/12168]    Overall Loss 0.013831    Objective Loss 0.000000    Distill Loss 0.013831                                        LR 0.000063    Time 0.832183    
+2023-12-05 10:24:37,873 - Epoch: [31][ 7100/12168]    Overall Loss 0.013830    Objective Loss 0.000000    Distill Loss 0.013830                                        LR 0.000063    Time 0.827846    
+2023-12-05 10:25:30,366 - Epoch: [31][ 7200/12168]    Overall Loss 0.013830    Objective Loss 0.000000    Distill Loss 0.013830                                        LR 0.000063    Time 0.823639    
+2023-12-05 10:26:22,828 - Epoch: [31][ 7300/12168]    Overall Loss 0.013829    Objective Loss 0.000000    Distill Loss 0.013829                                        LR 0.000063    Time 0.819542    
+2023-12-05 10:27:15,218 - Epoch: [31][ 7400/12168]    Overall Loss 0.013829    Objective Loss 0.000000    Distill Loss 0.013829                                        LR 0.000063    Time 0.815547    
+2023-12-05 10:28:07,636 - Epoch: [31][ 7500/12168]    Overall Loss 0.013829    Objective Loss 0.000000    Distill Loss 0.013829                                        LR 0.000063    Time 0.811661    
+2023-12-05 10:29:00,148 - Epoch: [31][ 7600/12168]    Overall Loss 0.013829    Objective Loss 0.000000    Distill Loss 0.013829                                        LR 0.000063    Time 0.807890    
+2023-12-05 10:29:52,569 - Epoch: [31][ 7700/12168]    Overall Loss 0.013829    Objective Loss 0.000000    Distill Loss 0.013829                                        LR 0.000063    Time 0.804206    
+2023-12-05 10:30:44,961 - Epoch: [31][ 7800/12168]    Overall Loss 0.013829    Objective Loss 0.000000    Distill Loss 0.013829                                        LR 0.000063    Time 0.800612    
+2023-12-05 10:31:37,379 - Epoch: [31][ 7900/12168]    Overall Loss 0.013828    Objective Loss 0.000000    Distill Loss 0.013828                                        LR 0.000063    Time 0.797112    
+2023-12-05 10:32:29,806 - Epoch: [31][ 8000/12168]    Overall Loss 0.013827    Objective Loss 0.000000    Distill Loss 0.013827                                        LR 0.000063    Time 0.793702    
+2023-12-05 10:33:22,206 - Epoch: [31][ 8100/12168]    Overall Loss 0.013826    Objective Loss 0.000000    Distill Loss 0.013826                                        LR 0.000063    Time 0.790371    
+2023-12-05 10:34:14,679 - Epoch: [31][ 8200/12168]    Overall Loss 0.013826    Objective Loss 0.000000    Distill Loss 0.013826                                        LR 0.000063    Time 0.787132    
+2023-12-05 10:35:07,125 - Epoch: [31][ 8300/12168]    Overall Loss 0.013827    Objective Loss 0.000000    Distill Loss 0.013827                                        LR 0.000063    Time 0.783966    
+2023-12-05 10:35:59,546 - Epoch: [31][ 8400/12168]    Overall Loss 0.013827    Objective Loss 0.000000    Distill Loss 0.013827                                        LR 0.000063    Time 0.780874    
+2023-12-05 10:36:51,986 - Epoch: [31][ 8500/12168]    Overall Loss 0.013827    Objective Loss 0.000000    Distill Loss 0.013827                                        LR 0.000063    Time 0.777856    
+2023-12-05 10:37:44,435 - Epoch: [31][ 8600/12168]    Overall Loss 0.013827    Objective Loss 0.000000    Distill Loss 0.013827                                        LR 0.000063    Time 0.774909    
+2023-12-05 10:38:36,911 - Epoch: [31][ 8700/12168]    Overall Loss 0.013826    Objective Loss 0.000000    Distill Loss 0.013826                                        LR 0.000063    Time 0.772034    
+2023-12-05 10:39:29,314 - Epoch: [31][ 8800/12168]    Overall Loss 0.013826    Objective Loss 0.000000    Distill Loss 0.013826                                        LR 0.000063    Time 0.769215    
+2023-12-05 10:40:21,834 - Epoch: [31][ 8900/12168]    Overall Loss 0.013824    Objective Loss 0.000000    Distill Loss 0.013824                                        LR 0.000063    Time 0.766473    
+2023-12-05 10:41:14,229 - Epoch: [31][ 9000/12168]    Overall Loss 0.013823    Objective Loss 0.000000    Distill Loss 0.013823                                        LR 0.000063    Time 0.763778    
+2023-12-05 10:42:06,688 - Epoch: [31][ 9100/12168]    Overall Loss 0.013824    Objective Loss 0.000000    Distill Loss 0.013824                                        LR 0.000063    Time 0.761149    
+2023-12-05 10:42:59,159 - Epoch: [31][ 9200/12168]    Overall Loss 0.013824    Objective Loss 0.000000    Distill Loss 0.013824                                        LR 0.000063    Time 0.758579    
+2023-12-05 10:43:51,628 - Epoch: [31][ 9300/12168]    Overall Loss 0.013824    Objective Loss 0.000000    Distill Loss 0.013824                                        LR 0.000063    Time 0.756064    
+2023-12-05 10:44:44,069 - Epoch: [31][ 9400/12168]    Overall Loss 0.013824    Objective Loss 0.000000    Distill Loss 0.013824                                        LR 0.000063    Time 0.753599    
+2023-12-05 10:45:36,505 - Epoch: [31][ 9500/12168]    Overall Loss 0.013823    Objective Loss 0.000000    Distill Loss 0.013823                                        LR 0.000063    Time 0.751185    
+2023-12-05 10:46:28,853 - Epoch: [31][ 9600/12168]    Overall Loss 0.013823    Objective Loss 0.000000    Distill Loss 0.013823                                        LR 0.000063    Time 0.748813    
+2023-12-05 10:47:21,237 - Epoch: [31][ 9700/12168]    Overall Loss 0.013823    Objective Loss 0.000000    Distill Loss 0.013823                                        LR 0.000063    Time 0.746494    
+2023-12-05 10:48:13,691 - Epoch: [31][ 9800/12168]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                                        LR 0.000063    Time 0.744228    
+2023-12-05 10:49:06,108 - Epoch: [31][ 9900/12168]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                                        LR 0.000063    Time 0.742005    
+2023-12-05 10:49:58,575 - Epoch: [31][10000/12168]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                                        LR 0.000063    Time 0.739832    
+2023-12-05 10:50:51,028 - Epoch: [31][10100/12168]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                                        LR 0.000063    Time 0.737699    
+2023-12-05 10:51:43,445 - Epoch: [31][10200/12168]    Overall Loss 0.013821    Objective Loss 0.000000    Distill Loss 0.013821                                        LR 0.000063    Time 0.735606    
+2023-12-05 10:52:35,895 - Epoch: [31][10300/12168]    Overall Loss 0.013821    Objective Loss 0.000000    Distill Loss 0.013821                                        LR 0.000063    Time 0.733556    
+2023-12-05 10:53:28,302 - Epoch: [31][10400/12168]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                                        LR 0.000063    Time 0.731541    
+2023-12-05 10:54:20,745 - Epoch: [31][10500/12168]    Overall Loss 0.013821    Objective Loss 0.000000    Distill Loss 0.013821                                        LR 0.000063    Time 0.729568    
+2023-12-05 10:55:13,160 - Epoch: [31][10600/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.727630    
+2023-12-05 10:56:05,539 - Epoch: [31][10700/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.725725    
+2023-12-05 10:56:57,914 - Epoch: [31][10800/12168]    Overall Loss 0.013820    Objective Loss 0.000000    Distill Loss 0.013820                                        LR 0.000063    Time 0.723854    
+2023-12-05 10:57:50,294 - Epoch: [31][10900/12168]    Overall Loss 0.013820    Objective Loss 0.000000    Distill Loss 0.013820                                        LR 0.000063    Time 0.722019    
+2023-12-05 10:58:42,657 - Epoch: [31][11000/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.720215    
+2023-12-05 10:59:34,995 - Epoch: [31][11100/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.718441    
+2023-12-05 11:00:27,433 - Epoch: [31][11200/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 0.716708    
+2023-12-05 11:01:19,844 - Epoch: [31][11300/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.715004    
+2023-12-05 11:02:12,271 - Epoch: [31][11400/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.713330    
+2023-12-05 11:03:04,714 - Epoch: [31][11500/12168]    Overall Loss 0.013819    Objective Loss 0.000000    Distill Loss 0.013819                                        LR 0.000063    Time 0.711687    
+2023-12-05 11:03:57,070 - Epoch: [31][11600/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 0.710065    
+2023-12-05 11:04:49,480 - Epoch: [31][11700/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 0.708475    
+2023-12-05 11:05:41,916 - Epoch: [31][11800/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 0.706915    
+2023-12-05 11:06:34,301 - Epoch: [31][11900/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 0.705376    
+2023-12-05 11:07:26,682 - Epoch: [31][12000/12168]    Overall Loss 0.013817    Objective Loss 0.000000    Distill Loss 0.013817                                        LR 0.000063    Time 0.703863    
+2023-12-05 11:08:19,124 - Epoch: [31][12100/12168]    Overall Loss 0.013818    Objective Loss 0.000000    Distill Loss 0.013818                                        LR 0.000063    Time 0.702380    
+2023-12-05 11:08:54,728 - Epoch: [31][12168/12168]    Overall Loss 0.013817    Objective Loss 0.000000    Distill Loss 0.013817                                        LR 0.000063    Time 0.701380    
+2023-12-05 11:08:55,103 - --- validate (epoch=31)-----------
+2023-12-05 11:08:55,104 - 167951 samples (256 per mini-batch)
+2023-12-05 11:09:46,061 - Epoch: [31][  100/  657]    Loss 0.000000    Overall Loss 0.014388    
+2023-12-05 11:10:34,594 - Epoch: [31][  200/  657]    Loss 0.000000    Overall Loss 0.014374    
+2023-12-05 11:11:23,139 - Epoch: [31][  300/  657]    Loss 0.000000    Overall Loss 0.014380    
+2023-12-05 11:12:11,685 - Epoch: [31][  400/  657]    Loss 0.000000    Overall Loss 0.014392    
+2023-12-05 11:13:00,208 - Epoch: [31][  500/  657]    Loss 0.000000    Overall Loss 0.014392    
+2023-12-05 11:13:48,729 - Epoch: [31][  600/  657]    Loss 0.000000    Overall Loss 0.014395    
+2023-12-05 11:14:15,949 - Epoch: [31][  657/  657]    Loss 0.000000    Overall Loss 0.014390    
+2023-12-05 11:14:16,158 - ==> Overall Loss: 0.014
+
+2023-12-05 11:14:16,160 - ==> Best [Overall Loss: 0.014390 on epoch: 31]
+2023-12-05 11:14:16,160 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 11:14:16,187 - 
+
+2023-12-05 11:14:16,187 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 11:15:17,114 - Epoch: [32][  100/12168]    Overall Loss 0.013736    Objective Loss 0.000000    Distill Loss 0.013736                                        LR 0.000063    Time 0.609229    
+2023-12-05 11:16:09,462 - Epoch: [32][  200/12168]    Overall Loss 0.013758    Objective Loss 0.000000    Distill Loss 0.013758                                        LR 0.000063    Time 0.566336    
+2023-12-05 11:17:01,863 - Epoch: [32][  300/12168]    Overall Loss 0.013757    Objective Loss 0.000000    Distill Loss 0.013757                                        LR 0.000063    Time 0.552215    
+2023-12-05 11:17:54,246 - Epoch: [32][  400/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.545111    
+2023-12-05 11:18:46,652 - Epoch: [32][  500/12168]    Overall Loss 0.013740    Objective Loss 0.000000    Distill Loss 0.013740                                        LR 0.000063    Time 0.540893    
+2023-12-05 11:19:38,991 - Epoch: [32][  600/12168]    Overall Loss 0.013755    Objective Loss 0.000000    Distill Loss 0.013755                                        LR 0.000063    Time 0.537972    
+2023-12-05 11:20:31,373 - Epoch: [32][  700/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.535944    
+2023-12-05 11:21:23,693 - Epoch: [32][  800/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.534348    
+2023-12-05 11:22:16,182 - Epoch: [32][  900/12168]    Overall Loss 0.013770    Objective Loss 0.000000    Distill Loss 0.013770                                        LR 0.000063    Time 0.533293    
+2023-12-05 11:23:08,611 - Epoch: [32][ 1000/12168]    Overall Loss 0.013777    Objective Loss 0.000000    Distill Loss 0.013777                                        LR 0.000063    Time 0.532389    
+2023-12-05 11:24:00,980 - Epoch: [32][ 1100/12168]    Overall Loss 0.013779    Objective Loss 0.000000    Distill Loss 0.013779                                        LR 0.000063    Time 0.531595    
+2023-12-05 11:24:53,281 - Epoch: [32][ 1200/12168]    Overall Loss 0.013777    Objective Loss 0.000000    Distill Loss 0.013777                                        LR 0.000063    Time 0.530877    
+2023-12-05 11:25:45,610 - Epoch: [32][ 1300/12168]    Overall Loss 0.013777    Objective Loss 0.000000    Distill Loss 0.013777                                        LR 0.000063    Time 0.530290    
+2023-12-05 11:26:37,948 - Epoch: [32][ 1400/12168]    Overall Loss 0.013779    Objective Loss 0.000000    Distill Loss 0.013779                                        LR 0.000063    Time 0.529795    
+2023-12-05 11:27:30,396 - Epoch: [32][ 1500/12168]    Overall Loss 0.013781    Objective Loss 0.000000    Distill Loss 0.013781                                        LR 0.000063    Time 0.529438    
+2023-12-05 11:28:22,776 - Epoch: [32][ 1600/12168]    Overall Loss 0.013780    Objective Loss 0.000000    Distill Loss 0.013780                                        LR 0.000063    Time 0.529084    
+2023-12-05 11:29:15,148 - Epoch: [32][ 1700/12168]    Overall Loss 0.013783    Objective Loss 0.000000    Distill Loss 0.013783                                        LR 0.000063    Time 0.528766    
+2023-12-05 11:30:07,548 - Epoch: [32][ 1800/12168]    Overall Loss 0.013783    Objective Loss 0.000000    Distill Loss 0.013783                                        LR 0.000063    Time 0.528500    
+2023-12-05 11:30:59,890 - Epoch: [32][ 1900/12168]    Overall Loss 0.013784    Objective Loss 0.000000    Distill Loss 0.013784                                        LR 0.000063    Time 0.528231    
+2023-12-05 11:31:52,250 - Epoch: [32][ 2000/12168]    Overall Loss 0.013783    Objective Loss 0.000000    Distill Loss 0.013783                                        LR 0.000063    Time 0.527998    
+2023-12-05 11:32:44,615 - Epoch: [32][ 2100/12168]    Overall Loss 0.013781    Objective Loss 0.000000    Distill Loss 0.013781                                        LR 0.000063    Time 0.527789    
+2023-12-05 11:33:37,032 - Epoch: [32][ 2200/12168]    Overall Loss 0.013779    Objective Loss 0.000000    Distill Loss 0.013779                                        LR 0.000063    Time 0.527623    
+2023-12-05 11:34:29,505 - Epoch: [32][ 2300/12168]    Overall Loss 0.013775    Objective Loss 0.000000    Distill Loss 0.013775                                        LR 0.000063    Time 0.527495    
+2023-12-05 11:35:21,937 - Epoch: [32][ 2400/12168]    Overall Loss 0.013774    Objective Loss 0.000000    Distill Loss 0.013774                                        LR 0.000063    Time 0.527362    
+2023-12-05 11:36:14,288 - Epoch: [32][ 2500/12168]    Overall Loss 0.013770    Objective Loss 0.000000    Distill Loss 0.013770                                        LR 0.000063    Time 0.527206    
+2023-12-05 11:37:06,697 - Epoch: [32][ 2600/12168]    Overall Loss 0.013770    Objective Loss 0.000000    Distill Loss 0.013770                                        LR 0.000063    Time 0.527085    
+2023-12-05 11:37:59,057 - Epoch: [32][ 2700/12168]    Overall Loss 0.013768    Objective Loss 0.000000    Distill Loss 0.013768                                        LR 0.000063    Time 0.526955    
+2023-12-05 11:38:51,388 - Epoch: [32][ 2800/12168]    Overall Loss 0.013767    Objective Loss 0.000000    Distill Loss 0.013767                                        LR 0.000063    Time 0.526823    
+2023-12-05 11:39:43,728 - Epoch: [32][ 2900/12168]    Overall Loss 0.013767    Objective Loss 0.000000    Distill Loss 0.013767                                        LR 0.000063    Time 0.526704    
+2023-12-05 11:40:36,101 - Epoch: [32][ 3000/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.526604    
+2023-12-05 11:41:28,443 - Epoch: [32][ 3100/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.526500    
+2023-12-05 11:42:20,861 - Epoch: [32][ 3200/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.526426    
+2023-12-05 11:43:13,232 - Epoch: [32][ 3300/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.526343    
+2023-12-05 11:44:05,591 - Epoch: [32][ 3400/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.526261    
+2023-12-05 11:44:57,968 - Epoch: [32][ 3500/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.526189    
+2023-12-05 11:45:50,340 - Epoch: [32][ 3600/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.526120    
+2023-12-05 11:46:42,724 - Epoch: [32][ 3700/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.526057    
+2023-12-05 11:47:35,127 - Epoch: [32][ 3800/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.526003    
+2023-12-05 11:48:27,561 - Epoch: [32][ 3900/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525959    
+2023-12-05 11:49:19,910 - Epoch: [32][ 4000/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525897    
+2023-12-05 11:50:12,319 - Epoch: [32][ 4100/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525852    
+2023-12-05 11:51:04,664 - Epoch: [32][ 4200/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.525794    
+2023-12-05 11:51:57,013 - Epoch: [32][ 4300/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.525740    
+2023-12-05 11:52:49,423 - Epoch: [32][ 4400/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525701    
+2023-12-05 11:53:41,824 - Epoch: [32][ 4500/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525663    
+2023-12-05 11:54:34,133 - Epoch: [32][ 4600/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525607    
+2023-12-05 11:55:26,521 - Epoch: [32][ 4700/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.525569    
+2023-12-05 11:56:18,927 - Epoch: [32][ 4800/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.525537    
+2023-12-05 11:57:11,301 - Epoch: [32][ 4900/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525500    
+2023-12-05 11:58:03,696 - Epoch: [32][ 5000/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525468    
+2023-12-05 11:58:56,069 - Epoch: [32][ 5100/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.525433    
+2023-12-05 11:59:48,433 - Epoch: [32][ 5200/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.525398    
+2023-12-05 12:00:40,810 - Epoch: [32][ 5300/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525367    
+2023-12-05 12:01:33,212 - Epoch: [32][ 5400/12168]    Overall Loss 0.013766    Objective Loss 0.000000    Distill Loss 0.013766                                        LR 0.000063    Time 0.525341    
+2023-12-05 12:02:25,586 - Epoch: [32][ 5500/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525311    
+2023-12-05 12:03:17,993 - Epoch: [32][ 5600/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525289    
+2023-12-05 12:04:10,359 - Epoch: [32][ 5700/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525259    
+2023-12-05 12:05:02,760 - Epoch: [32][ 5800/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.525237    
+2023-12-05 12:05:55,102 - Epoch: [32][ 5900/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525206    
+2023-12-05 12:06:47,515 - Epoch: [32][ 6000/12168]    Overall Loss 0.013766    Objective Loss 0.000000    Distill Loss 0.013766                                        LR 0.000063    Time 0.525187    
+2023-12-05 12:07:39,940 - Epoch: [32][ 6100/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525172    
+2023-12-05 12:08:32,339 - Epoch: [32][ 6200/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525152    
+2023-12-05 12:09:24,720 - Epoch: [32][ 6300/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525130    
+2023-12-05 12:10:17,155 - Epoch: [32][ 6400/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.525117    
+2023-12-05 12:11:09,507 - Epoch: [32][ 6500/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.525092    
+2023-12-05 12:12:01,886 - Epoch: [32][ 6600/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.525072    
+2023-12-05 12:12:54,252 - Epoch: [32][ 6700/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.525050    
+2023-12-05 12:13:46,594 - Epoch: [32][ 6800/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.525026    
+2023-12-05 12:14:39,125 - Epoch: [32][ 6900/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.525029    
+2023-12-05 12:15:31,468 - Epoch: [32][ 7000/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.525006    
+2023-12-05 12:16:23,869 - Epoch: [32][ 7100/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.524992    
+2023-12-05 12:17:16,279 - Epoch: [32][ 7200/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.524979    
+2023-12-05 12:18:08,631 - Epoch: [32][ 7300/12168]    Overall Loss 0.013771    Objective Loss 0.000000    Distill Loss 0.013771                                        LR 0.000063    Time 0.524958    
+2023-12-05 12:19:01,033 - Epoch: [32][ 7400/12168]    Overall Loss 0.013773    Objective Loss 0.000000    Distill Loss 0.013773                                        LR 0.000063    Time 0.524945    
+2023-12-05 12:19:53,346 - Epoch: [32][ 7500/12168]    Overall Loss 0.013773    Objective Loss 0.000000    Distill Loss 0.013773                                        LR 0.000063    Time 0.524921    
+2023-12-05 12:20:45,692 - Epoch: [32][ 7600/12168]    Overall Loss 0.013773    Objective Loss 0.000000    Distill Loss 0.013773                                        LR 0.000063    Time 0.524901    
+2023-12-05 12:21:38,094 - Epoch: [32][ 7700/12168]    Overall Loss 0.013773    Objective Loss 0.000000    Distill Loss 0.013773                                        LR 0.000063    Time 0.524889    
+2023-12-05 12:22:30,444 - Epoch: [32][ 7800/12168]    Overall Loss 0.013772    Objective Loss 0.000000    Distill Loss 0.013772                                        LR 0.000063    Time 0.524871    
+2023-12-05 12:23:22,809 - Epoch: [32][ 7900/12168]    Overall Loss 0.013773    Objective Loss 0.000000    Distill Loss 0.013773                                        LR 0.000063    Time 0.524855    
+2023-12-05 12:24:15,156 - Epoch: [32][ 8000/12168]    Overall Loss 0.013772    Objective Loss 0.000000    Distill Loss 0.013772                                        LR 0.000063    Time 0.524837    
+2023-12-05 12:25:07,575 - Epoch: [32][ 8100/12168]    Overall Loss 0.013771    Objective Loss 0.000000    Distill Loss 0.013771                                        LR 0.000063    Time 0.524829    
+2023-12-05 12:25:59,956 - Epoch: [32][ 8200/12168]    Overall Loss 0.013771    Objective Loss 0.000000    Distill Loss 0.013771                                        LR 0.000063    Time 0.524816    
+2023-12-05 12:26:52,328 - Epoch: [32][ 8300/12168]    Overall Loss 0.013770    Objective Loss 0.000000    Distill Loss 0.013770                                        LR 0.000063    Time 0.524802    
+2023-12-05 12:27:44,728 - Epoch: [32][ 8400/12168]    Overall Loss 0.013770    Objective Loss 0.000000    Distill Loss 0.013770                                        LR 0.000063    Time 0.524792    
+2023-12-05 12:28:37,230 - Epoch: [32][ 8500/12168]    Overall Loss 0.013768    Objective Loss 0.000000    Distill Loss 0.013768                                        LR 0.000063    Time 0.524795    
+2023-12-05 12:29:29,707 - Epoch: [32][ 8600/12168]    Overall Loss 0.013767    Objective Loss 0.000000    Distill Loss 0.013767                                        LR 0.000063    Time 0.524794    
+2023-12-05 12:30:22,087 - Epoch: [32][ 8700/12168]    Overall Loss 0.013766    Objective Loss 0.000000    Distill Loss 0.013766                                        LR 0.000063    Time 0.524782    
+2023-12-05 12:31:14,446 - Epoch: [32][ 8800/12168]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                                        LR 0.000063    Time 0.524768    
+2023-12-05 12:32:06,855 - Epoch: [32][ 8900/12168]    Overall Loss 0.013764    Objective Loss 0.000000    Distill Loss 0.013764                                        LR 0.000063    Time 0.524760    
+2023-12-05 12:32:59,245 - Epoch: [32][ 9000/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.524750    
+2023-12-05 12:33:51,640 - Epoch: [32][ 9100/12168]    Overall Loss 0.013763    Objective Loss 0.000000    Distill Loss 0.013763                                        LR 0.000063    Time 0.524741    
+2023-12-05 12:34:44,031 - Epoch: [32][ 9200/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.524732    
+2023-12-05 12:35:36,454 - Epoch: [32][ 9300/12168]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                                        LR 0.000063    Time 0.524726    
+2023-12-05 12:36:28,850 - Epoch: [32][ 9400/12168]    Overall Loss 0.013761    Objective Loss 0.000000    Distill Loss 0.013761                                        LR 0.000063    Time 0.524717    
+2023-12-05 12:37:21,248 - Epoch: [32][ 9500/12168]    Overall Loss 0.013760    Objective Loss 0.000000    Distill Loss 0.013760                                        LR 0.000063    Time 0.524709    
+2023-12-05 12:38:13,586 - Epoch: [32][ 9600/12168]    Overall Loss 0.013760    Objective Loss 0.000000    Distill Loss 0.013760                                        LR 0.000063    Time 0.524695    
+2023-12-05 12:39:05,971 - Epoch: [32][ 9700/12168]    Overall Loss 0.013759    Objective Loss 0.000000    Distill Loss 0.013759                                        LR 0.000063    Time 0.524686    
+2023-12-05 12:39:58,339 - Epoch: [32][ 9800/12168]    Overall Loss 0.013758    Objective Loss 0.000000    Distill Loss 0.013758                                        LR 0.000063    Time 0.524676    
+2023-12-05 12:40:50,737 - Epoch: [32][ 9900/12168]    Overall Loss 0.013757    Objective Loss 0.000000    Distill Loss 0.013757                                        LR 0.000063    Time 0.524668    
+2023-12-05 12:41:43,085 - Epoch: [32][10000/12168]    Overall Loss 0.013756    Objective Loss 0.000000    Distill Loss 0.013756                                        LR 0.000063    Time 0.524656    
+2023-12-05 12:42:35,438 - Epoch: [32][10100/12168]    Overall Loss 0.013755    Objective Loss 0.000000    Distill Loss 0.013755                                        LR 0.000063    Time 0.524644    
+2023-12-05 12:43:27,828 - Epoch: [32][10200/12168]    Overall Loss 0.013754    Objective Loss 0.000000    Distill Loss 0.013754                                        LR 0.000063    Time 0.524637    
+2023-12-05 12:44:20,204 - Epoch: [32][10300/12168]    Overall Loss 0.013754    Objective Loss 0.000000    Distill Loss 0.013754                                        LR 0.000063    Time 0.524628    
+2023-12-05 12:45:12,592 - Epoch: [32][10400/12168]    Overall Loss 0.013754    Objective Loss 0.000000    Distill Loss 0.013754                                        LR 0.000063    Time 0.524620    
+2023-12-05 12:46:05,041 - Epoch: [32][10500/12168]    Overall Loss 0.013753    Objective Loss 0.000000    Distill Loss 0.013753                                        LR 0.000063    Time 0.524619    
+2023-12-05 12:46:57,468 - Epoch: [32][10600/12168]    Overall Loss 0.013752    Objective Loss 0.000000    Distill Loss 0.013752                                        LR 0.000063    Time 0.524615    
+2023-12-05 12:47:49,852 - Epoch: [32][10700/12168]    Overall Loss 0.013751    Objective Loss 0.000000    Distill Loss 0.013751                                        LR 0.000063    Time 0.524608    
+2023-12-05 12:48:42,177 - Epoch: [32][10800/12168]    Overall Loss 0.013750    Objective Loss 0.000000    Distill Loss 0.013750                                        LR 0.000063    Time 0.524595    
+2023-12-05 12:49:34,566 - Epoch: [32][10900/12168]    Overall Loss 0.013749    Objective Loss 0.000000    Distill Loss 0.013749                                        LR 0.000063    Time 0.524588    
+2023-12-05 12:50:27,048 - Epoch: [32][11000/12168]    Overall Loss 0.013748    Objective Loss 0.000000    Distill Loss 0.013748                                        LR 0.000063    Time 0.524590    
+2023-12-05 12:51:19,447 - Epoch: [32][11100/12168]    Overall Loss 0.013748    Objective Loss 0.000000    Distill Loss 0.013748                                        LR 0.000063    Time 0.524584    
+2023-12-05 12:52:11,897 - Epoch: [32][11200/12168]    Overall Loss 0.013748    Objective Loss 0.000000    Distill Loss 0.013748                                        LR 0.000063    Time 0.524583    
+2023-12-05 12:53:04,346 - Epoch: [32][11300/12168]    Overall Loss 0.013748    Objective Loss 0.000000    Distill Loss 0.013748                                        LR 0.000063    Time 0.524582    
+2023-12-05 12:53:56,723 - Epoch: [32][11400/12168]    Overall Loss 0.013748    Objective Loss 0.000000    Distill Loss 0.013748                                        LR 0.000063    Time 0.524574    
+2023-12-05 12:54:49,140 - Epoch: [32][11500/12168]    Overall Loss 0.013747    Objective Loss 0.000000    Distill Loss 0.013747                                        LR 0.000063    Time 0.524571    
+2023-12-05 12:55:41,586 - Epoch: [32][11600/12168]    Overall Loss 0.013746    Objective Loss 0.000000    Distill Loss 0.013746                                        LR 0.000063    Time 0.524569    
+2023-12-05 12:56:34,017 - Epoch: [32][11700/12168]    Overall Loss 0.013745    Objective Loss 0.000000    Distill Loss 0.013745                                        LR 0.000063    Time 0.524567    
+2023-12-05 12:57:26,464 - Epoch: [32][11800/12168]    Overall Loss 0.013745    Objective Loss 0.000000    Distill Loss 0.013745                                        LR 0.000063    Time 0.524566    
+2023-12-05 12:58:18,786 - Epoch: [32][11900/12168]    Overall Loss 0.013744    Objective Loss 0.000000    Distill Loss 0.013744                                        LR 0.000063    Time 0.524554    
+2023-12-05 12:59:11,165 - Epoch: [32][12000/12168]    Overall Loss 0.013744    Objective Loss 0.000000    Distill Loss 0.013744                                        LR 0.000063    Time 0.524548    
+2023-12-05 13:00:03,586 - Epoch: [32][12100/12168]    Overall Loss 0.013743    Objective Loss 0.000000    Distill Loss 0.013743                                        LR 0.000063    Time 0.524544    
+2023-12-05 13:00:39,259 - Epoch: [32][12168/12168]    Overall Loss 0.013744    Objective Loss 0.000000    Distill Loss 0.013744                                        LR 0.000063    Time 0.524545    
+2023-12-05 13:00:39,630 - --- validate (epoch=32)-----------
+2023-12-05 13:00:39,630 - 167951 samples (256 per mini-batch)
+2023-12-05 13:01:29,922 - Epoch: [32][  100/  657]    Loss 0.000000    Overall Loss 0.014282    
+2023-12-05 13:02:18,474 - Epoch: [32][  200/  657]    Loss 0.000000    Overall Loss 0.014254    
+2023-12-05 13:03:07,029 - Epoch: [32][  300/  657]    Loss 0.000000    Overall Loss 0.014269    
+2023-12-05 13:03:55,590 - Epoch: [32][  400/  657]    Loss 0.000000    Overall Loss 0.014265    
+2023-12-05 13:04:44,143 - Epoch: [32][  500/  657]    Loss 0.000000    Overall Loss 0.014258    
+2023-12-05 13:05:32,692 - Epoch: [32][  600/  657]    Loss 0.000000    Overall Loss 0.014256    
+2023-12-05 13:05:59,926 - Epoch: [32][  657/  657]    Loss 0.000000    Overall Loss 0.014256    
+2023-12-05 13:06:00,141 - ==> Overall Loss: 0.014
+
+2023-12-05 13:06:00,144 - ==> Best [Overall Loss: 0.014256 on epoch: 32]
+2023-12-05 13:06:00,144 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 13:06:00,171 - 
+
+2023-12-05 13:06:00,171 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 13:07:01,739 - Epoch: [33][  100/12168]    Overall Loss 0.013644    Objective Loss 0.000000    Distill Loss 0.013644                                        LR 0.000063    Time 0.615638    
+2023-12-05 13:07:54,144 - Epoch: [33][  200/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.000063    Time 0.569823    
+2023-12-05 13:08:46,496 - Epoch: [33][  300/12168]    Overall Loss 0.013630    Objective Loss 0.000000    Distill Loss 0.013630                                        LR 0.000063    Time 0.554379    
+2023-12-05 13:09:38,878 - Epoch: [33][  400/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.000063    Time 0.546730    
+2023-12-05 13:10:31,247 - Epoch: [33][  500/12168]    Overall Loss 0.013646    Objective Loss 0.000000    Distill Loss 0.013646                                        LR 0.000063    Time 0.542115    
+2023-12-05 13:11:23,639 - Epoch: [33][  600/12168]    Overall Loss 0.013641    Objective Loss 0.000000    Distill Loss 0.013641                                        LR 0.000063    Time 0.539078    
+2023-12-05 13:12:16,039 - Epoch: [33][  700/12168]    Overall Loss 0.013644    Objective Loss 0.000000    Distill Loss 0.013644                                        LR 0.000063    Time 0.536918    
+2023-12-05 13:13:08,440 - Epoch: [33][  800/12168]    Overall Loss 0.013647    Objective Loss 0.000000    Distill Loss 0.013647                                        LR 0.000063    Time 0.535300    
+2023-12-05 13:14:00,785 - Epoch: [33][  900/12168]    Overall Loss 0.013655    Objective Loss 0.000000    Distill Loss 0.013655                                        LR 0.000063    Time 0.533980    
+2023-12-05 13:14:53,180 - Epoch: [33][ 1000/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.532974    
+2023-12-05 13:15:45,529 - Epoch: [33][ 1100/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.532108    
+2023-12-05 13:16:37,909 - Epoch: [33][ 1200/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.531414    
+2023-12-05 13:17:30,367 - Epoch: [33][ 1300/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.530885    
+2023-12-05 13:18:22,782 - Epoch: [33][ 1400/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.530402    
+2023-12-05 13:19:15,135 - Epoch: [33][ 1500/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.529942    
+2023-12-05 13:20:07,517 - Epoch: [33][ 1600/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.529557    
+2023-12-05 13:20:59,887 - Epoch: [33][ 1700/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.529211    
+2023-12-05 13:21:52,276 - Epoch: [33][ 1800/12168]    Overall Loss 0.013670    Objective Loss 0.000000    Distill Loss 0.013670                                        LR 0.000063    Time 0.528913    
+2023-12-05 13:22:44,718 - Epoch: [33][ 1900/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.528675    
+2023-12-05 13:23:37,080 - Epoch: [33][ 2000/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.528421    
+2023-12-05 13:24:29,457 - Epoch: [33][ 2100/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.528198    
+2023-12-05 13:25:21,824 - Epoch: [33][ 2200/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.527990    
+2023-12-05 13:26:14,175 - Epoch: [33][ 2300/12168]    Overall Loss 0.013670    Objective Loss 0.000000    Distill Loss 0.013670                                        LR 0.000063    Time 0.527794    
+2023-12-05 13:27:06,572 - Epoch: [33][ 2400/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.527633    
+2023-12-05 13:27:59,004 - Epoch: [33][ 2500/12168]    Overall Loss 0.013665    Objective Loss 0.000000    Distill Loss 0.013665                                        LR 0.000063    Time 0.527499    
+2023-12-05 13:28:51,446 - Epoch: [33][ 2600/12168]    Overall Loss 0.013664    Objective Loss 0.000000    Distill Loss 0.013664                                        LR 0.000063    Time 0.527380    
+2023-12-05 13:29:43,818 - Epoch: [33][ 2700/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.527243    
+2023-12-05 13:30:36,198 - Epoch: [33][ 2800/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.527118    
+2023-12-05 13:31:28,611 - Epoch: [33][ 2900/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.527014    
+2023-12-05 13:32:21,015 - Epoch: [33][ 3000/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.526914    
+2023-12-05 13:33:13,401 - Epoch: [33][ 3100/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526814    
+2023-12-05 13:34:05,812 - Epoch: [33][ 3200/12168]    Overall Loss 0.013663    Objective Loss 0.000000    Distill Loss 0.013663                                        LR 0.000063    Time 0.526729    
+2023-12-05 13:34:58,189 - Epoch: [33][ 3300/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.526638    
+2023-12-05 13:35:50,606 - Epoch: [33][ 3400/12168]    Overall Loss 0.013665    Objective Loss 0.000000    Distill Loss 0.013665                                        LR 0.000063    Time 0.526564    
+2023-12-05 13:36:43,009 - Epoch: [33][ 3500/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.526491    
+2023-12-05 13:37:35,367 - Epoch: [33][ 3600/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.526409    
+2023-12-05 13:38:27,755 - Epoch: [33][ 3700/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.526340    
+2023-12-05 13:39:20,199 - Epoch: [33][ 3800/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.526289    
+2023-12-05 13:40:12,625 - Epoch: [33][ 3900/12168]    Overall Loss 0.013670    Objective Loss 0.000000    Distill Loss 0.013670                                        LR 0.000063    Time 0.526236    
+2023-12-05 13:41:04,997 - Epoch: [33][ 4000/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.526173    
+2023-12-05 13:41:57,361 - Epoch: [33][ 4100/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.526110    
+2023-12-05 13:42:49,827 - Epoch: [33][ 4200/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.526075    
+2023-12-05 13:43:42,204 - Epoch: [33][ 4300/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.526020    
+2023-12-05 13:44:34,622 - Epoch: [33][ 4400/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.525978    
+2023-12-05 13:45:26,972 - Epoch: [33][ 4500/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.525922    
+2023-12-05 13:46:19,325 - Epoch: [33][ 4600/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.525869    
+2023-12-05 13:47:11,682 - Epoch: [33][ 4700/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.525820    
+2023-12-05 13:48:04,434 - Epoch: [33][ 4800/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.525854    
+2023-12-05 13:48:56,930 - Epoch: [33][ 4900/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.525835    
+2023-12-05 13:49:49,445 - Epoch: [33][ 5000/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.525821    
+2023-12-05 13:50:41,859 - Epoch: [33][ 5100/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.525787    
+2023-12-05 13:51:34,280 - Epoch: [33][ 5200/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.525756    
+2023-12-05 13:52:26,623 - Epoch: [33][ 5300/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.525711    
+2023-12-05 13:53:19,008 - Epoch: [33][ 5400/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.525676    
+2023-12-05 13:54:11,499 - Epoch: [33][ 5500/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.525662    
+2023-12-05 13:55:03,852 - Epoch: [33][ 5600/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.525623    
+2023-12-05 13:55:56,287 - Epoch: [33][ 5700/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.525600    
+2023-12-05 13:56:48,658 - Epoch: [33][ 5800/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.525567    
+2023-12-05 13:57:41,026 - Epoch: [33][ 5900/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525534    
+2023-12-05 13:58:33,360 - Epoch: [33][ 6000/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525497    
+2023-12-05 13:59:25,857 - Epoch: [33][ 6100/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525488    
+2023-12-05 14:00:18,178 - Epoch: [33][ 6200/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525451    
+2023-12-05 14:01:10,586 - Epoch: [33][ 6300/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525428    
+2023-12-05 14:02:03,004 - Epoch: [33][ 6400/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525408    
+2023-12-05 14:02:55,401 - Epoch: [33][ 6500/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525386    
+2023-12-05 14:03:47,764 - Epoch: [33][ 6600/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525359    
+2023-12-05 14:04:40,159 - Epoch: [33][ 6700/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525337    
+2023-12-05 14:05:32,564 - Epoch: [33][ 6800/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525318    
+2023-12-05 14:06:24,979 - Epoch: [33][ 6900/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525300    
+2023-12-05 14:07:17,369 - Epoch: [33][ 7000/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525280    
+2023-12-05 14:08:09,785 - Epoch: [33][ 7100/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525264    
+2023-12-05 14:09:02,194 - Epoch: [33][ 7200/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525247    
+2023-12-05 14:09:54,608 - Epoch: [33][ 7300/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525231    
+2023-12-05 14:10:47,067 - Epoch: [33][ 7400/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.525222    
+2023-12-05 14:11:39,492 - Epoch: [33][ 7500/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.525209    
+2023-12-05 14:12:31,861 - Epoch: [33][ 7600/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525188    
+2023-12-05 14:13:24,260 - Epoch: [33][ 7700/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525172    
+2023-12-05 14:14:16,687 - Epoch: [33][ 7800/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525160    
+2023-12-05 14:15:09,086 - Epoch: [33][ 7900/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525145    
+2023-12-05 14:16:01,506 - Epoch: [33][ 8000/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525133    
+2023-12-05 14:16:53,958 - Epoch: [33][ 8100/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.525125    
+2023-12-05 14:17:46,356 - Epoch: [33][ 8200/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525110    
+2023-12-05 14:18:38,744 - Epoch: [33][ 8300/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525095    
+2023-12-05 14:19:31,111 - Epoch: [33][ 8400/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525078    
+2023-12-05 14:20:23,513 - Epoch: [33][ 8500/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525065    
+2023-12-05 14:21:15,859 - Epoch: [33][ 8600/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525046    
+2023-12-05 14:22:08,214 - Epoch: [33][ 8700/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525028    
+2023-12-05 14:23:00,599 - Epoch: [33][ 8800/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525015    
+2023-12-05 14:23:53,032 - Epoch: [33][ 8900/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.525007    
+2023-12-05 14:24:45,399 - Epoch: [33][ 9000/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.524991    
+2023-12-05 14:25:37,982 - Epoch: [33][ 9100/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.525000    
+2023-12-05 14:26:30,591 - Epoch: [33][ 9200/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.525012    
+2023-12-05 14:27:23,064 - Epoch: [33][ 9300/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.525008    
+2023-12-05 14:28:15,571 - Epoch: [33][ 9400/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.525009    
+2023-12-05 14:29:07,962 - Epoch: [33][ 9500/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.524997    
+2023-12-05 14:30:00,444 - Epoch: [33][ 9600/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.524994    
+2023-12-05 14:30:52,845 - Epoch: [33][ 9700/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.524984    
+2023-12-05 14:31:45,284 - Epoch: [33][ 9800/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.524977    
+2023-12-05 14:32:37,714 - Epoch: [33][ 9900/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.524970    
+2023-12-05 14:33:30,181 - Epoch: [33][10000/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.524967    
+2023-12-05 14:34:22,562 - Epoch: [33][10100/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.524955    
+2023-12-05 14:35:14,958 - Epoch: [33][10200/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.524945    
+2023-12-05 14:36:07,389 - Epoch: [33][10300/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.524939    
+2023-12-05 14:36:59,870 - Epoch: [33][10400/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.524937    
+2023-12-05 14:37:52,309 - Epoch: [33][10500/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.524932    
+2023-12-05 14:38:44,788 - Epoch: [33][10600/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.524930    
+2023-12-05 14:39:37,166 - Epoch: [33][10700/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.524919    
+2023-12-05 14:40:29,619 - Epoch: [33][10800/12168]    Overall Loss 0.013681    Objective Loss 0.000000    Distill Loss 0.013681                                        LR 0.000063    Time 0.524915    
+2023-12-05 14:41:22,073 - Epoch: [33][10900/12168]    Overall Loss 0.013681    Objective Loss 0.000000    Distill Loss 0.013681                                        LR 0.000063    Time 0.524911    
+2023-12-05 14:42:14,552 - Epoch: [33][11000/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.524910    
+2023-12-05 14:43:06,998 - Epoch: [33][11100/12168]    Overall Loss 0.013681    Objective Loss 0.000000    Distill Loss 0.013681                                        LR 0.000063    Time 0.524905    
+2023-12-05 14:43:59,516 - Epoch: [33][11200/12168]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                                        LR 0.000063    Time 0.524907    
+2023-12-05 14:44:52,028 - Epoch: [33][11300/12168]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                                        LR 0.000063    Time 0.524909    
+2023-12-05 14:45:44,423 - Epoch: [33][11400/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524900    
+2023-12-05 14:46:36,900 - Epoch: [33][11500/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524899    
+2023-12-05 14:47:29,412 - Epoch: [33][11600/12168]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                                        LR 0.000063    Time 0.524900    
+2023-12-05 14:48:21,852 - Epoch: [33][11700/12168]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                                        LR 0.000063    Time 0.524896    
+2023-12-05 14:49:14,264 - Epoch: [33][11800/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524889    
+2023-12-05 14:50:06,685 - Epoch: [33][11900/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524883    
+2023-12-05 14:50:59,116 - Epoch: [33][12000/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524878    
+2023-12-05 14:51:51,554 - Epoch: [33][12100/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524874    
+2023-12-05 14:52:27,175 - Epoch: [33][12168/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000063    Time 0.524868    
+2023-12-05 14:52:27,567 - --- validate (epoch=33)-----------
+2023-12-05 14:52:27,568 - 167951 samples (256 per mini-batch)
+2023-12-05 14:53:17,974 - Epoch: [33][  100/  657]    Loss 0.000000    Overall Loss 0.014384    
+2023-12-05 14:54:06,569 - Epoch: [33][  200/  657]    Loss 0.000000    Overall Loss 0.014359    
+2023-12-05 14:54:55,140 - Epoch: [33][  300/  657]    Loss 0.000000    Overall Loss 0.014339    
+2023-12-05 14:55:43,711 - Epoch: [33][  400/  657]    Loss 0.000000    Overall Loss 0.014343    
+2023-12-05 14:56:32,278 - Epoch: [33][  500/  657]    Loss 0.000000    Overall Loss 0.014334    
+2023-12-05 14:57:20,836 - Epoch: [33][  600/  657]    Loss 0.000000    Overall Loss 0.014322    
+2023-12-05 14:57:48,065 - Epoch: [33][  657/  657]    Loss 0.000000    Overall Loss 0.014320    
+2023-12-05 14:57:48,293 - ==> Overall Loss: 0.014
+
+2023-12-05 14:57:48,295 - ==> Best [Overall Loss: 0.014256 on epoch: 32]
+2023-12-05 14:57:48,295 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 14:57:48,315 - 
+
+2023-12-05 14:57:48,316 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 14:58:51,447 - Epoch: [34][  100/12168]    Overall Loss 0.013656    Objective Loss 0.000000    Distill Loss 0.013656                                        LR 0.000063    Time 0.631275    
+2023-12-05 14:59:43,863 - Epoch: [34][  200/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.577704    
+2023-12-05 15:00:36,265 - Epoch: [34][  300/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.559799    
+2023-12-05 15:01:28,684 - Epoch: [34][  400/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.550887    
+2023-12-05 15:02:21,048 - Epoch: [34][  500/12168]    Overall Loss 0.013640    Objective Loss 0.000000    Distill Loss 0.013640                                        LR 0.000063    Time 0.545431    
+2023-12-05 15:03:13,423 - Epoch: [34][  600/12168]    Overall Loss 0.013629    Objective Loss 0.000000    Distill Loss 0.013629                                        LR 0.000063    Time 0.541813    
+2023-12-05 15:04:05,823 - Epoch: [34][  700/12168]    Overall Loss 0.013638    Objective Loss 0.000000    Distill Loss 0.013638                                        LR 0.000063    Time 0.539263    
+2023-12-05 15:04:58,259 - Epoch: [34][  800/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.000063    Time 0.537396    
+2023-12-05 15:05:50,677 - Epoch: [34][  900/12168]    Overall Loss 0.013652    Objective Loss 0.000000    Distill Loss 0.013652                                        LR 0.000063    Time 0.535924    
+2023-12-05 15:06:43,092 - Epoch: [34][ 1000/12168]    Overall Loss 0.013654    Objective Loss 0.000000    Distill Loss 0.013654                                        LR 0.000063    Time 0.534744    
+2023-12-05 15:07:35,510 - Epoch: [34][ 1100/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.533780    
+2023-12-05 15:08:27,932 - Epoch: [34][ 1200/12168]    Overall Loss 0.013653    Objective Loss 0.000000    Distill Loss 0.013653                                        LR 0.000063    Time 0.532981    
+2023-12-05 15:09:20,372 - Epoch: [34][ 1300/12168]    Overall Loss 0.013654    Objective Loss 0.000000    Distill Loss 0.013654                                        LR 0.000063    Time 0.532318    
+2023-12-05 15:10:12,839 - Epoch: [34][ 1400/12168]    Overall Loss 0.013655    Objective Loss 0.000000    Distill Loss 0.013655                                        LR 0.000063    Time 0.531770    
+2023-12-05 15:11:05,342 - Epoch: [34][ 1500/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.531317    
+2023-12-05 15:11:57,854 - Epoch: [34][ 1600/12168]    Overall Loss 0.013663    Objective Loss 0.000000    Distill Loss 0.013663                                        LR 0.000063    Time 0.530928    
+2023-12-05 15:12:50,300 - Epoch: [34][ 1700/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.530545    
+2023-12-05 15:13:42,779 - Epoch: [34][ 1800/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.530223    
+2023-12-05 15:14:35,258 - Epoch: [34][ 1900/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.529936    
+2023-12-05 15:15:27,736 - Epoch: [34][ 2000/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.529676    
+2023-12-05 15:16:20,333 - Epoch: [34][ 2100/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.529498    
+2023-12-05 15:17:12,848 - Epoch: [34][ 2200/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.529299    
+2023-12-05 15:18:05,303 - Epoch: [34][ 2300/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.529091    
+2023-12-05 15:18:57,737 - Epoch: [34][ 2400/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.528892    
+2023-12-05 15:19:50,210 - Epoch: [34][ 2500/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.528724    
+2023-12-05 15:20:42,721 - Epoch: [34][ 2600/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.528584    
+2023-12-05 15:21:35,162 - Epoch: [34][ 2700/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.528428    
+2023-12-05 15:22:27,655 - Epoch: [34][ 2800/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.528301    
+2023-12-05 15:23:20,131 - Epoch: [34][ 2900/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.528178    
+2023-12-05 15:24:12,721 - Epoch: [34][ 3000/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.528101    
+2023-12-05 15:25:05,279 - Epoch: [34][ 3100/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.528019    
+2023-12-05 15:25:57,700 - Epoch: [34][ 3200/12168]    Overall Loss 0.013665    Objective Loss 0.000000    Distill Loss 0.013665                                        LR 0.000063    Time 0.527899    
+2023-12-05 15:26:50,142 - Epoch: [34][ 3300/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.527792    
+2023-12-05 15:27:42,639 - Epoch: [34][ 3400/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.527708    
+2023-12-05 15:28:35,140 - Epoch: [34][ 3500/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.527630    
+2023-12-05 15:29:27,756 - Epoch: [34][ 3600/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.527588    
+2023-12-05 15:30:20,306 - Epoch: [34][ 3700/12168]    Overall Loss 0.013665    Objective Loss 0.000000    Distill Loss 0.013665                                        LR 0.000063    Time 0.527531    
+2023-12-05 15:31:12,874 - Epoch: [34][ 3800/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.527481    
+2023-12-05 15:32:05,538 - Epoch: [34][ 3900/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.527459    
+2023-12-05 15:32:58,140 - Epoch: [34][ 4000/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.527422    
+2023-12-05 15:33:50,611 - Epoch: [34][ 4100/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.527355    
+2023-12-05 15:34:43,095 - Epoch: [34][ 4200/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.527294    
+2023-12-05 15:35:35,718 - Epoch: [34][ 4300/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.527268    
+2023-12-05 15:36:28,207 - Epoch: [34][ 4400/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.527214    
+2023-12-05 15:37:20,763 - Epoch: [34][ 4500/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.527176    
+2023-12-05 15:38:13,225 - Epoch: [34][ 4600/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000063    Time 0.527120    
+2023-12-05 15:39:05,717 - Epoch: [34][ 4700/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.527072    
+2023-12-05 15:39:58,274 - Epoch: [34][ 4800/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.527040    
+2023-12-05 15:40:50,814 - Epoch: [34][ 4900/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.527006    
+2023-12-05 15:41:43,340 - Epoch: [34][ 5000/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.526971    
+2023-12-05 15:42:35,843 - Epoch: [34][ 5100/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.526932    
+2023-12-05 15:43:28,412 - Epoch: [34][ 5200/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.526907    
+2023-12-05 15:44:20,857 - Epoch: [34][ 5300/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.526860    
+2023-12-05 15:45:13,352 - Epoch: [34][ 5400/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.526824    
+2023-12-05 15:46:05,841 - Epoch: [34][ 5500/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.526788    
+2023-12-05 15:46:58,401 - Epoch: [34][ 5600/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.526767    
+2023-12-05 15:47:50,953 - Epoch: [34][ 5700/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526744    
+2023-12-05 15:48:43,388 - Epoch: [34][ 5800/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526702    
+2023-12-05 15:49:35,942 - Epoch: [34][ 5900/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526682    
+2023-12-05 15:50:28,397 - Epoch: [34][ 6000/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526646    
+2023-12-05 15:51:20,888 - Epoch: [34][ 6100/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526617    
+2023-12-05 15:52:13,368 - Epoch: [34][ 6200/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526587    
+2023-12-05 15:53:05,989 - Epoch: [34][ 6300/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526581    
+2023-12-05 15:53:58,612 - Epoch: [34][ 6400/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.526575    
+2023-12-05 15:54:51,158 - Epoch: [34][ 6500/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526557    
+2023-12-05 15:55:43,666 - Epoch: [34][ 6600/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526534    
+2023-12-05 15:56:36,104 - Epoch: [34][ 6700/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526501    
+2023-12-05 15:57:28,583 - Epoch: [34][ 6800/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526476    
+2023-12-05 15:58:21,041 - Epoch: [34][ 6900/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526448    
+2023-12-05 15:59:13,500 - Epoch: [34][ 7000/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526421    
+2023-12-05 16:00:05,894 - Epoch: [34][ 7100/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.526385    
+2023-12-05 16:00:58,350 - Epoch: [34][ 7200/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526360    
+2023-12-05 16:01:50,818 - Epoch: [34][ 7300/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526336    
+2023-12-05 16:02:43,252 - Epoch: [34][ 7400/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526309    
+2023-12-05 16:03:35,759 - Epoch: [34][ 7500/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526292    
+2023-12-05 16:04:28,281 - Epoch: [34][ 7600/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.526277    
+2023-12-05 16:05:20,816 - Epoch: [34][ 7700/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526265    
+2023-12-05 16:06:13,355 - Epoch: [34][ 7800/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526253    
+2023-12-05 16:07:05,867 - Epoch: [34][ 7900/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526238    
+2023-12-05 16:07:58,292 - Epoch: [34][ 8000/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526213    
+2023-12-05 16:08:50,766 - Epoch: [34][ 8100/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526194    
+2023-12-05 16:09:43,302 - Epoch: [34][ 8200/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526184    
+2023-12-05 16:10:36,102 - Epoch: [34][ 8300/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526205    
+2023-12-05 16:11:28,685 - Epoch: [34][ 8400/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526200    
+2023-12-05 16:12:21,229 - Epoch: [34][ 8500/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526191    
+2023-12-05 16:13:13,798 - Epoch: [34][ 8600/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526185    
+2023-12-05 16:14:06,316 - Epoch: [34][ 8700/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.526173    
+2023-12-05 16:14:58,906 - Epoch: [34][ 8800/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526169    
+2023-12-05 16:15:51,446 - Epoch: [34][ 8900/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526160    
+2023-12-05 16:16:43,967 - Epoch: [34][ 9000/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.526149    
+2023-12-05 16:17:36,551 - Epoch: [34][ 9100/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526146    
+2023-12-05 16:18:29,060 - Epoch: [34][ 9200/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.526134    
+2023-12-05 16:19:21,758 - Epoch: [34][ 9300/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.526142    
+2023-12-05 16:20:14,383 - Epoch: [34][ 9400/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.526143    
+2023-12-05 16:21:06,929 - Epoch: [34][ 9500/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.526136    
+2023-12-05 16:21:59,467 - Epoch: [34][ 9600/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.526127    
+2023-12-05 16:22:52,094 - Epoch: [34][ 9700/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.526128    
+2023-12-05 16:23:44,678 - Epoch: [34][ 9800/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.526125    
+2023-12-05 16:24:37,290 - Epoch: [34][ 9900/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000063    Time 0.526125    
+2023-12-05 16:25:29,840 - Epoch: [34][10000/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.526118    
+2023-12-05 16:26:22,560 - Epoch: [34][10100/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526128    
+2023-12-05 16:27:15,082 - Epoch: [34][10200/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526119    
+2023-12-05 16:28:07,770 - Epoch: [34][10300/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526126    
+2023-12-05 16:29:00,280 - Epoch: [34][10400/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.526116    
+2023-12-05 16:29:52,906 - Epoch: [34][10500/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526117    
+2023-12-05 16:30:45,380 - Epoch: [34][10600/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526104    
+2023-12-05 16:31:37,812 - Epoch: [34][10700/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526087    
+2023-12-05 16:32:30,327 - Epoch: [34][10800/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.526078    
+2023-12-05 16:33:22,816 - Epoch: [34][10900/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.526066    
+2023-12-05 16:34:15,337 - Epoch: [34][11000/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526058    
+2023-12-05 16:35:07,758 - Epoch: [34][11100/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526041    
+2023-12-05 16:36:00,224 - Epoch: [34][11200/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526029    
+2023-12-05 16:36:52,601 - Epoch: [34][11300/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526009    
+2023-12-05 16:37:45,188 - Epoch: [34][11400/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.526007    
+2023-12-05 16:38:37,658 - Epoch: [34][11500/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.525995    
+2023-12-05 16:39:30,159 - Epoch: [34][11600/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.525987    
+2023-12-05 16:40:22,736 - Epoch: [34][11700/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.525984    
+2023-12-05 16:41:15,318 - Epoch: [34][11800/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.525983    
+2023-12-05 16:42:07,780 - Epoch: [34][11900/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.525971    
+2023-12-05 16:43:00,244 - Epoch: [34][12000/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.525960    
+2023-12-05 16:43:52,681 - Epoch: [34][12100/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.525946    
+2023-12-05 16:44:28,382 - Epoch: [34][12168/12168]    Overall Loss 0.013680    Objective Loss 0.000000    Distill Loss 0.013680                                        LR 0.000063    Time 0.525941    
+2023-12-05 16:44:28,767 - --- validate (epoch=34)-----------
+2023-12-05 16:44:28,768 - 167951 samples (256 per mini-batch)
+2023-12-05 16:45:19,430 - Epoch: [34][  100/  657]    Loss 0.000000    Overall Loss 0.014328    
+2023-12-05 16:46:08,082 - Epoch: [34][  200/  657]    Loss 0.000000    Overall Loss 0.014314    
+2023-12-05 16:46:56,688 - Epoch: [34][  300/  657]    Loss 0.000000    Overall Loss 0.014313    
+2023-12-05 16:47:45,304 - Epoch: [34][  400/  657]    Loss 0.000000    Overall Loss 0.014313    
+2023-12-05 16:48:33,927 - Epoch: [34][  500/  657]    Loss 0.000000    Overall Loss 0.014319    
+2023-12-05 16:49:22,549 - Epoch: [34][  600/  657]    Loss 0.000000    Overall Loss 0.014320    
+2023-12-05 16:49:49,801 - Epoch: [34][  657/  657]    Loss 0.000000    Overall Loss 0.014321    
+2023-12-05 16:49:49,987 - ==> Overall Loss: 0.014
+
+2023-12-05 16:49:49,989 - ==> Best [Overall Loss: 0.014256 on epoch: 32]
+2023-12-05 16:49:49,989 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 16:49:50,010 - 
+
+2023-12-05 16:49:50,010 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 16:50:52,594 - Epoch: [35][  100/12168]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                                        LR 0.000063    Time 0.625795    
+2023-12-05 16:51:44,978 - Epoch: [35][  200/12168]    Overall Loss 0.013651    Objective Loss 0.000000    Distill Loss 0.013651                                        LR 0.000063    Time 0.574804    
+2023-12-05 16:52:37,393 - Epoch: [35][  300/12168]    Overall Loss 0.013656    Objective Loss 0.000000    Distill Loss 0.013656                                        LR 0.000063    Time 0.557906    
+2023-12-05 16:53:29,830 - Epoch: [35][  400/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.549515    
+2023-12-05 16:54:22,281 - Epoch: [35][  500/12168]    Overall Loss 0.013646    Objective Loss 0.000000    Distill Loss 0.013646                                        LR 0.000063    Time 0.544507    
+2023-12-05 16:55:14,700 - Epoch: [35][  600/12168]    Overall Loss 0.013649    Objective Loss 0.000000    Distill Loss 0.013649                                        LR 0.000063    Time 0.541115    
+2023-12-05 16:56:07,196 - Epoch: [35][  700/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.538802    
+2023-12-05 16:56:59,623 - Epoch: [35][  800/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.536982    
+2023-12-05 16:57:52,072 - Epoch: [35][  900/12168]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                                        LR 0.000063    Time 0.535589    
+2023-12-05 16:58:44,540 - Epoch: [35][ 1000/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.534495    
+2023-12-05 16:59:37,025 - Epoch: [35][ 1100/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.533615    
+2023-12-05 17:00:29,461 - Epoch: [35][ 1200/12168]    Overall Loss 0.013670    Objective Loss 0.000000    Distill Loss 0.013670                                        LR 0.000063    Time 0.532841    
+2023-12-05 17:01:21,950 - Epoch: [35][ 1300/12168]    Overall Loss 0.013670    Objective Loss 0.000000    Distill Loss 0.013670                                        LR 0.000063    Time 0.532228    
+2023-12-05 17:02:14,359 - Epoch: [35][ 1400/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.531644    
+2023-12-05 17:03:06,878 - Epoch: [35][ 1500/12168]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                                        LR 0.000063    Time 0.531211    
+2023-12-05 17:03:59,410 - Epoch: [35][ 1600/12168]    Overall Loss 0.013672    Objective Loss 0.000000    Distill Loss 0.013672                                        LR 0.000063    Time 0.530841    
+2023-12-05 17:04:51,887 - Epoch: [35][ 1700/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.530482    
+2023-12-05 17:05:44,327 - Epoch: [35][ 1800/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000063    Time 0.530142    
+2023-12-05 17:06:36,746 - Epoch: [35][ 1900/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.529827    
+2023-12-05 17:07:29,242 - Epoch: [35][ 2000/12168]    Overall Loss 0.013676    Objective Loss 0.000000    Distill Loss 0.013676                                        LR 0.000063    Time 0.529582    
+2023-12-05 17:08:21,700 - Epoch: [35][ 2100/12168]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                                        LR 0.000063    Time 0.529342    
+2023-12-05 17:09:14,153 - Epoch: [35][ 2200/12168]    Overall Loss 0.013679    Objective Loss 0.000000    Distill Loss 0.013679                                        LR 0.000063    Time 0.529121    
+2023-12-05 17:10:06,553 - Epoch: [35][ 2300/12168]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                                        LR 0.000063    Time 0.528897    
+2023-12-05 17:10:59,040 - Epoch: [35][ 2400/12168]    Overall Loss 0.013673    Objective Loss 0.000000    Distill Loss 0.013673                                        LR 0.000063    Time 0.528728    
+2023-12-05 17:11:51,454 - Epoch: [35][ 2500/12168]    Overall Loss 0.013669    Objective Loss 0.000000    Distill Loss 0.013669                                        LR 0.000063    Time 0.528543    
+2023-12-05 17:12:43,884 - Epoch: [35][ 2600/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.528379    
+2023-12-05 17:13:36,412 - Epoch: [35][ 2700/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.528263    
+2023-12-05 17:14:28,911 - Epoch: [35][ 2800/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.528145    
+2023-12-05 17:15:21,378 - Epoch: [35][ 2900/12168]    Overall Loss 0.013666    Objective Loss 0.000000    Distill Loss 0.013666                                        LR 0.000063    Time 0.528023    
+2023-12-05 17:16:13,866 - Epoch: [35][ 3000/12168]    Overall Loss 0.013663    Objective Loss 0.000000    Distill Loss 0.013663                                        LR 0.000063    Time 0.527918    
+2023-12-05 17:17:06,342 - Epoch: [35][ 3100/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.527815    
+2023-12-05 17:17:58,818 - Epoch: [35][ 3200/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.527718    
+2023-12-05 17:18:51,273 - Epoch: [35][ 3300/12168]    Overall Loss 0.013655    Objective Loss 0.000000    Distill Loss 0.013655                                        LR 0.000063    Time 0.527621    
+2023-12-05 17:19:43,667 - Epoch: [35][ 3400/12168]    Overall Loss 0.013656    Objective Loss 0.000000    Distill Loss 0.013656                                        LR 0.000063    Time 0.527512    
+2023-12-05 17:20:36,033 - Epoch: [35][ 3500/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.527401    
+2023-12-05 17:21:28,553 - Epoch: [35][ 3600/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.527339    
+2023-12-05 17:22:21,036 - Epoch: [35][ 3700/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.527270    
+2023-12-05 17:23:13,509 - Epoch: [35][ 3800/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.527202    
+2023-12-05 17:24:05,953 - Epoch: [35][ 3900/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.527130    
+2023-12-05 17:24:58,473 - Epoch: [35][ 4000/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.527081    
+2023-12-05 17:25:51,025 - Epoch: [35][ 4100/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.527042    
+2023-12-05 17:26:43,471 - Epoch: [35][ 4200/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526980    
+2023-12-05 17:27:35,944 - Epoch: [35][ 4300/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526927    
+2023-12-05 17:28:28,381 - Epoch: [35][ 4400/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526868    
+2023-12-05 17:29:20,848 - Epoch: [35][ 4500/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526818    
+2023-12-05 17:30:13,310 - Epoch: [35][ 4600/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526770    
+2023-12-05 17:31:05,798 - Epoch: [35][ 4700/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526729    
+2023-12-05 17:31:58,237 - Epoch: [35][ 4800/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526679    
+2023-12-05 17:32:50,732 - Epoch: [35][ 4900/12168]    Overall Loss 0.013656    Objective Loss 0.000000    Distill Loss 0.013656                                        LR 0.000063    Time 0.526643    
+2023-12-05 17:33:43,232 - Epoch: [35][ 5000/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526610    
+2023-12-05 17:34:35,782 - Epoch: [35][ 5100/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526587    
+2023-12-05 17:35:28,250 - Epoch: [35][ 5200/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526550    
+2023-12-05 17:36:20,771 - Epoch: [35][ 5300/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526524    
+2023-12-05 17:37:13,272 - Epoch: [35][ 5400/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526495    
+2023-12-05 17:38:06,178 - Epoch: [35][ 5500/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526541    
+2023-12-05 17:39:01,918 - Epoch: [35][ 5600/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.527091    
+2023-12-05 17:39:54,385 - Epoch: [35][ 5700/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.527048    
+2023-12-05 17:40:46,863 - Epoch: [35][ 5800/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.527009    
+2023-12-05 17:41:39,316 - Epoch: [35][ 5900/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526966    
+2023-12-05 17:42:31,804 - Epoch: [35][ 6000/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526931    
+2023-12-05 17:43:24,298 - Epoch: [35][ 6100/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526898    
+2023-12-05 17:44:16,809 - Epoch: [35][ 6200/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526868    
+2023-12-05 17:45:09,371 - Epoch: [35][ 6300/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526848    
+2023-12-05 17:46:01,768 - Epoch: [35][ 6400/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526802    
+2023-12-05 17:46:54,285 - Epoch: [35][ 6500/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526777    
+2023-12-05 17:47:46,818 - Epoch: [35][ 6600/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526754    
+2023-12-05 17:48:39,331 - Epoch: [35][ 6700/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526730    
+2023-12-05 17:49:31,811 - Epoch: [35][ 6800/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526701    
+2023-12-05 17:50:24,227 - Epoch: [35][ 6900/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526664    
+2023-12-05 17:51:16,659 - Epoch: [35][ 7000/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526630    
+2023-12-05 17:52:09,180 - Epoch: [35][ 7100/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000063    Time 0.526609    
+2023-12-05 17:53:01,642 - Epoch: [35][ 7200/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526581    
+2023-12-05 17:53:54,137 - Epoch: [35][ 7300/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526558    
+2023-12-05 17:54:46,598 - Epoch: [35][ 7400/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526531    
+2023-12-05 17:55:39,029 - Epoch: [35][ 7500/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000063    Time 0.526501    
+2023-12-05 17:56:31,473 - Epoch: [35][ 7600/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526474    
+2023-12-05 17:57:24,010 - Epoch: [35][ 7700/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526459    
+2023-12-05 17:58:16,476 - Epoch: [35][ 7800/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526436    
+2023-12-05 17:59:09,082 - Epoch: [35][ 7900/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.526430    
+2023-12-05 18:00:01,806 - Epoch: [35][ 8000/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526440    
+2023-12-05 18:00:54,399 - Epoch: [35][ 8100/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526433    
+2023-12-05 18:01:46,967 - Epoch: [35][ 8200/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526423    
+2023-12-05 18:02:39,627 - Epoch: [35][ 8300/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.526425    
+2023-12-05 18:03:32,207 - Epoch: [35][ 8400/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.526417    
+2023-12-05 18:04:24,684 - Epoch: [35][ 8500/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.526397    
+2023-12-05 18:05:17,144 - Epoch: [35][ 8600/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526376    
+2023-12-05 18:06:09,673 - Epoch: [35][ 8700/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000063    Time 0.526363    
+2023-12-05 18:07:02,159 - Epoch: [35][ 8800/12168]    Overall Loss 0.013661    Objective Loss 0.000000    Distill Loss 0.013661                                        LR 0.000063    Time 0.526345    
+2023-12-05 18:07:54,615 - Epoch: [35][ 8900/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526325    
+2023-12-05 18:08:47,119 - Epoch: [35][ 9000/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526310    
+2023-12-05 18:09:39,619 - Epoch: [35][ 9100/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526296    
+2023-12-05 18:10:32,095 - Epoch: [35][ 9200/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526279    
+2023-12-05 18:11:24,615 - Epoch: [35][ 9300/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526267    
+2023-12-05 18:12:17,032 - Epoch: [35][ 9400/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526244    
+2023-12-05 18:13:09,448 - Epoch: [35][ 9500/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526222    
+2023-12-05 18:14:01,947 - Epoch: [35][ 9600/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526208    
+2023-12-05 18:14:54,433 - Epoch: [35][ 9700/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526194    
+2023-12-05 18:15:46,905 - Epoch: [35][ 9800/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526179    
+2023-12-05 18:16:39,396 - Epoch: [35][ 9900/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526166    
+2023-12-05 18:17:31,872 - Epoch: [35][10000/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526151    
+2023-12-05 18:18:24,499 - Epoch: [35][10100/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526152    
+2023-12-05 18:19:17,036 - Epoch: [35][10200/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526144    
+2023-12-05 18:20:10,259 - Epoch: [35][10300/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526203    
+2023-12-05 18:21:03,202 - Epoch: [35][10400/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526233    
+2023-12-05 18:21:56,891 - Epoch: [35][10500/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526334    
+2023-12-05 18:22:49,352 - Epoch: [35][10600/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526318    
+2023-12-05 18:23:41,806 - Epoch: [35][10700/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526301    
+2023-12-05 18:24:34,264 - Epoch: [35][10800/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526285    
+2023-12-05 18:25:26,791 - Epoch: [35][10900/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526275    
+2023-12-05 18:26:19,276 - Epoch: [35][11000/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526262    
+2023-12-05 18:27:11,760 - Epoch: [35][11100/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526249    
+2023-12-05 18:28:04,246 - Epoch: [35][11200/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526236    
+2023-12-05 18:28:56,670 - Epoch: [35][11300/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526218    
+2023-12-05 18:29:49,128 - Epoch: [35][11400/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526203    
+2023-12-05 18:30:41,663 - Epoch: [35][11500/12168]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                                        LR 0.000063    Time 0.526196    
+2023-12-05 18:31:34,165 - Epoch: [35][11600/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526185    
+2023-12-05 18:32:26,626 - Epoch: [35][11700/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526171    
+2023-12-05 18:33:19,062 - Epoch: [35][11800/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526156    
+2023-12-05 18:34:11,480 - Epoch: [35][11900/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526139    
+2023-12-05 18:35:03,933 - Epoch: [35][12000/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526125    
+2023-12-05 18:35:56,367 - Epoch: [35][12100/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526110    
+2023-12-05 18:36:31,935 - Epoch: [35][12168/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000063    Time 0.526093    
+2023-12-05 18:36:32,271 - --- validate (epoch=35)-----------
+2023-12-05 18:36:32,272 - 167951 samples (256 per mini-batch)
+2023-12-05 18:37:22,916 - Epoch: [35][  100/  657]    Loss 0.000000    Overall Loss 0.014190    
+2023-12-05 18:38:11,632 - Epoch: [35][  200/  657]    Loss 0.000000    Overall Loss 0.014202    
+2023-12-05 18:39:00,350 - Epoch: [35][  300/  657]    Loss 0.000000    Overall Loss 0.014206    
+2023-12-05 18:39:49,030 - Epoch: [35][  400/  657]    Loss 0.000000    Overall Loss 0.014213    
+2023-12-05 18:40:37,698 - Epoch: [35][  500/  657]    Loss 0.000000    Overall Loss 0.014224    
+2023-12-05 18:41:26,356 - Epoch: [35][  600/  657]    Loss 0.000000    Overall Loss 0.014226    
+2023-12-05 18:41:53,647 - Epoch: [35][  657/  657]    Loss 0.000000    Overall Loss 0.014227    
+2023-12-05 18:41:53,842 - ==> Overall Loss: 0.014
+
+2023-12-05 18:41:53,844 - ==> Best [Overall Loss: 0.014227 on epoch: 35]
+2023-12-05 18:41:53,844 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 18:41:53,870 - 
+
+2023-12-05 18:41:53,870 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 18:42:57,476 - Epoch: [36][  100/12168]    Overall Loss 0.013626    Objective Loss 0.000000    Distill Loss 0.013626                                        LR 0.000063    Time 0.636007    
+2023-12-05 18:43:49,898 - Epoch: [36][  200/12168]    Overall Loss 0.013617    Objective Loss 0.000000    Distill Loss 0.013617                                        LR 0.000063    Time 0.580097    
+2023-12-05 18:44:42,320 - Epoch: [36][  300/12168]    Overall Loss 0.013627    Objective Loss 0.000000    Distill Loss 0.013627                                        LR 0.000063    Time 0.561460    
+2023-12-05 18:45:34,771 - Epoch: [36][  400/12168]    Overall Loss 0.013619    Objective Loss 0.000000    Distill Loss 0.013619                                        LR 0.000063    Time 0.552214    
+2023-12-05 18:46:27,216 - Epoch: [36][  500/12168]    Overall Loss 0.013605    Objective Loss 0.000000    Distill Loss 0.013605                                        LR 0.000063    Time 0.546654    
+2023-12-05 18:47:19,670 - Epoch: [36][  600/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.542963    
+2023-12-05 18:48:12,053 - Epoch: [36][  700/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.000063    Time 0.540226    
+2023-12-05 18:49:04,461 - Epoch: [36][  800/12168]    Overall Loss 0.013624    Objective Loss 0.000000    Distill Loss 0.013624                                        LR 0.000063    Time 0.538204    
+2023-12-05 18:49:56,882 - Epoch: [36][  900/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.536645    
+2023-12-05 18:50:49,337 - Epoch: [36][ 1000/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.535432    
+2023-12-05 18:51:41,791 - Epoch: [36][ 1100/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.534439    
+2023-12-05 18:52:34,257 - Epoch: [36][ 1200/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.533621    
+2023-12-05 18:53:26,662 - Epoch: [36][ 1300/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.532883    
+2023-12-05 18:54:19,143 - Epoch: [36][ 1400/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.532304    
+2023-12-05 18:55:11,613 - Epoch: [36][ 1500/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.000063    Time 0.531794    
+2023-12-05 18:56:04,083 - Epoch: [36][ 1600/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.000063    Time 0.531349    
+2023-12-05 18:56:56,556 - Epoch: [36][ 1700/12168]    Overall Loss 0.013641    Objective Loss 0.000000    Distill Loss 0.013641                                        LR 0.000063    Time 0.530958    
+2023-12-05 18:57:49,005 - Epoch: [36][ 1800/12168]    Overall Loss 0.013640    Objective Loss 0.000000    Distill Loss 0.013640                                        LR 0.000063    Time 0.530596    
+2023-12-05 18:58:41,486 - Epoch: [36][ 1900/12168]    Overall Loss 0.013641    Objective Loss 0.000000    Distill Loss 0.013641                                        LR 0.000063    Time 0.530290    
+2023-12-05 18:59:34,311 - Epoch: [36][ 2000/12168]    Overall Loss 0.013642    Objective Loss 0.000000    Distill Loss 0.013642                                        LR 0.000063    Time 0.530186    
+2023-12-05 19:00:26,904 - Epoch: [36][ 2100/12168]    Overall Loss 0.013644    Objective Loss 0.000000    Distill Loss 0.013644                                        LR 0.000063    Time 0.529981    
+2023-12-05 19:01:19,345 - Epoch: [36][ 2200/12168]    Overall Loss 0.013647    Objective Loss 0.000000    Distill Loss 0.013647                                        LR 0.000063    Time 0.529726    
+2023-12-05 19:02:11,863 - Epoch: [36][ 2300/12168]    Overall Loss 0.013645    Objective Loss 0.000000    Distill Loss 0.013645                                        LR 0.000063    Time 0.529527    
+2023-12-05 19:03:04,319 - Epoch: [36][ 2400/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.000063    Time 0.529319    
+2023-12-05 19:03:56,816 - Epoch: [36][ 2500/12168]    Overall Loss 0.013640    Objective Loss 0.000000    Distill Loss 0.013640                                        LR 0.000063    Time 0.529143    
+2023-12-05 19:04:49,305 - Epoch: [36][ 2600/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.000063    Time 0.528979    
+2023-12-05 19:05:41,758 - Epoch: [36][ 2700/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.000063    Time 0.528813    
+2023-12-05 19:06:34,268 - Epoch: [36][ 2800/12168]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                                        LR 0.000063    Time 0.528679    
+2023-12-05 19:07:26,717 - Epoch: [36][ 2900/12168]    Overall Loss 0.013638    Objective Loss 0.000000    Distill Loss 0.013638                                        LR 0.000063    Time 0.528533    
+2023-12-05 19:08:19,196 - Epoch: [36][ 3000/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.528407    
+2023-12-05 19:09:11,646 - Epoch: [36][ 3100/12168]    Overall Loss 0.013631    Objective Loss 0.000000    Distill Loss 0.013631                                        LR 0.000063    Time 0.528280    
+2023-12-05 19:10:04,104 - Epoch: [36][ 3200/12168]    Overall Loss 0.013631    Objective Loss 0.000000    Distill Loss 0.013631                                        LR 0.000063    Time 0.528164    
+2023-12-05 19:10:56,580 - Epoch: [36][ 3300/12168]    Overall Loss 0.013631    Objective Loss 0.000000    Distill Loss 0.013631                                        LR 0.000063    Time 0.528060    
+2023-12-05 19:11:49,072 - Epoch: [36][ 3400/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.527966    
+2023-12-05 19:12:41,626 - Epoch: [36][ 3500/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.527896    
+2023-12-05 19:13:34,132 - Epoch: [36][ 3600/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.527816    
+2023-12-05 19:14:26,549 - Epoch: [36][ 3700/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.527717    
+2023-12-05 19:15:19,064 - Epoch: [36][ 3800/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.527648    
+2023-12-05 19:16:11,502 - Epoch: [36][ 3900/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.527564    
+2023-12-05 19:17:03,979 - Epoch: [36][ 4000/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.527493    
+2023-12-05 19:17:56,441 - Epoch: [36][ 4100/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.527422    
+2023-12-05 19:18:48,878 - Epoch: [36][ 4200/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.527348    
+2023-12-05 19:19:41,421 - Epoch: [36][ 4300/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.527303    
+2023-12-05 19:20:33,875 - Epoch: [36][ 4400/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.527239    
+2023-12-05 19:21:26,328 - Epoch: [36][ 4500/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.527178    
+2023-12-05 19:22:18,810 - Epoch: [36][ 4600/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.527126    
+2023-12-05 19:23:11,260 - Epoch: [36][ 4700/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.527070    
+2023-12-05 19:24:03,722 - Epoch: [36][ 4800/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.527018    
+2023-12-05 19:24:56,214 - Epoch: [36][ 4900/12168]    Overall Loss 0.013631    Objective Loss 0.000000    Distill Loss 0.013631                                        LR 0.000063    Time 0.526975    
+2023-12-05 19:25:48,648 - Epoch: [36][ 5000/12168]    Overall Loss 0.013631    Objective Loss 0.000000    Distill Loss 0.013631                                        LR 0.000063    Time 0.526921    
+2023-12-05 19:26:41,089 - Epoch: [36][ 5100/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526871    
+2023-12-05 19:27:33,587 - Epoch: [36][ 5200/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526834    
+2023-12-05 19:28:26,091 - Epoch: [36][ 5300/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526800    
+2023-12-05 19:29:18,577 - Epoch: [36][ 5400/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526763    
+2023-12-05 19:30:11,068 - Epoch: [36][ 5500/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526729    
+2023-12-05 19:31:03,550 - Epoch: [36][ 5600/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.526694    
+2023-12-05 19:31:55,998 - Epoch: [36][ 5700/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.526655    
+2023-12-05 19:32:48,575 - Epoch: [36][ 5800/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000063    Time 0.526639    
+2023-12-05 19:33:41,091 - Epoch: [36][ 5900/12168]    Overall Loss 0.013633    Objective Loss 0.000000    Distill Loss 0.013633                                        LR 0.000063    Time 0.526613    
+2023-12-05 19:34:33,531 - Epoch: [36][ 6000/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526576    
+2023-12-05 19:35:26,029 - Epoch: [36][ 6100/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526549    
+2023-12-05 19:36:18,446 - Epoch: [36][ 6200/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526510    
+2023-12-05 19:37:10,971 - Epoch: [36][ 6300/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526490    
+2023-12-05 19:38:03,496 - Epoch: [36][ 6400/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.526470    
+2023-12-05 19:38:56,068 - Epoch: [36][ 6500/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.526458    
+2023-12-05 19:39:48,485 - Epoch: [36][ 6600/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.526423    
+2023-12-05 19:40:40,958 - Epoch: [36][ 6700/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.526397    
+2023-12-05 19:41:33,369 - Epoch: [36][ 6800/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.526363    
+2023-12-05 19:42:25,842 - Epoch: [36][ 6900/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526339    
+2023-12-05 19:43:18,314 - Epoch: [36][ 7000/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.526315    
+2023-12-05 19:44:10,773 - Epoch: [36][ 7100/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526290    
+2023-12-05 19:45:03,212 - Epoch: [36][ 7200/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526263    
+2023-12-05 19:45:55,658 - Epoch: [36][ 7300/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526238    
+2023-12-05 19:46:48,039 - Epoch: [36][ 7400/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526205    
+2023-12-05 19:47:40,513 - Epoch: [36][ 7500/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526185    
+2023-12-05 19:48:32,984 - Epoch: [36][ 7600/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526165    
+2023-12-05 19:49:25,455 - Epoch: [36][ 7700/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526146    
+2023-12-05 19:50:17,927 - Epoch: [36][ 7800/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526127    
+2023-12-05 19:51:10,375 - Epoch: [36][ 7900/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526106    
+2023-12-05 19:52:02,802 - Epoch: [36][ 8000/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526083    
+2023-12-05 19:52:55,310 - Epoch: [36][ 8100/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526070    
+2023-12-05 19:53:47,783 - Epoch: [36][ 8200/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000063    Time 0.526053    
+2023-12-05 19:54:40,297 - Epoch: [36][ 8300/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526042    
+2023-12-05 19:55:32,799 - Epoch: [36][ 8400/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526029    
+2023-12-05 19:56:25,190 - Epoch: [36][ 8500/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.526004    
+2023-12-05 19:57:17,636 - Epoch: [36][ 8600/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.525985    
+2023-12-05 19:58:10,197 - Epoch: [36][ 8700/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525981    
+2023-12-05 19:59:02,705 - Epoch: [36][ 8800/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525970    
+2023-12-05 19:59:55,189 - Epoch: [36][ 8900/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.525957    
+2023-12-05 20:00:47,702 - Epoch: [36][ 9000/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525947    
+2023-12-05 20:01:40,192 - Epoch: [36][ 9100/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525935    
+2023-12-05 20:02:32,683 - Epoch: [36][ 9200/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525924    
+2023-12-05 20:03:25,155 - Epoch: [36][ 9300/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525911    
+2023-12-05 20:04:17,627 - Epoch: [36][ 9400/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525898    
+2023-12-05 20:05:10,103 - Epoch: [36][ 9500/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525885    
+2023-12-05 20:06:02,631 - Epoch: [36][ 9600/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.525879    
+2023-12-05 20:06:55,109 - Epoch: [36][ 9700/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525867    
+2023-12-05 20:07:47,593 - Epoch: [36][ 9800/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525856    
+2023-12-05 20:08:40,108 - Epoch: [36][ 9900/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000063    Time 0.525849    
+2023-12-05 20:09:32,627 - Epoch: [36][10000/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525842    
+2023-12-05 20:10:25,118 - Epoch: [36][10100/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525832    
+2023-12-05 20:11:17,668 - Epoch: [36][10200/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525829    
+2023-12-05 20:12:10,200 - Epoch: [36][10300/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525823    
+2023-12-05 20:13:02,637 - Epoch: [36][10400/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525809    
+2023-12-05 20:13:55,100 - Epoch: [36][10500/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525797    
+2023-12-05 20:14:47,487 - Epoch: [36][10600/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525779    
+2023-12-05 20:15:39,851 - Epoch: [36][10700/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525759    
+2023-12-05 20:16:32,320 - Epoch: [36][10800/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525748    
+2023-12-05 20:17:24,802 - Epoch: [36][10900/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525740    
+2023-12-05 20:18:17,374 - Epoch: [36][11000/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525739    
+2023-12-05 20:19:09,824 - Epoch: [36][11100/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525728    
+2023-12-05 20:20:02,373 - Epoch: [36][11200/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525725    
+2023-12-05 20:20:54,806 - Epoch: [36][11300/12168]    Overall Loss 0.013636    Objective Loss 0.000000    Distill Loss 0.013636                                        LR 0.000063    Time 0.525713    
+2023-12-05 20:21:47,193 - Epoch: [36][11400/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525696    
+2023-12-05 20:22:39,671 - Epoch: [36][11500/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525688    
+2023-12-05 20:23:32,146 - Epoch: [36][11600/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525679    
+2023-12-05 20:24:24,628 - Epoch: [36][11700/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525672    
+2023-12-05 20:25:17,075 - Epoch: [36][11800/12168]    Overall Loss 0.013638    Objective Loss 0.000000    Distill Loss 0.013638                                        LR 0.000063    Time 0.525661    
+2023-12-05 20:26:09,584 - Epoch: [36][11900/12168]    Overall Loss 0.013638    Objective Loss 0.000000    Distill Loss 0.013638                                        LR 0.000063    Time 0.525656    
+2023-12-05 20:27:02,128 - Epoch: [36][12000/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525654    
+2023-12-05 20:27:54,589 - Epoch: [36][12100/12168]    Overall Loss 0.013638    Objective Loss 0.000000    Distill Loss 0.013638                                        LR 0.000063    Time 0.525645    
+2023-12-05 20:28:30,310 - Epoch: [36][12168/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000063    Time 0.525643    
+2023-12-05 20:28:30,667 - --- validate (epoch=36)-----------
+2023-12-05 20:28:30,667 - 167951 samples (256 per mini-batch)
+2023-12-05 20:29:21,666 - Epoch: [36][  100/  657]    Loss 0.000000    Overall Loss 0.014199    
+2023-12-05 20:30:10,335 - Epoch: [36][  200/  657]    Loss 0.000000    Overall Loss 0.014224    
+2023-12-05 20:30:58,947 - Epoch: [36][  300/  657]    Loss 0.000000    Overall Loss 0.014227    
+2023-12-05 20:31:47,558 - Epoch: [36][  400/  657]    Loss 0.000000    Overall Loss 0.014226    
+2023-12-05 20:32:36,186 - Epoch: [36][  500/  657]    Loss 0.000000    Overall Loss 0.014230    
+2023-12-05 20:33:24,781 - Epoch: [36][  600/  657]    Loss 0.000000    Overall Loss 0.014236    
+2023-12-05 20:33:52,046 - Epoch: [36][  657/  657]    Loss 0.000000    Overall Loss 0.014237    
+2023-12-05 20:33:52,233 - ==> Overall Loss: 0.014
+
+2023-12-05 20:33:52,235 - ==> Best [Overall Loss: 0.014227 on epoch: 35]
+2023-12-05 20:33:52,235 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 20:33:52,255 - 
+
+2023-12-05 20:33:52,255 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 20:34:53,980 - Epoch: [37][  100/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.617205    
+2023-12-05 20:35:46,489 - Epoch: [37][  200/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.571131    
+2023-12-05 20:36:39,023 - Epoch: [37][  300/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.555855    
+2023-12-05 20:37:31,401 - Epoch: [37][  400/12168]    Overall Loss 0.013592    Objective Loss 0.000000    Distill Loss 0.013592                                        LR 0.000063    Time 0.547827    
+2023-12-05 20:38:23,853 - Epoch: [37][  500/12168]    Overall Loss 0.013598    Objective Loss 0.000000    Distill Loss 0.013598                                        LR 0.000063    Time 0.543160    
+2023-12-05 20:39:16,262 - Epoch: [37][  600/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.539975    
+2023-12-05 20:40:08,689 - Epoch: [37][  700/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000063    Time 0.537728    
+2023-12-05 20:41:01,091 - Epoch: [37][  800/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000063    Time 0.536009    
+2023-12-05 20:41:53,532 - Epoch: [37][  900/12168]    Overall Loss 0.013603    Objective Loss 0.000000    Distill Loss 0.013603                                        LR 0.000063    Time 0.534717    
+2023-12-05 20:42:45,995 - Epoch: [37][ 1000/12168]    Overall Loss 0.013615    Objective Loss 0.000000    Distill Loss 0.013615                                        LR 0.000063    Time 0.533705    
+2023-12-05 20:43:38,470 - Epoch: [37][ 1100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.532887    
+2023-12-05 20:44:30,982 - Epoch: [37][ 1200/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.532237    
+2023-12-05 20:45:23,452 - Epoch: [37][ 1300/12168]    Overall Loss 0.013605    Objective Loss 0.000000    Distill Loss 0.013605                                        LR 0.000063    Time 0.531654    
+2023-12-05 20:46:15,836 - Epoch: [37][ 1400/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.531094    
+2023-12-05 20:47:08,238 - Epoch: [37][ 1500/12168]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                                        LR 0.000063    Time 0.530620    
+2023-12-05 20:48:00,645 - Epoch: [37][ 1600/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.530209    
+2023-12-05 20:48:53,050 - Epoch: [37][ 1700/12168]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                                        LR 0.000063    Time 0.529845    
+2023-12-05 20:49:45,472 - Epoch: [37][ 1800/12168]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                                        LR 0.000063    Time 0.529531    
+2023-12-05 20:50:37,894 - Epoch: [37][ 1900/12168]    Overall Loss 0.013615    Objective Loss 0.000000    Distill Loss 0.013615                                        LR 0.000063    Time 0.529249    
+2023-12-05 20:51:30,273 - Epoch: [37][ 2000/12168]    Overall Loss 0.013616    Objective Loss 0.000000    Distill Loss 0.013616                                        LR 0.000063    Time 0.528974    
+2023-12-05 20:52:22,761 - Epoch: [37][ 2100/12168]    Overall Loss 0.013620    Objective Loss 0.000000    Distill Loss 0.013620                                        LR 0.000063    Time 0.528778    
+2023-12-05 20:53:15,241 - Epoch: [37][ 2200/12168]    Overall Loss 0.013623    Objective Loss 0.000000    Distill Loss 0.013623                                        LR 0.000063    Time 0.528595    
+2023-12-05 20:54:07,674 - Epoch: [37][ 2300/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.000063    Time 0.528409    
+2023-12-05 20:55:00,083 - Epoch: [37][ 2400/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.000063    Time 0.528227    
+2023-12-05 20:55:52,579 - Epoch: [37][ 2500/12168]    Overall Loss 0.013617    Objective Loss 0.000000    Distill Loss 0.013617                                        LR 0.000063    Time 0.528095    
+2023-12-05 20:56:44,996 - Epoch: [37][ 2600/12168]    Overall Loss 0.013617    Objective Loss 0.000000    Distill Loss 0.013617                                        LR 0.000063    Time 0.527943    
+2023-12-05 20:57:37,431 - Epoch: [37][ 2700/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.000063    Time 0.527809    
+2023-12-05 20:58:29,919 - Epoch: [37][ 2800/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.000063    Time 0.527703    
+2023-12-05 20:59:22,406 - Epoch: [37][ 2900/12168]    Overall Loss 0.013619    Objective Loss 0.000000    Distill Loss 0.013619                                        LR 0.000063    Time 0.527604    
+2023-12-05 21:00:14,848 - Epoch: [37][ 3000/12168]    Overall Loss 0.013619    Objective Loss 0.000000    Distill Loss 0.013619                                        LR 0.000063    Time 0.527497    
+2023-12-05 21:01:07,218 - Epoch: [37][ 3100/12168]    Overall Loss 0.013615    Objective Loss 0.000000    Distill Loss 0.013615                                        LR 0.000063    Time 0.527373    
+2023-12-05 21:01:59,653 - Epoch: [37][ 3200/12168]    Overall Loss 0.013615    Objective Loss 0.000000    Distill Loss 0.013615                                        LR 0.000063    Time 0.527277    
+2023-12-05 21:02:52,117 - Epoch: [37][ 3300/12168]    Overall Loss 0.013614    Objective Loss 0.000000    Distill Loss 0.013614                                        LR 0.000063    Time 0.527196    
+2023-12-05 21:03:44,531 - Epoch: [37][ 3400/12168]    Overall Loss 0.013614    Objective Loss 0.000000    Distill Loss 0.013614                                        LR 0.000063    Time 0.527106    
+2023-12-05 21:04:36,990 - Epoch: [37][ 3500/12168]    Overall Loss 0.013616    Objective Loss 0.000000    Distill Loss 0.013616                                        LR 0.000063    Time 0.527033    
+2023-12-05 21:05:29,489 - Epoch: [37][ 3600/12168]    Overall Loss 0.013615    Objective Loss 0.000000    Distill Loss 0.013615                                        LR 0.000063    Time 0.526975    
+2023-12-05 21:06:21,906 - Epoch: [37][ 3700/12168]    Overall Loss 0.013614    Objective Loss 0.000000    Distill Loss 0.013614                                        LR 0.000063    Time 0.526898    
+2023-12-05 21:07:14,410 - Epoch: [37][ 3800/12168]    Overall Loss 0.013614    Objective Loss 0.000000    Distill Loss 0.013614                                        LR 0.000063    Time 0.526848    
+2023-12-05 21:08:06,905 - Epoch: [37][ 3900/12168]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                                        LR 0.000063    Time 0.526799    
+2023-12-05 21:08:59,309 - Epoch: [37][ 4000/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.526729    
+2023-12-05 21:09:51,753 - Epoch: [37][ 4100/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.526672    
+2023-12-05 21:10:44,269 - Epoch: [37][ 4200/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.526635    
+2023-12-05 21:11:36,718 - Epoch: [37][ 4300/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.526585    
+2023-12-05 21:12:29,161 - Epoch: [37][ 4400/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.526535    
+2023-12-05 21:13:21,648 - Epoch: [37][ 4500/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.526497    
+2023-12-05 21:14:14,063 - Epoch: [37][ 4600/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.526445    
+2023-12-05 21:15:06,502 - Epoch: [37][ 4700/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.526401    
+2023-12-05 21:15:58,912 - Epoch: [37][ 4800/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.526352    
+2023-12-05 21:16:51,378 - Epoch: [37][ 4900/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.526317    
+2023-12-05 21:17:43,958 - Epoch: [37][ 5000/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.526306    
+2023-12-05 21:18:36,434 - Epoch: [37][ 5100/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.526275    
+2023-12-05 21:19:28,890 - Epoch: [37][ 5200/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.526242    
+2023-12-05 21:20:21,433 - Epoch: [37][ 5300/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.526225    
+2023-12-05 21:21:13,839 - Epoch: [37][ 5400/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.526185    
+2023-12-05 21:22:06,285 - Epoch: [37][ 5500/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.526153    
+2023-12-05 21:22:58,742 - Epoch: [37][ 5600/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.526124    
+2023-12-05 21:23:51,217 - Epoch: [37][ 5700/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.526099    
+2023-12-05 21:24:43,617 - Epoch: [37][ 5800/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.526062    
+2023-12-05 21:25:36,005 - Epoch: [37][ 5900/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.526025    
+2023-12-05 21:26:28,437 - Epoch: [37][ 6000/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525996    
+2023-12-05 21:27:20,862 - Epoch: [37][ 6100/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.525967    
+2023-12-05 21:28:13,224 - Epoch: [37][ 6200/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525928    
+2023-12-05 21:29:05,612 - Epoch: [37][ 6300/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525895    
+2023-12-05 21:29:57,978 - Epoch: [37][ 6400/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525860    
+2023-12-05 21:30:50,400 - Epoch: [37][ 6500/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525834    
+2023-12-05 21:31:42,841 - Epoch: [37][ 6600/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.525812    
+2023-12-05 21:32:35,363 - Epoch: [37][ 6700/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.525803    
+2023-12-05 21:33:27,785 - Epoch: [37][ 6800/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.525779    
+2023-12-05 21:34:20,247 - Epoch: [37][ 6900/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.525762    
+2023-12-05 21:35:12,670 - Epoch: [37][ 7000/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.525739    
+2023-12-05 21:36:05,131 - Epoch: [37][ 7100/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.525723    
+2023-12-05 21:36:57,566 - Epoch: [37][ 7200/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.525703    
+2023-12-05 21:37:49,987 - Epoch: [37][ 7300/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.525682    
+2023-12-05 21:38:42,394 - Epoch: [37][ 7400/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.525660    
+2023-12-05 21:39:34,800 - Epoch: [37][ 7500/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.525639    
+2023-12-05 21:40:27,289 - Epoch: [37][ 7600/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000063    Time 0.525628    
+2023-12-05 21:41:19,712 - Epoch: [37][ 7700/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525610    
+2023-12-05 21:42:12,103 - Epoch: [37][ 7800/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525587    
+2023-12-05 21:43:04,555 - Epoch: [37][ 7900/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525573    
+2023-12-05 21:43:56,963 - Epoch: [37][ 8000/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525554    
+2023-12-05 21:44:49,482 - Epoch: [37][ 8100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525549    
+2023-12-05 21:45:41,876 - Epoch: [37][ 8200/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525529    
+2023-12-05 21:46:34,323 - Epoch: [37][ 8300/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525516    
+2023-12-05 21:47:26,823 - Epoch: [37][ 8400/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525510    
+2023-12-05 21:48:19,219 - Epoch: [37][ 8500/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525491    
+2023-12-05 21:49:11,610 - Epoch: [37][ 8600/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525472    
+2023-12-05 21:50:04,041 - Epoch: [37][ 8700/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525459    
+2023-12-05 21:50:56,472 - Epoch: [37][ 8800/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525445    
+2023-12-05 21:51:48,873 - Epoch: [37][ 8900/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525429    
+2023-12-05 21:52:41,236 - Epoch: [37][ 9000/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525408    
+2023-12-05 21:53:33,662 - Epoch: [37][ 9100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525395    
+2023-12-05 21:54:26,055 - Epoch: [37][ 9200/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525379    
+2023-12-05 21:55:18,495 - Epoch: [37][ 9300/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525368    
+2023-12-05 21:56:10,994 - Epoch: [37][ 9400/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525364    
+2023-12-05 21:57:03,435 - Epoch: [37][ 9500/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525353    
+2023-12-05 21:57:55,866 - Epoch: [37][ 9600/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525342    
+2023-12-05 21:58:48,272 - Epoch: [37][ 9700/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525329    
+2023-12-05 21:59:40,659 - Epoch: [37][ 9800/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525313    
+2023-12-05 22:00:33,135 - Epoch: [37][ 9900/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525307    
+2023-12-05 22:01:25,632 - Epoch: [37][10000/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000063    Time 0.525304    
+2023-12-05 22:02:18,057 - Epoch: [37][10100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525293    
+2023-12-05 22:03:10,476 - Epoch: [37][10200/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525282    
+2023-12-05 22:04:02,888 - Epoch: [37][10300/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525270    
+2023-12-05 22:04:55,357 - Epoch: [37][10400/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525264    
+2023-12-05 22:05:47,797 - Epoch: [37][10500/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525256    
+2023-12-05 22:06:40,180 - Epoch: [37][10600/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525242    
+2023-12-05 22:07:32,699 - Epoch: [37][10700/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525241    
+2023-12-05 22:08:25,132 - Epoch: [37][10800/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525232    
+2023-12-05 22:09:17,556 - Epoch: [37][10900/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525223    
+2023-12-05 22:10:10,012 - Epoch: [37][11000/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525217    
+2023-12-05 22:11:02,424 - Epoch: [37][11100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525206    
+2023-12-05 22:11:54,908 - Epoch: [37][11200/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525203    
+2023-12-05 22:12:47,380 - Epoch: [37][11300/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525198    
+2023-12-05 22:13:39,838 - Epoch: [37][11400/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525193    
+2023-12-05 22:14:32,319 - Epoch: [37][11500/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525189    
+2023-12-05 22:15:24,797 - Epoch: [37][11600/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525185    
+2023-12-05 22:16:17,307 - Epoch: [37][11700/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525184    
+2023-12-05 22:17:09,764 - Epoch: [37][11800/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525179    
+2023-12-05 22:18:02,311 - Epoch: [37][11900/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000063    Time 0.525181    
+2023-12-05 22:18:54,732 - Epoch: [37][12000/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525172    
+2023-12-05 22:19:47,164 - Epoch: [37][12100/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525165    
+2023-12-05 22:20:22,855 - Epoch: [37][12168/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000063    Time 0.525163    
+2023-12-05 22:20:23,232 - --- validate (epoch=37)-----------
+2023-12-05 22:20:23,232 - 167951 samples (256 per mini-batch)
+2023-12-05 22:21:13,972 - Epoch: [37][  100/  657]    Loss 0.000000    Overall Loss 0.014165    
+2023-12-05 22:22:02,536 - Epoch: [37][  200/  657]    Loss 0.000000    Overall Loss 0.014176    
+2023-12-05 22:22:51,091 - Epoch: [37][  300/  657]    Loss 0.000000    Overall Loss 0.014150    
+2023-12-05 22:23:39,683 - Epoch: [37][  400/  657]    Loss 0.000000    Overall Loss 0.014144    
+2023-12-05 22:24:28,243 - Epoch: [37][  500/  657]    Loss 0.000000    Overall Loss 0.014145    
+2023-12-05 22:25:16,779 - Epoch: [37][  600/  657]    Loss 0.000000    Overall Loss 0.014143    
+2023-12-05 22:25:44,003 - Epoch: [37][  657/  657]    Loss 0.000000    Overall Loss 0.014140    
+2023-12-05 22:25:44,197 - ==> Overall Loss: 0.014
+
+2023-12-05 22:25:44,199 - ==> Best [Overall Loss: 0.014140 on epoch: 37]
+2023-12-05 22:25:44,199 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-05 22:25:44,225 - 
+
+2023-12-05 22:25:44,226 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-05 22:26:47,252 - Epoch: [38][  100/12168]    Overall Loss 0.013533    Objective Loss 0.000000    Distill Loss 0.013533                                        LR 0.000063    Time 0.630225    
+2023-12-05 22:27:39,587 - Epoch: [38][  200/12168]    Overall Loss 0.013540    Objective Loss 0.000000    Distill Loss 0.013540                                        LR 0.000063    Time 0.576768    
+2023-12-05 22:28:31,987 - Epoch: [38][  300/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.559168    
+2023-12-05 22:29:24,358 - Epoch: [38][  400/12168]    Overall Loss 0.013555    Objective Loss 0.000000    Distill Loss 0.013555                                        LR 0.000063    Time 0.550295    
+2023-12-05 22:30:16,809 - Epoch: [38][  500/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.545122    
+2023-12-05 22:31:09,149 - Epoch: [38][  600/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.541497    
+2023-12-05 22:32:01,521 - Epoch: [38][  700/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.538952    
+2023-12-05 22:32:53,954 - Epoch: [38][  800/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.537119    
+2023-12-05 22:33:46,370 - Epoch: [38][  900/12168]    Overall Loss 0.013567    Objective Loss 0.000000    Distill Loss 0.013567                                        LR 0.000063    Time 0.535676    
+2023-12-05 22:34:38,800 - Epoch: [38][ 1000/12168]    Overall Loss 0.013572    Objective Loss 0.000000    Distill Loss 0.013572                                        LR 0.000063    Time 0.534535    
+2023-12-05 22:35:31,151 - Epoch: [38][ 1100/12168]    Overall Loss 0.013574    Objective Loss 0.000000    Distill Loss 0.013574                                        LR 0.000063    Time 0.533530    
+2023-12-05 22:36:23,620 - Epoch: [38][ 1200/12168]    Overall Loss 0.013577    Objective Loss 0.000000    Distill Loss 0.013577                                        LR 0.000063    Time 0.532790    
+2023-12-05 22:37:15,976 - Epoch: [38][ 1300/12168]    Overall Loss 0.013581    Objective Loss 0.000000    Distill Loss 0.013581                                        LR 0.000063    Time 0.532078    
+2023-12-05 22:38:08,381 - Epoch: [38][ 1400/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.531502    
+2023-12-05 22:39:00,783 - Epoch: [38][ 1500/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.531001    
+2023-12-05 22:39:53,176 - Epoch: [38][ 1600/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.530557    
+2023-12-05 22:40:45,536 - Epoch: [38][ 1700/12168]    Overall Loss 0.013595    Objective Loss 0.000000    Distill Loss 0.013595                                        LR 0.000063    Time 0.530146    
+2023-12-05 22:41:37,982 - Epoch: [38][ 1800/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000063    Time 0.529828    
+2023-12-05 22:42:30,466 - Epoch: [38][ 1900/12168]    Overall Loss 0.013592    Objective Loss 0.000000    Distill Loss 0.013592                                        LR 0.000063    Time 0.529563    
+2023-12-05 22:43:22,926 - Epoch: [38][ 2000/12168]    Overall Loss 0.013593    Objective Loss 0.000000    Distill Loss 0.013593                                        LR 0.000063    Time 0.529314    
+2023-12-05 22:44:15,318 - Epoch: [38][ 2100/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000063    Time 0.529055    
+2023-12-05 22:45:07,798 - Epoch: [38][ 2200/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000063    Time 0.528860    
+2023-12-05 22:46:00,217 - Epoch: [38][ 2300/12168]    Overall Loss 0.013595    Objective Loss 0.000000    Distill Loss 0.013595                                        LR 0.000063    Time 0.528656    
+2023-12-05 22:46:52,681 - Epoch: [38][ 2400/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.528487    
+2023-12-05 22:47:45,111 - Epoch: [38][ 2500/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.528318    
+2023-12-05 22:48:37,535 - Epoch: [38][ 2600/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.528160    
+2023-12-05 22:49:29,920 - Epoch: [38][ 2700/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.527999    
+2023-12-05 22:50:22,360 - Epoch: [38][ 2800/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.527869    
+2023-12-05 22:51:14,758 - Epoch: [38][ 2900/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.527734    
+2023-12-05 22:52:07,161 - Epoch: [38][ 3000/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.527610    
+2023-12-05 22:52:59,526 - Epoch: [38][ 3100/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.527481    
+2023-12-05 22:53:51,949 - Epoch: [38][ 3200/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.527378    
+2023-12-05 22:54:44,326 - Epoch: [38][ 3300/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.527268    
+2023-12-05 22:55:36,727 - Epoch: [38][ 3400/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.527171    
+2023-12-05 22:56:29,147 - Epoch: [38][ 3500/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.527085    
+2023-12-05 22:57:21,570 - Epoch: [38][ 3600/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.527005    
+2023-12-05 22:58:14,000 - Epoch: [38][ 3700/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.526931    
+2023-12-05 22:59:06,396 - Epoch: [38][ 3800/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.526852    
+2023-12-05 22:59:58,773 - Epoch: [38][ 3900/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.526772    
+2023-12-05 23:00:51,110 - Epoch: [38][ 4000/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.526686    
+2023-12-05 23:01:43,525 - Epoch: [38][ 4100/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.526623    
+2023-12-05 23:02:35,962 - Epoch: [38][ 4200/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.526569    
+2023-12-05 23:03:28,342 - Epoch: [38][ 4300/12168]    Overall Loss 0.013581    Objective Loss 0.000000    Distill Loss 0.013581                                        LR 0.000063    Time 0.526504    
+2023-12-05 23:04:20,791 - Epoch: [38][ 4400/12168]    Overall Loss 0.013579    Objective Loss 0.000000    Distill Loss 0.013579                                        LR 0.000063    Time 0.526457    
+2023-12-05 23:05:13,230 - Epoch: [38][ 4500/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.526410    
+2023-12-05 23:06:05,611 - Epoch: [38][ 4600/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.526353    
+2023-12-05 23:06:58,102 - Epoch: [38][ 4700/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.526322    
+2023-12-05 23:07:50,453 - Epoch: [38][ 4800/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.526262    
+2023-12-05 23:08:42,868 - Epoch: [38][ 4900/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.526219    
+2023-12-05 23:09:35,254 - Epoch: [38][ 5000/12168]    Overall Loss 0.013581    Objective Loss 0.000000    Distill Loss 0.013581                                        LR 0.000063    Time 0.526171    
+2023-12-05 23:10:27,644 - Epoch: [38][ 5100/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.526126    
+2023-12-05 23:11:19,992 - Epoch: [38][ 5200/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.526074    
+2023-12-05 23:12:12,442 - Epoch: [38][ 5300/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.526044    
+2023-12-05 23:13:04,785 - Epoch: [38][ 5400/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525995    
+2023-12-05 23:13:57,224 - Epoch: [38][ 5500/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525965    
+2023-12-05 23:14:49,548 - Epoch: [38][ 5600/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525916    
+2023-12-05 23:15:41,928 - Epoch: [38][ 5700/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525878    
+2023-12-05 23:16:34,413 - Epoch: [38][ 5800/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525860    
+2023-12-05 23:17:26,763 - Epoch: [38][ 5900/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525819    
+2023-12-05 23:18:19,159 - Epoch: [38][ 6000/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525788    
+2023-12-05 23:19:11,556 - Epoch: [38][ 6100/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525757    
+2023-12-05 23:20:03,977 - Epoch: [38][ 6200/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525732    
+2023-12-05 23:20:56,372 - Epoch: [38][ 6300/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525703    
+2023-12-05 23:21:48,824 - Epoch: [38][ 6400/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525684    
+2023-12-05 23:22:41,211 - Epoch: [38][ 6500/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525656    
+2023-12-05 23:23:33,593 - Epoch: [38][ 6600/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525627    
+2023-12-05 23:24:25,976 - Epoch: [38][ 6700/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525600    
+2023-12-05 23:25:18,414 - Epoch: [38][ 6800/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525582    
+2023-12-05 23:26:10,760 - Epoch: [38][ 6900/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525550    
+2023-12-05 23:27:03,139 - Epoch: [38][ 7000/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525525    
+2023-12-05 23:27:55,544 - Epoch: [38][ 7100/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525504    
+2023-12-05 23:28:47,972 - Epoch: [38][ 7200/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525486    
+2023-12-05 23:29:40,344 - Epoch: [38][ 7300/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525461    
+2023-12-05 23:30:32,807 - Epoch: [38][ 7400/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525450    
+2023-12-05 23:31:25,190 - Epoch: [38][ 7500/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525428    
+2023-12-05 23:32:17,556 - Epoch: [38][ 7600/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525404    
+2023-12-05 23:33:10,011 - Epoch: [38][ 7700/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525392    
+2023-12-05 23:34:02,379 - Epoch: [38][ 7800/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.525370    
+2023-12-05 23:34:54,741 - Epoch: [38][ 7900/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525347    
+2023-12-05 23:35:47,116 - Epoch: [38][ 8000/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525327    
+2023-12-05 23:36:39,479 - Epoch: [38][ 8100/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525306    
+2023-12-05 23:37:31,867 - Epoch: [38][ 8200/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525288    
+2023-12-05 23:38:24,289 - Epoch: [38][ 8300/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525275    
+2023-12-05 23:39:16,669 - Epoch: [38][ 8400/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525257    
+2023-12-05 23:40:09,086 - Epoch: [38][ 8500/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525244    
+2023-12-05 23:41:01,523 - Epoch: [38][ 8600/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.525233    
+2023-12-05 23:41:53,969 - Epoch: [38][ 8700/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525224    
+2023-12-05 23:42:46,330 - Epoch: [38][ 8800/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525205    
+2023-12-05 23:43:38,661 - Epoch: [38][ 8900/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525183    
+2023-12-05 23:44:31,083 - Epoch: [38][ 9000/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.525172    
+2023-12-05 23:45:23,475 - Epoch: [38][ 9100/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525158    
+2023-12-05 23:46:15,851 - Epoch: [38][ 9200/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525143    
+2023-12-05 23:47:08,222 - Epoch: [38][ 9300/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525127    
+2023-12-05 23:48:00,663 - Epoch: [38][ 9400/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525119    
+2023-12-05 23:48:53,023 - Epoch: [38][ 9500/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525103    
+2023-12-05 23:49:45,430 - Epoch: [38][ 9600/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525091    
+2023-12-05 23:50:37,816 - Epoch: [38][ 9700/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525078    
+2023-12-05 23:51:30,173 - Epoch: [38][ 9800/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525063    
+2023-12-05 23:52:22,535 - Epoch: [38][ 9900/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.525048    
+2023-12-05 23:53:14,901 - Epoch: [38][10000/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525034    
+2023-12-05 23:54:07,334 - Epoch: [38][10100/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525026    
+2023-12-05 23:54:59,739 - Epoch: [38][10200/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525016    
+2023-12-05 23:55:52,139 - Epoch: [38][10300/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.525006    
+2023-12-05 23:56:44,537 - Epoch: [38][10400/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524996    
+2023-12-05 23:57:37,028 - Epoch: [38][10500/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524995    
+2023-12-05 23:58:29,379 - Epoch: [38][10600/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524980    
+2023-12-05 23:59:21,736 - Epoch: [38][10700/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524967    
+2023-12-06 00:00:14,099 - Epoch: [38][10800/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524954    
+2023-12-06 00:01:06,528 - Epoch: [38][10900/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524948    
+2023-12-06 00:01:58,939 - Epoch: [38][11000/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524940    
+2023-12-06 00:02:51,325 - Epoch: [38][11100/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524930    
+2023-12-06 00:03:43,693 - Epoch: [38][11200/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524918    
+2023-12-06 00:04:36,074 - Epoch: [38][11300/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524908    
+2023-12-06 00:05:28,512 - Epoch: [38][11400/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524903    
+2023-12-06 00:06:20,929 - Epoch: [38][11500/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524897    
+2023-12-06 00:07:13,397 - Epoch: [38][11600/12168]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                                        LR 0.000063    Time 0.524895    
+2023-12-06 00:08:05,867 - Epoch: [38][11700/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524893    
+2023-12-06 00:08:58,297 - Epoch: [38][11800/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524887    
+2023-12-06 00:09:50,776 - Epoch: [38][11900/12168]    Overall Loss 0.013590    Objective Loss 0.000000    Distill Loss 0.013590                                        LR 0.000063    Time 0.524886    
+2023-12-06 00:10:43,220 - Epoch: [38][12000/12168]    Overall Loss 0.013590    Objective Loss 0.000000    Distill Loss 0.013590                                        LR 0.000063    Time 0.524882    
+2023-12-06 00:11:35,664 - Epoch: [38][12100/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524878    
+2023-12-06 00:12:11,285 - Epoch: [38][12168/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.524872    
+2023-12-06 00:12:11,653 - --- validate (epoch=38)-----------
+2023-12-06 00:12:11,654 - 167951 samples (256 per mini-batch)
+2023-12-06 00:13:02,106 - Epoch: [38][  100/  657]    Loss 0.000000    Overall Loss 0.014494    
+2023-12-06 00:13:50,670 - Epoch: [38][  200/  657]    Loss 0.000000    Overall Loss 0.014461    
+2023-12-06 00:14:39,216 - Epoch: [38][  300/  657]    Loss 0.000000    Overall Loss 0.014467    
+2023-12-06 00:15:27,778 - Epoch: [38][  400/  657]    Loss 0.000000    Overall Loss 0.014469    
+2023-12-06 00:16:16,312 - Epoch: [38][  500/  657]    Loss 0.000000    Overall Loss 0.014469    
+2023-12-06 00:17:04,873 - Epoch: [38][  600/  657]    Loss 0.000000    Overall Loss 0.014466    
+2023-12-06 00:17:32,104 - Epoch: [38][  657/  657]    Loss 0.000000    Overall Loss 0.014462    
+2023-12-06 00:17:32,303 - ==> Overall Loss: 0.014
+
+2023-12-06 00:17:32,305 - ==> Best [Overall Loss: 0.014140 on epoch: 37]
+2023-12-06 00:17:32,305 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 00:17:32,326 - 
+
+2023-12-06 00:17:32,326 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 00:18:33,986 - Epoch: [39][  100/12168]    Overall Loss 0.013648    Objective Loss 0.000000    Distill Loss 0.013648                                        LR 0.000063    Time 0.616562    
+2023-12-06 00:19:26,338 - Epoch: [39][  200/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000063    Time 0.570025    
+2023-12-06 00:20:18,738 - Epoch: [39][  300/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000063    Time 0.554671    
+2023-12-06 00:21:11,121 - Epoch: [39][  400/12168]    Overall Loss 0.013602    Objective Loss 0.000000    Distill Loss 0.013602                                        LR 0.000063    Time 0.546952    
+2023-12-06 00:22:03,488 - Epoch: [39][  500/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.542289    
+2023-12-06 00:22:55,827 - Epoch: [39][  600/12168]    Overall Loss 0.013589    Objective Loss 0.000000    Distill Loss 0.013589                                        LR 0.000063    Time 0.539134    
+2023-12-06 00:23:48,248 - Epoch: [39][  700/12168]    Overall Loss 0.013590    Objective Loss 0.000000    Distill Loss 0.013590                                        LR 0.000063    Time 0.536997    
+2023-12-06 00:24:40,604 - Epoch: [39][  800/12168]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                                        LR 0.000063    Time 0.535313    
+2023-12-06 00:25:33,018 - Epoch: [39][  900/12168]    Overall Loss 0.013587    Objective Loss 0.000000    Distill Loss 0.013587                                        LR 0.000063    Time 0.534068    
+2023-12-06 00:26:25,381 - Epoch: [39][ 1000/12168]    Overall Loss 0.013590    Objective Loss 0.000000    Distill Loss 0.013590                                        LR 0.000063    Time 0.533021    
+2023-12-06 00:27:17,778 - Epoch: [39][ 1100/12168]    Overall Loss 0.013591    Objective Loss 0.000000    Distill Loss 0.013591                                        LR 0.000063    Time 0.532195    
+2023-12-06 00:28:10,236 - Epoch: [39][ 1200/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.531557    
+2023-12-06 00:29:02,635 - Epoch: [39][ 1300/12168]    Overall Loss 0.013580    Objective Loss 0.000000    Distill Loss 0.013580                                        LR 0.000063    Time 0.530972    
+2023-12-06 00:29:55,013 - Epoch: [39][ 1400/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.530457    
+2023-12-06 00:30:47,388 - Epoch: [39][ 1500/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.530007    
+2023-12-06 00:31:39,768 - Epoch: [39][ 1600/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.529617    
+2023-12-06 00:32:32,182 - Epoch: [39][ 1700/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.529293    
+2023-12-06 00:33:24,606 - Epoch: [39][ 1800/12168]    Overall Loss 0.013584    Objective Loss 0.000000    Distill Loss 0.013584                                        LR 0.000063    Time 0.529011    
+2023-12-06 00:34:17,088 - Epoch: [39][ 1900/12168]    Overall Loss 0.013586    Objective Loss 0.000000    Distill Loss 0.013586                                        LR 0.000063    Time 0.528788    
+2023-12-06 00:35:09,435 - Epoch: [39][ 2000/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.528520    
+2023-12-06 00:36:01,835 - Epoch: [39][ 2100/12168]    Overall Loss 0.013583    Objective Loss 0.000000    Distill Loss 0.013583                                        LR 0.000063    Time 0.528303    
+2023-12-06 00:36:54,222 - Epoch: [39][ 2200/12168]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                                        LR 0.000063    Time 0.528100    
+2023-12-06 00:37:46,550 - Epoch: [39][ 2300/12168]    Overall Loss 0.013579    Objective Loss 0.000000    Distill Loss 0.013579                                        LR 0.000063    Time 0.527889    
+2023-12-06 00:38:38,934 - Epoch: [39][ 2400/12168]    Overall Loss 0.013575    Objective Loss 0.000000    Distill Loss 0.013575                                        LR 0.000063    Time 0.527719    
+2023-12-06 00:39:31,344 - Epoch: [39][ 2500/12168]    Overall Loss 0.013572    Objective Loss 0.000000    Distill Loss 0.013572                                        LR 0.000063    Time 0.527573    
+2023-12-06 00:40:23,709 - Epoch: [39][ 2600/12168]    Overall Loss 0.013570    Objective Loss 0.000000    Distill Loss 0.013570                                        LR 0.000063    Time 0.527421    
+2023-12-06 00:41:16,097 - Epoch: [39][ 2700/12168]    Overall Loss 0.013569    Objective Loss 0.000000    Distill Loss 0.013569                                        LR 0.000063    Time 0.527289    
+2023-12-06 00:42:08,504 - Epoch: [39][ 2800/12168]    Overall Loss 0.013570    Objective Loss 0.000000    Distill Loss 0.013570                                        LR 0.000063    Time 0.527172    
+2023-12-06 00:43:00,924 - Epoch: [39][ 2900/12168]    Overall Loss 0.013569    Objective Loss 0.000000    Distill Loss 0.013569                                        LR 0.000063    Time 0.527069    
+2023-12-06 00:43:53,340 - Epoch: [39][ 3000/12168]    Overall Loss 0.013569    Objective Loss 0.000000    Distill Loss 0.013569                                        LR 0.000063    Time 0.526971    
+2023-12-06 00:44:45,669 - Epoch: [39][ 3100/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.526851    
+2023-12-06 00:45:38,075 - Epoch: [39][ 3200/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.526762    
+2023-12-06 00:46:30,426 - Epoch: [39][ 3300/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.526663    
+2023-12-06 00:47:22,806 - Epoch: [39][ 3400/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.526578    
+2023-12-06 00:48:15,181 - Epoch: [39][ 3500/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.526496    
+2023-12-06 00:49:07,654 - Epoch: [39][ 3600/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.526446    
+2023-12-06 00:50:00,032 - Epoch: [39][ 3700/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.526373    
+2023-12-06 00:50:52,492 - Epoch: [39][ 3800/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.526325    
+2023-12-06 00:51:44,906 - Epoch: [39][ 3900/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.526269    
+2023-12-06 00:52:37,293 - Epoch: [39][ 4000/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.526208    
+2023-12-06 00:53:29,648 - Epoch: [39][ 4100/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.526142    
+2023-12-06 00:54:22,041 - Epoch: [39][ 4200/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.526089    
+2023-12-06 00:55:14,385 - Epoch: [39][ 4300/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.526026    
+2023-12-06 00:56:06,765 - Epoch: [39][ 4400/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525975    
+2023-12-06 00:56:59,105 - Epoch: [39][ 4500/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.525917    
+2023-12-06 00:57:51,450 - Epoch: [39][ 4600/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.525863    
+2023-12-06 00:58:43,751 - Epoch: [39][ 4700/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.525801    
+2023-12-06 00:59:36,116 - Epoch: [39][ 4800/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525756    
+2023-12-06 01:00:28,528 - Epoch: [39][ 4900/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.525722    
+2023-12-06 01:01:20,892 - Epoch: [39][ 5000/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525679    
+2023-12-06 01:02:13,222 - Epoch: [39][ 5100/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525632    
+2023-12-06 01:03:05,588 - Epoch: [39][ 5200/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525593    
+2023-12-06 01:03:57,965 - Epoch: [39][ 5300/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525558    
+2023-12-06 01:04:50,371 - Epoch: [39][ 5400/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525530    
+2023-12-06 01:05:42,739 - Epoch: [39][ 5500/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525496    
+2023-12-06 01:06:35,079 - Epoch: [39][ 5600/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.525458    
+2023-12-06 01:07:27,428 - Epoch: [39][ 5700/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525423    
+2023-12-06 01:08:19,783 - Epoch: [39][ 5800/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525390    
+2023-12-06 01:09:12,125 - Epoch: [39][ 5900/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525356    
+2023-12-06 01:10:04,567 - Epoch: [39][ 6000/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.525340    
+2023-12-06 01:10:56,966 - Epoch: [39][ 6100/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.525317    
+2023-12-06 01:11:49,351 - Epoch: [39][ 6200/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525293    
+2023-12-06 01:12:41,705 - Epoch: [39][ 6300/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.525265    
+2023-12-06 01:13:34,075 - Epoch: [39][ 6400/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525240    
+2023-12-06 01:14:26,523 - Epoch: [39][ 6500/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525227    
+2023-12-06 01:15:18,925 - Epoch: [39][ 6600/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525209    
+2023-12-06 01:16:11,256 - Epoch: [39][ 6700/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.525180    
+2023-12-06 01:17:03,604 - Epoch: [39][ 6800/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.525154    
+2023-12-06 01:17:55,975 - Epoch: [39][ 6900/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.525133    
+2023-12-06 01:18:48,317 - Epoch: [39][ 7000/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525108    
+2023-12-06 01:19:40,709 - Epoch: [39][ 7100/12168]    Overall Loss 0.013558    Objective Loss 0.000000    Distill Loss 0.013558                                        LR 0.000063    Time 0.525091    
+2023-12-06 01:20:33,080 - Epoch: [39][ 7200/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525071    
+2023-12-06 01:21:25,586 - Epoch: [39][ 7300/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525070    
+2023-12-06 01:22:18,029 - Epoch: [39][ 7400/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525061    
+2023-12-06 01:23:10,397 - Epoch: [39][ 7500/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525042    
+2023-12-06 01:24:02,817 - Epoch: [39][ 7600/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525030    
+2023-12-06 01:24:55,236 - Epoch: [39][ 7700/12168]    Overall Loss 0.013559    Objective Loss 0.000000    Distill Loss 0.013559                                        LR 0.000063    Time 0.525019    
+2023-12-06 01:25:47,658 - Epoch: [39][ 7800/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.525008    
+2023-12-06 01:26:40,053 - Epoch: [39][ 7900/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524994    
+2023-12-06 01:27:32,472 - Epoch: [39][ 8000/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524984    
+2023-12-06 01:28:24,789 - Epoch: [39][ 8100/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524961    
+2023-12-06 01:29:17,165 - Epoch: [39][ 8200/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524946    
+2023-12-06 01:30:09,595 - Epoch: [39][ 8300/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524938    
+2023-12-06 01:31:02,035 - Epoch: [39][ 8400/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524931    
+2023-12-06 01:31:54,429 - Epoch: [39][ 8500/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524919    
+2023-12-06 01:32:46,914 - Epoch: [39][ 8600/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524918    
+2023-12-06 01:33:39,375 - Epoch: [39][ 8700/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524914    
+2023-12-06 01:34:31,740 - Epoch: [39][ 8800/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524899    
+2023-12-06 01:35:24,171 - Epoch: [39][ 8900/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524892    
+2023-12-06 01:36:16,533 - Epoch: [39][ 9000/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524878    
+2023-12-06 01:37:08,903 - Epoch: [39][ 9100/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524864    
+2023-12-06 01:38:01,266 - Epoch: [39][ 9200/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524851    
+2023-12-06 01:38:53,644 - Epoch: [39][ 9300/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524839    
+2023-12-06 01:39:46,061 - Epoch: [39][ 9400/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524831    
+2023-12-06 01:40:38,485 - Epoch: [39][ 9500/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524825    
+2023-12-06 01:41:30,882 - Epoch: [39][ 9600/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524815    
+2023-12-06 01:42:23,206 - Epoch: [39][ 9700/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524799    
+2023-12-06 01:43:15,664 - Epoch: [39][ 9800/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524796    
+2023-12-06 01:44:08,081 - Epoch: [39][ 9900/12168]    Overall Loss 0.013560    Objective Loss 0.000000    Distill Loss 0.013560                                        LR 0.000063    Time 0.524790    
+2023-12-06 01:45:00,452 - Epoch: [39][10000/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524778    
+2023-12-06 01:45:52,862 - Epoch: [39][10100/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524771    
+2023-12-06 01:46:45,302 - Epoch: [39][10200/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524767    
+2023-12-06 01:47:37,667 - Epoch: [39][10300/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524756    
+2023-12-06 01:48:30,089 - Epoch: [39][10400/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524751    
+2023-12-06 01:49:22,513 - Epoch: [39][10500/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524746    
+2023-12-06 01:50:14,875 - Epoch: [39][10600/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524735    
+2023-12-06 01:51:07,234 - Epoch: [39][10700/12168]    Overall Loss 0.013561    Objective Loss 0.000000    Distill Loss 0.013561                                        LR 0.000063    Time 0.524724    
+2023-12-06 01:51:59,660 - Epoch: [39][10800/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524719    
+2023-12-06 01:52:52,050 - Epoch: [39][10900/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524711    
+2023-12-06 01:53:44,502 - Epoch: [39][11000/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524709    
+2023-12-06 01:54:36,874 - Epoch: [39][11100/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524700    
+2023-12-06 01:55:29,260 - Epoch: [39][11200/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524692    
+2023-12-06 01:56:21,683 - Epoch: [39][11300/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.524688    
+2023-12-06 01:57:14,063 - Epoch: [39][11400/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.524680    
+2023-12-06 01:58:06,542 - Epoch: [39][11500/12168]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                                        LR 0.000063    Time 0.524680    
+2023-12-06 01:58:58,917 - Epoch: [39][11600/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.524672    
+2023-12-06 01:59:51,352 - Epoch: [39][11700/12168]    Overall Loss 0.013563    Objective Loss 0.000000    Distill Loss 0.013563                                        LR 0.000063    Time 0.524669    
+2023-12-06 02:00:43,671 - Epoch: [39][11800/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.524656    
+2023-12-06 02:01:35,999 - Epoch: [39][11900/12168]    Overall Loss 0.013564    Objective Loss 0.000000    Distill Loss 0.013564                                        LR 0.000063    Time 0.524644    
+2023-12-06 02:02:28,343 - Epoch: [39][12000/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.524634    
+2023-12-06 02:03:20,794 - Epoch: [39][12100/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.524633    
+2023-12-06 02:03:56,398 - Epoch: [39][12168/12168]    Overall Loss 0.013565    Objective Loss 0.000000    Distill Loss 0.013565                                        LR 0.000063    Time 0.524627    
+2023-12-06 02:03:56,804 - --- validate (epoch=39)-----------
+2023-12-06 02:03:56,805 - 167951 samples (256 per mini-batch)
+2023-12-06 02:04:47,168 - Epoch: [39][  100/  657]    Loss 0.000000    Overall Loss 0.014314    
+2023-12-06 02:05:35,752 - Epoch: [39][  200/  657]    Loss 0.000000    Overall Loss 0.014303    
+2023-12-06 02:06:24,325 - Epoch: [39][  300/  657]    Loss 0.000000    Overall Loss 0.014278    
+2023-12-06 02:07:12,839 - Epoch: [39][  400/  657]    Loss 0.000000    Overall Loss 0.014261    
+2023-12-06 02:08:01,403 - Epoch: [39][  500/  657]    Loss 0.000000    Overall Loss 0.014267    
+2023-12-06 02:08:49,951 - Epoch: [39][  600/  657]    Loss 0.000000    Overall Loss 0.014267    
+2023-12-06 02:09:17,186 - Epoch: [39][  657/  657]    Loss 0.000000    Overall Loss 0.014266    
+2023-12-06 02:09:17,388 - ==> Overall Loss: 0.014
+
+2023-12-06 02:09:17,390 - ==> Best [Overall Loss: 0.014140 on epoch: 37]
+2023-12-06 02:09:17,391 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 02:09:17,411 - 
+
+2023-12-06 02:09:17,412 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 02:10:20,232 - Epoch: [40][  100/12168]    Overall Loss 0.013291    Objective Loss 0.000000    Distill Loss 0.013291                                        LR 0.000031    Time 0.628166    
+2023-12-06 02:11:12,599 - Epoch: [40][  200/12168]    Overall Loss 0.013282    Objective Loss 0.000000    Distill Loss 0.013282                                        LR 0.000031    Time 0.575901    
+2023-12-06 02:12:05,013 - Epoch: [40][  300/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000031    Time 0.558636    
+2023-12-06 02:12:57,308 - Epoch: [40][  400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000031    Time 0.549705    
+2023-12-06 02:13:49,661 - Epoch: [40][  500/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000031    Time 0.544464    
+2023-12-06 02:14:42,014 - Epoch: [40][  600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000031    Time 0.540971    
+2023-12-06 02:15:34,420 - Epoch: [40][  700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000031    Time 0.538549    
+2023-12-06 02:16:26,816 - Epoch: [40][  800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000031    Time 0.536722    
+2023-12-06 02:17:19,173 - Epoch: [40][  900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000031    Time 0.535257    
+2023-12-06 02:18:11,525 - Epoch: [40][ 1000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000031    Time 0.534080    
+2023-12-06 02:19:03,991 - Epoch: [40][ 1100/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000031    Time 0.533220    
+2023-12-06 02:19:56,402 - Epoch: [40][ 1200/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000031    Time 0.532459    
+2023-12-06 02:20:48,747 - Epoch: [40][ 1300/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000031    Time 0.531763    
+2023-12-06 02:21:41,113 - Epoch: [40][ 1400/12168]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                                        LR 0.000031    Time 0.531182    
+2023-12-06 02:22:33,433 - Epoch: [40][ 1500/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000031    Time 0.530648    
+2023-12-06 02:23:25,777 - Epoch: [40][ 1600/12168]    Overall Loss 0.013361    Objective Loss 0.000000    Distill Loss 0.013361                                        LR 0.000031    Time 0.530195    
+2023-12-06 02:24:18,116 - Epoch: [40][ 1700/12168]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                                        LR 0.000031    Time 0.529793    
+2023-12-06 02:25:10,479 - Epoch: [40][ 1800/12168]    Overall Loss 0.013363    Objective Loss 0.000000    Distill Loss 0.013363                                        LR 0.000031    Time 0.529449    
+2023-12-06 02:26:02,829 - Epoch: [40][ 1900/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000031    Time 0.529134    
+2023-12-06 02:26:55,244 - Epoch: [40][ 2000/12168]    Overall Loss 0.013360    Objective Loss 0.000000    Distill Loss 0.013360                                        LR 0.000031    Time 0.528883    
+2023-12-06 02:27:47,584 - Epoch: [40][ 2100/12168]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                                        LR 0.000031    Time 0.528620    
+2023-12-06 02:28:40,018 - Epoch: [40][ 2200/12168]    Overall Loss 0.013367    Objective Loss 0.000000    Distill Loss 0.013367                                        LR 0.000031    Time 0.528424    
+2023-12-06 02:29:32,441 - Epoch: [40][ 2300/12168]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                                        LR 0.000031    Time 0.528240    
+2023-12-06 02:30:24,843 - Epoch: [40][ 2400/12168]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                                        LR 0.000031    Time 0.528063    
+2023-12-06 02:31:17,166 - Epoch: [40][ 2500/12168]    Overall Loss 0.013360    Objective Loss 0.000000    Distill Loss 0.013360                                        LR 0.000031    Time 0.527869    
+2023-12-06 02:32:09,526 - Epoch: [40][ 2600/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.000031    Time 0.527703    
+2023-12-06 02:33:01,887 - Epoch: [40][ 2700/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000031    Time 0.527550    
+2023-12-06 02:33:54,291 - Epoch: [40][ 2800/12168]    Overall Loss 0.013360    Objective Loss 0.000000    Distill Loss 0.013360                                        LR 0.000031    Time 0.527424    
+2023-12-06 02:34:46,659 - Epoch: [40][ 2900/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000031    Time 0.527294    
+2023-12-06 02:35:39,019 - Epoch: [40][ 3000/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000031    Time 0.527169    
+2023-12-06 02:36:31,358 - Epoch: [40][ 3100/12168]    Overall Loss 0.013359    Objective Loss 0.000000    Distill Loss 0.013359                                        LR 0.000031    Time 0.527046    
+2023-12-06 02:37:23,800 - Epoch: [40][ 3200/12168]    Overall Loss 0.013359    Objective Loss 0.000000    Distill Loss 0.013359                                        LR 0.000031    Time 0.526963    
+2023-12-06 02:38:16,149 - Epoch: [40][ 3300/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000031    Time 0.526857    
+2023-12-06 02:39:08,514 - Epoch: [40][ 3400/12168]    Overall Loss 0.013366    Objective Loss 0.000000    Distill Loss 0.013366                                        LR 0.000031    Time 0.526762    
+2023-12-06 02:40:00,897 - Epoch: [40][ 3500/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000031    Time 0.526677    
+2023-12-06 02:40:53,297 - Epoch: [40][ 3600/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000031    Time 0.526601    
+2023-12-06 02:41:45,679 - Epoch: [40][ 3700/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000031    Time 0.526525    
+2023-12-06 02:42:38,063 - Epoch: [40][ 3800/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000031    Time 0.526454    
+2023-12-06 02:43:30,428 - Epoch: [40][ 3900/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000031    Time 0.526381    
+2023-12-06 02:44:22,846 - Epoch: [40][ 4000/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000031    Time 0.526325    
+2023-12-06 02:45:15,156 - Epoch: [40][ 4100/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000031    Time 0.526246    
+2023-12-06 02:46:07,600 - Epoch: [40][ 4200/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000031    Time 0.526202    
+2023-12-06 02:47:00,086 - Epoch: [40][ 4300/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000031    Time 0.526170    
+2023-12-06 02:47:52,500 - Epoch: [40][ 4400/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000031    Time 0.526123    
+2023-12-06 02:48:44,942 - Epoch: [40][ 4500/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000031    Time 0.526085    
+2023-12-06 02:49:37,424 - Epoch: [40][ 4600/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000031    Time 0.526056    
+2023-12-06 02:50:29,927 - Epoch: [40][ 4700/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000031    Time 0.526034    
+2023-12-06 02:51:22,359 - Epoch: [40][ 4800/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000031    Time 0.525997    
+2023-12-06 02:52:14,827 - Epoch: [40][ 4900/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000031    Time 0.525970    
+2023-12-06 02:53:07,215 - Epoch: [40][ 5000/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000031    Time 0.525927    
+2023-12-06 02:53:59,665 - Epoch: [40][ 5100/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000031    Time 0.525899    
+2023-12-06 02:54:52,133 - Epoch: [40][ 5200/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000031    Time 0.525875    
+2023-12-06 02:55:44,594 - Epoch: [40][ 5300/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000031    Time 0.525850    
+2023-12-06 02:56:37,043 - Epoch: [40][ 5400/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000031    Time 0.525824    
+2023-12-06 02:57:29,453 - Epoch: [40][ 5500/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000031    Time 0.525792    
+2023-12-06 02:58:21,888 - Epoch: [40][ 5600/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000031    Time 0.525766    
+2023-12-06 02:59:14,419 - Epoch: [40][ 5700/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000031    Time 0.525757    
+2023-12-06 03:00:06,891 - Epoch: [40][ 5800/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000031    Time 0.525739    
+2023-12-06 03:00:59,377 - Epoch: [40][ 5900/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000031    Time 0.525723    
+2023-12-06 03:01:51,817 - Epoch: [40][ 6000/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000031    Time 0.525701    
+2023-12-06 03:02:44,271 - Epoch: [40][ 6100/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000031    Time 0.525681    
+2023-12-06 03:03:36,797 - Epoch: [40][ 6200/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000031    Time 0.525674    
+2023-12-06 03:04:29,390 - Epoch: [40][ 6300/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000031    Time 0.525677    
+2023-12-06 03:05:21,785 - Epoch: [40][ 6400/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000031    Time 0.525650    
+2023-12-06 03:06:14,230 - Epoch: [40][ 6500/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000031    Time 0.525631    
+2023-12-06 03:07:06,815 - Epoch: [40][ 6600/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000031    Time 0.525633    
+2023-12-06 03:07:59,282 - Epoch: [40][ 6700/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000031    Time 0.525619    
+2023-12-06 03:08:51,728 - Epoch: [40][ 6800/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000031    Time 0.525601    
+2023-12-06 03:09:44,212 - Epoch: [40][ 6900/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000031    Time 0.525590    
+2023-12-06 03:10:36,865 - Epoch: [40][ 7000/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000031    Time 0.525602    
+2023-12-06 03:11:29,329 - Epoch: [40][ 7100/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000031    Time 0.525588    
+2023-12-06 03:12:21,822 - Epoch: [40][ 7200/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000031    Time 0.525579    
+2023-12-06 03:13:14,352 - Epoch: [40][ 7300/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000031    Time 0.525574    
+2023-12-06 03:14:06,867 - Epoch: [40][ 7400/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000031    Time 0.525568    
+2023-12-06 03:14:59,397 - Epoch: [40][ 7500/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000031    Time 0.525564    
+2023-12-06 03:15:51,849 - Epoch: [40][ 7600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000031    Time 0.525550    
+2023-12-06 03:16:44,372 - Epoch: [40][ 7700/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000031    Time 0.525545    
+2023-12-06 03:17:36,795 - Epoch: [40][ 7800/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000031    Time 0.525528    
+2023-12-06 03:18:29,245 - Epoch: [40][ 7900/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000031    Time 0.525515    
+2023-12-06 03:19:21,750 - Epoch: [40][ 8000/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000031    Time 0.525508    
+2023-12-06 03:20:14,326 - Epoch: [40][ 8100/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000031    Time 0.525511    
+2023-12-06 03:21:06,864 - Epoch: [40][ 8200/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000031    Time 0.525509    
+2023-12-06 03:21:59,473 - Epoch: [40][ 8300/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000031    Time 0.525516    
+2023-12-06 03:22:52,032 - Epoch: [40][ 8400/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525516    
+2023-12-06 03:23:44,629 - Epoch: [40][ 8500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525521    
+2023-12-06 03:24:37,146 - Epoch: [40][ 8600/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525517    
+2023-12-06 03:25:29,725 - Epoch: [40][ 8700/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525519    
+2023-12-06 03:26:22,293 - Epoch: [40][ 8800/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525521    
+2023-12-06 03:27:14,891 - Epoch: [40][ 8900/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525525    
+2023-12-06 03:28:07,324 - Epoch: [40][ 9000/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000031    Time 0.525512    
+2023-12-06 03:28:59,723 - Epoch: [40][ 9100/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000031    Time 0.525495    
+2023-12-06 03:29:52,152 - Epoch: [40][ 9200/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000031    Time 0.525481    
+2023-12-06 03:30:44,573 - Epoch: [40][ 9300/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000031    Time 0.525467    
+2023-12-06 03:31:37,027 - Epoch: [40][ 9400/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000031    Time 0.525457    
+2023-12-06 03:32:29,445 - Epoch: [40][ 9500/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000031    Time 0.525443    
+2023-12-06 03:33:21,916 - Epoch: [40][ 9600/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000031    Time 0.525435    
+2023-12-06 03:34:14,430 - Epoch: [40][ 9700/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000031    Time 0.525432    
+2023-12-06 03:35:06,849 - Epoch: [40][ 9800/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000031    Time 0.525419    
+2023-12-06 03:35:59,333 - Epoch: [40][ 9900/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000031    Time 0.525413    
+2023-12-06 03:36:51,822 - Epoch: [40][10000/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000031    Time 0.525407    
+2023-12-06 03:37:44,291 - Epoch: [40][10100/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000031    Time 0.525400    
+2023-12-06 03:38:36,673 - Epoch: [40][10200/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000031    Time 0.525384    
+2023-12-06 03:39:29,084 - Epoch: [40][10300/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000031    Time 0.525371    
+2023-12-06 03:40:21,504 - Epoch: [40][10400/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000031    Time 0.525359    
+2023-12-06 03:41:13,957 - Epoch: [40][10500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000031    Time 0.525351    
+2023-12-06 03:42:06,395 - Epoch: [40][10600/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000031    Time 0.525342    
+2023-12-06 03:42:58,888 - Epoch: [40][10700/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000031    Time 0.525338    
+2023-12-06 03:43:51,327 - Epoch: [40][10800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000031    Time 0.525329    
+2023-12-06 03:44:43,723 - Epoch: [40][10900/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000031    Time 0.525316    
+2023-12-06 03:45:36,211 - Epoch: [40][11000/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000031    Time 0.525311    
+2023-12-06 03:46:28,664 - Epoch: [40][11100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000031    Time 0.525304    
+2023-12-06 03:47:21,142 - Epoch: [40][11200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000031    Time 0.525299    
+2023-12-06 03:48:13,633 - Epoch: [40][11300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000031    Time 0.525295    
+2023-12-06 03:49:06,209 - Epoch: [40][11400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000031    Time 0.525299    
+2023-12-06 03:49:58,733 - Epoch: [40][11500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000031    Time 0.525298    
+2023-12-06 03:50:51,344 - Epoch: [40][11600/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000031    Time 0.525305    
+2023-12-06 03:51:44,107 - Epoch: [40][11700/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000031    Time 0.525324    
+2023-12-06 03:52:36,751 - Epoch: [40][11800/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000031    Time 0.525334    
+2023-12-06 03:53:29,174 - Epoch: [40][11900/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000031    Time 0.525324    
+2023-12-06 03:54:21,598 - Epoch: [40][12000/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000031    Time 0.525315    
+2023-12-06 03:55:14,161 - Epoch: [40][12100/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000031    Time 0.525317    
+2023-12-06 03:55:50,036 - Epoch: [40][12168/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000031    Time 0.525329    
+2023-12-06 03:55:50,472 - --- validate (epoch=40)-----------
+2023-12-06 03:55:50,473 - 167951 samples (256 per mini-batch)
+2023-12-06 03:56:41,058 - Epoch: [40][  100/  657]    Loss 0.000000    Overall Loss 0.014004    
+2023-12-06 03:57:29,728 - Epoch: [40][  200/  657]    Loss 0.000000    Overall Loss 0.014009    
+2023-12-06 03:58:18,395 - Epoch: [40][  300/  657]    Loss 0.000000    Overall Loss 0.014032    
+2023-12-06 03:59:07,019 - Epoch: [40][  400/  657]    Loss 0.000000    Overall Loss 0.014033    
+2023-12-06 03:59:55,635 - Epoch: [40][  500/  657]    Loss 0.000000    Overall Loss 0.014033    
+2023-12-06 04:00:44,239 - Epoch: [40][  600/  657]    Loss 0.000000    Overall Loss 0.014037    
+2023-12-06 04:01:11,495 - Epoch: [40][  657/  657]    Loss 0.000000    Overall Loss 0.014038    
+2023-12-06 04:01:11,698 - ==> Overall Loss: 0.014
+
+2023-12-06 04:01:11,700 - ==> Best [Overall Loss: 0.014038 on epoch: 40]
+2023-12-06 04:01:11,700 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 04:01:11,719 - 
+
+2023-12-06 04:01:11,720 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 04:02:13,876 - Epoch: [41][  100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000031    Time 0.621521    
+2023-12-06 04:03:06,466 - Epoch: [41][  200/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000031    Time 0.573687    
+2023-12-06 04:03:58,883 - Epoch: [41][  300/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.557171    
+2023-12-06 04:04:51,335 - Epoch: [41][  400/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.548999    
+2023-12-06 04:05:43,797 - Epoch: [41][  500/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.544115    
+2023-12-06 04:06:36,264 - Epoch: [41][  600/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.540869    
+2023-12-06 04:07:28,751 - Epoch: [41][  700/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.538579    
+2023-12-06 04:08:21,104 - Epoch: [41][  800/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.536694    
+2023-12-06 04:09:13,514 - Epoch: [41][  900/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.535290    
+2023-12-06 04:10:05,870 - Epoch: [41][ 1000/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.534114    
+2023-12-06 04:10:58,244 - Epoch: [41][ 1100/12168]    Overall Loss 0.013454    Objective Loss 0.000000    Distill Loss 0.013454                                        LR 0.000031    Time 0.533168    
+2023-12-06 04:11:50,663 - Epoch: [41][ 1200/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.532417    
+2023-12-06 04:12:43,103 - Epoch: [41][ 1300/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.531798    
+2023-12-06 04:13:35,498 - Epoch: [41][ 1400/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.531234    
+2023-12-06 04:14:27,881 - Epoch: [41][ 1500/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.530739    
+2023-12-06 04:15:20,228 - Epoch: [41][ 1600/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.530279    
+2023-12-06 04:16:12,617 - Epoch: [41][ 1700/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.529901    
+2023-12-06 04:17:04,945 - Epoch: [41][ 1800/12168]    Overall Loss 0.013455    Objective Loss 0.000000    Distill Loss 0.013455                                        LR 0.000031    Time 0.529532    
+2023-12-06 04:17:57,323 - Epoch: [41][ 1900/12168]    Overall Loss 0.013457    Objective Loss 0.000000    Distill Loss 0.013457                                        LR 0.000031    Time 0.529227    
+2023-12-06 04:18:49,743 - Epoch: [41][ 2000/12168]    Overall Loss 0.013459    Objective Loss 0.000000    Distill Loss 0.013459                                        LR 0.000031    Time 0.528974    
+2023-12-06 04:19:42,114 - Epoch: [41][ 2100/12168]    Overall Loss 0.013464    Objective Loss 0.000000    Distill Loss 0.013464                                        LR 0.000031    Time 0.528722    
+2023-12-06 04:20:34,534 - Epoch: [41][ 2200/12168]    Overall Loss 0.013464    Objective Loss 0.000000    Distill Loss 0.013464                                        LR 0.000031    Time 0.528515    
+2023-12-06 04:21:26,883 - Epoch: [41][ 2300/12168]    Overall Loss 0.013462    Objective Loss 0.000000    Distill Loss 0.013462                                        LR 0.000031    Time 0.528295    
+2023-12-06 04:22:19,239 - Epoch: [41][ 2400/12168]    Overall Loss 0.013457    Objective Loss 0.000000    Distill Loss 0.013457                                        LR 0.000031    Time 0.528096    
+2023-12-06 04:23:11,630 - Epoch: [41][ 2500/12168]    Overall Loss 0.013454    Objective Loss 0.000000    Distill Loss 0.013454                                        LR 0.000031    Time 0.527927    
+2023-12-06 04:24:04,005 - Epoch: [41][ 2600/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.527766    
+2023-12-06 04:24:56,316 - Epoch: [41][ 2700/12168]    Overall Loss 0.013451    Objective Loss 0.000000    Distill Loss 0.013451                                        LR 0.000031    Time 0.527592    
+2023-12-06 04:25:48,747 - Epoch: [41][ 2800/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.527474    
+2023-12-06 04:26:41,123 - Epoch: [41][ 2900/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.527344    
+2023-12-06 04:27:33,597 - Epoch: [41][ 3000/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.527257    
+2023-12-06 04:28:25,929 - Epoch: [41][ 3100/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.527128    
+2023-12-06 04:29:18,350 - Epoch: [41][ 3200/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.527036    
+2023-12-06 04:30:10,737 - Epoch: [41][ 3300/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.526939    
+2023-12-06 04:31:03,181 - Epoch: [41][ 3400/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.526864    
+2023-12-06 04:31:55,636 - Epoch: [41][ 3500/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.526797    
+2023-12-06 04:32:48,071 - Epoch: [41][ 3600/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.526728    
+2023-12-06 04:33:40,449 - Epoch: [41][ 3700/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.526648    
+2023-12-06 04:34:32,880 - Epoch: [41][ 3800/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.526585    
+2023-12-06 04:35:25,338 - Epoch: [41][ 3900/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.526533    
+2023-12-06 04:36:17,745 - Epoch: [41][ 4000/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.526471    
+2023-12-06 04:37:10,123 - Epoch: [41][ 4100/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.526404    
+2023-12-06 04:38:03,062 - Epoch: [41][ 4200/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.526475    
+2023-12-06 04:38:55,451 - Epoch: [41][ 4300/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.526414    
+2023-12-06 04:39:47,866 - Epoch: [41][ 4400/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526362    
+2023-12-06 04:40:40,235 - Epoch: [41][ 4500/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.526301    
+2023-12-06 04:41:32,602 - Epoch: [41][ 4600/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.526244    
+2023-12-06 04:42:25,034 - Epoch: [41][ 4700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526202    
+2023-12-06 04:43:17,470 - Epoch: [41][ 4800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526163    
+2023-12-06 04:44:09,905 - Epoch: [41][ 4900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526125    
+2023-12-06 04:45:02,287 - Epoch: [41][ 5000/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526078    
+2023-12-06 04:45:54,682 - Epoch: [41][ 5100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526036    
+2023-12-06 04:46:47,121 - Epoch: [41][ 5200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526003    
+2023-12-06 04:47:39,535 - Epoch: [41][ 5300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525968    
+2023-12-06 04:48:31,891 - Epoch: [41][ 5400/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525923    
+2023-12-06 04:49:24,240 - Epoch: [41][ 5500/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525878    
+2023-12-06 04:50:16,740 - Epoch: [41][ 5600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525861    
+2023-12-06 04:51:09,114 - Epoch: [41][ 5700/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525824    
+2023-12-06 04:52:01,514 - Epoch: [41][ 5800/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525792    
+2023-12-06 04:52:53,892 - Epoch: [41][ 5900/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525757    
+2023-12-06 04:53:46,298 - Epoch: [41][ 6000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525728    
+2023-12-06 04:54:38,693 - Epoch: [41][ 6100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525698    
+2023-12-06 04:55:31,112 - Epoch: [41][ 6200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525673    
+2023-12-06 04:56:23,498 - Epoch: [41][ 6300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525644    
+2023-12-06 04:57:15,866 - Epoch: [41][ 6400/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525613    
+2023-12-06 04:58:08,190 - Epoch: [41][ 6500/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525576    
+2023-12-06 04:59:00,531 - Epoch: [41][ 6600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525543    
+2023-12-06 04:59:52,905 - Epoch: [41][ 6700/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525515    
+2023-12-06 05:00:45,318 - Epoch: [41][ 6800/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525494    
+2023-12-06 05:01:37,736 - Epoch: [41][ 6900/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525475    
+2023-12-06 05:02:30,169 - Epoch: [41][ 7000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525458    
+2023-12-06 05:03:22,525 - Epoch: [41][ 7100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525431    
+2023-12-06 05:04:14,934 - Epoch: [41][ 7200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525412    
+2023-12-06 05:05:07,400 - Epoch: [41][ 7300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525401    
+2023-12-06 05:05:59,859 - Epoch: [41][ 7400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525389    
+2023-12-06 05:06:52,319 - Epoch: [41][ 7500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525378    
+2023-12-06 05:07:44,750 - Epoch: [41][ 7600/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525364    
+2023-12-06 05:08:37,168 - Epoch: [41][ 7700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525348    
+2023-12-06 05:09:29,619 - Epoch: [41][ 7800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525337    
+2023-12-06 05:10:22,072 - Epoch: [41][ 7900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525326    
+2023-12-06 05:11:14,481 - Epoch: [41][ 8000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525310    
+2023-12-06 05:12:06,837 - Epoch: [41][ 8100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525288    
+2023-12-06 05:12:59,187 - Epoch: [41][ 8200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525266    
+2023-12-06 05:13:51,549 - Epoch: [41][ 8300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525246    
+2023-12-06 05:14:43,944 - Epoch: [41][ 8400/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525230    
+2023-12-06 05:15:36,348 - Epoch: [41][ 8500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525216    
+2023-12-06 05:16:28,811 - Epoch: [41][ 8600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525209    
+2023-12-06 05:17:21,242 - Epoch: [41][ 8700/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525198    
+2023-12-06 05:18:13,654 - Epoch: [41][ 8800/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525185    
+2023-12-06 05:19:06,108 - Epoch: [41][ 8900/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525178    
+2023-12-06 05:19:58,464 - Epoch: [41][ 9000/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525159    
+2023-12-06 05:20:50,815 - Epoch: [41][ 9100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525141    
+2023-12-06 05:21:43,201 - Epoch: [41][ 9200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525126    
+2023-12-06 05:22:35,616 - Epoch: [41][ 9300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525116    
+2023-12-06 05:23:28,112 - Epoch: [41][ 9400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525114    
+2023-12-06 05:24:20,487 - Epoch: [41][ 9500/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525099    
+2023-12-06 05:25:12,900 - Epoch: [41][ 9600/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525088    
+2023-12-06 05:26:05,259 - Epoch: [41][ 9700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525073    
+2023-12-06 05:26:57,745 - Epoch: [41][ 9800/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525070    
+2023-12-06 05:27:50,199 - Epoch: [41][ 9900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525064    
+2023-12-06 05:28:42,603 - Epoch: [41][10000/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525054    
+2023-12-06 05:29:35,009 - Epoch: [41][10100/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525044    
+2023-12-06 05:30:27,438 - Epoch: [41][10200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525036    
+2023-12-06 05:31:19,871 - Epoch: [41][10300/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525029    
+2023-12-06 05:32:12,274 - Epoch: [41][10400/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525019    
+2023-12-06 05:33:04,687 - Epoch: [41][10500/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525010    
+2023-12-06 05:33:57,141 - Epoch: [41][10600/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525005    
+2023-12-06 05:34:49,662 - Epoch: [41][10700/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525007    
+2023-12-06 05:35:42,131 - Epoch: [41][10800/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525004    
+2023-12-06 05:36:34,538 - Epoch: [41][10900/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.524995    
+2023-12-06 05:37:26,958 - Epoch: [41][11000/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.524987    
+2023-12-06 05:38:19,361 - Epoch: [41][11100/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524978    
+2023-12-06 05:39:11,831 - Epoch: [41][11200/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524976    
+2023-12-06 05:40:04,235 - Epoch: [41][11300/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524967    
+2023-12-06 05:40:56,580 - Epoch: [41][11400/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524953    
+2023-12-06 05:41:48,904 - Epoch: [41][11500/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524938    
+2023-12-06 05:42:41,345 - Epoch: [41][11600/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524933    
+2023-12-06 05:43:33,743 - Epoch: [41][11700/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524925    
+2023-12-06 05:44:26,218 - Epoch: [41][11800/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524923    
+2023-12-06 05:45:18,687 - Epoch: [41][11900/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524921    
+2023-12-06 05:46:11,104 - Epoch: [41][12000/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524914    
+2023-12-06 05:47:03,486 - Epoch: [41][12100/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524905    
+2023-12-06 05:47:39,027 - Epoch: [41][12168/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524892    
+2023-12-06 05:47:39,389 - --- validate (epoch=41)-----------
+2023-12-06 05:47:39,390 - 167951 samples (256 per mini-batch)
+2023-12-06 05:48:29,930 - Epoch: [41][  100/  657]    Loss 0.000000    Overall Loss 0.014026    
+2023-12-06 05:49:18,470 - Epoch: [41][  200/  657]    Loss 0.000000    Overall Loss 0.014046    
+2023-12-06 05:50:07,002 - Epoch: [41][  300/  657]    Loss 0.000000    Overall Loss 0.014050    
+2023-12-06 05:50:55,537 - Epoch: [41][  400/  657]    Loss 0.000000    Overall Loss 0.014055    
+2023-12-06 05:51:44,077 - Epoch: [41][  500/  657]    Loss 0.000000    Overall Loss 0.014060    
+2023-12-06 05:52:32,637 - Epoch: [41][  600/  657]    Loss 0.000000    Overall Loss 0.014063    
+2023-12-06 05:52:59,856 - Epoch: [41][  657/  657]    Loss 0.000000    Overall Loss 0.014061    
+2023-12-06 05:53:00,046 - ==> Overall Loss: 0.014
+
+2023-12-06 05:53:00,048 - ==> Best [Overall Loss: 0.014038 on epoch: 40]
+2023-12-06 05:53:00,048 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 05:53:00,069 - 
+
+2023-12-06 05:53:00,069 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 05:54:01,515 - Epoch: [42][  100/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000031    Time 0.614421    
+2023-12-06 05:54:53,852 - Epoch: [42][  200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000031    Time 0.568881    
+2023-12-06 05:55:46,189 - Epoch: [42][  300/12168]    Overall Loss 0.013430    Objective Loss 0.000000    Distill Loss 0.013430                                        LR 0.000031    Time 0.553700    
+2023-12-06 05:56:38,554 - Epoch: [42][  400/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.546177    
+2023-12-06 05:57:30,966 - Epoch: [42][  500/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.541759    
+2023-12-06 05:58:23,312 - Epoch: [42][  600/12168]    Overall Loss 0.013432    Objective Loss 0.000000    Distill Loss 0.013432                                        LR 0.000031    Time 0.538704    
+2023-12-06 05:59:15,704 - Epoch: [42][  700/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.536586    
+2023-12-06 06:00:08,113 - Epoch: [42][  800/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.535021    
+2023-12-06 06:01:00,430 - Epoch: [42][  900/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.533699    
+2023-12-06 06:01:52,838 - Epoch: [42][ 1000/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.532734    
+2023-12-06 06:02:45,144 - Epoch: [42][ 1100/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.531852    
+2023-12-06 06:03:37,481 - Epoch: [42][ 1200/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.531142    
+2023-12-06 06:04:29,954 - Epoch: [42][ 1300/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.530646    
+2023-12-06 06:05:22,319 - Epoch: [42][ 1400/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.530144    
+2023-12-06 06:06:14,732 - Epoch: [42][ 1500/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.529741    
+2023-12-06 06:07:07,106 - Epoch: [42][ 1600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.529364    
+2023-12-06 06:07:59,512 - Epoch: [42][ 1700/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.529050    
+2023-12-06 06:08:51,988 - Epoch: [42][ 1800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.528809    
+2023-12-06 06:09:44,386 - Epoch: [42][ 1900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.528554    
+2023-12-06 06:10:36,750 - Epoch: [42][ 2000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.528306    
+2023-12-06 06:11:29,041 - Epoch: [42][ 2100/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.528048    
+2023-12-06 06:12:21,436 - Epoch: [42][ 2200/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.527860    
+2023-12-06 06:13:13,738 - Epoch: [42][ 2300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.527648    
+2023-12-06 06:14:06,095 - Epoch: [42][ 2400/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.527477    
+2023-12-06 06:14:58,480 - Epoch: [42][ 2500/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.527330    
+2023-12-06 06:15:50,852 - Epoch: [42][ 2600/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.527190    
+2023-12-06 06:16:43,179 - Epoch: [42][ 2700/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.527044    
+2023-12-06 06:17:35,584 - Epoch: [42][ 2800/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.526935    
+2023-12-06 06:18:28,012 - Epoch: [42][ 2900/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526843    
+2023-12-06 06:19:20,352 - Epoch: [42][ 3000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526727    
+2023-12-06 06:20:12,719 - Epoch: [42][ 3100/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.526627    
+2023-12-06 06:21:05,088 - Epoch: [42][ 3200/12168]    Overall Loss 0.013433    Objective Loss 0.000000    Distill Loss 0.013433                                        LR 0.000031    Time 0.526534    
+2023-12-06 06:21:57,441 - Epoch: [42][ 3300/12168]    Overall Loss 0.013433    Objective Loss 0.000000    Distill Loss 0.013433                                        LR 0.000031    Time 0.526442    
+2023-12-06 06:22:49,831 - Epoch: [42][ 3400/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.526367    
+2023-12-06 06:23:42,215 - Epoch: [42][ 3500/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.526293    
+2023-12-06 06:24:34,516 - Epoch: [42][ 3600/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.526201    
+2023-12-06 06:25:26,897 - Epoch: [42][ 3700/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.526136    
+2023-12-06 06:26:19,247 - Epoch: [42][ 3800/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.526065    
+2023-12-06 06:27:11,563 - Epoch: [42][ 3900/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525990    
+2023-12-06 06:28:03,964 - Epoch: [42][ 4000/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525940    
+2023-12-06 06:28:56,282 - Epoch: [42][ 4100/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525872    
+2023-12-06 06:29:48,701 - Epoch: [42][ 4200/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.525831    
+2023-12-06 06:30:41,031 - Epoch: [42][ 4300/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.525771    
+2023-12-06 06:31:33,454 - Epoch: [42][ 4400/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.525735    
+2023-12-06 06:32:25,831 - Epoch: [42][ 4500/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525691    
+2023-12-06 06:33:18,222 - Epoch: [42][ 4600/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525651    
+2023-12-06 06:34:10,602 - Epoch: [42][ 4700/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525611    
+2023-12-06 06:35:03,057 - Epoch: [42][ 4800/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525588    
+2023-12-06 06:35:55,403 - Epoch: [42][ 4900/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525544    
+2023-12-06 06:36:47,767 - Epoch: [42][ 5000/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525505    
+2023-12-06 06:37:40,141 - Epoch: [42][ 5100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525470    
+2023-12-06 06:38:32,509 - Epoch: [42][ 5200/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525435    
+2023-12-06 06:39:24,881 - Epoch: [42][ 5300/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525402    
+2023-12-06 06:40:17,263 - Epoch: [42][ 5400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525372    
+2023-12-06 06:41:09,639 - Epoch: [42][ 5500/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525342    
+2023-12-06 06:42:02,011 - Epoch: [42][ 5600/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525313    
+2023-12-06 06:42:54,388 - Epoch: [42][ 5700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525285    
+2023-12-06 06:43:46,842 - Epoch: [42][ 5800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525272    
+2023-12-06 06:44:39,253 - Epoch: [42][ 5900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525251    
+2023-12-06 06:45:31,590 - Epoch: [42][ 6000/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525220    
+2023-12-06 06:46:24,044 - Epoch: [42][ 6100/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525208    
+2023-12-06 06:47:16,389 - Epoch: [42][ 6200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525179    
+2023-12-06 06:48:08,769 - Epoch: [42][ 6300/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525157    
+2023-12-06 06:49:01,248 - Epoch: [42][ 6400/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525150    
+2023-12-06 06:49:53,641 - Epoch: [42][ 6500/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525131    
+2023-12-06 06:50:46,006 - Epoch: [42][ 6600/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525108    
+2023-12-06 06:51:38,421 - Epoch: [42][ 6700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525093    
+2023-12-06 06:52:30,848 - Epoch: [42][ 6800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525081    
+2023-12-06 06:53:23,238 - Epoch: [42][ 6900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525063    
+2023-12-06 06:54:15,677 - Epoch: [42][ 7000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525053    
+2023-12-06 06:55:08,053 - Epoch: [42][ 7100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525034    
+2023-12-06 06:56:00,462 - Epoch: [42][ 7200/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525021    
+2023-12-06 06:56:52,808 - Epoch: [42][ 7300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.524999    
+2023-12-06 06:57:45,218 - Epoch: [42][ 7400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.524986    
+2023-12-06 06:58:37,636 - Epoch: [42][ 7500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.524975    
+2023-12-06 06:59:30,156 - Epoch: [42][ 7600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.524978    
+2023-12-06 07:00:22,552 - Epoch: [42][ 7700/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.524964    
+2023-12-06 07:01:14,935 - Epoch: [42][ 7800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.524949    
+2023-12-06 07:02:07,375 - Epoch: [42][ 7900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.524942    
+2023-12-06 07:02:59,727 - Epoch: [42][ 8000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524923    
+2023-12-06 07:03:52,171 - Epoch: [42][ 8100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.524917    
+2023-12-06 07:04:44,588 - Epoch: [42][ 8200/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524908    
+2023-12-06 07:05:37,004 - Epoch: [42][ 8300/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524898    
+2023-12-06 07:06:29,369 - Epoch: [42][ 8400/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524883    
+2023-12-06 07:07:21,837 - Epoch: [42][ 8500/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524880    
+2023-12-06 07:08:14,302 - Epoch: [42][ 8600/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524877    
+2023-12-06 07:09:06,702 - Epoch: [42][ 8700/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524867    
+2023-12-06 07:09:59,151 - Epoch: [42][ 8800/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524862    
+2023-12-06 07:10:51,689 - Epoch: [42][ 8900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524867    
+2023-12-06 07:11:44,182 - Epoch: [42][ 9000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.524868    
+2023-12-06 07:12:36,632 - Epoch: [42][ 9100/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524863    
+2023-12-06 07:13:29,082 - Epoch: [42][ 9200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524859    
+2023-12-06 07:14:21,538 - Epoch: [42][ 9300/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524855    
+2023-12-06 07:15:13,947 - Epoch: [42][ 9400/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524847    
+2023-12-06 07:16:06,387 - Epoch: [42][ 9500/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524842    
+2023-12-06 07:16:58,954 - Epoch: [42][ 9600/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524850    
+2023-12-06 07:17:51,393 - Epoch: [42][ 9700/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.524845    
+2023-12-06 07:18:43,867 - Epoch: [42][ 9800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.524843    
+2023-12-06 07:19:36,276 - Epoch: [42][ 9900/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.524836    
+2023-12-06 07:20:28,725 - Epoch: [42][10000/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.524832    
+2023-12-06 07:21:21,176 - Epoch: [42][10100/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524828    
+2023-12-06 07:22:13,591 - Epoch: [42][10200/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524821    
+2023-12-06 07:23:06,119 - Epoch: [42][10300/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524825    
+2023-12-06 07:23:58,607 - Epoch: [42][10400/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524826    
+2023-12-06 07:24:50,989 - Epoch: [42][10500/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524816    
+2023-12-06 07:25:43,375 - Epoch: [42][10600/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524806    
+2023-12-06 07:26:35,844 - Epoch: [42][10700/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524805    
+2023-12-06 07:27:28,343 - Epoch: [42][10800/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524806    
+2023-12-06 07:28:20,805 - Epoch: [42][10900/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524804    
+2023-12-06 07:29:13,221 - Epoch: [42][11000/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524798    
+2023-12-06 07:30:05,656 - Epoch: [42][11100/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.524794    
+2023-12-06 07:30:58,141 - Epoch: [42][11200/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524794    
+2023-12-06 07:31:50,547 - Epoch: [42][11300/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524787    
+2023-12-06 07:32:43,049 - Epoch: [42][11400/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524789    
+2023-12-06 07:33:35,453 - Epoch: [42][11500/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524782    
+2023-12-06 07:34:27,880 - Epoch: [42][11600/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.524778    
+2023-12-06 07:35:20,322 - Epoch: [42][11700/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.524774    
+2023-12-06 07:36:12,721 - Epoch: [42][11800/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.524767    
+2023-12-06 07:37:05,128 - Epoch: [42][11900/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.524761    
+2023-12-06 07:37:57,530 - Epoch: [42][12000/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.524755    
+2023-12-06 07:38:49,999 - Epoch: [42][12100/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.524754    
+2023-12-06 07:39:26,054 - Epoch: [42][12168/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.524784    
+2023-12-06 07:39:26,462 - --- validate (epoch=42)-----------
+2023-12-06 07:39:26,462 - 167951 samples (256 per mini-batch)
+2023-12-06 07:40:17,394 - Epoch: [42][  100/  657]    Loss 0.000000    Overall Loss 0.014087    
+2023-12-06 07:41:05,992 - Epoch: [42][  200/  657]    Loss 0.000000    Overall Loss 0.014079    
+2023-12-06 07:41:54,590 - Epoch: [42][  300/  657]    Loss 0.000000    Overall Loss 0.014076    
+2023-12-06 07:42:43,187 - Epoch: [42][  400/  657]    Loss 0.000000    Overall Loss 0.014061    
+2023-12-06 07:43:31,764 - Epoch: [42][  500/  657]    Loss 0.000000    Overall Loss 0.014060    
+2023-12-06 07:44:20,352 - Epoch: [42][  600/  657]    Loss 0.000000    Overall Loss 0.014062    
+2023-12-06 07:44:47,594 - Epoch: [42][  657/  657]    Loss 0.000000    Overall Loss 0.014065    
+2023-12-06 07:44:47,780 - ==> Overall Loss: 0.014
+
+2023-12-06 07:44:47,783 - ==> Best [Overall Loss: 0.014038 on epoch: 40]
+2023-12-06 07:44:47,783 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 07:44:47,804 - 
+
+2023-12-06 07:44:47,804 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 07:45:48,979 - Epoch: [43][  100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.611708    
+2023-12-06 07:46:41,392 - Epoch: [43][  200/12168]    Overall Loss 0.013416    Objective Loss 0.000000    Distill Loss 0.013416                                        LR 0.000031    Time 0.567899    
+2023-12-06 07:47:33,783 - Epoch: [43][  300/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.553226    
+2023-12-06 07:48:26,217 - Epoch: [43][  400/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.545995    
+2023-12-06 07:49:18,673 - Epoch: [43][  500/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.541703    
+2023-12-06 07:50:11,056 - Epoch: [43][  600/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.538718    
+2023-12-06 07:51:03,503 - Epoch: [43][  700/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.536679    
+2023-12-06 07:51:55,948 - Epoch: [43][  800/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.535145    
+2023-12-06 07:52:48,363 - Epoch: [43][  900/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.533920    
+2023-12-06 07:53:40,786 - Epoch: [43][ 1000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.532948    
+2023-12-06 07:54:33,182 - Epoch: [43][ 1100/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.532128    
+2023-12-06 07:55:25,605 - Epoch: [43][ 1200/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.531467    
+2023-12-06 07:56:17,999 - Epoch: [43][ 1300/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.530885    
+2023-12-06 07:57:10,396 - Epoch: [43][ 1400/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.530389    
+2023-12-06 07:58:02,803 - Epoch: [43][ 1500/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.529966    
+2023-12-06 07:58:55,264 - Epoch: [43][ 1600/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.529629    
+2023-12-06 07:59:47,735 - Epoch: [43][ 1700/12168]    Overall Loss 0.013451    Objective Loss 0.000000    Distill Loss 0.013451                                        LR 0.000031    Time 0.529337    
+2023-12-06 08:00:40,151 - Epoch: [43][ 1800/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.529048    
+2023-12-06 08:01:32,579 - Epoch: [43][ 1900/12168]    Overall Loss 0.013453    Objective Loss 0.000000    Distill Loss 0.013453                                        LR 0.000031    Time 0.528795    
+2023-12-06 08:02:24,968 - Epoch: [43][ 2000/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.528548    
+2023-12-06 08:03:17,352 - Epoch: [43][ 2100/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.528322    
+2023-12-06 08:04:09,798 - Epoch: [43][ 2200/12168]    Overall Loss 0.013454    Objective Loss 0.000000    Distill Loss 0.013454                                        LR 0.000031    Time 0.528145    
+2023-12-06 08:05:02,218 - Epoch: [43][ 2300/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.527972    
+2023-12-06 08:05:54,627 - Epoch: [43][ 2400/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.527809    
+2023-12-06 08:06:47,065 - Epoch: [43][ 2500/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.527671    
+2023-12-06 08:07:39,539 - Epoch: [43][ 2600/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.527557    
+2023-12-06 08:08:31,951 - Epoch: [43][ 2700/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.527428    
+2023-12-06 08:09:24,413 - Epoch: [43][ 2800/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.527327    
+2023-12-06 08:10:16,958 - Epoch: [43][ 2900/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.527261    
+2023-12-06 08:11:09,429 - Epoch: [43][ 3000/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.527174    
+2023-12-06 08:12:01,797 - Epoch: [43][ 3100/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.527061    
+2023-12-06 08:12:54,297 - Epoch: [43][ 3200/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.526995    
+2023-12-06 08:13:46,644 - Epoch: [43][ 3300/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.526887    
+2023-12-06 08:14:39,065 - Epoch: [43][ 3400/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526807    
+2023-12-06 08:15:31,462 - Epoch: [43][ 3500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526726    
+2023-12-06 08:16:23,932 - Epoch: [43][ 3600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526668    
+2023-12-06 08:17:16,392 - Epoch: [43][ 3700/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526612    
+2023-12-06 08:18:08,771 - Epoch: [43][ 3800/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526536    
+2023-12-06 08:19:01,183 - Epoch: [43][ 3900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526474    
+2023-12-06 08:19:53,588 - Epoch: [43][ 4000/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526412    
+2023-12-06 08:20:46,004 - Epoch: [43][ 4100/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526356    
+2023-12-06 08:21:38,439 - Epoch: [43][ 4200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526308    
+2023-12-06 08:22:30,944 - Epoch: [43][ 4300/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526278    
+2023-12-06 08:23:23,370 - Epoch: [43][ 4400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526231    
+2023-12-06 08:24:15,821 - Epoch: [43][ 4500/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526192    
+2023-12-06 08:25:08,277 - Epoch: [43][ 4600/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526156    
+2023-12-06 08:26:00,743 - Epoch: [43][ 4700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526123    
+2023-12-06 08:26:53,085 - Epoch: [43][ 4800/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526066    
+2023-12-06 08:27:45,487 - Epoch: [43][ 4900/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526024    
+2023-12-06 08:28:37,902 - Epoch: [43][ 5000/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525986    
+2023-12-06 08:29:30,329 - Epoch: [43][ 5100/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525952    
+2023-12-06 08:30:22,758 - Epoch: [43][ 5200/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525919    
+2023-12-06 08:31:15,185 - Epoch: [43][ 5300/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525887    
+2023-12-06 08:32:07,636 - Epoch: [43][ 5400/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.525861    
+2023-12-06 08:33:00,046 - Epoch: [43][ 5500/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525828    
+2023-12-06 08:33:52,497 - Epoch: [43][ 5600/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525804    
+2023-12-06 08:34:44,964 - Epoch: [43][ 5700/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525784    
+2023-12-06 08:35:37,351 - Epoch: [43][ 5800/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525750    
+2023-12-06 08:36:29,819 - Epoch: [43][ 5900/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.525731    
+2023-12-06 08:37:22,214 - Epoch: [43][ 6000/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525701    
+2023-12-06 08:38:14,623 - Epoch: [43][ 6100/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525674    
+2023-12-06 08:39:07,061 - Epoch: [43][ 6200/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525653    
+2023-12-06 08:39:59,507 - Epoch: [43][ 6300/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525633    
+2023-12-06 08:40:51,917 - Epoch: [43][ 6400/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525609    
+2023-12-06 08:41:44,297 - Epoch: [43][ 6500/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525580    
+2023-12-06 08:42:36,748 - Epoch: [43][ 6600/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525564    
+2023-12-06 08:43:29,166 - Epoch: [43][ 6700/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525543    
+2023-12-06 08:44:21,646 - Epoch: [43][ 6800/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525531    
+2023-12-06 08:45:14,086 - Epoch: [43][ 6900/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525514    
+2023-12-06 08:46:06,588 - Epoch: [43][ 7000/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525507    
+2023-12-06 08:46:59,044 - Epoch: [43][ 7100/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525493    
+2023-12-06 08:47:51,458 - Epoch: [43][ 7200/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525474    
+2023-12-06 08:48:43,822 - Epoch: [43][ 7300/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525448    
+2023-12-06 08:49:36,281 - Epoch: [43][ 7400/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525436    
+2023-12-06 08:50:28,703 - Epoch: [43][ 7500/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525419    
+2023-12-06 08:51:21,120 - Epoch: [43][ 7600/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525403    
+2023-12-06 08:52:13,555 - Epoch: [43][ 7700/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525388    
+2023-12-06 08:53:05,959 - Epoch: [43][ 7800/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525371    
+2023-12-06 08:53:58,373 - Epoch: [43][ 7900/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525355    
+2023-12-06 08:54:50,813 - Epoch: [43][ 8000/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525342    
+2023-12-06 08:55:43,258 - Epoch: [43][ 8100/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525331    
+2023-12-06 08:56:35,757 - Epoch: [43][ 8200/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525326    
+2023-12-06 08:57:28,259 - Epoch: [43][ 8300/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525322    
+2023-12-06 08:58:20,753 - Epoch: [43][ 8400/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525317    
+2023-12-06 08:59:13,250 - Epoch: [43][ 8500/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525313    
+2023-12-06 09:00:05,669 - Epoch: [43][ 8600/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525299    
+2023-12-06 09:00:58,087 - Epoch: [43][ 8700/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525286    
+2023-12-06 09:01:50,644 - Epoch: [43][ 8800/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525289    
+2023-12-06 09:02:43,090 - Epoch: [43][ 8900/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525279    
+2023-12-06 09:03:35,501 - Epoch: [43][ 9000/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525266    
+2023-12-06 09:04:27,977 - Epoch: [43][ 9100/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525260    
+2023-12-06 09:05:20,467 - Epoch: [43][ 9200/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525256    
+2023-12-06 09:06:12,973 - Epoch: [43][ 9300/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525253    
+2023-12-06 09:07:05,490 - Epoch: [43][ 9400/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525252    
+2023-12-06 09:07:58,023 - Epoch: [43][ 9500/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525252    
+2023-12-06 09:08:50,487 - Epoch: [43][ 9600/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.525246    
+2023-12-06 09:09:42,887 - Epoch: [43][ 9700/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525233    
+2023-12-06 09:10:35,260 - Epoch: [43][ 9800/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525217    
+2023-12-06 09:11:27,750 - Epoch: [43][ 9900/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525213    
+2023-12-06 09:12:20,178 - Epoch: [43][10000/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.525204    
+2023-12-06 09:13:12,642 - Epoch: [43][10100/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525198    
+2023-12-06 09:14:05,057 - Epoch: [43][10200/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525187    
+2023-12-06 09:14:57,414 - Epoch: [43][10300/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525171    
+2023-12-06 09:15:49,882 - Epoch: [43][10400/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525166    
+2023-12-06 09:16:42,331 - Epoch: [43][10500/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525159    
+2023-12-06 09:17:34,744 - Epoch: [43][10600/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525149    
+2023-12-06 09:18:27,298 - Epoch: [43][10700/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525153    
+2023-12-06 09:19:19,730 - Epoch: [43][10800/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525145    
+2023-12-06 09:20:12,192 - Epoch: [43][10900/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525139    
+2023-12-06 09:21:04,782 - Epoch: [43][11000/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.525146    
+2023-12-06 09:21:57,261 - Epoch: [43][11100/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.525143    
+2023-12-06 09:22:49,712 - Epoch: [43][11200/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.525137    
+2023-12-06 09:23:42,210 - Epoch: [43][11300/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.525135    
+2023-12-06 09:24:34,673 - Epoch: [43][11400/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.525130    
+2023-12-06 09:25:27,162 - Epoch: [43][11500/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.525128    
+2023-12-06 09:26:19,632 - Epoch: [43][11600/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.525124    
+2023-12-06 09:27:12,122 - Epoch: [43][11700/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.525122    
+2023-12-06 09:28:04,523 - Epoch: [43][11800/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.525112    
+2023-12-06 09:28:56,936 - Epoch: [43][11900/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.525103    
+2023-12-06 09:29:49,358 - Epoch: [43][12000/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.525096    
+2023-12-06 09:30:41,874 - Epoch: [43][12100/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.525096    
+2023-12-06 09:31:17,472 - Epoch: [43][12168/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.525087    
+2023-12-06 09:31:17,843 - --- validate (epoch=43)-----------
+2023-12-06 09:31:17,843 - 167951 samples (256 per mini-batch)
+2023-12-06 09:32:08,574 - Epoch: [43][  100/  657]    Loss 0.000000    Overall Loss 0.014207    
+2023-12-06 09:32:57,164 - Epoch: [43][  200/  657]    Loss 0.000000    Overall Loss 0.014157    
+2023-12-06 09:33:45,709 - Epoch: [43][  300/  657]    Loss 0.000000    Overall Loss 0.014151    
+2023-12-06 09:34:34,300 - Epoch: [43][  400/  657]    Loss 0.000000    Overall Loss 0.014152    
+2023-12-06 09:35:22,873 - Epoch: [43][  500/  657]    Loss 0.000000    Overall Loss 0.014151    
+2023-12-06 09:36:11,428 - Epoch: [43][  600/  657]    Loss 0.000000    Overall Loss 0.014142    
+2023-12-06 09:36:38,665 - Epoch: [43][  657/  657]    Loss 0.000000    Overall Loss 0.014142    
+2023-12-06 09:36:38,851 - ==> Overall Loss: 0.014
+
+2023-12-06 09:36:38,852 - ==> Best [Overall Loss: 0.014038 on epoch: 40]
+2023-12-06 09:36:38,852 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 09:36:38,873 - 
+
+2023-12-06 09:36:38,873 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 09:37:39,164 - Epoch: [44][  100/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.602860    
+2023-12-06 09:38:31,542 - Epoch: [44][  200/12168]    Overall Loss 0.013418    Objective Loss 0.000000    Distill Loss 0.013418                                        LR 0.000031    Time 0.563305    
+2023-12-06 09:39:23,960 - Epoch: [44][  300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.550253    
+2023-12-06 09:40:16,324 - Epoch: [44][  400/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.543592    
+2023-12-06 09:41:08,787 - Epoch: [44][  500/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.539793    
+2023-12-06 09:42:01,210 - Epoch: [44][  600/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.537194    
+2023-12-06 09:42:53,604 - Epoch: [44][  700/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.535295    
+2023-12-06 09:43:46,016 - Epoch: [44][  800/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.533894    
+2023-12-06 09:44:38,466 - Epoch: [44][  900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.532847    
+2023-12-06 09:45:30,870 - Epoch: [44][ 1000/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.531962    
+2023-12-06 09:46:23,335 - Epoch: [44][ 1100/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.531294    
+2023-12-06 09:47:15,768 - Epoch: [44][ 1200/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.530711    
+2023-12-06 09:48:08,182 - Epoch: [44][ 1300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.530203    
+2023-12-06 09:49:00,613 - Epoch: [44][ 1400/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.529780    
+2023-12-06 09:49:53,072 - Epoch: [44][ 1500/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.529432    
+2023-12-06 09:50:45,558 - Epoch: [44][ 1600/12168]    Overall Loss 0.013449    Objective Loss 0.000000    Distill Loss 0.013449                                        LR 0.000031    Time 0.529143    
+2023-12-06 09:51:38,058 - Epoch: [44][ 1700/12168]    Overall Loss 0.013453    Objective Loss 0.000000    Distill Loss 0.013453                                        LR 0.000031    Time 0.528898    
+2023-12-06 09:52:30,588 - Epoch: [44][ 1800/12168]    Overall Loss 0.013454    Objective Loss 0.000000    Distill Loss 0.013454                                        LR 0.000031    Time 0.528696    
+2023-12-06 09:53:23,209 - Epoch: [44][ 1900/12168]    Overall Loss 0.013458    Objective Loss 0.000000    Distill Loss 0.013458                                        LR 0.000031    Time 0.528563    
+2023-12-06 09:54:15,580 - Epoch: [44][ 2000/12168]    Overall Loss 0.013455    Objective Loss 0.000000    Distill Loss 0.013455                                        LR 0.000031    Time 0.528319    
+2023-12-06 09:55:08,012 - Epoch: [44][ 2100/12168]    Overall Loss 0.013457    Objective Loss 0.000000    Distill Loss 0.013457                                        LR 0.000031    Time 0.528127    
+2023-12-06 09:56:00,480 - Epoch: [44][ 2200/12168]    Overall Loss 0.013455    Objective Loss 0.000000    Distill Loss 0.013455                                        LR 0.000031    Time 0.527968    
+2023-12-06 09:56:52,886 - Epoch: [44][ 2300/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.527797    
+2023-12-06 09:57:45,279 - Epoch: [44][ 2400/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.527634    
+2023-12-06 09:58:37,727 - Epoch: [44][ 2500/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.527507    
+2023-12-06 09:59:30,231 - Epoch: [44][ 2600/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.527411    
+2023-12-06 10:00:22,652 - Epoch: [44][ 2700/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.527291    
+2023-12-06 10:01:15,074 - Epoch: [44][ 2800/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.527180    
+2023-12-06 10:02:07,540 - Epoch: [44][ 2900/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.527092    
+2023-12-06 10:02:59,957 - Epoch: [44][ 3000/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.526993    
+2023-12-06 10:03:52,370 - Epoch: [44][ 3100/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526900    
+2023-12-06 10:04:44,737 - Epoch: [44][ 3200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526798    
+2023-12-06 10:05:37,188 - Epoch: [44][ 3300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526728    
+2023-12-06 10:06:29,640 - Epoch: [44][ 3400/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526662    
+2023-12-06 10:07:22,102 - Epoch: [44][ 3500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526602    
+2023-12-06 10:08:14,510 - Epoch: [44][ 3600/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526531    
+2023-12-06 10:09:06,934 - Epoch: [44][ 3700/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526468    
+2023-12-06 10:09:59,393 - Epoch: [44][ 3800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526418    
+2023-12-06 10:10:51,792 - Epoch: [44][ 3900/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526355    
+2023-12-06 10:11:44,240 - Epoch: [44][ 4000/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.526307    
+2023-12-06 10:12:36,677 - Epoch: [44][ 4100/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.526259    
+2023-12-06 10:13:29,054 - Epoch: [44][ 4200/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.526199    
+2023-12-06 10:14:21,511 - Epoch: [44][ 4300/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.526161    
+2023-12-06 10:15:13,980 - Epoch: [44][ 4400/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.526126    
+2023-12-06 10:16:06,492 - Epoch: [44][ 4500/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.526103    
+2023-12-06 10:16:58,914 - Epoch: [44][ 4600/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.526062    
+2023-12-06 10:17:51,315 - Epoch: [44][ 4700/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.526017    
+2023-12-06 10:18:43,686 - Epoch: [44][ 4800/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525968    
+2023-12-06 10:19:36,086 - Epoch: [44][ 4900/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525928    
+2023-12-06 10:20:28,567 - Epoch: [44][ 5000/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525905    
+2023-12-06 10:21:21,009 - Epoch: [44][ 5100/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525875    
+2023-12-06 10:22:13,416 - Epoch: [44][ 5200/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525839    
+2023-12-06 10:23:05,838 - Epoch: [44][ 5300/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525808    
+2023-12-06 10:23:58,273 - Epoch: [44][ 5400/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525781    
+2023-12-06 10:24:50,686 - Epoch: [44][ 5500/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525750    
+2023-12-06 10:25:43,071 - Epoch: [44][ 5600/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525716    
+2023-12-06 10:26:35,538 - Epoch: [44][ 5700/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.525697    
+2023-12-06 10:27:27,976 - Epoch: [44][ 5800/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525673    
+2023-12-06 10:28:20,363 - Epoch: [44][ 5900/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525642    
+2023-12-06 10:29:12,784 - Epoch: [44][ 6000/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525618    
+2023-12-06 10:30:05,219 - Epoch: [44][ 6100/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525597    
+2023-12-06 10:30:57,681 - Epoch: [44][ 6200/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525580    
+2023-12-06 10:31:50,084 - Epoch: [44][ 6300/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525555    
+2023-12-06 10:32:42,570 - Epoch: [44][ 6400/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525544    
+2023-12-06 10:33:35,007 - Epoch: [44][ 6500/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525525    
+2023-12-06 10:34:27,391 - Epoch: [44][ 6600/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525499    
+2023-12-06 10:35:19,880 - Epoch: [44][ 6700/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525490    
+2023-12-06 10:36:12,349 - Epoch: [44][ 6800/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525477    
+2023-12-06 10:37:04,755 - Epoch: [44][ 6900/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525456    
+2023-12-06 10:37:57,208 - Epoch: [44][ 7000/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525443    
+2023-12-06 10:38:49,615 - Epoch: [44][ 7100/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525423    
+2023-12-06 10:39:42,035 - Epoch: [44][ 7200/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525405    
+2023-12-06 10:40:34,415 - Epoch: [44][ 7300/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525383    
+2023-12-06 10:41:26,820 - Epoch: [44][ 7400/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525364    
+2023-12-06 10:42:19,244 - Epoch: [44][ 7500/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.525349    
+2023-12-06 10:43:11,642 - Epoch: [44][ 7600/12168]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                                        LR 0.000031    Time 0.525331    
+2023-12-06 10:44:04,129 - Epoch: [44][ 7700/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525324    
+2023-12-06 10:44:56,589 - Epoch: [44][ 7800/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.525314    
+2023-12-06 10:45:49,015 - Epoch: [44][ 7900/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525301    
+2023-12-06 10:46:41,395 - Epoch: [44][ 8000/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525281    
+2023-12-06 10:47:33,756 - Epoch: [44][ 8100/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525261    
+2023-12-06 10:48:26,215 - Epoch: [44][ 8200/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525252    
+2023-12-06 10:49:18,664 - Epoch: [44][ 8300/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525242    
+2023-12-06 10:50:11,181 - Epoch: [44][ 8400/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525241    
+2023-12-06 10:51:03,603 - Epoch: [44][ 8500/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525229    
+2023-12-06 10:51:56,037 - Epoch: [44][ 8600/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525218    
+2023-12-06 10:52:48,521 - Epoch: [44][ 8700/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525213    
+2023-12-06 10:53:40,966 - Epoch: [44][ 8800/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525204    
+2023-12-06 10:54:33,492 - Epoch: [44][ 8900/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525204    
+2023-12-06 10:55:25,981 - Epoch: [44][ 9000/12168]    Overall Loss 0.013437    Objective Loss 0.000000    Distill Loss 0.013437                                        LR 0.000031    Time 0.525201    
+2023-12-06 10:56:18,458 - Epoch: [44][ 9100/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525196    
+2023-12-06 10:57:10,892 - Epoch: [44][ 9200/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525186    
+2023-12-06 10:58:03,362 - Epoch: [44][ 9300/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525180    
+2023-12-06 10:58:55,802 - Epoch: [44][ 9400/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525172    
+2023-12-06 10:59:48,223 - Epoch: [44][ 9500/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525161    
+2023-12-06 11:00:40,685 - Epoch: [44][ 9600/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525155    
+2023-12-06 11:01:33,118 - Epoch: [44][ 9700/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525146    
+2023-12-06 11:02:25,678 - Epoch: [44][ 9800/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525150    
+2023-12-06 11:03:18,161 - Epoch: [44][ 9900/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.525147    
+2023-12-06 11:04:10,581 - Epoch: [44][10000/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525137    
+2023-12-06 11:05:02,988 - Epoch: [44][10100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525126    
+2023-12-06 11:05:55,472 - Epoch: [44][10200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525123    
+2023-12-06 11:06:47,989 - Epoch: [44][10300/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525123    
+2023-12-06 11:07:40,469 - Epoch: [44][10400/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525120    
+2023-12-06 11:08:32,917 - Epoch: [44][10500/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525113    
+2023-12-06 11:09:25,427 - Epoch: [44][10600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525113    
+2023-12-06 11:10:17,922 - Epoch: [44][10700/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525111    
+2023-12-06 11:11:10,390 - Epoch: [44][10800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525107    
+2023-12-06 11:12:02,834 - Epoch: [44][10900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525100    
+2023-12-06 11:12:55,239 - Epoch: [44][11000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525091    
+2023-12-06 11:13:47,655 - Epoch: [44][11100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525082    
+2023-12-06 11:14:40,105 - Epoch: [44][11200/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525076    
+2023-12-06 11:15:32,586 - Epoch: [44][11300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525074    
+2023-12-06 11:16:25,064 - Epoch: [44][11400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525071    
+2023-12-06 11:17:17,593 - Epoch: [44][11500/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525073    
+2023-12-06 11:18:10,036 - Epoch: [44][11600/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525067    
+2023-12-06 11:19:02,496 - Epoch: [44][11700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525062    
+2023-12-06 11:19:54,919 - Epoch: [44][11800/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525055    
+2023-12-06 11:20:47,447 - Epoch: [44][11900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525057    
+2023-12-06 11:21:39,891 - Epoch: [44][12000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525051    
+2023-12-06 11:22:32,375 - Epoch: [44][12100/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525049    
+2023-12-06 11:23:08,068 - Epoch: [44][12168/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525048    
+2023-12-06 11:23:08,442 - --- validate (epoch=44)-----------
+2023-12-06 11:23:08,442 - 167951 samples (256 per mini-batch)
+2023-12-06 11:23:59,186 - Epoch: [44][  100/  657]    Loss 0.000000    Overall Loss 0.014039    
+2023-12-06 11:24:47,757 - Epoch: [44][  200/  657]    Loss 0.000000    Overall Loss 0.014034    
+2023-12-06 11:25:36,373 - Epoch: [44][  300/  657]    Loss 0.000000    Overall Loss 0.014028    
+2023-12-06 11:26:24,943 - Epoch: [44][  400/  657]    Loss 0.000000    Overall Loss 0.014026    
+2023-12-06 11:27:13,503 - Epoch: [44][  500/  657]    Loss 0.000000    Overall Loss 0.014023    
+2023-12-06 11:28:02,067 - Epoch: [44][  600/  657]    Loss 0.000000    Overall Loss 0.014028    
+2023-12-06 11:28:29,323 - Epoch: [44][  657/  657]    Loss 0.000000    Overall Loss 0.014027    
+2023-12-06 11:28:29,514 - ==> Overall Loss: 0.014
+
+2023-12-06 11:28:29,516 - ==> Best [Overall Loss: 0.014027 on epoch: 44]
+2023-12-06 11:28:29,516 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 11:28:29,543 - 
+
+2023-12-06 11:28:29,543 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 11:29:29,746 - Epoch: [45][  100/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000031    Time 0.601994    
+2023-12-06 11:30:22,196 - Epoch: [45][  200/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000031    Time 0.563206    
+2023-12-06 11:31:14,636 - Epoch: [45][  300/12168]    Overall Loss 0.013419    Objective Loss 0.000000    Distill Loss 0.013419                                        LR 0.000031    Time 0.550259    
+2023-12-06 11:32:07,193 - Epoch: [45][  400/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.544078    
+2023-12-06 11:32:59,615 - Epoch: [45][  500/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.540099    
+2023-12-06 11:33:52,010 - Epoch: [45][  600/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.537403    
+2023-12-06 11:34:44,377 - Epoch: [45][  700/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.535436    
+2023-12-06 11:35:36,862 - Epoch: [45][  800/12168]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                                        LR 0.000031    Time 0.534108    
+2023-12-06 11:36:29,318 - Epoch: [45][  900/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.533044    
+2023-12-06 11:37:21,792 - Epoch: [45][ 1000/12168]    Overall Loss 0.013451    Objective Loss 0.000000    Distill Loss 0.013451                                        LR 0.000031    Time 0.532210    
+2023-12-06 11:38:14,202 - Epoch: [45][ 1100/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.531470    
+2023-12-06 11:39:06,654 - Epoch: [45][ 1200/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.530887    
+2023-12-06 11:39:59,141 - Epoch: [45][ 1300/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.530422    
+2023-12-06 11:40:51,647 - Epoch: [45][ 1400/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.530037    
+2023-12-06 11:41:44,088 - Epoch: [45][ 1500/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.529659    
+2023-12-06 11:42:36,548 - Epoch: [45][ 1600/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.529341    
+2023-12-06 11:43:28,952 - Epoch: [45][ 1700/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.529027    
+2023-12-06 11:44:21,359 - Epoch: [45][ 1800/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.528750    
+2023-12-06 11:45:13,725 - Epoch: [45][ 1900/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.528480    
+2023-12-06 11:46:06,160 - Epoch: [45][ 2000/12168]    Overall Loss 0.013451    Objective Loss 0.000000    Distill Loss 0.013451                                        LR 0.000031    Time 0.528272    
+2023-12-06 11:46:58,532 - Epoch: [45][ 2100/12168]    Overall Loss 0.013453    Objective Loss 0.000000    Distill Loss 0.013453                                        LR 0.000031    Time 0.528054    
+2023-12-06 11:47:51,020 - Epoch: [45][ 2200/12168]    Overall Loss 0.013452    Objective Loss 0.000000    Distill Loss 0.013452                                        LR 0.000031    Time 0.527908    
+2023-12-06 11:48:43,507 - Epoch: [45][ 2300/12168]    Overall Loss 0.013450    Objective Loss 0.000000    Distill Loss 0.013450                                        LR 0.000031    Time 0.527775    
+2023-12-06 11:49:35,994 - Epoch: [45][ 2400/12168]    Overall Loss 0.013451    Objective Loss 0.000000    Distill Loss 0.013451                                        LR 0.000031    Time 0.527652    
+2023-12-06 11:50:28,419 - Epoch: [45][ 2500/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.527514    
+2023-12-06 11:51:20,816 - Epoch: [45][ 2600/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.527377    
+2023-12-06 11:52:13,248 - Epoch: [45][ 2700/12168]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                                        LR 0.000031    Time 0.527262    
+2023-12-06 11:53:05,663 - Epoch: [45][ 2800/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.527150    
+2023-12-06 11:53:58,075 - Epoch: [45][ 2900/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.527045    
+2023-12-06 11:54:50,511 - Epoch: [45][ 3000/12168]    Overall Loss 0.013447    Objective Loss 0.000000    Distill Loss 0.013447                                        LR 0.000031    Time 0.526954    
+2023-12-06 11:55:42,927 - Epoch: [45][ 3100/12168]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                                        LR 0.000031    Time 0.526863    
+2023-12-06 11:56:35,413 - Epoch: [45][ 3200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526799    
+2023-12-06 11:57:27,833 - Epoch: [45][ 3300/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526719    
+2023-12-06 11:58:20,309 - Epoch: [45][ 3400/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.526661    
+2023-12-06 11:59:12,746 - Epoch: [45][ 3500/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.526594    
+2023-12-06 12:00:05,188 - Epoch: [45][ 3600/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526533    
+2023-12-06 12:00:57,561 - Epoch: [45][ 3700/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526457    
+2023-12-06 12:01:50,005 - Epoch: [45][ 3800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.526402    
+2023-12-06 12:02:42,398 - Epoch: [45][ 3900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.526338    
+2023-12-06 12:03:34,812 - Epoch: [45][ 4000/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526282    
+2023-12-06 12:04:27,289 - Epoch: [45][ 4100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526245    
+2023-12-06 12:05:19,779 - Epoch: [45][ 4200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526212    
+2023-12-06 12:06:12,270 - Epoch: [45][ 4300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526181    
+2023-12-06 12:07:04,682 - Epoch: [45][ 4400/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.526133    
+2023-12-06 12:07:57,145 - Epoch: [45][ 4500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526099    
+2023-12-06 12:08:49,553 - Epoch: [45][ 4600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526054    
+2023-12-06 12:09:42,045 - Epoch: [45][ 4700/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.526029    
+2023-12-06 12:10:34,514 - Epoch: [45][ 4800/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.526001    
+2023-12-06 12:11:26,994 - Epoch: [45][ 4900/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525975    
+2023-12-06 12:12:19,427 - Epoch: [45][ 5000/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525942    
+2023-12-06 12:13:11,852 - Epoch: [45][ 5100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525908    
+2023-12-06 12:14:04,257 - Epoch: [45][ 5200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525872    
+2023-12-06 12:14:56,712 - Epoch: [45][ 5300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525846    
+2023-12-06 12:15:49,150 - Epoch: [45][ 5400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525818    
+2023-12-06 12:16:41,612 - Epoch: [45][ 5500/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525796    
+2023-12-06 12:17:34,102 - Epoch: [45][ 5600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525779    
+2023-12-06 12:18:26,547 - Epoch: [45][ 5700/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525756    
+2023-12-06 12:19:18,948 - Epoch: [45][ 5800/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525725    
+2023-12-06 12:20:11,428 - Epoch: [45][ 5900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525709    
+2023-12-06 12:21:03,833 - Epoch: [45][ 6000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525680    
+2023-12-06 12:21:56,229 - Epoch: [45][ 6100/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525652    
+2023-12-06 12:22:48,743 - Epoch: [45][ 6200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525643    
+2023-12-06 12:23:41,143 - Epoch: [45][ 6300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525616    
+2023-12-06 12:24:33,644 - Epoch: [45][ 6400/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525606    
+2023-12-06 12:25:26,048 - Epoch: [45][ 6500/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525582    
+2023-12-06 12:26:18,513 - Epoch: [45][ 6600/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525567    
+2023-12-06 12:27:10,942 - Epoch: [45][ 6700/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525547    
+2023-12-06 12:28:03,420 - Epoch: [45][ 6800/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525536    
+2023-12-06 12:28:55,784 - Epoch: [45][ 6900/12168]    Overall Loss 0.013439    Objective Loss 0.000000    Distill Loss 0.013439                                        LR 0.000031    Time 0.525508    
+2023-12-06 12:29:48,183 - Epoch: [45][ 7000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525486    
+2023-12-06 12:30:40,618 - Epoch: [45][ 7100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525469    
+2023-12-06 12:31:33,054 - Epoch: [45][ 7200/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525453    
+2023-12-06 12:32:25,433 - Epoch: [45][ 7300/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525430    
+2023-12-06 12:33:17,882 - Epoch: [45][ 7400/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525417    
+2023-12-06 12:34:10,321 - Epoch: [45][ 7500/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525403    
+2023-12-06 12:35:02,852 - Epoch: [45][ 7600/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525401    
+2023-12-06 12:35:55,327 - Epoch: [45][ 7700/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525392    
+2023-12-06 12:36:47,771 - Epoch: [45][ 7800/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525379    
+2023-12-06 12:37:40,207 - Epoch: [45][ 7900/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525366    
+2023-12-06 12:38:32,624 - Epoch: [45][ 8000/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525351    
+2023-12-06 12:39:25,062 - Epoch: [45][ 8100/12168]    Overall Loss 0.013440    Objective Loss 0.000000    Distill Loss 0.013440                                        LR 0.000031    Time 0.525339    
+2023-12-06 12:40:17,501 - Epoch: [45][ 8200/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525326    
+2023-12-06 12:41:09,983 - Epoch: [45][ 8300/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525320    
+2023-12-06 12:42:02,375 - Epoch: [45][ 8400/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525303    
+2023-12-06 12:42:54,788 - Epoch: [45][ 8500/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525289    
+2023-12-06 12:43:47,183 - Epoch: [45][ 8600/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525273    
+2023-12-06 12:44:39,618 - Epoch: [45][ 8700/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525262    
+2023-12-06 12:45:32,121 - Epoch: [45][ 8800/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525259    
+2023-12-06 12:46:24,572 - Epoch: [45][ 8900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525250    
+2023-12-06 12:47:17,037 - Epoch: [45][ 9000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525243    
+2023-12-06 12:48:09,517 - Epoch: [45][ 9100/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525238    
+2023-12-06 12:49:01,920 - Epoch: [45][ 9200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525224    
+2023-12-06 12:49:54,342 - Epoch: [45][ 9300/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525213    
+2023-12-06 12:50:46,781 - Epoch: [45][ 9400/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525204    
+2023-12-06 12:51:39,269 - Epoch: [45][ 9500/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525200    
+2023-12-06 12:52:31,743 - Epoch: [45][ 9600/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525195    
+2023-12-06 12:53:24,237 - Epoch: [45][ 9700/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525192    
+2023-12-06 12:54:16,723 - Epoch: [45][ 9800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525188    
+2023-12-06 12:55:09,229 - Epoch: [45][ 9900/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525187    
+2023-12-06 12:56:01,660 - Epoch: [45][10000/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525178    
+2023-12-06 12:56:54,190 - Epoch: [45][10100/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525179    
+2023-12-06 12:57:46,715 - Epoch: [45][10200/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525179    
+2023-12-06 12:58:39,175 - Epoch: [45][10300/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525173    
+2023-12-06 12:59:31,667 - Epoch: [45][10400/12168]    Overall Loss 0.013444    Objective Loss 0.000000    Distill Loss 0.013444                                        LR 0.000031    Time 0.525170    
+2023-12-06 13:00:24,083 - Epoch: [45][10500/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525160    
+2023-12-06 13:01:16,608 - Epoch: [45][10600/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525161    
+2023-12-06 13:02:09,094 - Epoch: [45][10700/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525158    
+2023-12-06 13:03:01,654 - Epoch: [45][10800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525161    
+2023-12-06 13:03:54,156 - Epoch: [45][10900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525160    
+2023-12-06 13:04:46,606 - Epoch: [45][11000/12168]    Overall Loss 0.013441    Objective Loss 0.000000    Distill Loss 0.013441                                        LR 0.000031    Time 0.525153    
+2023-12-06 13:05:39,206 - Epoch: [45][11100/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525161    
+2023-12-06 13:06:31,739 - Epoch: [45][11200/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525162    
+2023-12-06 13:07:24,333 - Epoch: [45][11300/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525169    
+2023-12-06 13:08:16,876 - Epoch: [45][11400/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525171    
+2023-12-06 13:09:09,296 - Epoch: [45][11500/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525162    
+2023-12-06 13:10:01,728 - Epoch: [45][11600/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525154    
+2023-12-06 13:10:54,285 - Epoch: [45][11700/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525158    
+2023-12-06 13:11:46,802 - Epoch: [45][11800/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525157    
+2023-12-06 13:12:39,207 - Epoch: [45][11900/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525148    
+2023-12-06 13:13:31,688 - Epoch: [45][12000/12168]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                                        LR 0.000031    Time 0.525145    
+2023-12-06 13:14:24,194 - Epoch: [45][12100/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525144    
+2023-12-06 13:14:59,907 - Epoch: [45][12168/12168]    Overall Loss 0.013443    Objective Loss 0.000000    Distill Loss 0.013443                                        LR 0.000031    Time 0.525144    
+2023-12-06 13:15:00,275 - --- validate (epoch=45)-----------
+2023-12-06 13:15:00,276 - 167951 samples (256 per mini-batch)
+2023-12-06 13:15:50,941 - Epoch: [45][  100/  657]    Loss 0.000000    Overall Loss 0.013980    
+2023-12-06 13:16:39,552 - Epoch: [45][  200/  657]    Loss 0.000000    Overall Loss 0.013996    
+2023-12-06 13:17:28,141 - Epoch: [45][  300/  657]    Loss 0.000000    Overall Loss 0.013996    
+2023-12-06 13:18:16,695 - Epoch: [45][  400/  657]    Loss 0.000000    Overall Loss 0.013993    
+2023-12-06 13:19:05,285 - Epoch: [45][  500/  657]    Loss 0.000000    Overall Loss 0.013990    
+2023-12-06 13:19:53,893 - Epoch: [45][  600/  657]    Loss 0.000000    Overall Loss 0.013988    
+2023-12-06 13:20:21,142 - Epoch: [45][  657/  657]    Loss 0.000000    Overall Loss 0.013988    
+2023-12-06 13:20:21,334 - ==> Overall Loss: 0.014
+
+2023-12-06 13:20:21,336 - ==> Best [Overall Loss: 0.013988 on epoch: 45]
+2023-12-06 13:20:21,336 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 13:20:21,363 - 
+
+2023-12-06 13:20:21,363 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 13:21:22,445 - Epoch: [46][  100/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000031    Time 0.610778    
+2023-12-06 13:22:14,912 - Epoch: [46][  200/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000031    Time 0.567705    
+2023-12-06 13:23:07,322 - Epoch: [46][  300/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.553160    
+2023-12-06 13:23:59,779 - Epoch: [46][  400/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.546004    
+2023-12-06 13:24:52,231 - Epoch: [46][  500/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000031    Time 0.541700    
+2023-12-06 13:25:45,009 - Epoch: [46][  600/12168]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                                        LR 0.000031    Time 0.539374    
+2023-12-06 13:26:37,499 - Epoch: [46][  700/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000031    Time 0.537301    
+2023-12-06 13:27:29,918 - Epoch: [46][  800/12168]    Overall Loss 0.013420    Objective Loss 0.000000    Distill Loss 0.013420                                        LR 0.000031    Time 0.535658    
+2023-12-06 13:28:22,332 - Epoch: [46][  900/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.534375    
+2023-12-06 13:29:14,709 - Epoch: [46][ 1000/12168]    Overall Loss 0.013432    Objective Loss 0.000000    Distill Loss 0.013432                                        LR 0.000031    Time 0.533311    
+2023-12-06 13:30:07,126 - Epoch: [46][ 1100/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.532477    
+2023-12-06 13:30:59,566 - Epoch: [46][ 1200/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.531802    
+2023-12-06 13:31:52,046 - Epoch: [46][ 1300/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.531260    
+2023-12-06 13:32:44,501 - Epoch: [46][ 1400/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.530779    
+2023-12-06 13:33:37,030 - Epoch: [46][ 1500/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.530410    
+2023-12-06 13:34:29,459 - Epoch: [46][ 1600/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.530026    
+2023-12-06 13:35:21,913 - Epoch: [46][ 1700/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.529701    
+2023-12-06 13:36:14,332 - Epoch: [46][ 1800/12168]    Overall Loss 0.013430    Objective Loss 0.000000    Distill Loss 0.013430                                        LR 0.000031    Time 0.529393    
+2023-12-06 13:37:06,751 - Epoch: [46][ 1900/12168]    Overall Loss 0.013432    Objective Loss 0.000000    Distill Loss 0.013432                                        LR 0.000031    Time 0.529118    
+2023-12-06 13:37:59,209 - Epoch: [46][ 2000/12168]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                                        LR 0.000031    Time 0.528889    
+2023-12-06 13:38:51,691 - Epoch: [46][ 2100/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.528693    
+2023-12-06 13:39:44,141 - Epoch: [46][ 2200/12168]    Overall Loss 0.013436    Objective Loss 0.000000    Distill Loss 0.013436                                        LR 0.000031    Time 0.528502    
+2023-12-06 13:40:36,622 - Epoch: [46][ 2300/12168]    Overall Loss 0.013433    Objective Loss 0.000000    Distill Loss 0.013433                                        LR 0.000031    Time 0.528339    
+2023-12-06 13:41:29,040 - Epoch: [46][ 2400/12168]    Overall Loss 0.013434    Objective Loss 0.000000    Distill Loss 0.013434                                        LR 0.000031    Time 0.528165    
+2023-12-06 13:42:21,477 - Epoch: [46][ 2500/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.528012    
+2023-12-06 13:43:13,959 - Epoch: [46][ 2600/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.527888    
+2023-12-06 13:44:06,409 - Epoch: [46][ 2700/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.527761    
+2023-12-06 13:44:58,884 - Epoch: [46][ 2800/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.527652    
+2023-12-06 13:45:51,317 - Epoch: [46][ 2900/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.527536    
+2023-12-06 13:46:43,821 - Epoch: [46][ 3000/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.527452    
+2023-12-06 13:47:36,265 - Epoch: [46][ 3100/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.527354    
+2023-12-06 13:48:28,718 - Epoch: [46][ 3200/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000031    Time 0.527264    
+2023-12-06 13:49:21,166 - Epoch: [46][ 3300/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.527179    
+2023-12-06 13:50:13,661 - Epoch: [46][ 3400/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.527112    
+2023-12-06 13:51:06,116 - Epoch: [46][ 3500/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.527038    
+2023-12-06 13:51:58,595 - Epoch: [46][ 3600/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526975    
+2023-12-06 13:52:51,062 - Epoch: [46][ 3700/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526912    
+2023-12-06 13:53:43,508 - Epoch: [46][ 3800/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526846    
+2023-12-06 13:54:36,235 - Epoch: [46][ 3900/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526856    
+2023-12-06 13:55:28,889 - Epoch: [46][ 4000/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526847    
+2023-12-06 13:56:21,510 - Epoch: [46][ 4100/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526831    
+2023-12-06 13:57:14,020 - Epoch: [46][ 4200/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526789    
+2023-12-06 13:58:06,605 - Epoch: [46][ 4300/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526766    
+2023-12-06 13:58:59,127 - Epoch: [46][ 4400/12168]    Overall Loss 0.013421    Objective Loss 0.000000    Distill Loss 0.013421                                        LR 0.000031    Time 0.526730    
+2023-12-06 13:59:51,722 - Epoch: [46][ 4500/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526712    
+2023-12-06 14:00:44,277 - Epoch: [46][ 4600/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526686    
+2023-12-06 14:01:36,774 - Epoch: [46][ 4700/12168]    Overall Loss 0.013421    Objective Loss 0.000000    Distill Loss 0.013421                                        LR 0.000031    Time 0.526649    
+2023-12-06 14:02:29,332 - Epoch: [46][ 4800/12168]    Overall Loss 0.013420    Objective Loss 0.000000    Distill Loss 0.013420                                        LR 0.000031    Time 0.526626    
+2023-12-06 14:03:21,851 - Epoch: [46][ 4900/12168]    Overall Loss 0.013420    Objective Loss 0.000000    Distill Loss 0.013420                                        LR 0.000031    Time 0.526596    
+2023-12-06 14:04:14,298 - Epoch: [46][ 5000/12168]    Overall Loss 0.013420    Objective Loss 0.000000    Distill Loss 0.013420                                        LR 0.000031    Time 0.526553    
+2023-12-06 14:05:06,789 - Epoch: [46][ 5100/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000031    Time 0.526520    
+2023-12-06 14:05:59,406 - Epoch: [46][ 5200/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526512    
+2023-12-06 14:06:51,990 - Epoch: [46][ 5300/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526499    
+2023-12-06 14:07:44,549 - Epoch: [46][ 5400/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526481    
+2023-12-06 14:08:37,156 - Epoch: [46][ 5500/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526473    
+2023-12-06 14:09:29,673 - Epoch: [46][ 5600/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526449    
+2023-12-06 14:10:22,362 - Epoch: [46][ 5700/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526456    
+2023-12-06 14:11:14,914 - Epoch: [46][ 5800/12168]    Overall Loss 0.013423    Objective Loss 0.000000    Distill Loss 0.013423                                        LR 0.000031    Time 0.526440    
+2023-12-06 14:12:07,434 - Epoch: [46][ 5900/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526418    
+2023-12-06 14:12:59,962 - Epoch: [46][ 6000/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526398    
+2023-12-06 14:13:52,448 - Epoch: [46][ 6100/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526373    
+2023-12-06 14:14:44,965 - Epoch: [46][ 6200/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526353    
+2023-12-06 14:15:37,452 - Epoch: [46][ 6300/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526329    
+2023-12-06 14:16:30,169 - Epoch: [46][ 6400/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526341    
+2023-12-06 14:17:22,710 - Epoch: [46][ 6500/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526327    
+2023-12-06 14:18:15,262 - Epoch: [46][ 6600/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526314    
+2023-12-06 14:19:07,868 - Epoch: [46][ 6700/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526309    
+2023-12-06 14:20:00,533 - Epoch: [46][ 6800/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526314    
+2023-12-06 14:20:53,091 - Epoch: [46][ 6900/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526303    
+2023-12-06 14:21:45,642 - Epoch: [46][ 7000/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526291    
+2023-12-06 14:22:38,148 - Epoch: [46][ 7100/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526273    
+2023-12-06 14:23:30,705 - Epoch: [46][ 7200/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526263    
+2023-12-06 14:24:23,336 - Epoch: [46][ 7300/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526263    
+2023-12-06 14:25:15,921 - Epoch: [46][ 7400/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526257    
+2023-12-06 14:26:08,414 - Epoch: [46][ 7500/12168]    Overall Loss 0.013424    Objective Loss 0.000000    Distill Loss 0.013424                                        LR 0.000031    Time 0.526239    
+2023-12-06 14:27:01,126 - Epoch: [46][ 7600/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000031    Time 0.526250    
+2023-12-06 14:27:53,706 - Epoch: [46][ 7700/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526244    
+2023-12-06 14:28:46,243 - Epoch: [46][ 7800/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526232    
+2023-12-06 14:29:38,862 - Epoch: [46][ 7900/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.526231    
+2023-12-06 14:30:31,422 - Epoch: [46][ 8000/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526223    
+2023-12-06 14:31:24,061 - Epoch: [46][ 8100/12168]    Overall Loss 0.013426    Objective Loss 0.000000    Distill Loss 0.013426                                        LR 0.000031    Time 0.526224    
+2023-12-06 14:32:16,616 - Epoch: [46][ 8200/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.526216    
+2023-12-06 14:33:09,163 - Epoch: [46][ 8300/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.526206    
+2023-12-06 14:34:01,676 - Epoch: [46][ 8400/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.526193    
+2023-12-06 14:34:54,229 - Epoch: [46][ 8500/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.526185    
+2023-12-06 14:35:46,737 - Epoch: [46][ 8600/12168]    Overall Loss 0.013427    Objective Loss 0.000000    Distill Loss 0.013427                                        LR 0.000031    Time 0.526171    
+2023-12-06 14:36:39,287 - Epoch: [46][ 8700/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526163    
+2023-12-06 14:37:31,802 - Epoch: [46][ 8800/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526152    
+2023-12-06 14:38:24,337 - Epoch: [46][ 8900/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526142    
+2023-12-06 14:39:16,877 - Epoch: [46][ 9000/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526133    
+2023-12-06 14:40:09,414 - Epoch: [46][ 9100/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526125    
+2023-12-06 14:41:01,876 - Epoch: [46][ 9200/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.526108    
+2023-12-06 14:41:54,370 - Epoch: [46][ 9300/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.526095    
+2023-12-06 14:42:46,792 - Epoch: [46][ 9400/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.526075    
+2023-12-06 14:43:39,259 - Epoch: [46][ 9500/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526060    
+2023-12-06 14:44:31,730 - Epoch: [46][ 9600/12168]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                                        LR 0.000031    Time 0.526045    
+2023-12-06 14:45:24,200 - Epoch: [46][ 9700/12168]    Overall Loss 0.013429    Objective Loss 0.000000    Distill Loss 0.013429                                        LR 0.000031    Time 0.526031    
+2023-12-06 14:46:16,663 - Epoch: [46][ 9800/12168]    Overall Loss 0.013433    Objective Loss 0.000000    Distill Loss 0.013433                                        LR 0.000031    Time 0.526016    
+2023-12-06 14:47:09,121 - Epoch: [46][ 9900/12168]    Overall Loss 0.013446    Objective Loss 0.000000    Distill Loss 0.013446                                        LR 0.000031    Time 0.526001    
+2023-12-06 14:48:01,589 - Epoch: [46][10000/12168]    Overall Loss 0.013456    Objective Loss 0.000000    Distill Loss 0.013456                                        LR 0.000031    Time 0.525988    
+2023-12-06 14:48:54,024 - Epoch: [46][10100/12168]    Overall Loss 0.013463    Objective Loss 0.000000    Distill Loss 0.013463                                        LR 0.000031    Time 0.525971    
+2023-12-06 14:49:46,485 - Epoch: [46][10200/12168]    Overall Loss 0.013470    Objective Loss 0.000000    Distill Loss 0.013470                                        LR 0.000031    Time 0.525958    
+2023-12-06 14:50:38,934 - Epoch: [46][10300/12168]    Overall Loss 0.013476    Objective Loss 0.000000    Distill Loss 0.013476                                        LR 0.000031    Time 0.525943    
+2023-12-06 14:51:31,407 - Epoch: [46][10400/12168]    Overall Loss 0.013482    Objective Loss 0.000000    Distill Loss 0.013482                                        LR 0.000031    Time 0.525931    
+2023-12-06 14:52:23,889 - Epoch: [46][10500/12168]    Overall Loss 0.013487    Objective Loss 0.000000    Distill Loss 0.013487                                        LR 0.000031    Time 0.525920    
+2023-12-06 14:53:16,343 - Epoch: [46][10600/12168]    Overall Loss 0.013491    Objective Loss 0.000000    Distill Loss 0.013491                                        LR 0.000031    Time 0.525907    
+2023-12-06 14:54:08,816 - Epoch: [46][10700/12168]    Overall Loss 0.013495    Objective Loss 0.000000    Distill Loss 0.013495                                        LR 0.000031    Time 0.525896    
+2023-12-06 14:55:01,269 - Epoch: [46][10800/12168]    Overall Loss 0.013499    Objective Loss 0.000000    Distill Loss 0.013499                                        LR 0.000031    Time 0.525883    
+2023-12-06 14:55:53,699 - Epoch: [46][10900/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.525868    
+2023-12-06 14:56:46,154 - Epoch: [46][11000/12168]    Overall Loss 0.013507    Objective Loss 0.000000    Distill Loss 0.013507                                        LR 0.000031    Time 0.525856    
+2023-12-06 14:57:38,662 - Epoch: [46][11100/12168]    Overall Loss 0.013510    Objective Loss 0.000000    Distill Loss 0.013510                                        LR 0.000031    Time 0.525848    
+2023-12-06 14:58:31,108 - Epoch: [46][11200/12168]    Overall Loss 0.013514    Objective Loss 0.000000    Distill Loss 0.013514                                        LR 0.000031    Time 0.525836    
+2023-12-06 14:59:23,602 - Epoch: [46][11300/12168]    Overall Loss 0.013517    Objective Loss 0.000000    Distill Loss 0.013517                                        LR 0.000031    Time 0.525827    
+2023-12-06 15:00:16,069 - Epoch: [46][11400/12168]    Overall Loss 0.013520    Objective Loss 0.000000    Distill Loss 0.013520                                        LR 0.000031    Time 0.525817    
+2023-12-06 15:01:08,571 - Epoch: [46][11500/12168]    Overall Loss 0.013523    Objective Loss 0.000000    Distill Loss 0.013523                                        LR 0.000031    Time 0.525810    
+2023-12-06 15:02:01,075 - Epoch: [46][11600/12168]    Overall Loss 0.013525    Objective Loss 0.000000    Distill Loss 0.013525                                        LR 0.000031    Time 0.525803    
+2023-12-06 15:02:53,678 - Epoch: [46][11700/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525804    
+2023-12-06 15:03:46,210 - Epoch: [46][11800/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525800    
+2023-12-06 15:04:38,704 - Epoch: [46][11900/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.525792    
+2023-12-06 15:05:31,276 - Epoch: [46][12000/12168]    Overall Loss 0.013533    Objective Loss 0.000000    Distill Loss 0.013533                                        LR 0.000031    Time 0.525792    
+2023-12-06 15:06:23,773 - Epoch: [46][12100/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.525784    
+2023-12-06 15:06:59,778 - Epoch: [46][12168/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.525805    
+2023-12-06 15:07:00,139 - --- validate (epoch=46)-----------
+2023-12-06 15:07:00,139 - 167951 samples (256 per mini-batch)
+2023-12-06 15:07:50,973 - Epoch: [46][  100/  657]    Loss 0.000000    Overall Loss 0.014298    
+2023-12-06 15:08:39,627 - Epoch: [46][  200/  657]    Loss 0.000000    Overall Loss 0.014288    
+2023-12-06 15:09:28,289 - Epoch: [46][  300/  657]    Loss 0.000000    Overall Loss 0.014309    
+2023-12-06 15:10:16,918 - Epoch: [46][  400/  657]    Loss 0.000000    Overall Loss 0.014315    
+2023-12-06 15:11:05,524 - Epoch: [46][  500/  657]    Loss 0.000000    Overall Loss 0.014309    
+2023-12-06 15:11:54,157 - Epoch: [46][  600/  657]    Loss 0.000000    Overall Loss 0.014314    
+2023-12-06 15:12:21,430 - Epoch: [46][  657/  657]    Loss 0.000000    Overall Loss 0.014321    
+2023-12-06 15:12:21,621 - ==> Overall Loss: 0.014
+
+2023-12-06 15:12:21,623 - ==> Best [Overall Loss: 0.013988 on epoch: 45]
+2023-12-06 15:12:21,623 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 15:12:21,644 - 
+
+2023-12-06 15:12:21,644 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 15:13:23,515 - Epoch: [47][  100/12168]    Overall Loss 0.013650    Objective Loss 0.000000    Distill Loss 0.013650                                        LR 0.000031    Time 0.618669    
+2023-12-06 15:14:15,964 - Epoch: [47][  200/12168]    Overall Loss 0.013656    Objective Loss 0.000000    Distill Loss 0.013656                                        LR 0.000031    Time 0.571564    
+2023-12-06 15:15:08,388 - Epoch: [47][  300/12168]    Overall Loss 0.013667    Objective Loss 0.000000    Distill Loss 0.013667                                        LR 0.000031    Time 0.555776    
+2023-12-06 15:16:00,848 - Epoch: [47][  400/12168]    Overall Loss 0.013677    Objective Loss 0.000000    Distill Loss 0.013677                                        LR 0.000031    Time 0.547973    
+2023-12-06 15:16:53,359 - Epoch: [47][  500/12168]    Overall Loss 0.013683    Objective Loss 0.000000    Distill Loss 0.013683                                        LR 0.000031    Time 0.543394    
+2023-12-06 15:17:45,825 - Epoch: [47][  600/12168]    Overall Loss 0.013681    Objective Loss 0.000000    Distill Loss 0.013681                                        LR 0.000031    Time 0.540267    
+2023-12-06 15:18:38,322 - Epoch: [47][  700/12168]    Overall Loss 0.013686    Objective Loss 0.000000    Distill Loss 0.013686                                        LR 0.000031    Time 0.538076    
+2023-12-06 15:19:30,825 - Epoch: [47][  800/12168]    Overall Loss 0.013692    Objective Loss 0.000000    Distill Loss 0.013692                                        LR 0.000031    Time 0.536441    
+2023-12-06 15:20:23,275 - Epoch: [47][  900/12168]    Overall Loss 0.013701    Objective Loss 0.000000    Distill Loss 0.013701                                        LR 0.000031    Time 0.535111    
+2023-12-06 15:21:15,758 - Epoch: [47][ 1000/12168]    Overall Loss 0.013707    Objective Loss 0.000000    Distill Loss 0.013707                                        LR 0.000031    Time 0.534080    
+2023-12-06 15:22:08,238 - Epoch: [47][ 1100/12168]    Overall Loss 0.013705    Objective Loss 0.000000    Distill Loss 0.013705                                        LR 0.000031    Time 0.533233    
+2023-12-06 15:23:00,644 - Epoch: [47][ 1200/12168]    Overall Loss 0.013697    Objective Loss 0.000000    Distill Loss 0.013697                                        LR 0.000031    Time 0.532465    
+2023-12-06 15:23:53,096 - Epoch: [47][ 1300/12168]    Overall Loss 0.013692    Objective Loss 0.000000    Distill Loss 0.013692                                        LR 0.000031    Time 0.531852    
+2023-12-06 15:24:45,541 - Epoch: [47][ 1400/12168]    Overall Loss 0.013690    Objective Loss 0.000000    Distill Loss 0.013690                                        LR 0.000031    Time 0.531321    
+2023-12-06 15:25:38,046 - Epoch: [47][ 1500/12168]    Overall Loss 0.013690    Objective Loss 0.000000    Distill Loss 0.013690                                        LR 0.000031    Time 0.530900    
+2023-12-06 15:26:30,465 - Epoch: [47][ 1600/12168]    Overall Loss 0.013688    Objective Loss 0.000000    Distill Loss 0.013688                                        LR 0.000031    Time 0.530479    
+2023-12-06 15:27:22,907 - Epoch: [47][ 1700/12168]    Overall Loss 0.013687    Objective Loss 0.000000    Distill Loss 0.013687                                        LR 0.000031    Time 0.530121    
+2023-12-06 15:28:15,294 - Epoch: [47][ 1800/12168]    Overall Loss 0.013687    Objective Loss 0.000000    Distill Loss 0.013687                                        LR 0.000031    Time 0.529771    
+2023-12-06 15:29:07,737 - Epoch: [47][ 1900/12168]    Overall Loss 0.013684    Objective Loss 0.000000    Distill Loss 0.013684                                        LR 0.000031    Time 0.529488    
+2023-12-06 15:30:00,196 - Epoch: [47][ 2000/12168]    Overall Loss 0.013684    Objective Loss 0.000000    Distill Loss 0.013684                                        LR 0.000031    Time 0.529242    
+2023-12-06 15:30:52,602 - Epoch: [47][ 2100/12168]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                                        LR 0.000031    Time 0.528994    
+2023-12-06 15:31:45,044 - Epoch: [47][ 2200/12168]    Overall Loss 0.013681    Objective Loss 0.000000    Distill Loss 0.013681                                        LR 0.000031    Time 0.528784    
+2023-12-06 15:32:37,594 - Epoch: [47][ 2300/12168]    Overall Loss 0.013674    Objective Loss 0.000000    Distill Loss 0.013674                                        LR 0.000031    Time 0.528640    
+2023-12-06 15:33:30,052 - Epoch: [47][ 2400/12168]    Overall Loss 0.013670    Objective Loss 0.000000    Distill Loss 0.013670                                        LR 0.000031    Time 0.528469    
+2023-12-06 15:34:22,546 - Epoch: [47][ 2500/12168]    Overall Loss 0.013665    Objective Loss 0.000000    Distill Loss 0.013665                                        LR 0.000031    Time 0.528327    
+2023-12-06 15:35:15,040 - Epoch: [47][ 2600/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000031    Time 0.528195    
+2023-12-06 15:36:07,554 - Epoch: [47][ 2700/12168]    Overall Loss 0.013662    Objective Loss 0.000000    Distill Loss 0.013662                                        LR 0.000031    Time 0.528081    
+2023-12-06 15:37:00,027 - Epoch: [47][ 2800/12168]    Overall Loss 0.013660    Objective Loss 0.000000    Distill Loss 0.013660                                        LR 0.000031    Time 0.527960    
+2023-12-06 15:37:52,484 - Epoch: [47][ 2900/12168]    Overall Loss 0.013658    Objective Loss 0.000000    Distill Loss 0.013658                                        LR 0.000031    Time 0.527842    
+2023-12-06 15:38:44,860 - Epoch: [47][ 3000/12168]    Overall Loss 0.013657    Objective Loss 0.000000    Distill Loss 0.013657                                        LR 0.000031    Time 0.527705    
+2023-12-06 15:39:37,239 - Epoch: [47][ 3100/12168]    Overall Loss 0.013652    Objective Loss 0.000000    Distill Loss 0.013652                                        LR 0.000031    Time 0.527577    
+2023-12-06 15:40:29,689 - Epoch: [47][ 3200/12168]    Overall Loss 0.013650    Objective Loss 0.000000    Distill Loss 0.013650                                        LR 0.000031    Time 0.527480    
+2023-12-06 15:41:22,085 - Epoch: [47][ 3300/12168]    Overall Loss 0.013649    Objective Loss 0.000000    Distill Loss 0.013649                                        LR 0.000031    Time 0.527372    
+2023-12-06 15:42:14,536 - Epoch: [47][ 3400/12168]    Overall Loss 0.013648    Objective Loss 0.000000    Distill Loss 0.013648                                        LR 0.000031    Time 0.527287    
+2023-12-06 15:43:07,003 - Epoch: [47][ 3500/12168]    Overall Loss 0.013648    Objective Loss 0.000000    Distill Loss 0.013648                                        LR 0.000031    Time 0.527211    
+2023-12-06 15:43:59,382 - Epoch: [47][ 3600/12168]    Overall Loss 0.013646    Objective Loss 0.000000    Distill Loss 0.013646                                        LR 0.000031    Time 0.527116    
+2023-12-06 15:44:51,827 - Epoch: [47][ 3700/12168]    Overall Loss 0.013644    Objective Loss 0.000000    Distill Loss 0.013644                                        LR 0.000031    Time 0.527043    
+2023-12-06 15:45:44,323 - Epoch: [47][ 3800/12168]    Overall Loss 0.013645    Objective Loss 0.000000    Distill Loss 0.013645                                        LR 0.000031    Time 0.526987    
+2023-12-06 15:46:36,810 - Epoch: [47][ 3900/12168]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                                        LR 0.000031    Time 0.526932    
+2023-12-06 15:47:29,292 - Epoch: [47][ 4000/12168]    Overall Loss 0.013642    Objective Loss 0.000000    Distill Loss 0.013642                                        LR 0.000031    Time 0.526878    
+2023-12-06 15:48:21,772 - Epoch: [47][ 4100/12168]    Overall Loss 0.013640    Objective Loss 0.000000    Distill Loss 0.013640                                        LR 0.000031    Time 0.526827    
+2023-12-06 15:49:14,221 - Epoch: [47][ 4200/12168]    Overall Loss 0.013637    Objective Loss 0.000000    Distill Loss 0.013637                                        LR 0.000031    Time 0.526770    
+2023-12-06 15:50:06,704 - Epoch: [47][ 4300/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000031    Time 0.526724    
+2023-12-06 15:50:59,168 - Epoch: [47][ 4400/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000031    Time 0.526676    
+2023-12-06 15:51:51,638 - Epoch: [47][ 4500/12168]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                                        LR 0.000031    Time 0.526631    
+2023-12-06 15:52:44,075 - Epoch: [47][ 4600/12168]    Overall Loss 0.013634    Objective Loss 0.000000    Distill Loss 0.013634                                        LR 0.000031    Time 0.526581    
+2023-12-06 15:53:36,521 - Epoch: [47][ 4700/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000031    Time 0.526536    
+2023-12-06 15:54:28,970 - Epoch: [47][ 4800/12168]    Overall Loss 0.013632    Objective Loss 0.000000    Distill Loss 0.013632                                        LR 0.000031    Time 0.526492    
+2023-12-06 15:55:21,478 - Epoch: [47][ 4900/12168]    Overall Loss 0.013630    Objective Loss 0.000000    Distill Loss 0.013630                                        LR 0.000031    Time 0.526463    
+2023-12-06 15:56:13,928 - Epoch: [47][ 5000/12168]    Overall Loss 0.013628    Objective Loss 0.000000    Distill Loss 0.013628                                        LR 0.000031    Time 0.526423    
+2023-12-06 15:57:06,412 - Epoch: [47][ 5100/12168]    Overall Loss 0.013629    Objective Loss 0.000000    Distill Loss 0.013629                                        LR 0.000031    Time 0.526391    
+2023-12-06 15:57:58,883 - Epoch: [47][ 5200/12168]    Overall Loss 0.013628    Objective Loss 0.000000    Distill Loss 0.013628                                        LR 0.000031    Time 0.526358    
+2023-12-06 15:58:51,384 - Epoch: [47][ 5300/12168]    Overall Loss 0.013628    Objective Loss 0.000000    Distill Loss 0.013628                                        LR 0.000031    Time 0.526332    
+2023-12-06 15:59:43,855 - Epoch: [47][ 5400/12168]    Overall Loss 0.013626    Objective Loss 0.000000    Distill Loss 0.013626                                        LR 0.000031    Time 0.526301    
+2023-12-06 16:00:36,335 - Epoch: [47][ 5500/12168]    Overall Loss 0.013627    Objective Loss 0.000000    Distill Loss 0.013627                                        LR 0.000031    Time 0.526274    
+2023-12-06 16:01:28,823 - Epoch: [47][ 5600/12168]    Overall Loss 0.013624    Objective Loss 0.000000    Distill Loss 0.013624                                        LR 0.000031    Time 0.526248    
+2023-12-06 16:02:21,296 - Epoch: [47][ 5700/12168]    Overall Loss 0.013623    Objective Loss 0.000000    Distill Loss 0.013623                                        LR 0.000031    Time 0.526221    
+2023-12-06 16:03:13,744 - Epoch: [47][ 5800/12168]    Overall Loss 0.013622    Objective Loss 0.000000    Distill Loss 0.013622                                        LR 0.000031    Time 0.526190    
+2023-12-06 16:04:06,225 - Epoch: [47][ 5900/12168]    Overall Loss 0.013623    Objective Loss 0.000000    Distill Loss 0.013623                                        LR 0.000031    Time 0.526166    
+2023-12-06 16:04:58,704 - Epoch: [47][ 6000/12168]    Overall Loss 0.013623    Objective Loss 0.000000    Distill Loss 0.013623                                        LR 0.000031    Time 0.526143    
+2023-12-06 16:05:51,190 - Epoch: [47][ 6100/12168]    Overall Loss 0.013622    Objective Loss 0.000000    Distill Loss 0.013622                                        LR 0.000031    Time 0.526121    
+2023-12-06 16:06:43,671 - Epoch: [47][ 6200/12168]    Overall Loss 0.013621    Objective Loss 0.000000    Distill Loss 0.013621                                        LR 0.000031    Time 0.526099    
+2023-12-06 16:07:36,147 - Epoch: [47][ 6300/12168]    Overall Loss 0.013621    Objective Loss 0.000000    Distill Loss 0.013621                                        LR 0.000031    Time 0.526078    
+2023-12-06 16:08:28,703 - Epoch: [47][ 6400/12168]    Overall Loss 0.013621    Objective Loss 0.000000    Distill Loss 0.013621                                        LR 0.000031    Time 0.526069    
+2023-12-06 16:09:21,182 - Epoch: [47][ 6500/12168]    Overall Loss 0.013619    Objective Loss 0.000000    Distill Loss 0.013619                                        LR 0.000031    Time 0.526049    
+2023-12-06 16:10:13,625 - Epoch: [47][ 6600/12168]    Overall Loss 0.013618    Objective Loss 0.000000    Distill Loss 0.013618                                        LR 0.000031    Time 0.526024    
+2023-12-06 16:11:06,081 - Epoch: [47][ 6700/12168]    Overall Loss 0.013616    Objective Loss 0.000000    Distill Loss 0.013616                                        LR 0.000031    Time 0.526002    
+2023-12-06 16:11:58,514 - Epoch: [47][ 6800/12168]    Overall Loss 0.013615    Objective Loss 0.000000    Distill Loss 0.013615                                        LR 0.000031    Time 0.525977    
+2023-12-06 16:12:51,009 - Epoch: [47][ 6900/12168]    Overall Loss 0.013614    Objective Loss 0.000000    Distill Loss 0.013614                                        LR 0.000031    Time 0.525961    
+2023-12-06 16:13:43,467 - Epoch: [47][ 7000/12168]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                                        LR 0.000031    Time 0.525941    
+2023-12-06 16:14:35,927 - Epoch: [47][ 7100/12168]    Overall Loss 0.013611    Objective Loss 0.000000    Distill Loss 0.013611                                        LR 0.000031    Time 0.525922    
+2023-12-06 16:15:28,331 - Epoch: [47][ 7200/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000031    Time 0.525895    
+2023-12-06 16:16:20,824 - Epoch: [47][ 7300/12168]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                                        LR 0.000031    Time 0.525881    
+2023-12-06 16:17:13,269 - Epoch: [47][ 7400/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000031    Time 0.525862    
+2023-12-06 16:18:05,720 - Epoch: [47][ 7500/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000031    Time 0.525843    
+2023-12-06 16:18:58,212 - Epoch: [47][ 7600/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000031    Time 0.525830    
+2023-12-06 16:19:50,653 - Epoch: [47][ 7700/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000031    Time 0.525812    
+2023-12-06 16:20:43,121 - Epoch: [47][ 7800/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000031    Time 0.525797    
+2023-12-06 16:21:35,656 - Epoch: [47][ 7900/12168]    Overall Loss 0.013609    Objective Loss 0.000000    Distill Loss 0.013609                                        LR 0.000031    Time 0.525791    
+2023-12-06 16:22:28,084 - Epoch: [47][ 8000/12168]    Overall Loss 0.013608    Objective Loss 0.000000    Distill Loss 0.013608                                        LR 0.000031    Time 0.525771    
+2023-12-06 16:23:20,830 - Epoch: [47][ 8100/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000031    Time 0.525792    
+2023-12-06 16:24:13,468 - Epoch: [47][ 8200/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000031    Time 0.525798    
+2023-12-06 16:25:05,987 - Epoch: [47][ 8300/12168]    Overall Loss 0.013607    Objective Loss 0.000000    Distill Loss 0.013607                                        LR 0.000031    Time 0.525791    
+2023-12-06 16:25:58,448 - Epoch: [47][ 8400/12168]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                                        LR 0.000031    Time 0.525776    
+2023-12-06 16:26:50,891 - Epoch: [47][ 8500/12168]    Overall Loss 0.013605    Objective Loss 0.000000    Distill Loss 0.013605                                        LR 0.000031    Time 0.525760    
+2023-12-06 16:27:43,363 - Epoch: [47][ 8600/12168]    Overall Loss 0.013604    Objective Loss 0.000000    Distill Loss 0.013604                                        LR 0.000031    Time 0.525747    
+2023-12-06 16:28:35,856 - Epoch: [47][ 8700/12168]    Overall Loss 0.013604    Objective Loss 0.000000    Distill Loss 0.013604                                        LR 0.000031    Time 0.525738    
+2023-12-06 16:29:28,370 - Epoch: [47][ 8800/12168]    Overall Loss 0.013604    Objective Loss 0.000000    Distill Loss 0.013604                                        LR 0.000031    Time 0.525730    
+2023-12-06 16:30:20,893 - Epoch: [47][ 8900/12168]    Overall Loss 0.013603    Objective Loss 0.000000    Distill Loss 0.013603                                        LR 0.000031    Time 0.525724    
+2023-12-06 16:31:13,376 - Epoch: [47][ 9000/12168]    Overall Loss 0.013603    Objective Loss 0.000000    Distill Loss 0.013603                                        LR 0.000031    Time 0.525714    
+2023-12-06 16:32:05,911 - Epoch: [47][ 9100/12168]    Overall Loss 0.013602    Objective Loss 0.000000    Distill Loss 0.013602                                        LR 0.000031    Time 0.525710    
+2023-12-06 16:32:58,369 - Epoch: [47][ 9200/12168]    Overall Loss 0.013603    Objective Loss 0.000000    Distill Loss 0.013603                                        LR 0.000031    Time 0.525697    
+2023-12-06 16:33:50,876 - Epoch: [47][ 9300/12168]    Overall Loss 0.013603    Objective Loss 0.000000    Distill Loss 0.013603                                        LR 0.000031    Time 0.525690    
+2023-12-06 16:34:43,361 - Epoch: [47][ 9400/12168]    Overall Loss 0.013602    Objective Loss 0.000000    Distill Loss 0.013602                                        LR 0.000031    Time 0.525681    
+2023-12-06 16:35:35,916 - Epoch: [47][ 9500/12168]    Overall Loss 0.013602    Objective Loss 0.000000    Distill Loss 0.013602                                        LR 0.000031    Time 0.525679    
+2023-12-06 16:36:28,459 - Epoch: [47][ 9600/12168]    Overall Loss 0.013601    Objective Loss 0.000000    Distill Loss 0.013601                                        LR 0.000031    Time 0.525676    
+2023-12-06 16:37:21,028 - Epoch: [47][ 9700/12168]    Overall Loss 0.013601    Objective Loss 0.000000    Distill Loss 0.013601                                        LR 0.000031    Time 0.525676    
+2023-12-06 16:38:13,512 - Epoch: [47][ 9800/12168]    Overall Loss 0.013600    Objective Loss 0.000000    Distill Loss 0.013600                                        LR 0.000031    Time 0.525667    
+2023-12-06 16:39:06,056 - Epoch: [47][ 9900/12168]    Overall Loss 0.013599    Objective Loss 0.000000    Distill Loss 0.013599                                        LR 0.000031    Time 0.525664    
+2023-12-06 16:39:58,526 - Epoch: [47][10000/12168]    Overall Loss 0.013598    Objective Loss 0.000000    Distill Loss 0.013598                                        LR 0.000031    Time 0.525654    
+2023-12-06 16:40:51,059 - Epoch: [47][10100/12168]    Overall Loss 0.013598    Objective Loss 0.000000    Distill Loss 0.013598                                        LR 0.000031    Time 0.525651    
+2023-12-06 16:41:43,533 - Epoch: [47][10200/12168]    Overall Loss 0.013598    Objective Loss 0.000000    Distill Loss 0.013598                                        LR 0.000031    Time 0.525642    
+2023-12-06 16:42:36,019 - Epoch: [47][10300/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000031    Time 0.525634    
+2023-12-06 16:43:28,493 - Epoch: [47][10400/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000031    Time 0.525625    
+2023-12-06 16:44:20,938 - Epoch: [47][10500/12168]    Overall Loss 0.013597    Objective Loss 0.000000    Distill Loss 0.013597                                        LR 0.000031    Time 0.525613    
+2023-12-06 16:45:13,459 - Epoch: [47][10600/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525609    
+2023-12-06 16:46:05,936 - Epoch: [47][10700/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525601    
+2023-12-06 16:46:58,468 - Epoch: [47][10800/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525598    
+2023-12-06 16:47:50,968 - Epoch: [47][10900/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525592    
+2023-12-06 16:48:43,529 - Epoch: [47][11000/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525592    
+2023-12-06 16:49:36,055 - Epoch: [47][11100/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525589    
+2023-12-06 16:50:28,533 - Epoch: [47][11200/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525581    
+2023-12-06 16:51:21,033 - Epoch: [47][11300/12168]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                                        LR 0.000031    Time 0.525576    
+2023-12-06 16:52:13,624 - Epoch: [47][11400/12168]    Overall Loss 0.013595    Objective Loss 0.000000    Distill Loss 0.013595                                        LR 0.000031    Time 0.525579    
+2023-12-06 16:53:06,095 - Epoch: [47][11500/12168]    Overall Loss 0.013595    Objective Loss 0.000000    Distill Loss 0.013595                                        LR 0.000031    Time 0.525571    
+2023-12-06 16:53:58,731 - Epoch: [47][11600/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000031    Time 0.525577    
+2023-12-06 16:54:51,236 - Epoch: [47][11700/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000031    Time 0.525572    
+2023-12-06 16:55:43,730 - Epoch: [47][11800/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000031    Time 0.525567    
+2023-12-06 16:56:36,296 - Epoch: [47][11900/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000031    Time 0.525567    
+2023-12-06 16:57:28,811 - Epoch: [47][12000/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000031    Time 0.525563    
+2023-12-06 16:58:21,280 - Epoch: [47][12100/12168]    Overall Loss 0.013594    Objective Loss 0.000000    Distill Loss 0.013594                                        LR 0.000031    Time 0.525556    
+2023-12-06 16:58:56,889 - Epoch: [47][12168/12168]    Overall Loss 0.013595    Objective Loss 0.000000    Distill Loss 0.013595                                        LR 0.000031    Time 0.525545    
+2023-12-06 16:58:57,254 - --- validate (epoch=47)-----------
+2023-12-06 16:58:57,255 - 167951 samples (256 per mini-batch)
+2023-12-06 16:59:48,064 - Epoch: [47][  100/  657]    Loss 0.000000    Overall Loss 0.014216    
+2023-12-06 17:00:36,699 - Epoch: [47][  200/  657]    Loss 0.000000    Overall Loss 0.014203    
+2023-12-06 17:01:25,314 - Epoch: [47][  300/  657]    Loss 0.000000    Overall Loss 0.014201    
+2023-12-06 17:02:13,930 - Epoch: [47][  400/  657]    Loss 0.000000    Overall Loss 0.014202    
+2023-12-06 17:03:02,552 - Epoch: [47][  500/  657]    Loss 0.000000    Overall Loss 0.014215    
+2023-12-06 17:03:51,184 - Epoch: [47][  600/  657]    Loss 0.000000    Overall Loss 0.014213    
+2023-12-06 17:04:18,460 - Epoch: [47][  657/  657]    Loss 0.000000    Overall Loss 0.014208    
+2023-12-06 17:04:18,660 - ==> Overall Loss: 0.014
+
+2023-12-06 17:04:18,661 - ==> Best [Overall Loss: 0.013988 on epoch: 45]
+2023-12-06 17:04:18,661 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 17:04:18,683 - 
+
+2023-12-06 17:04:18,683 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 17:05:19,487 - Epoch: [48][  100/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.608001    
+2023-12-06 17:06:11,964 - Epoch: [48][  200/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.566368    
+2023-12-06 17:07:04,428 - Epoch: [48][  300/12168]    Overall Loss 0.013553    Objective Loss 0.000000    Distill Loss 0.013553                                        LR 0.000031    Time 0.552446    
+2023-12-06 17:07:56,930 - Epoch: [48][  400/12168]    Overall Loss 0.013546    Objective Loss 0.000000    Distill Loss 0.013546                                        LR 0.000031    Time 0.545581    
+2023-12-06 17:08:49,377 - Epoch: [48][  500/12168]    Overall Loss 0.013539    Objective Loss 0.000000    Distill Loss 0.013539                                        LR 0.000031    Time 0.541353    
+2023-12-06 17:09:41,887 - Epoch: [48][  600/12168]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                                        LR 0.000031    Time 0.538638    
+2023-12-06 17:10:34,372 - Epoch: [48][  700/12168]    Overall Loss 0.013536    Objective Loss 0.000000    Distill Loss 0.013536                                        LR 0.000031    Time 0.536663    
+2023-12-06 17:11:26,790 - Epoch: [48][  800/12168]    Overall Loss 0.013533    Objective Loss 0.000000    Distill Loss 0.013533                                        LR 0.000031    Time 0.535100    
+2023-12-06 17:12:19,214 - Epoch: [48][  900/12168]    Overall Loss 0.013538    Objective Loss 0.000000    Distill Loss 0.013538                                        LR 0.000031    Time 0.533888    
+2023-12-06 17:13:11,632 - Epoch: [48][ 1000/12168]    Overall Loss 0.013544    Objective Loss 0.000000    Distill Loss 0.013544                                        LR 0.000031    Time 0.532915    
+2023-12-06 17:14:04,088 - Epoch: [48][ 1100/12168]    Overall Loss 0.013541    Objective Loss 0.000000    Distill Loss 0.013541                                        LR 0.000031    Time 0.532152    
+2023-12-06 17:14:56,598 - Epoch: [48][ 1200/12168]    Overall Loss 0.013540    Objective Loss 0.000000    Distill Loss 0.013540                                        LR 0.000031    Time 0.531561    
+2023-12-06 17:15:49,072 - Epoch: [48][ 1300/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.531034    
+2023-12-06 17:16:41,552 - Epoch: [48][ 1400/12168]    Overall Loss 0.013536    Objective Loss 0.000000    Distill Loss 0.013536                                        LR 0.000031    Time 0.530587    
+2023-12-06 17:17:34,119 - Epoch: [48][ 1500/12168]    Overall Loss 0.013538    Objective Loss 0.000000    Distill Loss 0.013538                                        LR 0.000031    Time 0.530256    
+2023-12-06 17:18:26,594 - Epoch: [48][ 1600/12168]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                                        LR 0.000031    Time 0.529910    
+2023-12-06 17:19:19,080 - Epoch: [48][ 1700/12168]    Overall Loss 0.013542    Objective Loss 0.000000    Distill Loss 0.013542                                        LR 0.000031    Time 0.529611    
+2023-12-06 17:20:11,538 - Epoch: [48][ 1800/12168]    Overall Loss 0.013540    Objective Loss 0.000000    Distill Loss 0.013540                                        LR 0.000031    Time 0.529330    
+2023-12-06 17:21:04,017 - Epoch: [48][ 1900/12168]    Overall Loss 0.013544    Objective Loss 0.000000    Distill Loss 0.013544                                        LR 0.000031    Time 0.529089    
+2023-12-06 17:21:56,480 - Epoch: [48][ 2000/12168]    Overall Loss 0.013545    Objective Loss 0.000000    Distill Loss 0.013545                                        LR 0.000031    Time 0.528864    
+2023-12-06 17:22:48,974 - Epoch: [48][ 2100/12168]    Overall Loss 0.013546    Objective Loss 0.000000    Distill Loss 0.013546                                        LR 0.000031    Time 0.528676    
+2023-12-06 17:23:41,432 - Epoch: [48][ 2200/12168]    Overall Loss 0.013544    Objective Loss 0.000000    Distill Loss 0.013544                                        LR 0.000031    Time 0.528488    
+2023-12-06 17:24:33,900 - Epoch: [48][ 2300/12168]    Overall Loss 0.013541    Objective Loss 0.000000    Distill Loss 0.013541                                        LR 0.000031    Time 0.528321    
+2023-12-06 17:25:26,376 - Epoch: [48][ 2400/12168]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                                        LR 0.000031    Time 0.528171    
+2023-12-06 17:26:18,856 - Epoch: [48][ 2500/12168]    Overall Loss 0.013534    Objective Loss 0.000000    Distill Loss 0.013534                                        LR 0.000031    Time 0.528035    
+2023-12-06 17:27:11,348 - Epoch: [48][ 2600/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.527914    
+2023-12-06 17:28:03,827 - Epoch: [48][ 2700/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.527797    
+2023-12-06 17:28:56,318 - Epoch: [48][ 2800/12168]    Overall Loss 0.013535    Objective Loss 0.000000    Distill Loss 0.013535                                        LR 0.000031    Time 0.527693    
+2023-12-06 17:29:48,795 - Epoch: [48][ 2900/12168]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                                        LR 0.000031    Time 0.527591    
+2023-12-06 17:30:41,278 - Epoch: [48][ 3000/12168]    Overall Loss 0.013536    Objective Loss 0.000000    Distill Loss 0.013536                                        LR 0.000031    Time 0.527498    
+2023-12-06 17:31:33,743 - Epoch: [48][ 3100/12168]    Overall Loss 0.013533    Objective Loss 0.000000    Distill Loss 0.013533                                        LR 0.000031    Time 0.527405    
+2023-12-06 17:32:26,230 - Epoch: [48][ 3200/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.527325    
+2023-12-06 17:33:18,710 - Epoch: [48][ 3300/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.527247    
+2023-12-06 17:34:11,191 - Epoch: [48][ 3400/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.527175    
+2023-12-06 17:35:03,674 - Epoch: [48][ 3500/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.527106    
+2023-12-06 17:35:56,132 - Epoch: [48][ 3600/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.527035    
+2023-12-06 17:36:48,683 - Epoch: [48][ 3700/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526993    
+2023-12-06 17:37:41,147 - Epoch: [48][ 3800/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.526930    
+2023-12-06 17:38:33,643 - Epoch: [48][ 3900/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526879    
+2023-12-06 17:39:26,122 - Epoch: [48][ 4000/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526826    
+2023-12-06 17:40:18,576 - Epoch: [48][ 4100/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526769    
+2023-12-06 17:41:11,117 - Epoch: [48][ 4200/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526736    
+2023-12-06 17:42:03,601 - Epoch: [48][ 4300/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526691    
+2023-12-06 17:42:56,090 - Epoch: [48][ 4400/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526650    
+2023-12-06 17:43:48,561 - Epoch: [48][ 4500/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526606    
+2023-12-06 17:44:41,020 - Epoch: [48][ 4600/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526561    
+2023-12-06 17:45:33,499 - Epoch: [48][ 4700/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526523    
+2023-12-06 17:46:25,975 - Epoch: [48][ 4800/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526485    
+2023-12-06 17:47:18,641 - Epoch: [48][ 4900/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526488    
+2023-12-06 17:48:11,105 - Epoch: [48][ 5000/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.526451    
+2023-12-06 17:49:03,567 - Epoch: [48][ 5100/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526414    
+2023-12-06 17:49:55,996 - Epoch: [48][ 5200/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526373    
+2023-12-06 17:50:48,528 - Epoch: [48][ 5300/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526352    
+2023-12-06 17:51:41,085 - Epoch: [48][ 5400/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526337    
+2023-12-06 17:52:33,554 - Epoch: [48][ 5500/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526307    
+2023-12-06 17:53:25,980 - Epoch: [48][ 5600/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526269    
+2023-12-06 17:54:18,450 - Epoch: [48][ 5700/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.526241    
+2023-12-06 17:55:10,924 - Epoch: [48][ 5800/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.526215    
+2023-12-06 17:56:03,445 - Epoch: [48][ 5900/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.526197    
+2023-12-06 17:56:56,004 - Epoch: [48][ 6000/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526186    
+2023-12-06 17:57:48,509 - Epoch: [48][ 6100/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.526167    
+2023-12-06 17:58:40,993 - Epoch: [48][ 6200/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526145    
+2023-12-06 17:59:33,494 - Epoch: [48][ 6300/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526127    
+2023-12-06 18:00:25,970 - Epoch: [48][ 6400/12168]    Overall Loss 0.013533    Objective Loss 0.000000    Distill Loss 0.013533                                        LR 0.000031    Time 0.526105    
+2023-12-06 18:01:18,443 - Epoch: [48][ 6500/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.526083    
+2023-12-06 18:02:10,921 - Epoch: [48][ 6600/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.526063    
+2023-12-06 18:03:03,393 - Epoch: [48][ 6700/12168]    Overall Loss 0.013532    Objective Loss 0.000000    Distill Loss 0.013532                                        LR 0.000031    Time 0.526042    
+2023-12-06 18:03:55,885 - Epoch: [48][ 6800/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526025    
+2023-12-06 18:04:48,362 - Epoch: [48][ 6900/12168]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                                        LR 0.000031    Time 0.526007    
+2023-12-06 18:05:40,885 - Epoch: [48][ 7000/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525995    
+2023-12-06 18:06:33,329 - Epoch: [48][ 7100/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525973    
+2023-12-06 18:07:25,847 - Epoch: [48][ 7200/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525961    
+2023-12-06 18:08:18,275 - Epoch: [48][ 7300/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525938    
+2023-12-06 18:09:10,744 - Epoch: [48][ 7400/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525921    
+2023-12-06 18:10:03,218 - Epoch: [48][ 7500/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525904    
+2023-12-06 18:10:55,698 - Epoch: [48][ 7600/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525889    
+2023-12-06 18:11:48,195 - Epoch: [48][ 7700/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525877    
+2023-12-06 18:12:40,686 - Epoch: [48][ 7800/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525864    
+2023-12-06 18:13:33,256 - Epoch: [48][ 7900/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525862    
+2023-12-06 18:14:25,754 - Epoch: [48][ 8000/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525850    
+2023-12-06 18:15:18,271 - Epoch: [48][ 8100/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525841    
+2023-12-06 18:16:10,814 - Epoch: [48][ 8200/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525836    
+2023-12-06 18:17:03,348 - Epoch: [48][ 8300/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525830    
+2023-12-06 18:17:55,837 - Epoch: [48][ 8400/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525818    
+2023-12-06 18:18:48,310 - Epoch: [48][ 8500/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525805    
+2023-12-06 18:19:40,791 - Epoch: [48][ 8600/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525793    
+2023-12-06 18:20:33,226 - Epoch: [48][ 8700/12168]    Overall Loss 0.013530    Objective Loss 0.000000    Distill Loss 0.013530                                        LR 0.000031    Time 0.525776    
+2023-12-06 18:21:25,757 - Epoch: [48][ 8800/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525770    
+2023-12-06 18:22:18,273 - Epoch: [48][ 8900/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525763    
+2023-12-06 18:23:10,731 - Epoch: [48][ 9000/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525749    
+2023-12-06 18:24:03,214 - Epoch: [48][ 9100/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525739    
+2023-12-06 18:24:55,612 - Epoch: [48][ 9200/12168]    Overall Loss 0.013529    Objective Loss 0.000000    Distill Loss 0.013529                                        LR 0.000031    Time 0.525719    
+2023-12-06 18:25:48,103 - Epoch: [48][ 9300/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525710    
+2023-12-06 18:26:40,616 - Epoch: [48][ 9400/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525704    
+2023-12-06 18:27:33,061 - Epoch: [48][ 9500/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525690    
+2023-12-06 18:28:25,548 - Epoch: [48][ 9600/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525681    
+2023-12-06 18:29:18,055 - Epoch: [48][ 9700/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525675    
+2023-12-06 18:30:10,550 - Epoch: [48][ 9800/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525667    
+2023-12-06 18:31:03,086 - Epoch: [48][ 9900/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525664    
+2023-12-06 18:31:55,650 - Epoch: [48][10000/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525663    
+2023-12-06 18:32:48,056 - Epoch: [48][10100/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525647    
+2023-12-06 18:33:40,536 - Epoch: [48][10200/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525638    
+2023-12-06 18:34:32,983 - Epoch: [48][10300/12168]    Overall Loss 0.013526    Objective Loss 0.000000    Distill Loss 0.013526                                        LR 0.000031    Time 0.525627    
+2023-12-06 18:35:25,474 - Epoch: [48][10400/12168]    Overall Loss 0.013526    Objective Loss 0.000000    Distill Loss 0.013526                                        LR 0.000031    Time 0.525619    
+2023-12-06 18:36:17,978 - Epoch: [48][10500/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525613    
+2023-12-06 18:37:10,411 - Epoch: [48][10600/12168]    Overall Loss 0.013526    Objective Loss 0.000000    Distill Loss 0.013526                                        LR 0.000031    Time 0.525601    
+2023-12-06 18:38:02,878 - Epoch: [48][10700/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525592    
+2023-12-06 18:38:55,363 - Epoch: [48][10800/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525585    
+2023-12-06 18:39:47,918 - Epoch: [48][10900/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525584    
+2023-12-06 18:40:40,653 - Epoch: [48][11000/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525600    
+2023-12-06 18:41:33,175 - Epoch: [48][11100/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525596    
+2023-12-06 18:42:25,635 - Epoch: [48][11200/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525587    
+2023-12-06 18:43:18,540 - Epoch: [48][11300/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525617    
+2023-12-06 18:44:11,104 - Epoch: [48][11400/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525617    
+2023-12-06 18:45:03,582 - Epoch: [48][11500/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525610    
+2023-12-06 18:45:56,111 - Epoch: [48][11600/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525606    
+2023-12-06 18:46:48,557 - Epoch: [48][11700/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525596    
+2023-12-06 18:47:41,138 - Epoch: [48][11800/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525598    
+2023-12-06 18:48:33,600 - Epoch: [48][11900/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525589    
+2023-12-06 18:49:26,124 - Epoch: [48][12000/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525586    
+2023-12-06 18:50:18,637 - Epoch: [48][12100/12168]    Overall Loss 0.013527    Objective Loss 0.000000    Distill Loss 0.013527                                        LR 0.000031    Time 0.525582    
+2023-12-06 18:50:54,296 - Epoch: [48][12168/12168]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                                        LR 0.000031    Time 0.525575    
+2023-12-06 18:50:54,655 - --- validate (epoch=48)-----------
+2023-12-06 18:50:54,655 - 167951 samples (256 per mini-batch)
+2023-12-06 18:51:45,347 - Epoch: [48][  100/  657]    Loss 0.000000    Overall Loss 0.014204    
+2023-12-06 18:52:34,010 - Epoch: [48][  200/  657]    Loss 0.000000    Overall Loss 0.014207    
+2023-12-06 18:53:22,615 - Epoch: [48][  300/  657]    Loss 0.000000    Overall Loss 0.014221    
+2023-12-06 18:54:11,237 - Epoch: [48][  400/  657]    Loss 0.000000    Overall Loss 0.014203    
+2023-12-06 18:54:59,874 - Epoch: [48][  500/  657]    Loss 0.000000    Overall Loss 0.014203    
+2023-12-06 18:55:48,489 - Epoch: [48][  600/  657]    Loss 0.000000    Overall Loss 0.014205    
+2023-12-06 18:56:15,743 - Epoch: [48][  657/  657]    Loss 0.000000    Overall Loss 0.014210    
+2023-12-06 18:56:15,929 - ==> Overall Loss: 0.014
+
+2023-12-06 18:56:15,931 - ==> Best [Overall Loss: 0.013988 on epoch: 45]
+2023-12-06 18:56:15,931 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 18:56:15,952 - 
+
+2023-12-06 18:56:15,952 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 18:57:16,594 - Epoch: [49][  100/12168]    Overall Loss 0.013458    Objective Loss 0.000000    Distill Loss 0.013458                                        LR 0.000031    Time 0.606373    
+2023-12-06 18:58:09,030 - Epoch: [49][  200/12168]    Overall Loss 0.013473    Objective Loss 0.000000    Distill Loss 0.013473                                        LR 0.000031    Time 0.565351    
+2023-12-06 18:59:01,486 - Epoch: [49][  300/12168]    Overall Loss 0.013470    Objective Loss 0.000000    Distill Loss 0.013470                                        LR 0.000031    Time 0.551740    
+2023-12-06 18:59:53,962 - Epoch: [49][  400/12168]    Overall Loss 0.013477    Objective Loss 0.000000    Distill Loss 0.013477                                        LR 0.000031    Time 0.544988    
+2023-12-06 19:00:46,463 - Epoch: [49][  500/12168]    Overall Loss 0.013487    Objective Loss 0.000000    Distill Loss 0.013487                                        LR 0.000031    Time 0.540984    
+2023-12-06 19:01:38,991 - Epoch: [49][  600/12168]    Overall Loss 0.013499    Objective Loss 0.000000    Distill Loss 0.013499                                        LR 0.000031    Time 0.538361    
+2023-12-06 19:02:31,448 - Epoch: [49][  700/12168]    Overall Loss 0.013500    Objective Loss 0.000000    Distill Loss 0.013500                                        LR 0.000031    Time 0.536386    
+2023-12-06 19:03:23,878 - Epoch: [49][  800/12168]    Overall Loss 0.013492    Objective Loss 0.000000    Distill Loss 0.013492                                        LR 0.000031    Time 0.534871    
+2023-12-06 19:04:16,300 - Epoch: [49][  900/12168]    Overall Loss 0.013497    Objective Loss 0.000000    Distill Loss 0.013497                                        LR 0.000031    Time 0.533684    
+2023-12-06 19:05:08,716 - Epoch: [49][ 1000/12168]    Overall Loss 0.013500    Objective Loss 0.000000    Distill Loss 0.013500                                        LR 0.000031    Time 0.532728    
+2023-12-06 19:06:01,193 - Epoch: [49][ 1100/12168]    Overall Loss 0.013498    Objective Loss 0.000000    Distill Loss 0.013498                                        LR 0.000031    Time 0.532002    
+2023-12-06 19:06:53,576 - Epoch: [49][ 1200/12168]    Overall Loss 0.013498    Objective Loss 0.000000    Distill Loss 0.013498                                        LR 0.000031    Time 0.531318    
+2023-12-06 19:07:46,057 - Epoch: [49][ 1300/12168]    Overall Loss 0.013492    Objective Loss 0.000000    Distill Loss 0.013492                                        LR 0.000031    Time 0.530815    
+2023-12-06 19:08:38,475 - Epoch: [49][ 1400/12168]    Overall Loss 0.013494    Objective Loss 0.000000    Distill Loss 0.013494                                        LR 0.000031    Time 0.530339    
+2023-12-06 19:09:30,905 - Epoch: [49][ 1500/12168]    Overall Loss 0.013494    Objective Loss 0.000000    Distill Loss 0.013494                                        LR 0.000031    Time 0.529934    
+2023-12-06 19:10:23,303 - Epoch: [49][ 1600/12168]    Overall Loss 0.013497    Objective Loss 0.000000    Distill Loss 0.013497                                        LR 0.000031    Time 0.529560    
+2023-12-06 19:11:15,717 - Epoch: [49][ 1700/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.529239    
+2023-12-06 19:12:08,229 - Epoch: [49][ 1800/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.529008    
+2023-12-06 19:13:00,703 - Epoch: [49][ 1900/12168]    Overall Loss 0.013507    Objective Loss 0.000000    Distill Loss 0.013507                                        LR 0.000031    Time 0.528782    
+2023-12-06 19:13:53,158 - Epoch: [49][ 2000/12168]    Overall Loss 0.013507    Objective Loss 0.000000    Distill Loss 0.013507                                        LR 0.000031    Time 0.528568    
+2023-12-06 19:14:45,602 - Epoch: [49][ 2100/12168]    Overall Loss 0.013510    Objective Loss 0.000000    Distill Loss 0.013510                                        LR 0.000031    Time 0.528370    
+2023-12-06 19:15:38,044 - Epoch: [49][ 2200/12168]    Overall Loss 0.013509    Objective Loss 0.000000    Distill Loss 0.013509                                        LR 0.000031    Time 0.528189    
+2023-12-06 19:16:30,453 - Epoch: [49][ 2300/12168]    Overall Loss 0.013509    Objective Loss 0.000000    Distill Loss 0.013509                                        LR 0.000031    Time 0.528009    
+2023-12-06 19:17:22,969 - Epoch: [49][ 2400/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.527889    
+2023-12-06 19:18:15,418 - Epoch: [49][ 2500/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.527752    
+2023-12-06 19:19:07,877 - Epoch: [49][ 2600/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.527629    
+2023-12-06 19:20:00,263 - Epoch: [49][ 2700/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.527488    
+2023-12-06 19:20:52,680 - Epoch: [49][ 2800/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.527368    
+2023-12-06 19:21:45,147 - Epoch: [49][ 2900/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.527274    
+2023-12-06 19:22:37,621 - Epoch: [49][ 3000/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.527188    
+2023-12-06 19:23:30,108 - Epoch: [49][ 3100/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.527112    
+2023-12-06 19:24:22,557 - Epoch: [49][ 3200/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.527030    
+2023-12-06 19:25:14,971 - Epoch: [49][ 3300/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.526941    
+2023-12-06 19:26:07,397 - Epoch: [49][ 3400/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.526861    
+2023-12-06 19:26:59,922 - Epoch: [49][ 3500/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.526814    
+2023-12-06 19:27:52,340 - Epoch: [49][ 3600/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.526740    
+2023-12-06 19:28:44,793 - Epoch: [49][ 3700/12168]    Overall Loss 0.013507    Objective Loss 0.000000    Distill Loss 0.013507                                        LR 0.000031    Time 0.526679    
+2023-12-06 19:29:37,247 - Epoch: [49][ 3800/12168]    Overall Loss 0.013509    Objective Loss 0.000000    Distill Loss 0.013509                                        LR 0.000031    Time 0.526622    
+2023-12-06 19:30:29,644 - Epoch: [49][ 3900/12168]    Overall Loss 0.013508    Objective Loss 0.000000    Distill Loss 0.013508                                        LR 0.000031    Time 0.526553    
+2023-12-06 19:31:22,038 - Epoch: [49][ 4000/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.526487    
+2023-12-06 19:32:14,590 - Epoch: [49][ 4100/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.526463    
+2023-12-06 19:33:07,110 - Epoch: [49][ 4200/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.526432    
+2023-12-06 19:33:59,607 - Epoch: [49][ 4300/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.526397    
+2023-12-06 19:34:52,073 - Epoch: [49][ 4400/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.526357    
+2023-12-06 19:35:44,594 - Epoch: [49][ 4500/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.526331    
+2023-12-06 19:36:37,082 - Epoch: [49][ 4600/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.526298    
+2023-12-06 19:37:29,533 - Epoch: [49][ 4700/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.526259    
+2023-12-06 19:38:27,623 - Epoch: [49][ 4800/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.527397    
+2023-12-06 19:39:43,824 - Epoch: [49][ 4900/12168]    Overall Loss 0.013501    Objective Loss 0.000000    Distill Loss 0.013501                                        LR 0.000031    Time 0.532184    
+2023-12-06 19:40:57,836 - Epoch: [49][ 5000/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.536342    
+2023-12-06 19:42:09,982 - Epoch: [49][ 5100/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.539970    
+2023-12-06 19:43:23,308 - Epoch: [49][ 5200/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.543687    
+2023-12-06 19:44:38,839 - Epoch: [49][ 5300/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.547679    
+2023-12-06 19:45:55,762 - Epoch: [49][ 5400/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.551781    
+2023-12-06 19:47:09,834 - Epoch: [49][ 5500/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.555215    
+2023-12-06 19:48:26,848 - Epoch: [49][ 5600/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.559052    
+2023-12-06 19:49:41,467 - Epoch: [49][ 5700/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.562334    
+2023-12-06 19:50:57,261 - Epoch: [49][ 5800/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.565706    
+2023-12-06 19:52:09,787 - Epoch: [49][ 5900/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.568410    
+2023-12-06 19:53:22,735 - Epoch: [49][ 6000/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.571093    
+2023-12-06 19:54:39,126 - Epoch: [49][ 6100/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.574253    
+2023-12-06 19:55:53,280 - Epoch: [49][ 6200/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.576951    
+2023-12-06 19:56:49,818 - Epoch: [49][ 6300/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.576766    
+2023-12-06 19:57:42,354 - Epoch: [49][ 6400/12168]    Overall Loss 0.013507    Objective Loss 0.000000    Distill Loss 0.013507                                        LR 0.000031    Time 0.575963    
+2023-12-06 19:58:34,852 - Epoch: [49][ 6500/12168]    Overall Loss 0.013507    Objective Loss 0.000000    Distill Loss 0.013507                                        LR 0.000031    Time 0.575178    
+2023-12-06 19:59:27,356 - Epoch: [49][ 6600/12168]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                                        LR 0.000031    Time 0.574418    
+2023-12-06 20:00:19,945 - Epoch: [49][ 6700/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.573693    
+2023-12-06 20:01:12,404 - Epoch: [49][ 6800/12168]    Overall Loss 0.013505    Objective Loss 0.000000    Distill Loss 0.013505                                        LR 0.000031    Time 0.572970    
+2023-12-06 20:02:04,804 - Epoch: [49][ 6900/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.572260    
+2023-12-06 20:02:57,265 - Epoch: [49][ 7000/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.571579    
+2023-12-06 20:03:49,747 - Epoch: [49][ 7100/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.570920    
+2023-12-06 20:04:42,299 - Epoch: [49][ 7200/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.570289    
+2023-12-06 20:05:35,238 - Epoch: [49][ 7300/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.569728    
+2023-12-06 20:06:46,971 - Epoch: [49][ 7400/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.571722    
+2023-12-06 20:07:59,814 - Epoch: [49][ 7500/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.573811    
+2023-12-06 20:09:04,912 - Epoch: [49][ 7600/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.574826    
+2023-12-06 20:10:15,855 - Epoch: [49][ 7700/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.576573    
+2023-12-06 20:11:29,833 - Epoch: [49][ 7800/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.578665    
+2023-12-06 20:12:43,689 - Epoch: [49][ 7900/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.580688    
+2023-12-06 20:14:00,155 - Epoch: [49][ 8000/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.582987    
+2023-12-06 20:15:04,329 - Epoch: [49][ 8100/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.583712    
+2023-12-06 20:15:56,827 - Epoch: [49][ 8200/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.582996    
+2023-12-06 20:16:49,382 - Epoch: [49][ 8300/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.582303    
+2023-12-06 20:17:42,085 - Epoch: [49][ 8400/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.581645    
+2023-12-06 20:18:46,235 - Epoch: [49][ 8500/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.582348    
+2023-12-06 20:19:52,611 - Epoch: [49][ 8600/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.583294    
+2023-12-06 20:20:58,500 - Epoch: [49][ 8700/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.584163    
+2023-12-06 20:22:07,010 - Epoch: [49][ 8800/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.585309    
+2023-12-06 20:23:12,201 - Epoch: [49][ 8900/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.586057    
+2023-12-06 20:24:10,965 - Epoch: [49][ 9000/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.586074    
+2023-12-06 20:25:03,551 - Epoch: [49][ 9100/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.585412    
+2023-12-06 20:25:56,096 - Epoch: [49][ 9200/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.584760    
+2023-12-06 20:26:48,581 - Epoch: [49][ 9300/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.584116    
+2023-12-06 20:27:41,095 - Epoch: [49][ 9400/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.583488    
+2023-12-06 20:28:33,575 - Epoch: [49][ 9500/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.582870    
+2023-12-06 20:29:26,129 - Epoch: [49][ 9600/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.582272    
+2023-12-06 20:30:18,703 - Epoch: [49][ 9700/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.581689    
+2023-12-06 20:31:11,161 - Epoch: [49][ 9800/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.581106    
+2023-12-06 20:32:03,685 - Epoch: [49][ 9900/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.580541    
+2023-12-06 20:32:56,111 - Epoch: [49][10000/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.579978    
+2023-12-06 20:33:48,608 - Epoch: [49][10100/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.579433    
+2023-12-06 20:34:41,056 - Epoch: [49][10200/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.578894    
+2023-12-06 20:35:33,489 - Epoch: [49][10300/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.578364    
+2023-12-06 20:36:25,977 - Epoch: [49][10400/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.577849    
+2023-12-06 20:37:18,462 - Epoch: [49][10500/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.577344    
+2023-12-06 20:38:10,899 - Epoch: [49][10600/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.576844    
+2023-12-06 20:39:03,409 - Epoch: [49][10700/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.576360    
+2023-12-06 20:39:55,896 - Epoch: [49][10800/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.575883    
+2023-12-06 20:40:48,340 - Epoch: [49][10900/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.575411    
+2023-12-06 20:41:40,831 - Epoch: [49][11000/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.574952    
+2023-12-06 20:42:33,323 - Epoch: [49][11100/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.574501    
+2023-12-06 20:43:25,805 - Epoch: [49][11200/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.574057    
+2023-12-06 20:44:18,369 - Epoch: [49][11300/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.573628    
+2023-12-06 20:45:10,873 - Epoch: [49][11400/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.573201    
+2023-12-06 20:46:03,393 - Epoch: [49][11500/12168]    Overall Loss 0.013502    Objective Loss 0.000000    Distill Loss 0.013502                                        LR 0.000031    Time 0.572784    
+2023-12-06 20:46:55,912 - Epoch: [49][11600/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.572373    
+2023-12-06 20:47:48,342 - Epoch: [49][11700/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.571962    
+2023-12-06 20:48:40,760 - Epoch: [49][11800/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.571557    
+2023-12-06 20:49:33,242 - Epoch: [49][11900/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.571164    
+2023-12-06 20:50:25,725 - Epoch: [49][12000/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.570777    
+2023-12-06 20:51:18,268 - Epoch: [49][12100/12168]    Overall Loss 0.013504    Objective Loss 0.000000    Distill Loss 0.013504                                        LR 0.000031    Time 0.570402    
+2023-12-06 20:51:54,026 - Epoch: [49][12168/12168]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                                        LR 0.000031    Time 0.570153    
+2023-12-06 20:51:54,428 - --- validate (epoch=49)-----------
+2023-12-06 20:51:54,428 - 167951 samples (256 per mini-batch)
+2023-12-06 20:52:44,988 - Epoch: [49][  100/  657]    Loss 0.000000    Overall Loss 0.014195    
+2023-12-06 20:53:33,575 - Epoch: [49][  200/  657]    Loss 0.000000    Overall Loss 0.014184    
+2023-12-06 20:54:22,126 - Epoch: [49][  300/  657]    Loss 0.000000    Overall Loss 0.014184    
+2023-12-06 20:55:10,706 - Epoch: [49][  400/  657]    Loss 0.000000    Overall Loss 0.014191    
+2023-12-06 20:55:59,287 - Epoch: [49][  500/  657]    Loss 0.000000    Overall Loss 0.014190    
+2023-12-06 20:56:47,853 - Epoch: [49][  600/  657]    Loss 0.000000    Overall Loss 0.014191    
+2023-12-06 20:57:15,073 - Epoch: [49][  657/  657]    Loss 0.000000    Overall Loss 0.014193    
+2023-12-06 20:57:15,280 - ==> Overall Loss: 0.014
+
+2023-12-06 20:57:15,283 - ==> Best [Overall Loss: 0.013988 on epoch: 45]
+2023-12-06 20:57:15,283 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 20:57:15,309 - 
+
+2023-12-06 20:57:15,309 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 20:58:17,274 - Epoch: [50][  100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000016    Time 0.619607    
+2023-12-06 20:59:09,694 - Epoch: [50][  200/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000016    Time 0.571884    
+2023-12-06 21:00:02,137 - Epoch: [50][  300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000016    Time 0.556055    
+2023-12-06 21:00:54,545 - Epoch: [50][  400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000016    Time 0.548053    
+2023-12-06 21:01:46,967 - Epoch: [50][  500/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000016    Time 0.543280    
+2023-12-06 21:02:39,374 - Epoch: [50][  600/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000016    Time 0.540073    
+2023-12-06 21:03:31,815 - Epoch: [50][  700/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000016    Time 0.537829    
+2023-12-06 21:04:24,209 - Epoch: [50][  800/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000016    Time 0.536090    
+2023-12-06 21:05:16,719 - Epoch: [50][  900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000016    Time 0.534865    
+2023-12-06 21:06:09,196 - Epoch: [50][ 1000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000016    Time 0.533851    
+2023-12-06 21:07:01,606 - Epoch: [50][ 1100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000016    Time 0.532962    
+2023-12-06 21:07:54,047 - Epoch: [50][ 1200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000016    Time 0.532247    
+2023-12-06 21:08:46,458 - Epoch: [50][ 1300/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000016    Time 0.531618    
+2023-12-06 21:09:38,878 - Epoch: [50][ 1400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000016    Time 0.531086    
+2023-12-06 21:10:31,324 - Epoch: [50][ 1500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000016    Time 0.530642    
+2023-12-06 21:11:23,740 - Epoch: [50][ 1600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000016    Time 0.530235    
+2023-12-06 21:12:16,110 - Epoch: [50][ 1700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000016    Time 0.529848    
+2023-12-06 21:13:08,515 - Epoch: [50][ 1800/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000016    Time 0.529524    
+2023-12-06 21:14:00,957 - Epoch: [50][ 1900/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000016    Time 0.529254    
+2023-12-06 21:14:53,371 - Epoch: [50][ 2000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000016    Time 0.528997    
+2023-12-06 21:15:45,837 - Epoch: [50][ 2100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000016    Time 0.528789    
+2023-12-06 21:16:38,264 - Epoch: [50][ 2200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000016    Time 0.528582    
+2023-12-06 21:17:30,639 - Epoch: [50][ 2300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000016    Time 0.528370    
+2023-12-06 21:18:23,058 - Epoch: [50][ 2400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000016    Time 0.528194    
+2023-12-06 21:19:15,500 - Epoch: [50][ 2500/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000016    Time 0.528042    
+2023-12-06 21:20:07,922 - Epoch: [50][ 2600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000016    Time 0.527894    
+2023-12-06 21:21:00,338 - Epoch: [50][ 2700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000016    Time 0.527754    
+2023-12-06 21:21:52,752 - Epoch: [50][ 2800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000016    Time 0.527624    
+2023-12-06 21:22:45,194 - Epoch: [50][ 2900/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000016    Time 0.527512    
+2023-12-06 21:23:37,618 - Epoch: [50][ 3000/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000016    Time 0.527402    
+2023-12-06 21:24:30,088 - Epoch: [50][ 3100/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000016    Time 0.527314    
+2023-12-06 21:25:22,498 - Epoch: [50][ 3200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000016    Time 0.527212    
+2023-12-06 21:26:14,878 - Epoch: [50][ 3300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000016    Time 0.527108    
+2023-12-06 21:27:07,306 - Epoch: [50][ 3400/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000016    Time 0.527024    
+2023-12-06 21:27:59,678 - Epoch: [50][ 3500/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000016    Time 0.526928    
+2023-12-06 21:28:52,061 - Epoch: [50][ 3600/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000016    Time 0.526841    
+2023-12-06 21:29:44,501 - Epoch: [50][ 3700/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000016    Time 0.526774    
+2023-12-06 21:30:36,901 - Epoch: [50][ 3800/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526701    
+2023-12-06 21:31:29,423 - Epoch: [50][ 3900/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526662    
+2023-12-06 21:32:21,895 - Epoch: [50][ 4000/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526612    
+2023-12-06 21:33:14,347 - Epoch: [50][ 4100/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526560    
+2023-12-06 21:34:06,754 - Epoch: [50][ 4200/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526500    
+2023-12-06 21:34:59,220 - Epoch: [50][ 4300/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526457    
+2023-12-06 21:35:51,646 - Epoch: [50][ 4400/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000016    Time 0.526406    
+2023-12-06 21:36:44,093 - Epoch: [50][ 4500/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000016    Time 0.526362    
+2023-12-06 21:37:36,475 - Epoch: [50][ 4600/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000016    Time 0.526306    
+2023-12-06 21:38:28,868 - Epoch: [50][ 4700/12168]    Overall Loss 0.013346    Objective Loss 0.000000    Distill Loss 0.013346                                        LR 0.000016    Time 0.526255    
+2023-12-06 21:39:21,330 - Epoch: [50][ 4800/12168]    Overall Loss 0.013346    Objective Loss 0.000000    Distill Loss 0.013346                                        LR 0.000016    Time 0.526220    
+2023-12-06 21:40:13,721 - Epoch: [50][ 4900/12168]    Overall Loss 0.013347    Objective Loss 0.000000    Distill Loss 0.013347                                        LR 0.000016    Time 0.526173    
+2023-12-06 21:41:06,180 - Epoch: [50][ 5000/12168]    Overall Loss 0.013348    Objective Loss 0.000000    Distill Loss 0.013348                                        LR 0.000016    Time 0.526140    
+2023-12-06 21:41:58,623 - Epoch: [50][ 5100/12168]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                                        LR 0.000016    Time 0.526106    
+2023-12-06 21:42:50,988 - Epoch: [50][ 5200/12168]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                                        LR 0.000016    Time 0.526058    
+2023-12-06 21:43:43,376 - Epoch: [50][ 5300/12168]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                                        LR 0.000016    Time 0.526016    
+2023-12-06 21:44:35,831 - Epoch: [50][ 5400/12168]    Overall Loss 0.013353    Objective Loss 0.000000    Distill Loss 0.013353                                        LR 0.000016    Time 0.525988    
+2023-12-06 21:45:28,305 - Epoch: [50][ 5500/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000016    Time 0.525965    
+2023-12-06 21:46:20,718 - Epoch: [50][ 5600/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000016    Time 0.525932    
+2023-12-06 21:47:13,196 - Epoch: [50][ 5700/12168]    Overall Loss 0.013355    Objective Loss 0.000000    Distill Loss 0.013355                                        LR 0.000016    Time 0.525911    
+2023-12-06 21:48:05,604 - Epoch: [50][ 5800/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000016    Time 0.525879    
+2023-12-06 21:48:58,000 - Epoch: [50][ 5900/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000016    Time 0.525846    
+2023-12-06 21:49:50,383 - Epoch: [50][ 6000/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000016    Time 0.525812    
+2023-12-06 21:50:42,796 - Epoch: [50][ 6100/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000016    Time 0.525784    
+2023-12-06 21:51:35,209 - Epoch: [50][ 6200/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.000016    Time 0.525756    
+2023-12-06 21:52:27,690 - Epoch: [50][ 6300/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525741    
+2023-12-06 21:53:20,046 - Epoch: [50][ 6400/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525706    
+2023-12-06 21:54:12,433 - Epoch: [50][ 6500/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525677    
+2023-12-06 21:55:04,815 - Epoch: [50][ 6600/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525649    
+2023-12-06 21:55:57,254 - Epoch: [50][ 6700/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525630    
+2023-12-06 21:56:49,672 - Epoch: [50][ 6800/12168]    Overall Loss 0.013359    Objective Loss 0.000000    Distill Loss 0.013359                                        LR 0.000016    Time 0.525608    
+2023-12-06 21:57:42,107 - Epoch: [50][ 6900/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525589    
+2023-12-06 21:58:34,526 - Epoch: [50][ 7000/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525568    
+2023-12-06 21:59:26,954 - Epoch: [50][ 7100/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.525550    
+2023-12-06 22:00:19,400 - Epoch: [50][ 7200/12168]    Overall Loss 0.013359    Objective Loss 0.000000    Distill Loss 0.013359                                        LR 0.000016    Time 0.525534    
+2023-12-06 22:01:11,930 - Epoch: [50][ 7300/12168]    Overall Loss 0.013359    Objective Loss 0.000000    Distill Loss 0.013359                                        LR 0.000016    Time 0.525531    
+2023-12-06 22:02:04,336 - Epoch: [50][ 7400/12168]    Overall Loss 0.013361    Objective Loss 0.000000    Distill Loss 0.013361                                        LR 0.000016    Time 0.525510    
+2023-12-06 22:02:56,782 - Epoch: [50][ 7500/12168]    Overall Loss 0.013361    Objective Loss 0.000000    Distill Loss 0.013361                                        LR 0.000016    Time 0.525496    
+2023-12-06 22:03:49,204 - Epoch: [50][ 7600/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000016    Time 0.525479    
+2023-12-06 22:04:41,584 - Epoch: [50][ 7700/12168]    Overall Loss 0.013363    Objective Loss 0.000000    Distill Loss 0.013363                                        LR 0.000016    Time 0.525456    
+2023-12-06 22:05:34,011 - Epoch: [50][ 7800/12168]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                                        LR 0.000016    Time 0.525441    
+2023-12-06 22:06:26,536 - Epoch: [50][ 7900/12168]    Overall Loss 0.013365    Objective Loss 0.000000    Distill Loss 0.013365                                        LR 0.000016    Time 0.525438    
+2023-12-06 22:07:18,969 - Epoch: [50][ 8000/12168]    Overall Loss 0.013365    Objective Loss 0.000000    Distill Loss 0.013365                                        LR 0.000016    Time 0.525424    
+2023-12-06 22:08:11,392 - Epoch: [50][ 8100/12168]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                                        LR 0.000016    Time 0.525408    
+2023-12-06 22:09:03,823 - Epoch: [50][ 8200/12168]    Overall Loss 0.013365    Objective Loss 0.000000    Distill Loss 0.013365                                        LR 0.000016    Time 0.525395    
+2023-12-06 22:09:56,242 - Epoch: [50][ 8300/12168]    Overall Loss 0.013366    Objective Loss 0.000000    Distill Loss 0.013366                                        LR 0.000016    Time 0.525380    
+2023-12-06 22:10:48,753 - Epoch: [50][ 8400/12168]    Overall Loss 0.013367    Objective Loss 0.000000    Distill Loss 0.013367                                        LR 0.000016    Time 0.525376    
+2023-12-06 22:11:41,152 - Epoch: [50][ 8500/12168]    Overall Loss 0.013366    Objective Loss 0.000000    Distill Loss 0.013366                                        LR 0.000016    Time 0.525359    
+2023-12-06 22:12:33,652 - Epoch: [50][ 8600/12168]    Overall Loss 0.013366    Objective Loss 0.000000    Distill Loss 0.013366                                        LR 0.000016    Time 0.525355    
+2023-12-06 22:13:26,083 - Epoch: [50][ 8700/12168]    Overall Loss 0.013367    Objective Loss 0.000000    Distill Loss 0.013367                                        LR 0.000016    Time 0.525342    
+2023-12-06 22:14:18,564 - Epoch: [50][ 8800/12168]    Overall Loss 0.013367    Objective Loss 0.000000    Distill Loss 0.013367                                        LR 0.000016    Time 0.525336    
+2023-12-06 22:15:11,073 - Epoch: [50][ 8900/12168]    Overall Loss 0.013368    Objective Loss 0.000000    Distill Loss 0.013368                                        LR 0.000016    Time 0.525333    
+2023-12-06 22:16:03,539 - Epoch: [50][ 9000/12168]    Overall Loss 0.013368    Objective Loss 0.000000    Distill Loss 0.013368                                        LR 0.000016    Time 0.525325    
+2023-12-06 22:16:55,990 - Epoch: [50][ 9100/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000016    Time 0.525316    
+2023-12-06 22:17:48,422 - Epoch: [50][ 9200/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000016    Time 0.525304    
+2023-12-06 22:18:40,855 - Epoch: [50][ 9300/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.525294    
+2023-12-06 22:19:33,325 - Epoch: [50][ 9400/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.525287    
+2023-12-06 22:20:25,773 - Epoch: [50][ 9500/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.525278    
+2023-12-06 22:21:18,198 - Epoch: [50][ 9600/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.525267    
+2023-12-06 22:22:10,651 - Epoch: [50][ 9700/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.525259    
+2023-12-06 22:23:03,202 - Epoch: [50][ 9800/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.525261    
+2023-12-06 22:23:55,650 - Epoch: [50][ 9900/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.525253    
+2023-12-06 22:24:48,129 - Epoch: [50][10000/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.525248    
+2023-12-06 22:25:40,560 - Epoch: [50][10100/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.525238    
+2023-12-06 22:26:32,909 - Epoch: [50][10200/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.525221    
+2023-12-06 22:27:25,330 - Epoch: [50][10300/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.525211    
+2023-12-06 22:28:17,795 - Epoch: [50][10400/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000016    Time 0.525205    
+2023-12-06 22:29:10,190 - Epoch: [50][10500/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000016    Time 0.525193    
+2023-12-06 22:30:02,590 - Epoch: [50][10600/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000016    Time 0.525181    
+2023-12-06 22:30:55,049 - Epoch: [50][10700/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.525175    
+2023-12-06 22:31:47,485 - Epoch: [50][10800/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.525168    
+2023-12-06 22:32:39,867 - Epoch: [50][10900/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.525155    
+2023-12-06 22:33:32,316 - Epoch: [50][11000/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.525149    
+2023-12-06 22:34:24,780 - Epoch: [50][11100/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.525144    
+2023-12-06 22:35:17,161 - Epoch: [50][11200/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.525132    
+2023-12-06 22:36:09,613 - Epoch: [50][11300/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.525126    
+2023-12-06 22:37:02,068 - Epoch: [50][11400/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.525121    
+2023-12-06 22:37:54,481 - Epoch: [50][11500/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.525112    
+2023-12-06 22:38:46,903 - Epoch: [50][11600/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.525104    
+2023-12-06 22:39:39,342 - Epoch: [50][11700/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.525097    
+2023-12-06 22:40:31,773 - Epoch: [50][11800/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.525090    
+2023-12-06 22:41:24,196 - Epoch: [50][11900/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.525083    
+2023-12-06 22:42:16,648 - Epoch: [50][12000/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.525078    
+2023-12-06 22:43:09,072 - Epoch: [50][12100/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525071    
+2023-12-06 22:43:44,655 - Epoch: [50][12168/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525060    
+2023-12-06 22:43:45,040 - --- validate (epoch=50)-----------
+2023-12-06 22:43:45,040 - 167951 samples (256 per mini-batch)
+2023-12-06 22:44:35,604 - Epoch: [50][  100/  657]    Loss 0.000000    Overall Loss 0.014150    
+2023-12-06 22:45:24,176 - Epoch: [50][  200/  657]    Loss 0.000000    Overall Loss 0.014137    
+2023-12-06 22:46:12,720 - Epoch: [50][  300/  657]    Loss 0.000000    Overall Loss 0.014134    
+2023-12-06 22:47:01,280 - Epoch: [50][  400/  657]    Loss 0.000000    Overall Loss 0.014125    
+2023-12-06 22:47:49,846 - Epoch: [50][  500/  657]    Loss 0.000000    Overall Loss 0.014134    
+2023-12-06 22:48:38,394 - Epoch: [50][  600/  657]    Loss 0.000000    Overall Loss 0.014124    
+2023-12-06 22:49:05,637 - Epoch: [50][  657/  657]    Loss 0.000000    Overall Loss 0.014130    
+2023-12-06 22:49:05,828 - ==> Overall Loss: 0.014
+
+2023-12-06 22:49:05,831 - ==> Best [Overall Loss: 0.013988 on epoch: 45]
+2023-12-06 22:49:05,831 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-06 22:49:05,852 - 
+
+2023-12-06 22:49:05,852 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-06 22:50:06,452 - Epoch: [51][  100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000016    Time 0.605962    
+2023-12-06 22:50:58,892 - Epoch: [51][  200/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.000016    Time 0.565166    
+2023-12-06 22:51:51,294 - Epoch: [51][  300/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.551440    
+2023-12-06 22:52:43,732 - Epoch: [51][  400/12168]    Overall Loss 0.013363    Objective Loss 0.000000    Distill Loss 0.013363                                        LR 0.000016    Time 0.544666    
+2023-12-06 22:53:36,162 - Epoch: [51][  500/12168]    Overall Loss 0.013363    Objective Loss 0.000000    Distill Loss 0.013363                                        LR 0.000016    Time 0.540584    
+2023-12-06 22:54:28,650 - Epoch: [51][  600/12168]    Overall Loss 0.013367    Objective Loss 0.000000    Distill Loss 0.013367                                        LR 0.000016    Time 0.537962    
+2023-12-06 22:55:21,035 - Epoch: [51][  700/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.535941    
+2023-12-06 22:56:13,438 - Epoch: [51][  800/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.534448    
+2023-12-06 22:57:05,929 - Epoch: [51][  900/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.533384    
+2023-12-06 22:57:58,345 - Epoch: [51][ 1000/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.532458    
+2023-12-06 22:58:50,779 - Epoch: [51][ 1100/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.531717    
+2023-12-06 22:59:43,177 - Epoch: [51][ 1200/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.531069    
+2023-12-06 23:00:35,571 - Epoch: [51][ 1300/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.530519    
+2023-12-06 23:01:27,970 - Epoch: [51][ 1400/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.530050    
+2023-12-06 23:02:20,353 - Epoch: [51][ 1500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.529633    
+2023-12-06 23:03:12,801 - Epoch: [51][ 1600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.529309    
+2023-12-06 23:04:05,161 - Epoch: [51][ 1700/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.528971    
+2023-12-06 23:04:57,564 - Epoch: [51][ 1800/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.528695    
+2023-12-06 23:05:49,969 - Epoch: [51][ 1900/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.528449    
+2023-12-06 23:06:42,366 - Epoch: [51][ 2000/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.528223    
+2023-12-06 23:07:34,800 - Epoch: [51][ 2100/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.528037    
+2023-12-06 23:08:27,184 - Epoch: [51][ 2200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.527844    
+2023-12-06 23:09:19,663 - Epoch: [51][ 2300/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.527710    
+2023-12-06 23:10:12,104 - Epoch: [51][ 2400/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.527571    
+2023-12-06 23:11:04,540 - Epoch: [51][ 2500/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.527442    
+2023-12-06 23:11:56,972 - Epoch: [51][ 2600/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.527320    
+2023-12-06 23:12:49,475 - Epoch: [51][ 2700/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.527234    
+2023-12-06 23:13:41,859 - Epoch: [51][ 2800/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.527112    
+2023-12-06 23:14:34,290 - Epoch: [51][ 2900/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.527014    
+2023-12-06 23:15:26,736 - Epoch: [51][ 3000/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.526928    
+2023-12-06 23:16:19,164 - Epoch: [51][ 3100/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526841    
+2023-12-06 23:17:11,549 - Epoch: [51][ 3200/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.526747    
+2023-12-06 23:18:03,967 - Epoch: [51][ 3300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.526668    
+2023-12-06 23:18:56,381 - Epoch: [51][ 3400/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.526593    
+2023-12-06 23:19:48,764 - Epoch: [51][ 3500/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.526513    
+2023-12-06 23:20:41,248 - Epoch: [51][ 3600/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526465    
+2023-12-06 23:21:33,694 - Epoch: [51][ 3700/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526410    
+2023-12-06 23:22:26,113 - Epoch: [51][ 3800/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.526351    
+2023-12-06 23:23:18,528 - Epoch: [51][ 3900/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526294    
+2023-12-06 23:24:11,002 - Epoch: [51][ 4000/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.526254    
+2023-12-06 23:25:03,408 - Epoch: [51][ 4100/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526200    
+2023-12-06 23:25:55,793 - Epoch: [51][ 4200/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526142    
+2023-12-06 23:26:48,272 - Epoch: [51][ 4300/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526109    
+2023-12-06 23:27:40,718 - Epoch: [51][ 4400/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.526071    
+2023-12-06 23:28:33,127 - Epoch: [51][ 4500/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526026    
+2023-12-06 23:29:25,547 - Epoch: [51][ 4600/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525986    
+2023-12-06 23:30:17,971 - Epoch: [51][ 4700/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525948    
+2023-12-06 23:31:10,406 - Epoch: [51][ 4800/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525914    
+2023-12-06 23:32:02,806 - Epoch: [51][ 4900/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525875    
+2023-12-06 23:32:55,188 - Epoch: [51][ 5000/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525833    
+2023-12-06 23:33:47,710 - Epoch: [51][ 5100/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525820    
+2023-12-06 23:34:40,137 - Epoch: [51][ 5200/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525789    
+2023-12-06 23:35:32,603 - Epoch: [51][ 5300/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525768    
+2023-12-06 23:36:25,036 - Epoch: [51][ 5400/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525740    
+2023-12-06 23:37:17,429 - Epoch: [51][ 5500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525707    
+2023-12-06 23:38:09,828 - Epoch: [51][ 5600/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525676    
+2023-12-06 23:39:02,247 - Epoch: [51][ 5700/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525649    
+2023-12-06 23:39:54,720 - Epoch: [51][ 5800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525632    
+2023-12-06 23:40:47,242 - Epoch: [51][ 5900/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525625    
+2023-12-06 23:41:39,633 - Epoch: [51][ 6000/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525596    
+2023-12-06 23:42:32,031 - Epoch: [51][ 6100/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525569    
+2023-12-06 23:43:24,509 - Epoch: [51][ 6200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525556    
+2023-12-06 23:44:16,892 - Epoch: [51][ 6300/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525528    
+2023-12-06 23:45:09,287 - Epoch: [51][ 6400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525502    
+2023-12-06 23:46:01,643 - Epoch: [51][ 6500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525472    
+2023-12-06 23:46:54,086 - Epoch: [51][ 6600/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525456    
+2023-12-06 23:47:46,489 - Epoch: [51][ 6700/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525434    
+2023-12-06 23:48:38,919 - Epoch: [51][ 6800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525417    
+2023-12-06 23:49:31,271 - Epoch: [51][ 6900/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525389    
+2023-12-06 23:50:23,795 - Epoch: [51][ 7000/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525386    
+2023-12-06 23:51:16,302 - Epoch: [51][ 7100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525381    
+2023-12-06 23:52:08,700 - Epoch: [51][ 7200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525361    
+2023-12-06 23:53:01,172 - Epoch: [51][ 7300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525352    
+2023-12-06 23:53:53,656 - Epoch: [51][ 7400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525345    
+2023-12-06 23:54:46,209 - Epoch: [51][ 7500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525347    
+2023-12-06 23:55:38,660 - Epoch: [51][ 7600/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525335    
+2023-12-06 23:56:31,175 - Epoch: [51][ 7700/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525333    
+2023-12-06 23:57:23,617 - Epoch: [51][ 7800/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525320    
+2023-12-06 23:58:16,043 - Epoch: [51][ 7900/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525307    
+2023-12-06 23:59:08,552 - Epoch: [51][ 8000/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525303    
+2023-12-07 00:00:00,980 - Epoch: [51][ 8100/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525290    
+2023-12-07 00:00:53,477 - Epoch: [51][ 8200/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525286    
+2023-12-07 00:01:45,972 - Epoch: [51][ 8300/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525282    
+2023-12-07 00:02:38,472 - Epoch: [51][ 8400/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525278    
+2023-12-07 00:03:30,944 - Epoch: [51][ 8500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525271    
+2023-12-07 00:04:23,419 - Epoch: [51][ 8600/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525264    
+2023-12-07 00:05:15,882 - Epoch: [51][ 8700/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525257    
+2023-12-07 00:06:08,361 - Epoch: [51][ 8800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525251    
+2023-12-07 00:07:00,842 - Epoch: [51][ 8900/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525246    
+2023-12-07 00:07:53,184 - Epoch: [51][ 9000/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525225    
+2023-12-07 00:08:45,619 - Epoch: [51][ 9100/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525215    
+2023-12-07 00:09:38,118 - Epoch: [51][ 9200/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525212    
+2023-12-07 00:10:30,548 - Epoch: [51][ 9300/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525202    
+2023-12-07 00:11:23,071 - Epoch: [51][ 9400/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525202    
+2023-12-07 00:12:15,580 - Epoch: [51][ 9500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525200    
+2023-12-07 00:13:08,093 - Epoch: [51][ 9600/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525199    
+2023-12-07 00:14:00,568 - Epoch: [51][ 9700/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525194    
+2023-12-07 00:14:53,027 - Epoch: [51][ 9800/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525188    
+2023-12-07 00:15:45,457 - Epoch: [51][ 9900/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525179    
+2023-12-07 00:16:37,931 - Epoch: [51][10000/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525174    
+2023-12-07 00:17:30,445 - Epoch: [51][10100/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525173    
+2023-12-07 00:18:22,915 - Epoch: [51][10200/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525168    
+2023-12-07 00:19:15,333 - Epoch: [51][10300/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525158    
+2023-12-07 00:20:07,834 - Epoch: [51][10400/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525157    
+2023-12-07 00:21:00,315 - Epoch: [51][10500/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525153    
+2023-12-07 00:21:52,780 - Epoch: [51][10600/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525148    
+2023-12-07 00:22:45,226 - Epoch: [51][10700/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525141    
+2023-12-07 00:23:37,660 - Epoch: [51][10800/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525133    
+2023-12-07 00:24:30,112 - Epoch: [51][10900/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525127    
+2023-12-07 00:25:22,541 - Epoch: [51][11000/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525120    
+2023-12-07 00:26:15,043 - Epoch: [51][11100/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525118    
+2023-12-07 00:27:07,499 - Epoch: [51][11200/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525113    
+2023-12-07 00:27:59,978 - Epoch: [51][11300/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525110    
+2023-12-07 00:28:52,394 - Epoch: [51][11400/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525101    
+2023-12-07 00:29:44,858 - Epoch: [51][11500/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525097    
+2023-12-07 00:30:37,284 - Epoch: [51][11600/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525090    
+2023-12-07 00:31:29,747 - Epoch: [51][11700/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525085    
+2023-12-07 00:32:22,262 - Epoch: [51][11800/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525086    
+2023-12-07 00:33:14,733 - Epoch: [51][11900/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525082    
+2023-12-07 00:34:07,206 - Epoch: [51][12000/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525079    
+2023-12-07 00:34:59,705 - Epoch: [51][12100/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525078    
+2023-12-07 00:35:35,170 - Epoch: [51][12168/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525058    
+2023-12-07 00:35:35,564 - --- validate (epoch=51)-----------
+2023-12-07 00:35:35,565 - 167951 samples (256 per mini-batch)
+2023-12-07 00:36:26,487 - Epoch: [51][  100/  657]    Loss 0.000000    Overall Loss 0.013920    
+2023-12-07 00:37:15,053 - Epoch: [51][  200/  657]    Loss 0.000000    Overall Loss 0.013931    
+2023-12-07 00:38:03,644 - Epoch: [51][  300/  657]    Loss 0.000000    Overall Loss 0.013925    
+2023-12-07 00:38:52,241 - Epoch: [51][  400/  657]    Loss 0.000000    Overall Loss 0.013937    
+2023-12-07 00:39:40,804 - Epoch: [51][  500/  657]    Loss 0.000000    Overall Loss 0.013945    
+2023-12-07 00:40:29,380 - Epoch: [51][  600/  657]    Loss 0.000000    Overall Loss 0.013946    
+2023-12-07 00:40:56,617 - Epoch: [51][  657/  657]    Loss 0.000000    Overall Loss 0.013942    
+2023-12-07 00:40:56,813 - ==> Overall Loss: 0.014
+
+2023-12-07 00:40:56,815 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 00:40:56,815 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 00:40:56,842 - 
+
+2023-12-07 00:40:56,842 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 00:42:00,839 - Epoch: [52][  100/12168]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                                        LR 0.000016    Time 0.639931    
+2023-12-07 00:42:53,243 - Epoch: [52][  200/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.581971    
+2023-12-07 00:43:45,780 - Epoch: [52][  300/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.563091    
+2023-12-07 00:44:38,450 - Epoch: [52][  400/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.553982    
+2023-12-07 00:45:31,885 - Epoch: [52][  500/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.550049    
+2023-12-07 00:46:24,373 - Epoch: [52][  600/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.545847    
+2023-12-07 00:47:16,771 - Epoch: [52][  700/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.542718    
+2023-12-07 00:48:09,154 - Epoch: [52][  800/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.540354    
+2023-12-07 00:49:01,554 - Epoch: [52][  900/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.538532    
+2023-12-07 00:49:53,986 - Epoch: [52][ 1000/12168]    Overall Loss 0.013417    Objective Loss 0.000000    Distill Loss 0.013417                                        LR 0.000016    Time 0.537108    
+2023-12-07 00:50:46,429 - Epoch: [52][ 1100/12168]    Overall Loss 0.013420    Objective Loss 0.000000    Distill Loss 0.013420                                        LR 0.000016    Time 0.535952    
+2023-12-07 00:51:38,865 - Epoch: [52][ 1200/12168]    Overall Loss 0.013417    Objective Loss 0.000000    Distill Loss 0.013417                                        LR 0.000016    Time 0.534983    
+2023-12-07 00:52:31,288 - Epoch: [52][ 1300/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.534154    
+2023-12-07 00:53:23,734 - Epoch: [52][ 1400/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.533459    
+2023-12-07 00:54:16,207 - Epoch: [52][ 1500/12168]    Overall Loss 0.013419    Objective Loss 0.000000    Distill Loss 0.013419                                        LR 0.000016    Time 0.532875    
+2023-12-07 00:55:08,652 - Epoch: [52][ 1600/12168]    Overall Loss 0.013416    Objective Loss 0.000000    Distill Loss 0.013416                                        LR 0.000016    Time 0.532346    
+2023-12-07 00:56:01,068 - Epoch: [52][ 1700/12168]    Overall Loss 0.013421    Objective Loss 0.000000    Distill Loss 0.013421                                        LR 0.000016    Time 0.531862    
+2023-12-07 00:56:53,560 - Epoch: [52][ 1800/12168]    Overall Loss 0.013420    Objective Loss 0.000000    Distill Loss 0.013420                                        LR 0.000016    Time 0.531475    
+2023-12-07 00:57:46,053 - Epoch: [52][ 1900/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000016    Time 0.531128    
+2023-12-07 00:58:38,491 - Epoch: [52][ 2000/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000016    Time 0.530789    
+2023-12-07 00:59:30,933 - Epoch: [52][ 2100/12168]    Overall Loss 0.013422    Objective Loss 0.000000    Distill Loss 0.013422                                        LR 0.000016    Time 0.530484    
+2023-12-07 01:00:23,341 - Epoch: [52][ 2200/12168]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                                        LR 0.000016    Time 0.530192    
+2023-12-07 01:01:15,775 - Epoch: [52][ 2300/12168]    Overall Loss 0.013421    Objective Loss 0.000000    Distill Loss 0.013421                                        LR 0.000016    Time 0.529935    
+2023-12-07 01:02:08,124 - Epoch: [52][ 2400/12168]    Overall Loss 0.013418    Objective Loss 0.000000    Distill Loss 0.013418                                        LR 0.000016    Time 0.529665    
+2023-12-07 01:03:00,549 - Epoch: [52][ 2500/12168]    Overall Loss 0.013416    Objective Loss 0.000000    Distill Loss 0.013416                                        LR 0.000016    Time 0.529448    
+2023-12-07 01:03:52,950 - Epoch: [52][ 2600/12168]    Overall Loss 0.013417    Objective Loss 0.000000    Distill Loss 0.013417                                        LR 0.000016    Time 0.529237    
+2023-12-07 01:04:45,362 - Epoch: [52][ 2700/12168]    Overall Loss 0.013418    Objective Loss 0.000000    Distill Loss 0.013418                                        LR 0.000016    Time 0.529046    
+2023-12-07 01:05:37,819 - Epoch: [52][ 2800/12168]    Overall Loss 0.013417    Objective Loss 0.000000    Distill Loss 0.013417                                        LR 0.000016    Time 0.528885    
+2023-12-07 01:06:30,271 - Epoch: [52][ 2900/12168]    Overall Loss 0.013416    Objective Loss 0.000000    Distill Loss 0.013416                                        LR 0.000016    Time 0.528733    
+2023-12-07 01:07:22,674 - Epoch: [52][ 3000/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.528576    
+2023-12-07 01:08:15,113 - Epoch: [52][ 3100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.528439    
+2023-12-07 01:09:07,527 - Epoch: [52][ 3200/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.528304    
+2023-12-07 01:09:59,995 - Epoch: [52][ 3300/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.528193    
+2023-12-07 01:10:52,453 - Epoch: [52][ 3400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.528086    
+2023-12-07 01:11:44,918 - Epoch: [52][ 3500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.527987    
+2023-12-07 01:12:37,337 - Epoch: [52][ 3600/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.527880    
+2023-12-07 01:13:29,758 - Epoch: [52][ 3700/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.527780    
+2023-12-07 01:14:22,148 - Epoch: [52][ 3800/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.527677    
+2023-12-07 01:15:14,505 - Epoch: [52][ 3900/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.527571    
+2023-12-07 01:16:06,912 - Epoch: [52][ 4000/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.527483    
+2023-12-07 01:16:59,319 - Epoch: [52][ 4100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.527399    
+2023-12-07 01:17:51,757 - Epoch: [52][ 4200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.527326    
+2023-12-07 01:18:44,237 - Epoch: [52][ 4300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.527266    
+2023-12-07 01:19:36,700 - Epoch: [52][ 4400/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.527206    
+2023-12-07 01:20:29,087 - Epoch: [52][ 4500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.527131    
+2023-12-07 01:21:21,485 - Epoch: [52][ 4600/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.527062    
+2023-12-07 01:22:13,920 - Epoch: [52][ 4700/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.527003    
+2023-12-07 01:23:06,337 - Epoch: [52][ 4800/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526944    
+2023-12-07 01:23:58,758 - Epoch: [52][ 4900/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526887    
+2023-12-07 01:24:51,197 - Epoch: [52][ 5000/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526836    
+2023-12-07 01:25:43,611 - Epoch: [52][ 5100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526783    
+2023-12-07 01:26:36,056 - Epoch: [52][ 5200/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.526737    
+2023-12-07 01:27:28,415 - Epoch: [52][ 5300/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526677    
+2023-12-07 01:28:20,837 - Epoch: [52][ 5400/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526631    
+2023-12-07 01:29:13,232 - Epoch: [52][ 5500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526582    
+2023-12-07 01:30:05,690 - Epoch: [52][ 5600/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526545    
+2023-12-07 01:30:58,121 - Epoch: [52][ 5700/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.526506    
+2023-12-07 01:31:50,562 - Epoch: [52][ 5800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.526469    
+2023-12-07 01:32:42,990 - Epoch: [52][ 5900/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526431    
+2023-12-07 01:33:35,451 - Epoch: [52][ 6000/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526400    
+2023-12-07 01:34:27,860 - Epoch: [52][ 6100/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526362    
+2023-12-07 01:35:20,268 - Epoch: [52][ 6200/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526325    
+2023-12-07 01:36:12,721 - Epoch: [52][ 6300/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.526296    
+2023-12-07 01:37:05,264 - Epoch: [52][ 6400/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526282    
+2023-12-07 01:37:57,737 - Epoch: [52][ 6500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526257    
+2023-12-07 01:38:50,264 - Epoch: [52][ 6600/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526242    
+2023-12-07 01:39:42,725 - Epoch: [52][ 6700/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.526217    
+2023-12-07 01:40:35,125 - Epoch: [52][ 6800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.526184    
+2023-12-07 01:41:27,617 - Epoch: [52][ 6900/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526165    
+2023-12-07 01:42:20,101 - Epoch: [52][ 7000/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526146    
+2023-12-07 01:43:12,562 - Epoch: [52][ 7100/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526123    
+2023-12-07 01:44:04,950 - Epoch: [52][ 7200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526092    
+2023-12-07 01:44:57,321 - Epoch: [52][ 7300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526059    
+2023-12-07 01:45:49,739 - Epoch: [52][ 7400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526033    
+2023-12-07 01:46:42,206 - Epoch: [52][ 7500/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.526014    
+2023-12-07 01:47:34,728 - Epoch: [52][ 7600/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.526003    
+2023-12-07 01:48:27,169 - Epoch: [52][ 7700/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525982    
+2023-12-07 01:49:19,581 - Epoch: [52][ 7800/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525958    
+2023-12-07 01:50:11,946 - Epoch: [52][ 7900/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525928    
+2023-12-07 01:51:04,406 - Epoch: [52][ 8000/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525911    
+2023-12-07 01:51:56,890 - Epoch: [52][ 8100/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525898    
+2023-12-07 01:52:49,410 - Epoch: [52][ 8200/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525889    
+2023-12-07 01:53:41,963 - Epoch: [52][ 8300/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525884    
+2023-12-07 01:54:34,440 - Epoch: [52][ 8400/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525870    
+2023-12-07 01:55:26,879 - Epoch: [52][ 8500/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525852    
+2023-12-07 01:56:19,351 - Epoch: [52][ 8600/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525839    
+2023-12-07 01:57:11,771 - Epoch: [52][ 8700/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525820    
+2023-12-07 01:58:04,289 - Epoch: [52][ 8800/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525812    
+2023-12-07 01:58:56,734 - Epoch: [52][ 8900/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525796    
+2023-12-07 01:59:49,205 - Epoch: [52][ 9000/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525784    
+2023-12-07 02:00:41,631 - Epoch: [52][ 9100/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525767    
+2023-12-07 02:01:34,098 - Epoch: [52][ 9200/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525754    
+2023-12-07 02:02:26,506 - Epoch: [52][ 9300/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525736    
+2023-12-07 02:03:18,967 - Epoch: [52][ 9400/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525724    
+2023-12-07 02:04:11,392 - Epoch: [52][ 9500/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525708    
+2023-12-07 02:05:03,859 - Epoch: [52][ 9600/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525697    
+2023-12-07 02:05:56,278 - Epoch: [52][ 9700/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525681    
+2023-12-07 02:06:48,726 - Epoch: [52][ 9800/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525668    
+2023-12-07 02:07:41,219 - Epoch: [52][ 9900/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525660    
+2023-12-07 02:08:33,625 - Epoch: [52][10000/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525644    
+2023-12-07 02:09:26,054 - Epoch: [52][10100/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525630    
+2023-12-07 02:10:18,513 - Epoch: [52][10200/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525620    
+2023-12-07 02:11:11,017 - Epoch: [52][10300/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525614    
+2023-12-07 02:12:03,441 - Epoch: [52][10400/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525600    
+2023-12-07 02:12:55,943 - Epoch: [52][10500/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525594    
+2023-12-07 02:13:48,400 - Epoch: [52][10600/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525584    
+2023-12-07 02:14:40,863 - Epoch: [52][10700/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525575    
+2023-12-07 02:15:33,239 - Epoch: [52][10800/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525558    
+2023-12-07 02:16:25,638 - Epoch: [52][10900/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525543    
+2023-12-07 02:17:18,037 - Epoch: [52][11000/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525529    
+2023-12-07 02:18:10,429 - Epoch: [52][11100/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525514    
+2023-12-07 02:19:02,906 - Epoch: [52][11200/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.525507    
+2023-12-07 02:19:55,371 - Epoch: [52][11300/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525499    
+2023-12-07 02:20:47,785 - Epoch: [52][11400/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525487    
+2023-12-07 02:21:40,205 - Epoch: [52][11500/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525476    
+2023-12-07 02:22:32,626 - Epoch: [52][11600/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.525465    
+2023-12-07 02:23:25,094 - Epoch: [52][11700/12168]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                                        LR 0.000016    Time 0.525458    
+2023-12-07 02:24:17,517 - Epoch: [52][11800/12168]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                                        LR 0.000016    Time 0.525447    
+2023-12-07 02:25:10,236 - Epoch: [52][11900/12168]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                                        LR 0.000016    Time 0.525461    
+2023-12-07 02:26:02,793 - Epoch: [52][12000/12168]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                                        LR 0.000016    Time 0.525462    
+2023-12-07 02:26:55,218 - Epoch: [52][12100/12168]    Overall Loss 0.013416    Objective Loss 0.000000    Distill Loss 0.013416                                        LR 0.000016    Time 0.525451    
+2023-12-07 02:27:30,707 - Epoch: [52][12168/12168]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                                        LR 0.000016    Time 0.525431    
+2023-12-07 02:27:31,097 - --- validate (epoch=52)-----------
+2023-12-07 02:27:31,098 - 167951 samples (256 per mini-batch)
+2023-12-07 02:28:21,773 - Epoch: [52][  100/  657]    Loss 0.000000    Overall Loss 0.014066    
+2023-12-07 02:29:10,339 - Epoch: [52][  200/  657]    Loss 0.000000    Overall Loss 0.014054    
+2023-12-07 02:29:58,884 - Epoch: [52][  300/  657]    Loss 0.000000    Overall Loss 0.014050    
+2023-12-07 02:30:47,399 - Epoch: [52][  400/  657]    Loss 0.000000    Overall Loss 0.014038    
+2023-12-07 02:31:35,987 - Epoch: [52][  500/  657]    Loss 0.000000    Overall Loss 0.014032    
+2023-12-07 02:32:24,521 - Epoch: [52][  600/  657]    Loss 0.000000    Overall Loss 0.014036    
+2023-12-07 02:32:51,751 - Epoch: [52][  657/  657]    Loss 0.000000    Overall Loss 0.014029    
+2023-12-07 02:32:51,953 - ==> Overall Loss: 0.014
+
+2023-12-07 02:32:51,955 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 02:32:51,955 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 02:32:51,976 - 
+
+2023-12-07 02:32:51,976 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 02:33:54,579 - Epoch: [53][  100/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.625987    
+2023-12-07 02:34:46,931 - Epoch: [53][  200/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.574738    
+2023-12-07 02:35:39,338 - Epoch: [53][  300/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.557838    
+2023-12-07 02:36:31,729 - Epoch: [53][  400/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.549347    
+2023-12-07 02:37:24,185 - Epoch: [53][  500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.544385    
+2023-12-07 02:38:16,591 - Epoch: [53][  600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.540991    
+2023-12-07 02:39:09,004 - Epoch: [53][  700/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.538577    
+2023-12-07 02:40:01,488 - Epoch: [53][  800/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.536856    
+2023-12-07 02:40:53,933 - Epoch: [53][  900/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.535473    
+2023-12-07 02:41:46,371 - Epoch: [53][ 1000/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.534361    
+2023-12-07 02:42:38,714 - Epoch: [53][ 1100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.533364    
+2023-12-07 02:43:31,127 - Epoch: [53][ 1200/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.532591    
+2023-12-07 02:44:23,500 - Epoch: [53][ 1300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.531908    
+2023-12-07 02:45:15,964 - Epoch: [53][ 1400/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.531386    
+2023-12-07 02:46:08,453 - Epoch: [53][ 1500/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.530951    
+2023-12-07 02:47:00,966 - Epoch: [53][ 1600/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.530584    
+2023-12-07 02:47:53,356 - Epoch: [53][ 1700/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.530189    
+2023-12-07 02:48:45,744 - Epoch: [53][ 1800/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.529837    
+2023-12-07 02:49:38,257 - Epoch: [53][ 1900/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.529588    
+2023-12-07 02:50:30,753 - Epoch: [53][ 2000/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.529354    
+2023-12-07 02:51:23,183 - Epoch: [53][ 2100/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.529112    
+2023-12-07 02:52:15,677 - Epoch: [53][ 2200/12168]    Overall Loss 0.013414    Objective Loss 0.000000    Distill Loss 0.013414                                        LR 0.000016    Time 0.528921    
+2023-12-07 02:53:08,042 - Epoch: [53][ 2300/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.528690    
+2023-12-07 02:54:00,445 - Epoch: [53][ 2400/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.528495    
+2023-12-07 02:54:52,859 - Epoch: [53][ 2500/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.528319    
+2023-12-07 02:55:45,254 - Epoch: [53][ 2600/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.528150    
+2023-12-07 02:56:37,681 - Epoch: [53][ 2700/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.528005    
+2023-12-07 02:57:30,181 - Epoch: [53][ 2800/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.527896    
+2023-12-07 02:58:22,571 - Epoch: [53][ 2900/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.527758    
+2023-12-07 02:59:14,995 - Epoch: [53][ 3000/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.527639    
+2023-12-07 03:00:07,337 - Epoch: [53][ 3100/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.527502    
+2023-12-07 03:00:59,742 - Epoch: [53][ 3200/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.527393    
+2023-12-07 03:01:52,147 - Epoch: [53][ 3300/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.527291    
+2023-12-07 03:02:44,539 - Epoch: [53][ 3400/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.527190    
+2023-12-07 03:03:36,944 - Epoch: [53][ 3500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.527100    
+2023-12-07 03:04:29,923 - Epoch: [53][ 3600/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.527173    
+2023-12-07 03:05:22,365 - Epoch: [53][ 3700/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.527098    
+2023-12-07 03:06:14,782 - Epoch: [53][ 3800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.527020    
+2023-12-07 03:07:07,221 - Epoch: [53][ 3900/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.526952    
+2023-12-07 03:07:59,806 - Epoch: [53][ 4000/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.526923    
+2023-12-07 03:08:52,299 - Epoch: [53][ 4100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526874    
+2023-12-07 03:09:45,003 - Epoch: [53][ 4200/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526877    
+2023-12-07 03:10:37,340 - Epoch: [53][ 4300/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526795    
+2023-12-07 03:11:29,734 - Epoch: [53][ 4400/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.526729    
+2023-12-07 03:12:22,154 - Epoch: [53][ 4500/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526672    
+2023-12-07 03:13:14,577 - Epoch: [53][ 4600/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526618    
+2023-12-07 03:14:06,955 - Epoch: [53][ 4700/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526557    
+2023-12-07 03:14:59,380 - Epoch: [53][ 4800/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526509    
+2023-12-07 03:15:51,817 - Epoch: [53][ 4900/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.526464    
+2023-12-07 03:16:44,192 - Epoch: [53][ 5000/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526409    
+2023-12-07 03:17:36,600 - Epoch: [53][ 5100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526363    
+2023-12-07 03:18:28,981 - Epoch: [53][ 5200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526313    
+2023-12-07 03:19:21,380 - Epoch: [53][ 5300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526269    
+2023-12-07 03:20:13,775 - Epoch: [53][ 5400/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526225    
+2023-12-07 03:21:06,185 - Epoch: [53][ 5500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526186    
+2023-12-07 03:21:58,893 - Epoch: [53][ 5600/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526201    
+2023-12-07 03:22:51,308 - Epoch: [53][ 5700/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526165    
+2023-12-07 03:23:43,758 - Epoch: [53][ 5800/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.526135    
+2023-12-07 03:24:36,221 - Epoch: [53][ 5900/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526109    
+2023-12-07 03:25:28,609 - Epoch: [53][ 6000/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.526072    
+2023-12-07 03:26:21,039 - Epoch: [53][ 6100/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526042    
+2023-12-07 03:27:13,536 - Epoch: [53][ 6200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.526024    
+2023-12-07 03:28:05,953 - Epoch: [53][ 6300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525994    
+2023-12-07 03:28:58,359 - Epoch: [53][ 6400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525963    
+2023-12-07 03:29:50,735 - Epoch: [53][ 6500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525929    
+2023-12-07 03:30:43,113 - Epoch: [53][ 6600/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525896    
+2023-12-07 03:31:35,523 - Epoch: [53][ 6700/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525869    
+2023-12-07 03:32:27,927 - Epoch: [53][ 6800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525841    
+2023-12-07 03:33:20,383 - Epoch: [53][ 6900/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525822    
+2023-12-07 03:34:12,810 - Epoch: [53][ 7000/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525800    
+2023-12-07 03:35:05,270 - Epoch: [53][ 7100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525782    
+2023-12-07 03:35:57,723 - Epoch: [53][ 7200/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525764    
+2023-12-07 03:36:50,184 - Epoch: [53][ 7300/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525748    
+2023-12-07 03:37:42,700 - Epoch: [53][ 7400/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525740    
+2023-12-07 03:38:35,157 - Epoch: [53][ 7500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525724    
+2023-12-07 03:39:27,515 - Epoch: [53][ 7600/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525695    
+2023-12-07 03:40:19,927 - Epoch: [53][ 7700/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525674    
+2023-12-07 03:41:12,440 - Epoch: [53][ 7800/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525667    
+2023-12-07 03:42:04,798 - Epoch: [53][ 7900/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525640    
+2023-12-07 03:42:57,278 - Epoch: [53][ 8000/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525629    
+2023-12-07 03:43:49,653 - Epoch: [53][ 8100/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525605    
+2023-12-07 03:44:42,043 - Epoch: [53][ 8200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525584    
+2023-12-07 03:45:34,522 - Epoch: [53][ 8300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525574    
+2023-12-07 03:46:26,971 - Epoch: [53][ 8400/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525561    
+2023-12-07 03:47:19,408 - Epoch: [53][ 8500/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525546    
+2023-12-07 03:48:11,835 - Epoch: [53][ 8600/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525531    
+2023-12-07 03:49:04,213 - Epoch: [53][ 8700/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525511    
+2023-12-07 03:49:56,639 - Epoch: [53][ 8800/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525496    
+2023-12-07 03:50:49,093 - Epoch: [53][ 8900/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525485    
+2023-12-07 03:51:41,584 - Epoch: [53][ 9000/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525478    
+2023-12-07 03:52:33,979 - Epoch: [53][ 9100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525461    
+2023-12-07 03:53:26,347 - Epoch: [53][ 9200/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525441    
+2023-12-07 03:54:18,810 - Epoch: [53][ 9300/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525432    
+2023-12-07 03:55:11,143 - Epoch: [53][ 9400/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525410    
+2023-12-07 03:56:03,521 - Epoch: [53][ 9500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525392    
+2023-12-07 03:56:55,932 - Epoch: [53][ 9600/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525378    
+2023-12-07 03:57:48,356 - Epoch: [53][ 9700/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525366    
+2023-12-07 03:58:40,851 - Epoch: [53][ 9800/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525362    
+2023-12-07 03:59:33,947 - Epoch: [53][ 9900/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525418    
+2023-12-07 04:00:26,347 - Epoch: [53][10000/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525403    
+2023-12-07 04:01:18,738 - Epoch: [53][10100/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525388    
+2023-12-07 04:02:11,253 - Epoch: [53][10200/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525386    
+2023-12-07 04:03:03,742 - Epoch: [53][10300/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525381    
+2023-12-07 04:03:56,193 - Epoch: [53][10400/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525372    
+2023-12-07 04:04:48,704 - Epoch: [53][10500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525369    
+2023-12-07 04:05:41,128 - Epoch: [53][10600/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525358    
+2023-12-07 04:06:33,515 - Epoch: [53][10700/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525344    
+2023-12-07 04:07:26,013 - Epoch: [53][10800/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525340    
+2023-12-07 04:08:18,412 - Epoch: [53][10900/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525327    
+2023-12-07 04:09:10,900 - Epoch: [53][11000/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525323    
+2023-12-07 04:10:03,348 - Epoch: [53][11100/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525315    
+2023-12-07 04:10:55,824 - Epoch: [53][11200/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525310    
+2023-12-07 04:11:48,333 - Epoch: [53][11300/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525308    
+2023-12-07 04:12:40,762 - Epoch: [53][11400/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525298    
+2023-12-07 04:13:33,170 - Epoch: [53][11500/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525288    
+2023-12-07 04:14:25,649 - Epoch: [53][11600/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525283    
+2023-12-07 04:15:18,099 - Epoch: [53][11700/12168]    Overall Loss 0.013410    Objective Loss 0.000000    Distill Loss 0.013410                                        LR 0.000016    Time 0.525276    
+2023-12-07 04:16:10,484 - Epoch: [53][11800/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525264    
+2023-12-07 04:17:02,875 - Epoch: [53][11900/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525252    
+2023-12-07 04:17:55,267 - Epoch: [53][12000/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525241    
+2023-12-07 04:18:47,711 - Epoch: [53][12100/12168]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                                        LR 0.000016    Time 0.525234    
+2023-12-07 04:19:23,314 - Epoch: [53][12168/12168]    Overall Loss 0.013411    Objective Loss 0.000000    Distill Loss 0.013411                                        LR 0.000016    Time 0.525224    
+2023-12-07 04:19:23,743 - --- validate (epoch=53)-----------
+2023-12-07 04:19:23,743 - 167951 samples (256 per mini-batch)
+2023-12-07 04:20:14,051 - Epoch: [53][  100/  657]    Loss 0.000000    Overall Loss 0.013986    
+2023-12-07 04:21:02,618 - Epoch: [53][  200/  657]    Loss 0.000000    Overall Loss 0.014006    
+2023-12-07 04:21:51,163 - Epoch: [53][  300/  657]    Loss 0.000000    Overall Loss 0.014009    
+2023-12-07 04:22:39,715 - Epoch: [53][  400/  657]    Loss 0.000000    Overall Loss 0.014013    
+2023-12-07 04:23:28,225 - Epoch: [53][  500/  657]    Loss 0.000000    Overall Loss 0.014009    
+2023-12-07 04:24:16,761 - Epoch: [53][  600/  657]    Loss 0.000000    Overall Loss 0.014009    
+2023-12-07 04:24:43,972 - Epoch: [53][  657/  657]    Loss 0.000000    Overall Loss 0.014011    
+2023-12-07 04:24:44,183 - ==> Overall Loss: 0.014
+
+2023-12-07 04:24:44,186 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 04:24:44,186 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 04:24:44,214 - 
+
+2023-12-07 04:24:44,214 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 04:25:46,868 - Epoch: [54][  100/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.626501    
+2023-12-07 04:26:39,191 - Epoch: [54][  200/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.574849    
+2023-12-07 04:27:31,531 - Epoch: [54][  300/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.557691    
+2023-12-07 04:28:23,855 - Epoch: [54][  400/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.549070    
+2023-12-07 04:29:16,299 - Epoch: [54][  500/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.544136    
+2023-12-07 04:30:08,714 - Epoch: [54][  600/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.540800    
+2023-12-07 04:31:01,107 - Epoch: [54][  700/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.538384    
+2023-12-07 04:31:53,482 - Epoch: [54][  800/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.536550    
+2023-12-07 04:32:45,908 - Epoch: [54][  900/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.535182    
+2023-12-07 04:33:38,268 - Epoch: [54][ 1000/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.534021    
+2023-12-07 04:34:30,733 - Epoch: [54][ 1100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.533165    
+2023-12-07 04:35:23,140 - Epoch: [54][ 1200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.532405    
+2023-12-07 04:36:15,471 - Epoch: [54][ 1300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.531703    
+2023-12-07 04:37:07,855 - Epoch: [54][ 1400/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.531139    
+2023-12-07 04:38:00,237 - Epoch: [54][ 1500/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.530649    
+2023-12-07 04:38:52,655 - Epoch: [54][ 1600/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.530242    
+2023-12-07 04:39:45,096 - Epoch: [54][ 1700/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.529897    
+2023-12-07 04:40:37,498 - Epoch: [54][ 1800/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.529569    
+2023-12-07 04:41:29,924 - Epoch: [54][ 1900/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.529288    
+2023-12-07 04:42:22,298 - Epoch: [54][ 2000/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.529009    
+2023-12-07 04:43:14,670 - Epoch: [54][ 2100/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.528755    
+2023-12-07 04:44:07,190 - Epoch: [54][ 2200/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.528592    
+2023-12-07 04:44:59,576 - Epoch: [54][ 2300/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.528385    
+2023-12-07 04:45:51,945 - Epoch: [54][ 2400/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.528188    
+2023-12-07 04:46:44,259 - Epoch: [54][ 2500/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.527985    
+2023-12-07 04:47:36,676 - Epoch: [54][ 2600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.527837    
+2023-12-07 04:48:29,099 - Epoch: [54][ 2700/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.527702    
+2023-12-07 04:49:21,488 - Epoch: [54][ 2800/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.527565    
+2023-12-07 04:50:13,897 - Epoch: [54][ 2900/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.527443    
+2023-12-07 04:51:06,268 - Epoch: [54][ 3000/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.527318    
+2023-12-07 04:51:58,644 - Epoch: [54][ 3100/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.527202    
+2023-12-07 04:52:50,976 - Epoch: [54][ 3200/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.527080    
+2023-12-07 04:53:43,345 - Epoch: [54][ 3300/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.526976    
+2023-12-07 04:54:35,747 - Epoch: [54][ 3400/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.526888    
+2023-12-07 04:55:28,098 - Epoch: [54][ 3500/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.526791    
+2023-12-07 04:56:20,477 - Epoch: [54][ 3600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.526706    
+2023-12-07 04:57:12,878 - Epoch: [54][ 3700/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.526633    
+2023-12-07 04:58:05,317 - Epoch: [54][ 3800/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526573    
+2023-12-07 04:58:57,726 - Epoch: [54][ 3900/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526508    
+2023-12-07 04:59:50,112 - Epoch: [54][ 4000/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.526441    
+2023-12-07 05:00:42,587 - Epoch: [54][ 4100/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.526399    
+2023-12-07 05:01:35,003 - Epoch: [54][ 4200/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526345    
+2023-12-07 05:02:27,417 - Epoch: [54][ 4300/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526293    
+2023-12-07 05:03:19,825 - Epoch: [54][ 4400/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.526242    
+2023-12-07 05:04:12,263 - Epoch: [54][ 4500/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526200    
+2023-12-07 05:05:04,661 - Epoch: [54][ 4600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.526151    
+2023-12-07 05:05:57,069 - Epoch: [54][ 4700/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.526106    
+2023-12-07 05:06:49,490 - Epoch: [54][ 4800/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526066    
+2023-12-07 05:07:41,855 - Epoch: [54][ 4900/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.526016    
+2023-12-07 05:08:34,286 - Epoch: [54][ 5000/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525981    
+2023-12-07 05:09:26,710 - Epoch: [54][ 5100/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525946    
+2023-12-07 05:10:19,110 - Epoch: [54][ 5200/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525908    
+2023-12-07 05:11:11,483 - Epoch: [54][ 5300/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525866    
+2023-12-07 05:12:03,849 - Epoch: [54][ 5400/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525825    
+2023-12-07 05:12:56,212 - Epoch: [54][ 5500/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525784    
+2023-12-07 05:13:48,579 - Epoch: [54][ 5600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525746    
+2023-12-07 05:14:40,942 - Epoch: [54][ 5700/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525708    
+2023-12-07 05:15:33,331 - Epoch: [54][ 5800/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525676    
+2023-12-07 05:16:25,749 - Epoch: [54][ 5900/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525651    
+2023-12-07 05:17:18,186 - Epoch: [54][ 6000/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525629    
+2023-12-07 05:18:10,572 - Epoch: [54][ 6100/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525599    
+2023-12-07 05:19:02,939 - Epoch: [54][ 6200/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525567    
+2023-12-07 05:19:55,269 - Epoch: [54][ 6300/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525531    
+2023-12-07 05:20:47,635 - Epoch: [54][ 6400/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.525501    
+2023-12-07 05:21:40,056 - Epoch: [54][ 6500/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525481    
+2023-12-07 05:22:32,453 - Epoch: [54][ 6600/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525457    
+2023-12-07 05:23:24,907 - Epoch: [54][ 6700/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525443    
+2023-12-07 05:24:17,312 - Epoch: [54][ 6800/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525422    
+2023-12-07 05:25:09,773 - Epoch: [54][ 6900/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525410    
+2023-12-07 05:26:02,143 - Epoch: [54][ 7000/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525385    
+2023-12-07 05:26:54,555 - Epoch: [54][ 7100/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525367    
+2023-12-07 05:27:46,896 - Epoch: [54][ 7200/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525339    
+2023-12-07 05:28:39,263 - Epoch: [54][ 7300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525316    
+2023-12-07 05:29:31,646 - Epoch: [54][ 7400/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525295    
+2023-12-07 05:30:24,018 - Epoch: [54][ 7500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525274    
+2023-12-07 05:31:16,370 - Epoch: [54][ 7600/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525250    
+2023-12-07 05:32:08,739 - Epoch: [54][ 7700/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525229    
+2023-12-07 05:33:01,181 - Epoch: [54][ 7800/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525219    
+2023-12-07 05:33:53,667 - Epoch: [54][ 7900/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525214    
+2023-12-07 05:34:46,010 - Epoch: [54][ 8000/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525191    
+2023-12-07 05:35:38,460 - Epoch: [54][ 8100/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525182    
+2023-12-07 05:36:30,890 - Epoch: [54][ 8200/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.525171    
+2023-12-07 05:37:23,246 - Epoch: [54][ 8300/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.525151    
+2023-12-07 05:38:15,621 - Epoch: [54][ 8400/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.525134    
+2023-12-07 05:39:08,004 - Epoch: [54][ 8500/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525118    
+2023-12-07 05:40:00,376 - Epoch: [54][ 8600/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525102    
+2023-12-07 05:40:52,788 - Epoch: [54][ 8700/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525090    
+2023-12-07 05:41:45,187 - Epoch: [54][ 8800/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525077    
+2023-12-07 05:42:37,581 - Epoch: [54][ 8900/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525064    
+2023-12-07 05:43:30,094 - Epoch: [54][ 9000/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525064    
+2023-12-07 05:44:22,442 - Epoch: [54][ 9100/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525047    
+2023-12-07 05:45:14,866 - Epoch: [54][ 9200/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525037    
+2023-12-07 05:46:07,229 - Epoch: [54][ 9300/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525022    
+2023-12-07 05:46:59,705 - Epoch: [54][ 9400/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525019    
+2023-12-07 05:47:52,120 - Epoch: [54][ 9500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525009    
+2023-12-07 05:48:44,514 - Epoch: [54][ 9600/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.524998    
+2023-12-07 05:49:36,996 - Epoch: [54][ 9700/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.524996    
+2023-12-07 05:50:29,374 - Epoch: [54][ 9800/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.524983    
+2023-12-07 05:51:21,765 - Epoch: [54][ 9900/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.524972    
+2023-12-07 05:52:14,149 - Epoch: [54][10000/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.524960    
+2023-12-07 05:53:06,535 - Epoch: [54][10100/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.524949    
+2023-12-07 05:53:58,997 - Epoch: [54][10200/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.524945    
+2023-12-07 05:54:51,516 - Epoch: [54][10300/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.524947    
+2023-12-07 05:55:44,011 - Epoch: [54][10400/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.524947    
+2023-12-07 05:56:36,357 - Epoch: [54][10500/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.524932    
+2023-12-07 05:57:28,761 - Epoch: [54][10600/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.524924    
+2023-12-07 05:58:21,164 - Epoch: [54][10700/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.524915    
+2023-12-07 05:59:13,523 - Epoch: [54][10800/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.524902    
+2023-12-07 06:00:05,903 - Epoch: [54][10900/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.524892    
+2023-12-07 06:00:58,285 - Epoch: [54][11000/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.524882    
+2023-12-07 06:01:50,767 - Epoch: [54][11100/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.524881    
+2023-12-07 06:02:43,104 - Epoch: [54][11200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.524867    
+2023-12-07 06:03:35,541 - Epoch: [54][11300/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.524863    
+2023-12-07 06:04:28,003 - Epoch: [54][11400/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.524860    
+2023-12-07 06:05:20,468 - Epoch: [54][11500/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.524858    
+2023-12-07 06:06:12,824 - Epoch: [54][11600/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.524847    
+2023-12-07 06:07:05,222 - Epoch: [54][11700/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.524839    
+2023-12-07 06:07:57,603 - Epoch: [54][11800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.524830    
+2023-12-07 06:08:50,069 - Epoch: [54][11900/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.524828    
+2023-12-07 06:09:42,425 - Epoch: [54][12000/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.524817    
+2023-12-07 06:10:34,863 - Epoch: [54][12100/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.524814    
+2023-12-07 06:11:10,468 - Epoch: [54][12168/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.524807    
+2023-12-07 06:11:10,859 - --- validate (epoch=54)-----------
+2023-12-07 06:11:10,859 - 167951 samples (256 per mini-batch)
+2023-12-07 06:12:01,283 - Epoch: [54][  100/  657]    Loss 0.000000    Overall Loss 0.013950    
+2023-12-07 06:12:49,839 - Epoch: [54][  200/  657]    Loss 0.000000    Overall Loss 0.013950    
+2023-12-07 06:13:38,416 - Epoch: [54][  300/  657]    Loss 0.000000    Overall Loss 0.013947    
+2023-12-07 06:14:26,936 - Epoch: [54][  400/  657]    Loss 0.000000    Overall Loss 0.013952    
+2023-12-07 06:15:15,493 - Epoch: [54][  500/  657]    Loss 0.000000    Overall Loss 0.013959    
+2023-12-07 06:16:04,056 - Epoch: [54][  600/  657]    Loss 0.000000    Overall Loss 0.013960    
+2023-12-07 06:16:31,287 - Epoch: [54][  657/  657]    Loss 0.000000    Overall Loss 0.013959    
+2023-12-07 06:16:31,498 - ==> Overall Loss: 0.014
+
+2023-12-07 06:16:31,500 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 06:16:31,500 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 06:16:31,520 - 
+
+2023-12-07 06:16:31,520 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 06:17:36,229 - Epoch: [55][  100/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.647052    
+2023-12-07 06:18:28,621 - Epoch: [55][  200/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.000016    Time 0.585468    
+2023-12-07 06:19:20,963 - Epoch: [55][  300/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.564772    
+2023-12-07 06:20:13,436 - Epoch: [55][  400/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.554755    
+2023-12-07 06:21:05,804 - Epoch: [55][  500/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.548534    
+2023-12-07 06:21:58,161 - Epoch: [55][  600/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.544367    
+2023-12-07 06:22:50,540 - Epoch: [55][  700/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.541423    
+2023-12-07 06:23:42,926 - Epoch: [55][  800/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.539224    
+2023-12-07 06:24:35,346 - Epoch: [55][  900/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.537551    
+2023-12-07 06:25:27,690 - Epoch: [55][ 1000/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.536136    
+2023-12-07 06:26:20,118 - Epoch: [55][ 1100/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.535056    
+2023-12-07 06:27:12,492 - Epoch: [55][ 1200/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.534110    
+2023-12-07 06:28:04,985 - Epoch: [55][ 1300/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.533402    
+2023-12-07 06:28:57,385 - Epoch: [55][ 1400/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.532727    
+2023-12-07 06:29:49,787 - Epoch: [55][ 1500/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.532144    
+2023-12-07 06:30:42,175 - Epoch: [55][ 1600/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.531626    
+2023-12-07 06:31:34,520 - Epoch: [55][ 1700/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.531143    
+2023-12-07 06:32:26,940 - Epoch: [55][ 1800/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.530755    
+2023-12-07 06:33:19,369 - Epoch: [55][ 1900/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.530413    
+2023-12-07 06:34:11,761 - Epoch: [55][ 2000/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.530087    
+2023-12-07 06:35:04,174 - Epoch: [55][ 2100/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.529802    
+2023-12-07 06:35:56,616 - Epoch: [55][ 2200/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.529555    
+2023-12-07 06:36:49,026 - Epoch: [55][ 2300/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.529317    
+2023-12-07 06:37:41,465 - Epoch: [55][ 2400/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.529110    
+2023-12-07 06:38:33,903 - Epoch: [55][ 2500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.528920    
+2023-12-07 06:39:26,318 - Epoch: [55][ 2600/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.528735    
+2023-12-07 06:40:18,714 - Epoch: [55][ 2700/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.528557    
+2023-12-07 06:41:11,122 - Epoch: [55][ 2800/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.528396    
+2023-12-07 06:42:03,489 - Epoch: [55][ 2900/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.528232    
+2023-12-07 06:42:55,905 - Epoch: [55][ 3000/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.528095    
+2023-12-07 06:43:48,311 - Epoch: [55][ 3100/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.527963    
+2023-12-07 06:44:40,702 - Epoch: [55][ 3200/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.527834    
+2023-12-07 06:45:33,060 - Epoch: [55][ 3300/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.527704    
+2023-12-07 06:46:25,414 - Epoch: [55][ 3400/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.527581    
+2023-12-07 06:47:17,793 - Epoch: [55][ 3500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.527471    
+2023-12-07 06:48:10,202 - Epoch: [55][ 3600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.527377    
+2023-12-07 06:49:02,681 - Epoch: [55][ 3700/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.527306    
+2023-12-07 06:49:55,104 - Epoch: [55][ 3800/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.527224    
+2023-12-07 06:50:47,494 - Epoch: [55][ 3900/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.527138    
+2023-12-07 06:51:39,902 - Epoch: [55][ 4000/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.527061    
+2023-12-07 06:52:32,321 - Epoch: [55][ 4100/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.526990    
+2023-12-07 06:53:24,662 - Epoch: [55][ 4200/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.526904    
+2023-12-07 06:54:17,038 - Epoch: [55][ 4300/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.526830    
+2023-12-07 06:55:09,427 - Epoch: [55][ 4400/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.526762    
+2023-12-07 06:56:01,835 - Epoch: [55][ 4500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.526702    
+2023-12-07 06:56:54,240 - Epoch: [55][ 4600/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.526644    
+2023-12-07 06:57:46,729 - Epoch: [55][ 4700/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.526606    
+2023-12-07 06:58:39,073 - Epoch: [55][ 4800/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.526539    
+2023-12-07 06:59:31,433 - Epoch: [55][ 4900/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.526478    
+2023-12-07 07:00:23,788 - Epoch: [55][ 5000/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.526419    
+2023-12-07 07:01:16,165 - Epoch: [55][ 5100/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526367    
+2023-12-07 07:02:08,603 - Epoch: [55][ 5200/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526328    
+2023-12-07 07:03:00,998 - Epoch: [55][ 5300/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526282    
+2023-12-07 07:03:53,372 - Epoch: [55][ 5400/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526234    
+2023-12-07 07:04:45,716 - Epoch: [55][ 5500/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.526183    
+2023-12-07 07:05:38,113 - Epoch: [55][ 5600/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526143    
+2023-12-07 07:06:30,555 - Epoch: [55][ 5700/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526112    
+2023-12-07 07:07:22,934 - Epoch: [55][ 5800/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.526072    
+2023-12-07 07:08:15,323 - Epoch: [55][ 5900/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.526034    
+2023-12-07 07:09:07,653 - Epoch: [55][ 6000/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525988    
+2023-12-07 07:10:00,025 - Epoch: [55][ 6100/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525950    
+2023-12-07 07:10:52,420 - Epoch: [55][ 6200/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525917    
+2023-12-07 07:11:44,828 - Epoch: [55][ 6300/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525888    
+2023-12-07 07:12:37,231 - Epoch: [55][ 6400/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525858    
+2023-12-07 07:13:29,611 - Epoch: [55][ 6500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525826    
+2023-12-07 07:14:22,039 - Epoch: [55][ 6600/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525802    
+2023-12-07 07:15:14,364 - Epoch: [55][ 6700/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525764    
+2023-12-07 07:16:06,737 - Epoch: [55][ 6800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525733    
+2023-12-07 07:16:59,090 - Epoch: [55][ 6900/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525701    
+2023-12-07 07:17:51,529 - Epoch: [55][ 7000/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525681    
+2023-12-07 07:18:43,913 - Epoch: [55][ 7100/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525655    
+2023-12-07 07:19:36,292 - Epoch: [55][ 7200/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525629    
+2023-12-07 07:20:28,691 - Epoch: [55][ 7300/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525606    
+2023-12-07 07:21:21,168 - Epoch: [55][ 7400/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525594    
+2023-12-07 07:22:13,551 - Epoch: [55][ 7500/12168]    Overall Loss 0.013403    Objective Loss 0.000000    Distill Loss 0.013403                                        LR 0.000016    Time 0.525570    
+2023-12-07 07:23:05,955 - Epoch: [55][ 7600/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525550    
+2023-12-07 07:23:58,393 - Epoch: [55][ 7700/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525534    
+2023-12-07 07:24:50,782 - Epoch: [55][ 7800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525512    
+2023-12-07 07:25:43,167 - Epoch: [55][ 7900/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525491    
+2023-12-07 07:26:35,567 - Epoch: [55][ 8000/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525472    
+2023-12-07 07:27:27,919 - Epoch: [55][ 8100/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.525447    
+2023-12-07 07:28:20,360 - Epoch: [55][ 8200/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525434    
+2023-12-07 07:29:12,872 - Epoch: [55][ 8300/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525430    
+2023-12-07 07:30:05,255 - Epoch: [55][ 8400/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525411    
+2023-12-07 07:30:57,720 - Epoch: [55][ 8500/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525401    
+2023-12-07 07:31:50,109 - Epoch: [55][ 8600/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525383    
+2023-12-07 07:32:42,566 - Epoch: [55][ 8700/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525374    
+2023-12-07 07:33:34,975 - Epoch: [55][ 8800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525359    
+2023-12-07 07:34:27,388 - Epoch: [55][ 8900/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525344    
+2023-12-07 07:35:19,751 - Epoch: [55][ 9000/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525325    
+2023-12-07 07:36:12,122 - Epoch: [55][ 9100/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525307    
+2023-12-07 07:37:04,551 - Epoch: [55][ 9200/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525296    
+2023-12-07 07:37:56,944 - Epoch: [55][ 9300/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525281    
+2023-12-07 07:38:49,380 - Epoch: [55][ 9400/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525270    
+2023-12-07 07:39:41,827 - Epoch: [55][ 9500/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525262    
+2023-12-07 07:40:34,253 - Epoch: [55][ 9600/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525251    
+2023-12-07 07:41:26,678 - Epoch: [55][ 9700/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525240    
+2023-12-07 07:42:19,153 - Epoch: [55][ 9800/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525235    
+2023-12-07 07:43:11,563 - Epoch: [55][ 9900/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525223    
+2023-12-07 07:44:03,985 - Epoch: [55][10000/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525213    
+2023-12-07 07:44:56,379 - Epoch: [55][10100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525200    
+2023-12-07 07:45:48,867 - Epoch: [55][10200/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525196    
+2023-12-07 07:46:41,298 - Epoch: [55][10300/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525187    
+2023-12-07 07:47:33,801 - Epoch: [55][10400/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525185    
+2023-12-07 07:48:26,215 - Epoch: [55][10500/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525175    
+2023-12-07 07:49:18,579 - Epoch: [55][10600/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525160    
+2023-12-07 07:50:11,046 - Epoch: [55][10700/12168]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                                        LR 0.000016    Time 0.525156    
+2023-12-07 07:51:03,572 - Epoch: [55][10800/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525156    
+2023-12-07 07:51:56,001 - Epoch: [55][10900/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525148    
+2023-12-07 07:52:48,534 - Epoch: [55][11000/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525149    
+2023-12-07 07:53:40,972 - Epoch: [55][11100/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.525142    
+2023-12-07 07:54:33,393 - Epoch: [55][11200/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525133    
+2023-12-07 07:55:25,785 - Epoch: [55][11300/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525122    
+2023-12-07 07:56:18,219 - Epoch: [55][11400/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525115    
+2023-12-07 07:57:10,685 - Epoch: [55][11500/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525111    
+2023-12-07 07:58:03,132 - Epoch: [55][11600/12168]    Overall Loss 0.013407    Objective Loss 0.000000    Distill Loss 0.013407                                        LR 0.000016    Time 0.525105    
+2023-12-07 07:58:55,499 - Epoch: [55][11700/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525093    
+2023-12-07 07:59:47,924 - Epoch: [55][11800/12168]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                                        LR 0.000016    Time 0.525085    
+2023-12-07 08:00:40,368 - Epoch: [55][11900/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525079    
+2023-12-07 08:01:32,776 - Epoch: [55][12000/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525071    
+2023-12-07 08:02:25,223 - Epoch: [55][12100/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525066    
+2023-12-07 08:03:00,722 - Epoch: [55][12168/12168]    Overall Loss 0.013408    Objective Loss 0.000000    Distill Loss 0.013408                                        LR 0.000016    Time 0.525049    
+2023-12-07 08:03:01,121 - --- validate (epoch=55)-----------
+2023-12-07 08:03:01,121 - 167951 samples (256 per mini-batch)
+2023-12-07 08:03:51,411 - Epoch: [55][  100/  657]    Loss 0.000000    Overall Loss 0.013948    
+2023-12-07 08:04:39,990 - Epoch: [55][  200/  657]    Loss 0.000000    Overall Loss 0.013946    
+2023-12-07 08:05:28,567 - Epoch: [55][  300/  657]    Loss 0.000000    Overall Loss 0.013949    
+2023-12-07 08:06:17,114 - Epoch: [55][  400/  657]    Loss 0.000000    Overall Loss 0.013949    
+2023-12-07 08:07:05,628 - Epoch: [55][  500/  657]    Loss 0.000000    Overall Loss 0.013952    
+2023-12-07 08:07:54,161 - Epoch: [55][  600/  657]    Loss 0.000000    Overall Loss 0.013959    
+2023-12-07 08:08:21,375 - Epoch: [55][  657/  657]    Loss 0.000000    Overall Loss 0.013961    
+2023-12-07 08:08:21,603 - ==> Overall Loss: 0.014
+
+2023-12-07 08:08:21,606 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 08:08:21,606 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 08:08:21,630 - 
+
+2023-12-07 08:08:21,630 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 08:09:23,004 - Epoch: [56][  100/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000016    Time 0.613699    
+2023-12-07 08:10:15,358 - Epoch: [56][  200/12168]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                                        LR 0.000016    Time 0.568603    
+2023-12-07 08:11:07,802 - Epoch: [56][  300/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.553871    
+2023-12-07 08:12:00,154 - Epoch: [56][  400/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.546273    
+2023-12-07 08:12:52,477 - Epoch: [56][  500/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.541659    
+2023-12-07 08:13:44,903 - Epoch: [56][  600/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.538754    
+2023-12-07 08:14:37,275 - Epoch: [56][  700/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.536602    
+2023-12-07 08:15:29,597 - Epoch: [56][  800/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.534925    
+2023-12-07 08:16:21,932 - Epoch: [56][  900/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.533635    
+2023-12-07 08:17:14,266 - Epoch: [56][ 1000/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.532603    
+2023-12-07 08:18:06,601 - Epoch: [56][ 1100/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.531758    
+2023-12-07 08:18:58,975 - Epoch: [56][ 1200/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.531087    
+2023-12-07 08:19:51,383 - Epoch: [56][ 1300/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.530545    
+2023-12-07 08:20:43,788 - Epoch: [56][ 1400/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.530079    
+2023-12-07 08:21:36,224 - Epoch: [56][ 1500/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.529696    
+2023-12-07 08:22:28,660 - Epoch: [56][ 1600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.529360    
+2023-12-07 08:23:20,998 - Epoch: [56][ 1700/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.529007    
+2023-12-07 08:24:13,453 - Epoch: [56][ 1800/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.528757    
+2023-12-07 08:25:05,780 - Epoch: [56][ 1900/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.528467    
+2023-12-07 08:25:58,156 - Epoch: [56][ 2000/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.528230    
+2023-12-07 08:26:50,534 - Epoch: [56][ 2100/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.528016    
+2023-12-07 08:27:42,856 - Epoch: [56][ 2200/12168]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                                        LR 0.000016    Time 0.527797    
+2023-12-07 08:28:35,216 - Epoch: [56][ 2300/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.527613    
+2023-12-07 08:29:27,557 - Epoch: [56][ 2400/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.527437    
+2023-12-07 08:30:19,984 - Epoch: [56][ 2500/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.527309    
+2023-12-07 08:31:12,399 - Epoch: [56][ 2600/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.527186    
+2023-12-07 08:32:04,798 - Epoch: [56][ 2700/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.527066    
+2023-12-07 08:32:57,163 - Epoch: [56][ 2800/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.526943    
+2023-12-07 08:33:49,505 - Epoch: [56][ 2900/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.526820    
+2023-12-07 08:34:41,934 - Epoch: [56][ 3000/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.526735    
+2023-12-07 08:35:34,374 - Epoch: [56][ 3100/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.526658    
+2023-12-07 08:36:26,790 - Epoch: [56][ 3200/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.526579    
+2023-12-07 08:37:19,247 - Epoch: [56][ 3300/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.526517    
+2023-12-07 08:38:11,693 - Epoch: [56][ 3400/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.526456    
+2023-12-07 08:39:04,119 - Epoch: [56][ 3500/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.526392    
+2023-12-07 08:39:56,508 - Epoch: [56][ 3600/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.526321    
+2023-12-07 08:40:48,975 - Epoch: [56][ 3700/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.526276    
+2023-12-07 08:41:41,395 - Epoch: [56][ 3800/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.526220    
+2023-12-07 08:42:33,727 - Epoch: [56][ 3900/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.526145    
+2023-12-07 08:43:26,094 - Epoch: [56][ 4000/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.526082    
+2023-12-07 08:44:18,499 - Epoch: [56][ 4100/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.526032    
+2023-12-07 08:45:10,912 - Epoch: [56][ 4200/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525986    
+2023-12-07 08:46:03,321 - Epoch: [56][ 4300/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525941    
+2023-12-07 08:46:55,795 - Epoch: [56][ 4400/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525913    
+2023-12-07 08:47:48,192 - Epoch: [56][ 4500/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525869    
+2023-12-07 08:48:40,539 - Epoch: [56][ 4600/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.525816    
+2023-12-07 08:49:32,925 - Epoch: [56][ 4700/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.525774    
+2023-12-07 08:50:25,263 - Epoch: [56][ 4800/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525723    
+2023-12-07 08:51:17,629 - Epoch: [56][ 4900/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525680    
+2023-12-07 08:52:09,984 - Epoch: [56][ 5000/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.525637    
+2023-12-07 08:53:02,383 - Epoch: [56][ 5100/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525604    
+2023-12-07 08:53:54,706 - Epoch: [56][ 5200/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525558    
+2023-12-07 08:54:47,087 - Epoch: [56][ 5300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525524    
+2023-12-07 08:55:39,533 - Epoch: [56][ 5400/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.525504    
+2023-12-07 08:56:31,972 - Epoch: [56][ 5500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525483    
+2023-12-07 08:57:24,356 - Epoch: [56][ 5600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525453    
+2023-12-07 08:58:16,747 - Epoch: [56][ 5700/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525426    
+2023-12-07 08:59:09,111 - Epoch: [56][ 5800/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525394    
+2023-12-07 09:00:01,467 - Epoch: [56][ 5900/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525363    
+2023-12-07 09:00:53,845 - Epoch: [56][ 6000/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525336    
+2023-12-07 09:01:46,307 - Epoch: [56][ 6100/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525323    
+2023-12-07 09:02:38,697 - Epoch: [56][ 6200/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525300    
+2023-12-07 09:03:31,071 - Epoch: [56][ 6300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525275    
+2023-12-07 09:04:23,570 - Epoch: [56][ 6400/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525270    
+2023-12-07 09:05:15,975 - Epoch: [56][ 6500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.525250    
+2023-12-07 09:06:08,333 - Epoch: [56][ 6600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525225    
+2023-12-07 09:07:00,700 - Epoch: [56][ 6700/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525201    
+2023-12-07 09:07:53,104 - Epoch: [56][ 6800/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525183    
+2023-12-07 09:08:45,553 - Epoch: [56][ 6900/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525173    
+2023-12-07 09:09:37,961 - Epoch: [56][ 7000/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525157    
+2023-12-07 09:10:30,360 - Epoch: [56][ 7100/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525140    
+2023-12-07 09:11:22,762 - Epoch: [56][ 7200/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525124    
+2023-12-07 09:12:15,145 - Epoch: [56][ 7300/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.525106    
+2023-12-07 09:13:07,494 - Epoch: [56][ 7400/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525083    
+2023-12-07 09:13:59,852 - Epoch: [56][ 7500/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525063    
+2023-12-07 09:14:52,287 - Epoch: [56][ 7600/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525053    
+2023-12-07 09:15:44,725 - Epoch: [56][ 7700/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525044    
+2023-12-07 09:16:37,136 - Epoch: [56][ 7800/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525032    
+2023-12-07 09:17:29,565 - Epoch: [56][ 7900/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.525022    
+2023-12-07 09:18:21,974 - Epoch: [56][ 8000/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.525010    
+2023-12-07 09:19:14,338 - Epoch: [56][ 8100/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524992    
+2023-12-07 09:20:06,690 - Epoch: [56][ 8200/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524974    
+2023-12-07 09:20:59,132 - Epoch: [56][ 8300/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524967    
+2023-12-07 09:21:51,555 - Epoch: [56][ 8400/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524958    
+2023-12-07 09:22:43,957 - Epoch: [56][ 8500/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524946    
+2023-12-07 09:23:36,342 - Epoch: [56][ 8600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524933    
+2023-12-07 09:24:28,780 - Epoch: [56][ 8700/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524926    
+2023-12-07 09:25:21,198 - Epoch: [56][ 8800/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524918    
+2023-12-07 09:26:13,619 - Epoch: [56][ 8900/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524909    
+2023-12-07 09:27:06,059 - Epoch: [56][ 9000/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524903    
+2023-12-07 09:27:58,449 - Epoch: [56][ 9100/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524892    
+2023-12-07 09:28:50,803 - Epoch: [56][ 9200/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524877    
+2023-12-07 09:29:43,249 - Epoch: [56][ 9300/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524872    
+2023-12-07 09:30:35,641 - Epoch: [56][ 9400/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524862    
+2023-12-07 09:31:28,000 - Epoch: [56][ 9500/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524848    
+2023-12-07 09:32:20,389 - Epoch: [56][ 9600/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524838    
+2023-12-07 09:33:12,827 - Epoch: [56][ 9700/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524833    
+2023-12-07 09:34:05,212 - Epoch: [56][ 9800/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524822    
+2023-12-07 09:34:57,632 - Epoch: [56][ 9900/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524816    
+2023-12-07 09:35:50,020 - Epoch: [56][10000/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524806    
+2023-12-07 09:36:42,460 - Epoch: [56][10100/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524801    
+2023-12-07 09:37:34,852 - Epoch: [56][10200/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524792    
+2023-12-07 09:38:27,245 - Epoch: [56][10300/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524784    
+2023-12-07 09:39:19,687 - Epoch: [56][10400/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524780    
+2023-12-07 09:40:12,142 - Epoch: [56][10500/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524777    
+2023-12-07 09:41:04,567 - Epoch: [56][10600/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524772    
+2023-12-07 09:41:56,965 - Epoch: [56][10700/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.524764    
+2023-12-07 09:42:49,419 - Epoch: [56][10800/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524762    
+2023-12-07 09:43:41,809 - Epoch: [56][10900/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524754    
+2023-12-07 09:44:34,250 - Epoch: [56][11000/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.524750    
+2023-12-07 09:45:26,651 - Epoch: [56][11100/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.524743    
+2023-12-07 09:46:19,073 - Epoch: [56][11200/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.524738    
+2023-12-07 09:47:11,493 - Epoch: [56][11300/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.524733    
+2023-12-07 09:48:03,948 - Epoch: [56][11400/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.524731    
+2023-12-07 09:48:56,323 - Epoch: [56][11500/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.524723    
+2023-12-07 09:49:48,755 - Epoch: [56][11600/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.524719    
+2023-12-07 09:50:41,099 - Epoch: [56][11700/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.524708    
+2023-12-07 09:51:33,479 - Epoch: [56][11800/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.524700    
+2023-12-07 09:52:25,935 - Epoch: [56][11900/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.524698    
+2023-12-07 09:53:18,343 - Epoch: [56][12000/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.524693    
+2023-12-07 09:54:10,800 - Epoch: [56][12100/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.524692    
+2023-12-07 09:54:46,374 - Epoch: [56][12168/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.524683    
+2023-12-07 09:54:46,776 - --- validate (epoch=56)-----------
+2023-12-07 09:54:46,776 - 167951 samples (256 per mini-batch)
+2023-12-07 09:55:37,146 - Epoch: [56][  100/  657]    Loss 0.000000    Overall Loss 0.014006    
+2023-12-07 09:56:25,718 - Epoch: [56][  200/  657]    Loss 0.000000    Overall Loss 0.014016    
+2023-12-07 09:57:14,266 - Epoch: [56][  300/  657]    Loss 0.000000    Overall Loss 0.014022    
+2023-12-07 09:58:02,829 - Epoch: [56][  400/  657]    Loss 0.000000    Overall Loss 0.014030    
+2023-12-07 09:58:51,385 - Epoch: [56][  500/  657]    Loss 0.000000    Overall Loss 0.014023    
+2023-12-07 09:59:39,918 - Epoch: [56][  600/  657]    Loss 0.000000    Overall Loss 0.014021    
+2023-12-07 10:00:07,164 - Epoch: [56][  657/  657]    Loss 0.000000    Overall Loss 0.014029    
+2023-12-07 10:00:07,366 - ==> Overall Loss: 0.014
+
+2023-12-07 10:00:07,368 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 10:00:07,368 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 10:00:07,389 - 
+
+2023-12-07 10:00:07,389 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 10:01:08,399 - Epoch: [57][  100/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000016    Time 0.610054    
+2023-12-07 10:02:00,747 - Epoch: [57][  200/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000016    Time 0.566755    
+2023-12-07 10:02:53,168 - Epoch: [57][  300/12168]    Overall Loss 0.013365    Objective Loss 0.000000    Distill Loss 0.013365                                        LR 0.000016    Time 0.552562    
+2023-12-07 10:03:45,607 - Epoch: [57][  400/12168]    Overall Loss 0.013360    Objective Loss 0.000000    Distill Loss 0.013360                                        LR 0.000016    Time 0.545511    
+2023-12-07 10:04:38,019 - Epoch: [57][  500/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000016    Time 0.541225    
+2023-12-07 10:05:30,430 - Epoch: [57][  600/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000016    Time 0.538366    
+2023-12-07 10:06:22,830 - Epoch: [57][  700/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.536310    
+2023-12-07 10:07:15,250 - Epoch: [57][  800/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000016    Time 0.534792    
+2023-12-07 10:08:07,665 - Epoch: [57][  900/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000016    Time 0.533605    
+2023-12-07 10:09:00,044 - Epoch: [57][ 1000/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.532620    
+2023-12-07 10:09:52,505 - Epoch: [57][ 1100/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.531889    
+2023-12-07 10:10:44,864 - Epoch: [57][ 1200/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.531195    
+2023-12-07 10:11:37,291 - Epoch: [57][ 1300/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.530660    
+2023-12-07 10:12:29,667 - Epoch: [57][ 1400/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.530165    
+2023-12-07 10:13:22,023 - Epoch: [57][ 1500/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.529722    
+2023-12-07 10:14:14,366 - Epoch: [57][ 1600/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.529327    
+2023-12-07 10:15:06,702 - Epoch: [57][ 1700/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.528974    
+2023-12-07 10:15:59,122 - Epoch: [57][ 1800/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.528707    
+2023-12-07 10:16:51,505 - Epoch: [57][ 1900/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.528448    
+2023-12-07 10:17:43,911 - Epoch: [57][ 2000/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.528227    
+2023-12-07 10:18:36,239 - Epoch: [57][ 2100/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.527990    
+2023-12-07 10:19:28,655 - Epoch: [57][ 2200/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.527815    
+2023-12-07 10:20:21,083 - Epoch: [57][ 2300/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.527659    
+2023-12-07 10:21:13,454 - Epoch: [57][ 2400/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.527494    
+2023-12-07 10:22:05,850 - Epoch: [57][ 2500/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.527351    
+2023-12-07 10:22:58,201 - Epoch: [57][ 2600/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.527202    
+2023-12-07 10:23:50,644 - Epoch: [57][ 2700/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.527098    
+2023-12-07 10:24:43,069 - Epoch: [57][ 2800/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.526995    
+2023-12-07 10:25:35,447 - Epoch: [57][ 2900/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.526883    
+2023-12-07 10:26:27,824 - Epoch: [57][ 3000/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.526778    
+2023-12-07 10:27:20,249 - Epoch: [57][ 3100/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.526695    
+2023-12-07 10:28:12,718 - Epoch: [57][ 3200/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.526632    
+2023-12-07 10:29:05,206 - Epoch: [57][ 3300/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.526578    
+2023-12-07 10:29:57,588 - Epoch: [57][ 3400/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.526496    
+2023-12-07 10:30:49,975 - Epoch: [57][ 3500/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.526420    
+2023-12-07 10:31:42,363 - Epoch: [57][ 3600/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.526348    
+2023-12-07 10:32:34,802 - Epoch: [57][ 3700/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.526295    
+2023-12-07 10:33:27,299 - Epoch: [57][ 3800/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.526259    
+2023-12-07 10:34:19,732 - Epoch: [57][ 3900/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.526208    
+2023-12-07 10:35:12,157 - Epoch: [57][ 4000/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.526159    
+2023-12-07 10:36:04,508 - Epoch: [57][ 4100/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.526093    
+2023-12-07 10:36:56,924 - Epoch: [57][ 4200/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.526046    
+2023-12-07 10:37:49,308 - Epoch: [57][ 4300/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525994    
+2023-12-07 10:38:41,713 - Epoch: [57][ 4400/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525949    
+2023-12-07 10:39:34,121 - Epoch: [57][ 4500/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.525907    
+2023-12-07 10:40:26,557 - Epoch: [57][ 4600/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525872    
+2023-12-07 10:41:18,909 - Epoch: [57][ 4700/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525822    
+2023-12-07 10:42:11,301 - Epoch: [57][ 4800/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525781    
+2023-12-07 10:43:03,727 - Epoch: [57][ 4900/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.525750    
+2023-12-07 10:43:56,152 - Epoch: [57][ 5000/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.525719    
+2023-12-07 10:44:48,531 - Epoch: [57][ 5100/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.525681    
+2023-12-07 10:45:41,014 - Epoch: [57][ 5200/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.525663    
+2023-12-07 10:46:33,376 - Epoch: [57][ 5300/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.525624    
+2023-12-07 10:47:25,732 - Epoch: [57][ 5400/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.525585    
+2023-12-07 10:48:18,137 - Epoch: [57][ 5500/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525557    
+2023-12-07 10:49:10,562 - Epoch: [57][ 5600/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525533    
+2023-12-07 10:50:03,012 - Epoch: [57][ 5700/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525514    
+2023-12-07 10:50:55,326 - Epoch: [57][ 5800/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525473    
+2023-12-07 10:51:47,711 - Epoch: [57][ 5900/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525445    
+2023-12-07 10:52:40,090 - Epoch: [57][ 6000/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525417    
+2023-12-07 10:53:32,466 - Epoch: [57][ 6100/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525389    
+2023-12-07 10:54:24,880 - Epoch: [57][ 6200/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525368    
+2023-12-07 10:55:17,327 - Epoch: [57][ 6300/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525353    
+2023-12-07 10:56:09,674 - Epoch: [57][ 6400/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525323    
+2023-12-07 10:57:02,076 - Epoch: [57][ 6500/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.525303    
+2023-12-07 10:57:54,467 - Epoch: [57][ 6600/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525281    
+2023-12-07 10:58:46,879 - Epoch: [57][ 6700/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525263    
+2023-12-07 10:59:39,356 - Epoch: [57][ 6800/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525256    
+2023-12-07 11:00:31,792 - Epoch: [57][ 6900/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525242    
+2023-12-07 11:01:24,203 - Epoch: [57][ 7000/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525226    
+2023-12-07 11:02:16,576 - Epoch: [57][ 7100/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525204    
+2023-12-07 11:03:08,987 - Epoch: [57][ 7200/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525188    
+2023-12-07 11:04:01,371 - Epoch: [57][ 7300/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525169    
+2023-12-07 11:04:53,762 - Epoch: [57][ 7400/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525152    
+2023-12-07 11:05:46,231 - Epoch: [57][ 7500/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525145    
+2023-12-07 11:06:38,676 - Epoch: [57][ 7600/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525136    
+2023-12-07 11:07:31,054 - Epoch: [57][ 7700/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525118    
+2023-12-07 11:08:23,473 - Epoch: [57][ 7800/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525106    
+2023-12-07 11:09:15,879 - Epoch: [57][ 7900/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525092    
+2023-12-07 11:10:08,310 - Epoch: [57][ 8000/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525082    
+2023-12-07 11:11:00,697 - Epoch: [57][ 8100/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.525066    
+2023-12-07 11:11:53,083 - Epoch: [57][ 8200/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525051    
+2023-12-07 11:12:45,453 - Epoch: [57][ 8300/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.525034    
+2023-12-07 11:13:37,879 - Epoch: [57][ 8400/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525025    
+2023-12-07 11:14:30,296 - Epoch: [57][ 8500/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525014    
+2023-12-07 11:15:22,700 - Epoch: [57][ 8600/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.525003    
+2023-12-07 11:16:15,160 - Epoch: [57][ 8700/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.524998    
+2023-12-07 11:17:07,654 - Epoch: [57][ 8800/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.524997    
+2023-12-07 11:18:00,063 - Epoch: [57][ 8900/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.524986    
+2023-12-07 11:18:52,449 - Epoch: [57][ 9000/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.524973    
+2023-12-07 11:19:44,887 - Epoch: [57][ 9100/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.524966    
+2023-12-07 11:20:37,339 - Epoch: [57][ 9200/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.524961    
+2023-12-07 11:21:29,776 - Epoch: [57][ 9300/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.524954    
+2023-12-07 11:22:22,207 - Epoch: [57][ 9400/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.524947    
+2023-12-07 11:23:14,570 - Epoch: [57][ 9500/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.524933    
+2023-12-07 11:24:07,024 - Epoch: [57][ 9600/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.524928    
+2023-12-07 11:24:59,424 - Epoch: [57][ 9700/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524919    
+2023-12-07 11:25:51,811 - Epoch: [57][ 9800/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.524908    
+2023-12-07 11:26:44,253 - Epoch: [57][ 9900/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.524902    
+2023-12-07 11:27:36,675 - Epoch: [57][10000/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.524895    
+2023-12-07 11:28:29,072 - Epoch: [57][10100/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524886    
+2023-12-07 11:29:21,438 - Epoch: [57][10200/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524873    
+2023-12-07 11:30:13,843 - Epoch: [57][10300/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524865    
+2023-12-07 11:31:06,304 - Epoch: [57][10400/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524862    
+2023-12-07 11:31:58,735 - Epoch: [57][10500/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524857    
+2023-12-07 11:32:51,140 - Epoch: [57][10600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524849    
+2023-12-07 11:33:43,577 - Epoch: [57][10700/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524844    
+2023-12-07 11:34:35,992 - Epoch: [57][10800/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524837    
+2023-12-07 11:35:28,417 - Epoch: [57][10900/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524831    
+2023-12-07 11:36:20,811 - Epoch: [57][11000/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524823    
+2023-12-07 11:37:13,149 - Epoch: [57][11100/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524810    
+2023-12-07 11:38:05,638 - Epoch: [57][11200/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524810    
+2023-12-07 11:38:58,019 - Epoch: [57][11300/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524801    
+2023-12-07 11:39:50,402 - Epoch: [57][11400/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524792    
+2023-12-07 11:40:42,822 - Epoch: [57][11500/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524787    
+2023-12-07 11:41:35,259 - Epoch: [57][11600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.524783    
+2023-12-07 11:42:27,729 - Epoch: [57][11700/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524782    
+2023-12-07 11:43:20,172 - Epoch: [57][11800/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524779    
+2023-12-07 11:44:12,554 - Epoch: [57][11900/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524770    
+2023-12-07 11:45:04,959 - Epoch: [57][12000/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524764    
+2023-12-07 11:45:57,383 - Epoch: [57][12100/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524760    
+2023-12-07 11:46:32,968 - Epoch: [57][12168/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.524751    
+2023-12-07 11:46:33,374 - --- validate (epoch=57)-----------
+2023-12-07 11:46:33,374 - 167951 samples (256 per mini-batch)
+2023-12-07 11:47:23,903 - Epoch: [57][  100/  657]    Loss 0.000000    Overall Loss 0.014252    
+2023-12-07 11:48:12,471 - Epoch: [57][  200/  657]    Loss 0.000000    Overall Loss 0.014237    
+2023-12-07 11:49:01,048 - Epoch: [57][  300/  657]    Loss 0.000000    Overall Loss 0.014227    
+2023-12-07 11:49:49,594 - Epoch: [57][  400/  657]    Loss 0.000000    Overall Loss 0.014228    
+2023-12-07 11:50:38,159 - Epoch: [57][  500/  657]    Loss 0.000000    Overall Loss 0.014209    
+2023-12-07 11:51:26,707 - Epoch: [57][  600/  657]    Loss 0.000000    Overall Loss 0.014204    
+2023-12-07 11:51:53,937 - Epoch: [57][  657/  657]    Loss 0.000000    Overall Loss 0.014198    
+2023-12-07 11:51:54,153 - ==> Overall Loss: 0.014
+
+2023-12-07 11:51:54,155 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 11:51:54,155 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 11:51:54,176 - 
+
+2023-12-07 11:51:54,176 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 11:52:57,737 - Epoch: [58][  100/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.635571    
+2023-12-07 11:53:50,172 - Epoch: [58][  200/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.579940    
+2023-12-07 11:54:42,598 - Epoch: [58][  300/12168]    Overall Loss 0.013413    Objective Loss 0.000000    Distill Loss 0.013413                                        LR 0.000016    Time 0.561371    
+2023-12-07 11:55:34,948 - Epoch: [58][  400/12168]    Overall Loss 0.013421    Objective Loss 0.000000    Distill Loss 0.013421                                        LR 0.000016    Time 0.551895    
+2023-12-07 11:56:27,397 - Epoch: [58][  500/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.546407    
+2023-12-07 11:57:19,759 - Epoch: [58][  600/12168]    Overall Loss 0.013404    Objective Loss 0.000000    Distill Loss 0.013404                                        LR 0.000016    Time 0.542604    
+2023-12-07 11:58:12,181 - Epoch: [58][  700/12168]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                                        LR 0.000016    Time 0.539973    
+2023-12-07 11:59:04,595 - Epoch: [58][  800/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.537990    
+2023-12-07 11:59:56,978 - Epoch: [58][  900/12168]    Overall Loss 0.013399    Objective Loss 0.000000    Distill Loss 0.013399                                        LR 0.000016    Time 0.536413    
+2023-12-07 12:00:49,411 - Epoch: [58][ 1000/12168]    Overall Loss 0.013406    Objective Loss 0.000000    Distill Loss 0.013406                                        LR 0.000016    Time 0.535201    
+2023-12-07 12:01:41,830 - Epoch: [58][ 1100/12168]    Overall Loss 0.013401    Objective Loss 0.000000    Distill Loss 0.013401                                        LR 0.000016    Time 0.534197    
+2023-12-07 12:02:34,287 - Epoch: [58][ 1200/12168]    Overall Loss 0.013395    Objective Loss 0.000000    Distill Loss 0.013395                                        LR 0.000016    Time 0.533392    
+2023-12-07 12:03:26,766 - Epoch: [58][ 1300/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.532727    
+2023-12-07 12:04:19,138 - Epoch: [58][ 1400/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.532082    
+2023-12-07 12:05:11,574 - Epoch: [58][ 1500/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.531564    
+2023-12-07 12:06:03,961 - Epoch: [58][ 1600/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.531081    
+2023-12-07 12:06:56,345 - Epoch: [58][ 1700/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.530653    
+2023-12-07 12:07:48,788 - Epoch: [58][ 1800/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.530306    
+2023-12-07 12:08:41,194 - Epoch: [58][ 1900/12168]    Overall Loss 0.013398    Objective Loss 0.000000    Distill Loss 0.013398                                        LR 0.000016    Time 0.529975    
+2023-12-07 12:09:33,683 - Epoch: [58][ 2000/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.529719    
+2023-12-07 12:10:26,089 - Epoch: [58][ 2100/12168]    Overall Loss 0.013397    Objective Loss 0.000000    Distill Loss 0.013397                                        LR 0.000016    Time 0.529448    
+2023-12-07 12:11:18,481 - Epoch: [58][ 2200/12168]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                                        LR 0.000016    Time 0.529195    
+2023-12-07 12:12:10,935 - Epoch: [58][ 2300/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.528992    
+2023-12-07 12:13:03,321 - Epoch: [58][ 2400/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.528776    
+2023-12-07 12:13:55,734 - Epoch: [58][ 2500/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.528589    
+2023-12-07 12:14:48,150 - Epoch: [58][ 2600/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.528418    
+2023-12-07 12:15:40,541 - Epoch: [58][ 2700/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.528250    
+2023-12-07 12:16:32,924 - Epoch: [58][ 2800/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.528091    
+2023-12-07 12:17:25,345 - Epoch: [58][ 2900/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.527956    
+2023-12-07 12:18:17,848 - Epoch: [58][ 3000/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.527857    
+2023-12-07 12:19:10,257 - Epoch: [58][ 3100/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.527734    
+2023-12-07 12:20:02,653 - Epoch: [58][ 3200/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.527615    
+2023-12-07 12:20:55,030 - Epoch: [58][ 3300/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.527498    
+2023-12-07 12:21:47,426 - Epoch: [58][ 3400/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.527393    
+2023-12-07 12:22:39,790 - Epoch: [58][ 3500/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.527285    
+2023-12-07 12:23:32,144 - Epoch: [58][ 3600/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.527180    
+2023-12-07 12:24:24,533 - Epoch: [58][ 3700/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.527090    
+2023-12-07 12:25:16,901 - Epoch: [58][ 3800/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.527000    
+2023-12-07 12:26:09,351 - Epoch: [58][ 3900/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.526935    
+2023-12-07 12:27:01,722 - Epoch: [58][ 4000/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.526853    
+2023-12-07 12:27:54,158 - Epoch: [58][ 4100/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.526792    
+2023-12-07 12:28:46,636 - Epoch: [58][ 4200/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.526743    
+2023-12-07 12:29:39,040 - Epoch: [58][ 4300/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.526679    
+2023-12-07 12:30:31,549 - Epoch: [58][ 4400/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.526642    
+2023-12-07 12:31:23,984 - Epoch: [58][ 4500/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.526591    
+2023-12-07 12:32:16,378 - Epoch: [58][ 4600/12168]    Overall Loss 0.013388    Objective Loss 0.000000    Distill Loss 0.013388                                        LR 0.000016    Time 0.526532    
+2023-12-07 12:33:08,760 - Epoch: [58][ 4700/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.526474    
+2023-12-07 12:34:01,201 - Epoch: [58][ 4800/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.526430    
+2023-12-07 12:34:53,613 - Epoch: [58][ 4900/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.526382    
+2023-12-07 12:35:46,066 - Epoch: [58][ 5000/12168]    Overall Loss 0.013389    Objective Loss 0.000000    Distill Loss 0.013389                                        LR 0.000016    Time 0.526345    
+2023-12-07 12:36:38,442 - Epoch: [58][ 5100/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.526293    
+2023-12-07 12:37:30,878 - Epoch: [58][ 5200/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.526255    
+2023-12-07 12:38:23,301 - Epoch: [58][ 5300/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.526217    
+2023-12-07 12:39:15,670 - Epoch: [58][ 5400/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.526169    
+2023-12-07 12:40:08,084 - Epoch: [58][ 5500/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.526132    
+2023-12-07 12:41:00,503 - Epoch: [58][ 5600/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.526097    
+2023-12-07 12:41:52,883 - Epoch: [58][ 5700/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.526056    
+2023-12-07 12:42:45,242 - Epoch: [58][ 5800/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.526013    
+2023-12-07 12:43:37,657 - Epoch: [58][ 5900/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525980    
+2023-12-07 12:44:30,021 - Epoch: [58][ 6000/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525941    
+2023-12-07 12:45:22,470 - Epoch: [58][ 6100/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525917    
+2023-12-07 12:46:14,879 - Epoch: [58][ 6200/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525887    
+2023-12-07 12:47:07,266 - Epoch: [58][ 6300/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525854    
+2023-12-07 12:47:59,648 - Epoch: [58][ 6400/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525822    
+2023-12-07 12:48:51,989 - Epoch: [58][ 6500/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525784    
+2023-12-07 12:49:44,354 - Epoch: [58][ 6600/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525751    
+2023-12-07 12:50:36,775 - Epoch: [58][ 6700/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525728    
+2023-12-07 12:51:29,244 - Epoch: [58][ 6800/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525712    
+2023-12-07 12:52:21,635 - Epoch: [58][ 6900/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525686    
+2023-12-07 12:53:14,011 - Epoch: [58][ 7000/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525658    
+2023-12-07 12:54:06,433 - Epoch: [58][ 7100/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525637    
+2023-12-07 12:54:58,786 - Epoch: [58][ 7200/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525607    
+2023-12-07 12:55:51,172 - Epoch: [58][ 7300/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525583    
+2023-12-07 12:56:43,641 - Epoch: [58][ 7400/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525570    
+2023-12-07 12:57:36,052 - Epoch: [58][ 7500/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525550    
+2023-12-07 12:58:28,435 - Epoch: [58][ 7600/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525527    
+2023-12-07 12:59:20,925 - Epoch: [58][ 7700/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525519    
+2023-12-07 13:00:13,339 - Epoch: [58][ 7800/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525501    
+2023-12-07 13:01:05,721 - Epoch: [58][ 7900/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525479    
+2023-12-07 13:01:58,052 - Epoch: [58][ 8000/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525451    
+2023-12-07 13:02:50,442 - Epoch: [58][ 8100/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525432    
+2023-12-07 13:03:42,857 - Epoch: [58][ 8200/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525416    
+2023-12-07 13:04:35,249 - Epoch: [58][ 8300/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525397    
+2023-12-07 13:05:27,694 - Epoch: [58][ 8400/12168]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                                        LR 0.000016    Time 0.525386    
+2023-12-07 13:06:20,043 - Epoch: [58][ 8500/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525363    
+2023-12-07 13:07:12,504 - Epoch: [58][ 8600/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525354    
+2023-12-07 13:08:04,860 - Epoch: [58][ 8700/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525333    
+2023-12-07 13:08:57,218 - Epoch: [58][ 8800/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525313    
+2023-12-07 13:09:49,629 - Epoch: [58][ 8900/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525299    
+2023-12-07 13:10:42,076 - Epoch: [58][ 9000/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525289    
+2023-12-07 13:11:34,425 - Epoch: [58][ 9100/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525269    
+2023-12-07 13:12:26,825 - Epoch: [58][ 9200/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525255    
+2023-12-07 13:13:19,229 - Epoch: [58][ 9300/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525241    
+2023-12-07 13:14:11,661 - Epoch: [58][ 9400/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525231    
+2023-12-07 13:15:04,100 - Epoch: [58][ 9500/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525222    
+2023-12-07 13:15:56,589 - Epoch: [58][ 9600/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525218    
+2023-12-07 13:16:49,032 - Epoch: [58][ 9700/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525210    
+2023-12-07 13:17:41,403 - Epoch: [58][ 9800/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525194    
+2023-12-07 13:18:33,837 - Epoch: [58][ 9900/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525185    
+2023-12-07 13:19:26,213 - Epoch: [58][10000/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525171    
+2023-12-07 13:20:18,672 - Epoch: [58][10100/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525164    
+2023-12-07 13:21:11,079 - Epoch: [58][10200/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525153    
+2023-12-07 13:22:03,482 - Epoch: [58][10300/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525142    
+2023-12-07 13:22:55,910 - Epoch: [58][10400/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525134    
+2023-12-07 13:23:48,318 - Epoch: [58][10500/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525123    
+2023-12-07 13:24:40,726 - Epoch: [58][10600/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525113    
+2023-12-07 13:25:33,183 - Epoch: [58][10700/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525108    
+2023-12-07 13:26:25,581 - Epoch: [58][10800/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525097    
+2023-12-07 13:27:18,000 - Epoch: [58][10900/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525088    
+2023-12-07 13:28:10,421 - Epoch: [58][11000/12168]    Overall Loss 0.013390    Objective Loss 0.000000    Distill Loss 0.013390                                        LR 0.000016    Time 0.525080    
+2023-12-07 13:29:02,833 - Epoch: [58][11100/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525071    
+2023-12-07 13:29:55,255 - Epoch: [58][11200/12168]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                                        LR 0.000016    Time 0.525063    
+2023-12-07 13:30:47,730 - Epoch: [58][11300/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525060    
+2023-12-07 13:31:40,131 - Epoch: [58][11400/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525051    
+2023-12-07 13:32:32,527 - Epoch: [58][11500/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525041    
+2023-12-07 13:33:24,954 - Epoch: [58][11600/12168]    Overall Loss 0.013392    Objective Loss 0.000000    Distill Loss 0.013392                                        LR 0.000016    Time 0.525034    
+2023-12-07 13:34:17,382 - Epoch: [58][11700/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525027    
+2023-12-07 13:35:09,751 - Epoch: [58][11800/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525016    
+2023-12-07 13:36:02,159 - Epoch: [58][11900/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.525007    
+2023-12-07 13:36:54,564 - Epoch: [58][12000/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524999    
+2023-12-07 13:37:46,965 - Epoch: [58][12100/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524991    
+2023-12-07 13:38:22,595 - Epoch: [58][12168/12168]    Overall Loss 0.013393    Objective Loss 0.000000    Distill Loss 0.013393                                        LR 0.000016    Time 0.524985    
+2023-12-07 13:38:22,999 - --- validate (epoch=58)-----------
+2023-12-07 13:38:22,999 - 167951 samples (256 per mini-batch)
+2023-12-07 13:39:13,355 - Epoch: [58][  100/  657]    Loss 0.000000    Overall Loss 0.014026    
+2023-12-07 13:40:01,937 - Epoch: [58][  200/  657]    Loss 0.000000    Overall Loss 0.014016    
+2023-12-07 13:40:50,508 - Epoch: [58][  300/  657]    Loss 0.000000    Overall Loss 0.014027    
+2023-12-07 13:41:39,115 - Epoch: [58][  400/  657]    Loss 0.000000    Overall Loss 0.014027    
+2023-12-07 13:42:27,694 - Epoch: [58][  500/  657]    Loss 0.000000    Overall Loss 0.014023    
+2023-12-07 13:43:16,302 - Epoch: [58][  600/  657]    Loss 0.000000    Overall Loss 0.014020    
+2023-12-07 13:43:43,536 - Epoch: [58][  657/  657]    Loss 0.000000    Overall Loss 0.014023    
+2023-12-07 13:43:43,750 - ==> Overall Loss: 0.014
+
+2023-12-07 13:43:43,751 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 13:43:43,752 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 13:43:43,765 - 
+
+2023-12-07 13:43:43,765 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 13:44:45,618 - Epoch: [59][  100/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000016    Time 0.618484    
+2023-12-07 13:45:38,125 - Epoch: [59][  200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000016    Time 0.571761    
+2023-12-07 13:46:30,672 - Epoch: [59][  300/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000016    Time 0.556317    
+2023-12-07 13:47:23,195 - Epoch: [59][  400/12168]    Overall Loss 0.013360    Objective Loss 0.000000    Distill Loss 0.013360                                        LR 0.000016    Time 0.548538    
+2023-12-07 13:48:15,583 - Epoch: [59][  500/12168]    Overall Loss 0.013359    Objective Loss 0.000000    Distill Loss 0.013359                                        LR 0.000016    Time 0.543601    
+2023-12-07 13:49:08,048 - Epoch: [59][  600/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000016    Time 0.540437    
+2023-12-07 13:50:00,534 - Epoch: [59][  700/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000016    Time 0.538207    
+2023-12-07 13:50:53,041 - Epoch: [59][  800/12168]    Overall Loss 0.013361    Objective Loss 0.000000    Distill Loss 0.013361                                        LR 0.000016    Time 0.536560    
+2023-12-07 13:51:45,560 - Epoch: [59][  900/12168]    Overall Loss 0.013365    Objective Loss 0.000000    Distill Loss 0.013365                                        LR 0.000016    Time 0.535292    
+2023-12-07 13:52:38,016 - Epoch: [59][ 1000/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000016    Time 0.534216    
+2023-12-07 13:53:30,447 - Epoch: [59][ 1100/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000016    Time 0.533313    
+2023-12-07 13:54:22,966 - Epoch: [59][ 1200/12168]    Overall Loss 0.013369    Objective Loss 0.000000    Distill Loss 0.013369                                        LR 0.000016    Time 0.532633    
+2023-12-07 13:55:15,442 - Epoch: [59][ 1300/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.532025    
+2023-12-07 13:56:07,909 - Epoch: [59][ 1400/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.531498    
+2023-12-07 13:57:00,439 - Epoch: [59][ 1500/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.531082    
+2023-12-07 13:57:53,042 - Epoch: [59][ 1600/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000016    Time 0.530764    
+2023-12-07 13:58:45,557 - Epoch: [59][ 1700/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.530431    
+2023-12-07 13:59:38,044 - Epoch: [59][ 1800/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.530121    
+2023-12-07 14:00:30,657 - Epoch: [59][ 1900/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.529908    
+2023-12-07 14:01:23,140 - Epoch: [59][ 2000/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.529653    
+2023-12-07 14:02:15,787 - Epoch: [59][ 2100/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.529500    
+2023-12-07 14:03:08,314 - Epoch: [59][ 2200/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.529306    
+2023-12-07 14:04:00,802 - Epoch: [59][ 2300/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.529112    
+2023-12-07 14:04:53,353 - Epoch: [59][ 2400/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.528960    
+2023-12-07 14:05:45,856 - Epoch: [59][ 2500/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.528802    
+2023-12-07 14:06:38,390 - Epoch: [59][ 2600/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.528667    
+2023-12-07 14:07:30,960 - Epoch: [59][ 2700/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.528556    
+2023-12-07 14:08:23,467 - Epoch: [59][ 2800/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.528430    
+2023-12-07 14:09:15,932 - Epoch: [59][ 2900/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.528299    
+2023-12-07 14:10:08,457 - Epoch: [59][ 3000/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.528196    
+2023-12-07 14:11:01,252 - Epoch: [59][ 3100/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.528187    
+2023-12-07 14:11:56,498 - Epoch: [59][ 3200/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.528944    
+2023-12-07 14:12:49,298 - Epoch: [59][ 3300/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000016    Time 0.528914    
+2023-12-07 14:13:41,848 - Epoch: [59][ 3400/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000016    Time 0.528813    
+2023-12-07 14:14:34,394 - Epoch: [59][ 3500/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.528716    
+2023-12-07 14:15:26,825 - Epoch: [59][ 3600/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.528593    
+2023-12-07 14:16:19,342 - Epoch: [59][ 3700/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.528499    
+2023-12-07 14:17:11,890 - Epoch: [59][ 3800/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.528419    
+2023-12-07 14:18:04,406 - Epoch: [59][ 3900/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.528334    
+2023-12-07 14:18:56,932 - Epoch: [59][ 4000/12168]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                                        LR 0.000016    Time 0.528257    
+2023-12-07 14:19:49,447 - Epoch: [59][ 4100/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.528180    
+2023-12-07 14:20:42,135 - Epoch: [59][ 4200/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.528148    
+2023-12-07 14:21:34,631 - Epoch: [59][ 4300/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.528073    
+2023-12-07 14:22:27,092 - Epoch: [59][ 4400/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527994    
+2023-12-07 14:23:19,541 - Epoch: [59][ 4500/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527915    
+2023-12-07 14:24:12,027 - Epoch: [59][ 4600/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.527848    
+2023-12-07 14:25:04,459 - Epoch: [59][ 4700/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.527772    
+2023-12-07 14:25:57,004 - Epoch: [59][ 4800/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.527723    
+2023-12-07 14:26:49,514 - Epoch: [59][ 4900/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527669    
+2023-12-07 14:27:41,996 - Epoch: [59][ 5000/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527611    
+2023-12-07 14:28:34,470 - Epoch: [59][ 5100/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.527554    
+2023-12-07 14:29:26,940 - Epoch: [59][ 5200/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527499    
+2023-12-07 14:30:19,476 - Epoch: [59][ 5300/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527458    
+2023-12-07 14:31:11,990 - Epoch: [59][ 5400/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.527414    
+2023-12-07 14:32:04,432 - Epoch: [59][ 5500/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527359    
+2023-12-07 14:32:56,956 - Epoch: [59][ 5600/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.527321    
+2023-12-07 14:33:49,515 - Epoch: [59][ 5700/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.527290    
+2023-12-07 14:34:42,004 - Epoch: [59][ 5800/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.527248    
+2023-12-07 14:35:34,444 - Epoch: [59][ 5900/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.527199    
+2023-12-07 14:36:26,880 - Epoch: [59][ 6000/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527151    
+2023-12-07 14:37:19,388 - Epoch: [59][ 6100/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527116    
+2023-12-07 14:38:11,870 - Epoch: [59][ 6200/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527079    
+2023-12-07 14:39:04,339 - Epoch: [59][ 6300/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.527040    
+2023-12-07 14:39:56,799 - Epoch: [59][ 6400/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.527002    
+2023-12-07 14:40:49,208 - Epoch: [59][ 6500/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.526956    
+2023-12-07 14:41:41,638 - Epoch: [59][ 6600/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.526916    
+2023-12-07 14:42:34,121 - Epoch: [59][ 6700/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.526884    
+2023-12-07 14:43:26,560 - Epoch: [59][ 6800/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.526847    
+2023-12-07 14:44:19,011 - Epoch: [59][ 6900/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.526813    
+2023-12-07 14:45:11,479 - Epoch: [59][ 7000/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.526782    
+2023-12-07 14:46:03,935 - Epoch: [59][ 7100/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.526750    
+2023-12-07 14:46:56,432 - Epoch: [59][ 7200/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.526725    
+2023-12-07 14:47:48,889 - Epoch: [59][ 7300/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.526695    
+2023-12-07 14:48:41,265 - Epoch: [59][ 7400/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.526655    
+2023-12-07 14:49:33,723 - Epoch: [59][ 7500/12168]    Overall Loss 0.013371    Objective Loss 0.000000    Distill Loss 0.013371                                        LR 0.000016    Time 0.526626    
+2023-12-07 14:50:26,191 - Epoch: [59][ 7600/12168]    Overall Loss 0.013372    Objective Loss 0.000000    Distill Loss 0.013372                                        LR 0.000016    Time 0.526600    
+2023-12-07 14:51:18,661 - Epoch: [59][ 7700/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.526575    
+2023-12-07 14:52:11,161 - Epoch: [59][ 7800/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.526555    
+2023-12-07 14:53:03,643 - Epoch: [59][ 7900/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.526532    
+2023-12-07 14:53:56,145 - Epoch: [59][ 8000/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.526513    
+2023-12-07 14:54:48,576 - Epoch: [59][ 8100/12168]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                                        LR 0.000016    Time 0.526485    
+2023-12-07 14:55:41,104 - Epoch: [59][ 8200/12168]    Overall Loss 0.013374    Objective Loss 0.000000    Distill Loss 0.013374                                        LR 0.000016    Time 0.526470    
+2023-12-07 14:56:33,552 - Epoch: [59][ 8300/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.526446    
+2023-12-07 14:57:25,951 - Epoch: [59][ 8400/12168]    Overall Loss 0.013375    Objective Loss 0.000000    Distill Loss 0.013375                                        LR 0.000016    Time 0.526416    
+2023-12-07 14:58:18,327 - Epoch: [59][ 8500/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000016    Time 0.526384    
+2023-12-07 14:59:10,684 - Epoch: [59][ 8600/12168]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                                        LR 0.000016    Time 0.526351    
+2023-12-07 15:00:03,156 - Epoch: [59][ 8700/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.526332    
+2023-12-07 15:00:55,637 - Epoch: [59][ 8800/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.526315    
+2023-12-07 15:01:48,135 - Epoch: [59][ 8900/12168]    Overall Loss 0.013377    Objective Loss 0.000000    Distill Loss 0.013377                                        LR 0.000016    Time 0.526299    
+2023-12-07 15:02:40,548 - Epoch: [59][ 9000/12168]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                                        LR 0.000016    Time 0.526275    
+2023-12-07 15:03:33,065 - Epoch: [59][ 9100/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.526262    
+2023-12-07 15:04:25,487 - Epoch: [59][ 9200/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.526240    
+2023-12-07 15:05:18,004 - Epoch: [59][ 9300/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.526228    
+2023-12-07 15:06:10,434 - Epoch: [59][ 9400/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.526207    
+2023-12-07 15:07:02,961 - Epoch: [59][ 9500/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.526197    
+2023-12-07 15:07:55,489 - Epoch: [59][ 9600/12168]    Overall Loss 0.013379    Objective Loss 0.000000    Distill Loss 0.013379                                        LR 0.000016    Time 0.526187    
+2023-12-07 15:08:47,928 - Epoch: [59][ 9700/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.526168    
+2023-12-07 15:09:40,409 - Epoch: [59][ 9800/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.526154    
+2023-12-07 15:10:32,862 - Epoch: [59][ 9900/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.526137    
+2023-12-07 15:11:25,352 - Epoch: [59][10000/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.526124    
+2023-12-07 15:12:17,871 - Epoch: [59][10100/12168]    Overall Loss 0.013380    Objective Loss 0.000000    Distill Loss 0.013380                                        LR 0.000016    Time 0.526115    
+2023-12-07 15:13:10,265 - Epoch: [59][10200/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.526093    
+2023-12-07 15:14:02,740 - Epoch: [59][10300/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.526080    
+2023-12-07 15:14:55,241 - Epoch: [59][10400/12168]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                                        LR 0.000016    Time 0.526069    
+2023-12-07 15:15:47,676 - Epoch: [59][10500/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.526052    
+2023-12-07 15:16:40,109 - Epoch: [59][10600/12168]    Overall Loss 0.013382    Objective Loss 0.000000    Distill Loss 0.013382                                        LR 0.000016    Time 0.526036    
+2023-12-07 15:17:32,552 - Epoch: [59][10700/12168]    Overall Loss 0.013383    Objective Loss 0.000000    Distill Loss 0.013383                                        LR 0.000016    Time 0.526021    
+2023-12-07 15:18:24,985 - Epoch: [59][10800/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.526005    
+2023-12-07 15:19:17,509 - Epoch: [59][10900/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.525997    
+2023-12-07 15:20:09,905 - Epoch: [59][11000/12168]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                                        LR 0.000016    Time 0.525979    
+2023-12-07 15:21:02,304 - Epoch: [59][11100/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.525960    
+2023-12-07 15:21:54,725 - Epoch: [59][11200/12168]    Overall Loss 0.013385    Objective Loss 0.000000    Distill Loss 0.013385                                        LR 0.000016    Time 0.525944    
+2023-12-07 15:22:47,188 - Epoch: [59][11300/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525932    
+2023-12-07 15:23:39,622 - Epoch: [59][11400/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525918    
+2023-12-07 15:24:32,099 - Epoch: [59][11500/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525908    
+2023-12-07 15:25:24,552 - Epoch: [59][11600/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525896    
+2023-12-07 15:26:17,106 - Epoch: [59][11700/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525892    
+2023-12-07 15:27:09,653 - Epoch: [59][11800/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525889    
+2023-12-07 15:28:02,171 - Epoch: [59][11900/12168]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                                        LR 0.000016    Time 0.525882    
+2023-12-07 15:28:54,667 - Epoch: [59][12000/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525874    
+2023-12-07 15:29:47,090 - Epoch: [59][12100/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525860    
+2023-12-07 15:30:22,750 - Epoch: [59][12168/12168]    Overall Loss 0.013386    Objective Loss 0.000000    Distill Loss 0.013386                                        LR 0.000016    Time 0.525852    
+2023-12-07 15:30:23,141 - --- validate (epoch=59)-----------
+2023-12-07 15:30:23,141 - 167951 samples (256 per mini-batch)
+2023-12-07 15:31:14,662 - Epoch: [59][  100/  657]    Loss 0.000000    Overall Loss 0.013949    
+2023-12-07 15:32:03,278 - Epoch: [59][  200/  657]    Loss 0.000000    Overall Loss 0.013960    
+2023-12-07 15:32:51,914 - Epoch: [59][  300/  657]    Loss 0.000000    Overall Loss 0.013959    
+2023-12-07 15:33:40,496 - Epoch: [59][  400/  657]    Loss 0.000000    Overall Loss 0.013959    
+2023-12-07 15:34:29,095 - Epoch: [59][  500/  657]    Loss 0.000000    Overall Loss 0.013969    
+2023-12-07 15:35:17,668 - Epoch: [59][  600/  657]    Loss 0.000000    Overall Loss 0.013967    
+2023-12-07 15:35:44,923 - Epoch: [59][  657/  657]    Loss 0.000000    Overall Loss 0.013966    
+2023-12-07 15:35:45,127 - ==> Overall Loss: 0.014
+
+2023-12-07 15:35:45,129 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 15:35:45,129 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 15:35:45,156 - 
+
+2023-12-07 15:35:45,157 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 15:36:45,754 - Epoch: [60][  100/12168]    Overall Loss 0.013144    Objective Loss 0.000000    Distill Loss 0.013144                                        LR 0.000008    Time 0.605929    
+2023-12-07 15:37:38,163 - Epoch: [60][  200/12168]    Overall Loss 0.013160    Objective Loss 0.000000    Distill Loss 0.013160                                        LR 0.000008    Time 0.564992    
+2023-12-07 15:38:30,588 - Epoch: [60][  300/12168]    Overall Loss 0.013200    Objective Loss 0.000000    Distill Loss 0.013200                                        LR 0.000008    Time 0.551400    
+2023-12-07 15:39:23,035 - Epoch: [60][  400/12168]    Overall Loss 0.013198    Objective Loss 0.000000    Distill Loss 0.013198                                        LR 0.000008    Time 0.544660    
+2023-12-07 15:40:15,513 - Epoch: [60][  500/12168]    Overall Loss 0.013203    Objective Loss 0.000000    Distill Loss 0.013203                                        LR 0.000008    Time 0.540677    
+2023-12-07 15:41:07,971 - Epoch: [60][  600/12168]    Overall Loss 0.013203    Objective Loss 0.000000    Distill Loss 0.013203                                        LR 0.000008    Time 0.537989    
+2023-12-07 15:42:00,401 - Epoch: [60][  700/12168]    Overall Loss 0.013214    Objective Loss 0.000000    Distill Loss 0.013214                                        LR 0.000008    Time 0.536028    
+2023-12-07 15:42:52,809 - Epoch: [60][  800/12168]    Overall Loss 0.013216    Objective Loss 0.000000    Distill Loss 0.013216                                        LR 0.000008    Time 0.534530    
+2023-12-07 15:43:45,246 - Epoch: [60][  900/12168]    Overall Loss 0.013219    Objective Loss 0.000000    Distill Loss 0.013219                                        LR 0.000008    Time 0.533398    
+2023-12-07 15:44:37,664 - Epoch: [60][ 1000/12168]    Overall Loss 0.013227    Objective Loss 0.000000    Distill Loss 0.013227                                        LR 0.000008    Time 0.532473    
+2023-12-07 15:45:30,192 - Epoch: [60][ 1100/12168]    Overall Loss 0.013229    Objective Loss 0.000000    Distill Loss 0.013229                                        LR 0.000008    Time 0.531815    
+2023-12-07 15:46:22,635 - Epoch: [60][ 1200/12168]    Overall Loss 0.013230    Objective Loss 0.000000    Distill Loss 0.013230                                        LR 0.000008    Time 0.531197    
+2023-12-07 15:47:15,053 - Epoch: [60][ 1300/12168]    Overall Loss 0.013227    Objective Loss 0.000000    Distill Loss 0.013227                                        LR 0.000008    Time 0.530655    
+2023-12-07 15:48:07,447 - Epoch: [60][ 1400/12168]    Overall Loss 0.013227    Objective Loss 0.000000    Distill Loss 0.013227                                        LR 0.000008    Time 0.530173    
+2023-12-07 15:48:59,852 - Epoch: [60][ 1500/12168]    Overall Loss 0.013228    Objective Loss 0.000000    Distill Loss 0.013228                                        LR 0.000008    Time 0.529762    
+2023-12-07 15:49:52,312 - Epoch: [60][ 1600/12168]    Overall Loss 0.013233    Objective Loss 0.000000    Distill Loss 0.013233                                        LR 0.000008    Time 0.529437    
+2023-12-07 15:50:44,891 - Epoch: [60][ 1700/12168]    Overall Loss 0.013237    Objective Loss 0.000000    Distill Loss 0.013237                                        LR 0.000008    Time 0.529221    
+2023-12-07 15:51:37,282 - Epoch: [60][ 1800/12168]    Overall Loss 0.013237    Objective Loss 0.000000    Distill Loss 0.013237                                        LR 0.000008    Time 0.528924    
+2023-12-07 15:52:29,763 - Epoch: [60][ 1900/12168]    Overall Loss 0.013239    Objective Loss 0.000000    Distill Loss 0.013239                                        LR 0.000008    Time 0.528705    
+2023-12-07 15:53:22,281 - Epoch: [60][ 2000/12168]    Overall Loss 0.013241    Objective Loss 0.000000    Distill Loss 0.013241                                        LR 0.000008    Time 0.528527    
+2023-12-07 15:54:14,769 - Epoch: [60][ 2100/12168]    Overall Loss 0.013245    Objective Loss 0.000000    Distill Loss 0.013245                                        LR 0.000008    Time 0.528352    
+2023-12-07 15:55:07,251 - Epoch: [60][ 2200/12168]    Overall Loss 0.013246    Objective Loss 0.000000    Distill Loss 0.013246                                        LR 0.000008    Time 0.528190    
+2023-12-07 15:55:59,685 - Epoch: [60][ 2300/12168]    Overall Loss 0.013247    Objective Loss 0.000000    Distill Loss 0.013247                                        LR 0.000008    Time 0.528021    
+2023-12-07 15:56:52,159 - Epoch: [60][ 2400/12168]    Overall Loss 0.013247    Objective Loss 0.000000    Distill Loss 0.013247                                        LR 0.000008    Time 0.527883    
+2023-12-07 15:57:44,519 - Epoch: [60][ 2500/12168]    Overall Loss 0.013247    Objective Loss 0.000000    Distill Loss 0.013247                                        LR 0.000008    Time 0.527710    
+2023-12-07 15:58:36,987 - Epoch: [60][ 2600/12168]    Overall Loss 0.013246    Objective Loss 0.000000    Distill Loss 0.013246                                        LR 0.000008    Time 0.527592    
+2023-12-07 15:59:29,398 - Epoch: [60][ 2700/12168]    Overall Loss 0.013246    Objective Loss 0.000000    Distill Loss 0.013246                                        LR 0.000008    Time 0.527462    
+2023-12-07 16:00:21,885 - Epoch: [60][ 2800/12168]    Overall Loss 0.013247    Objective Loss 0.000000    Distill Loss 0.013247                                        LR 0.000008    Time 0.527369    
+2023-12-07 16:01:14,368 - Epoch: [60][ 2900/12168]    Overall Loss 0.013249    Objective Loss 0.000000    Distill Loss 0.013249                                        LR 0.000008    Time 0.527280    
+2023-12-07 16:02:06,847 - Epoch: [60][ 3000/12168]    Overall Loss 0.013249    Objective Loss 0.000000    Distill Loss 0.013249                                        LR 0.000008    Time 0.527195    
+2023-12-07 16:02:59,278 - Epoch: [60][ 3100/12168]    Overall Loss 0.013247    Objective Loss 0.000000    Distill Loss 0.013247                                        LR 0.000008    Time 0.527102    
+2023-12-07 16:03:51,714 - Epoch: [60][ 3200/12168]    Overall Loss 0.013247    Objective Loss 0.000000    Distill Loss 0.013247                                        LR 0.000008    Time 0.527015    
+2023-12-07 16:04:44,156 - Epoch: [60][ 3300/12168]    Overall Loss 0.013248    Objective Loss 0.000000    Distill Loss 0.013248                                        LR 0.000008    Time 0.526935    
+2023-12-07 16:05:36,652 - Epoch: [60][ 3400/12168]    Overall Loss 0.013250    Objective Loss 0.000000    Distill Loss 0.013250                                        LR 0.000008    Time 0.526876    
+2023-12-07 16:06:29,021 - Epoch: [60][ 3500/12168]    Overall Loss 0.013252    Objective Loss 0.000000    Distill Loss 0.013252                                        LR 0.000008    Time 0.526784    
+2023-12-07 16:07:21,541 - Epoch: [60][ 3600/12168]    Overall Loss 0.013253    Objective Loss 0.000000    Distill Loss 0.013253                                        LR 0.000008    Time 0.526739    
+2023-12-07 16:08:13,952 - Epoch: [60][ 3700/12168]    Overall Loss 0.013254    Objective Loss 0.000000    Distill Loss 0.013254                                        LR 0.000008    Time 0.526667    
+2023-12-07 16:09:06,388 - Epoch: [60][ 3800/12168]    Overall Loss 0.013256    Objective Loss 0.000000    Distill Loss 0.013256                                        LR 0.000008    Time 0.526605    
+2023-12-07 16:09:58,836 - Epoch: [60][ 3900/12168]    Overall Loss 0.013257    Objective Loss 0.000000    Distill Loss 0.013257                                        LR 0.000008    Time 0.526550    
+2023-12-07 16:10:51,323 - Epoch: [60][ 4000/12168]    Overall Loss 0.013254    Objective Loss 0.000000    Distill Loss 0.013254                                        LR 0.000008    Time 0.526507    
+2023-12-07 16:11:43,789 - Epoch: [60][ 4100/12168]    Overall Loss 0.013256    Objective Loss 0.000000    Distill Loss 0.013256                                        LR 0.000008    Time 0.526461    
+2023-12-07 16:12:36,290 - Epoch: [60][ 4200/12168]    Overall Loss 0.013256    Objective Loss 0.000000    Distill Loss 0.013256                                        LR 0.000008    Time 0.526426    
+2023-12-07 16:13:28,692 - Epoch: [60][ 4300/12168]    Overall Loss 0.013256    Objective Loss 0.000000    Distill Loss 0.013256                                        LR 0.000008    Time 0.526369    
+2023-12-07 16:14:21,144 - Epoch: [60][ 4400/12168]    Overall Loss 0.013256    Objective Loss 0.000000    Distill Loss 0.013256                                        LR 0.000008    Time 0.526326    
+2023-12-07 16:15:13,589 - Epoch: [60][ 4500/12168]    Overall Loss 0.013258    Objective Loss 0.000000    Distill Loss 0.013258                                        LR 0.000008    Time 0.526284    
+2023-12-07 16:16:06,136 - Epoch: [60][ 4600/12168]    Overall Loss 0.013258    Objective Loss 0.000000    Distill Loss 0.013258                                        LR 0.000008    Time 0.526266    
+2023-12-07 16:16:58,583 - Epoch: [60][ 4700/12168]    Overall Loss 0.013258    Objective Loss 0.000000    Distill Loss 0.013258                                        LR 0.000008    Time 0.526227    
+2023-12-07 16:17:50,998 - Epoch: [60][ 4800/12168]    Overall Loss 0.013259    Objective Loss 0.000000    Distill Loss 0.013259                                        LR 0.000008    Time 0.526183    
+2023-12-07 16:18:43,474 - Epoch: [60][ 4900/12168]    Overall Loss 0.013258    Objective Loss 0.000000    Distill Loss 0.013258                                        LR 0.000008    Time 0.526153    
+2023-12-07 16:19:36,038 - Epoch: [60][ 5000/12168]    Overall Loss 0.013259    Objective Loss 0.000000    Distill Loss 0.013259                                        LR 0.000008    Time 0.526142    
+2023-12-07 16:20:28,525 - Epoch: [60][ 5100/12168]    Overall Loss 0.013260    Objective Loss 0.000000    Distill Loss 0.013260                                        LR 0.000008    Time 0.526117    
+2023-12-07 16:21:20,974 - Epoch: [60][ 5200/12168]    Overall Loss 0.013260    Objective Loss 0.000000    Distill Loss 0.013260                                        LR 0.000008    Time 0.526085    
+2023-12-07 16:22:13,473 - Epoch: [60][ 5300/12168]    Overall Loss 0.013260    Objective Loss 0.000000    Distill Loss 0.013260                                        LR 0.000008    Time 0.526063    
+2023-12-07 16:23:05,980 - Epoch: [60][ 5400/12168]    Overall Loss 0.013260    Objective Loss 0.000000    Distill Loss 0.013260                                        LR 0.000008    Time 0.526044    
+2023-12-07 16:23:58,505 - Epoch: [60][ 5500/12168]    Overall Loss 0.013261    Objective Loss 0.000000    Distill Loss 0.013261                                        LR 0.000008    Time 0.526029    
+2023-12-07 16:24:50,924 - Epoch: [60][ 5600/12168]    Overall Loss 0.013261    Objective Loss 0.000000    Distill Loss 0.013261                                        LR 0.000008    Time 0.525996    
+2023-12-07 16:25:43,382 - Epoch: [60][ 5700/12168]    Overall Loss 0.013263    Objective Loss 0.000000    Distill Loss 0.013263                                        LR 0.000008    Time 0.525970    
+2023-12-07 16:26:35,875 - Epoch: [60][ 5800/12168]    Overall Loss 0.013262    Objective Loss 0.000000    Distill Loss 0.013262                                        LR 0.000008    Time 0.525952    
+2023-12-07 16:27:28,340 - Epoch: [60][ 5900/12168]    Overall Loss 0.013263    Objective Loss 0.000000    Distill Loss 0.013263                                        LR 0.000008    Time 0.525929    
+2023-12-07 16:28:20,844 - Epoch: [60][ 6000/12168]    Overall Loss 0.013263    Objective Loss 0.000000    Distill Loss 0.013263                                        LR 0.000008    Time 0.525914    
+2023-12-07 16:29:13,324 - Epoch: [60][ 6100/12168]    Overall Loss 0.013263    Objective Loss 0.000000    Distill Loss 0.013263                                        LR 0.000008    Time 0.525895    
+2023-12-07 16:30:05,738 - Epoch: [60][ 6200/12168]    Overall Loss 0.013263    Objective Loss 0.000000    Distill Loss 0.013263                                        LR 0.000008    Time 0.525866    
+2023-12-07 16:30:58,140 - Epoch: [60][ 6300/12168]    Overall Loss 0.013264    Objective Loss 0.000000    Distill Loss 0.013264                                        LR 0.000008    Time 0.525836    
+2023-12-07 16:31:50,639 - Epoch: [60][ 6400/12168]    Overall Loss 0.013264    Objective Loss 0.000000    Distill Loss 0.013264                                        LR 0.000008    Time 0.525822    
+2023-12-07 16:32:43,013 - Epoch: [60][ 6500/12168]    Overall Loss 0.013264    Objective Loss 0.000000    Distill Loss 0.013264                                        LR 0.000008    Time 0.525790    
+2023-12-07 16:33:35,453 - Epoch: [60][ 6600/12168]    Overall Loss 0.013265    Objective Loss 0.000000    Distill Loss 0.013265                                        LR 0.000008    Time 0.525768    
+2023-12-07 16:34:27,890 - Epoch: [60][ 6700/12168]    Overall Loss 0.013265    Objective Loss 0.000000    Distill Loss 0.013265                                        LR 0.000008    Time 0.525747    
+2023-12-07 16:35:20,307 - Epoch: [60][ 6800/12168]    Overall Loss 0.013266    Objective Loss 0.000000    Distill Loss 0.013266                                        LR 0.000008    Time 0.525723    
+2023-12-07 16:36:12,789 - Epoch: [60][ 6900/12168]    Overall Loss 0.013266    Objective Loss 0.000000    Distill Loss 0.013266                                        LR 0.000008    Time 0.525710    
+2023-12-07 16:37:05,270 - Epoch: [60][ 7000/12168]    Overall Loss 0.013266    Objective Loss 0.000000    Distill Loss 0.013266                                        LR 0.000008    Time 0.525696    
+2023-12-07 16:37:57,718 - Epoch: [60][ 7100/12168]    Overall Loss 0.013266    Objective Loss 0.000000    Distill Loss 0.013266                                        LR 0.000008    Time 0.525679    
+2023-12-07 16:38:50,168 - Epoch: [60][ 7200/12168]    Overall Loss 0.013267    Objective Loss 0.000000    Distill Loss 0.013267                                        LR 0.000008    Time 0.525662    
+2023-12-07 16:39:42,618 - Epoch: [60][ 7300/12168]    Overall Loss 0.013267    Objective Loss 0.000000    Distill Loss 0.013267                                        LR 0.000008    Time 0.525646    
+2023-12-07 16:40:35,061 - Epoch: [60][ 7400/12168]    Overall Loss 0.013267    Objective Loss 0.000000    Distill Loss 0.013267                                        LR 0.000008    Time 0.525629    
+2023-12-07 16:41:27,497 - Epoch: [60][ 7500/12168]    Overall Loss 0.013266    Objective Loss 0.000000    Distill Loss 0.013266                                        LR 0.000008    Time 0.525611    
+2023-12-07 16:42:19,966 - Epoch: [60][ 7600/12168]    Overall Loss 0.013267    Objective Loss 0.000000    Distill Loss 0.013267                                        LR 0.000008    Time 0.525599    
+2023-12-07 16:43:12,482 - Epoch: [60][ 7700/12168]    Overall Loss 0.013268    Objective Loss 0.000000    Distill Loss 0.013268                                        LR 0.000008    Time 0.525592    
+2023-12-07 16:44:04,965 - Epoch: [60][ 7800/12168]    Overall Loss 0.013269    Objective Loss 0.000000    Distill Loss 0.013269                                        LR 0.000008    Time 0.525582    
+2023-12-07 16:44:57,439 - Epoch: [60][ 7900/12168]    Overall Loss 0.013269    Objective Loss 0.000000    Distill Loss 0.013269                                        LR 0.000008    Time 0.525571    
+2023-12-07 16:45:49,848 - Epoch: [60][ 8000/12168]    Overall Loss 0.013269    Objective Loss 0.000000    Distill Loss 0.013269                                        LR 0.000008    Time 0.525552    
+2023-12-07 16:46:42,380 - Epoch: [60][ 8100/12168]    Overall Loss 0.013268    Objective Loss 0.000000    Distill Loss 0.013268                                        LR 0.000008    Time 0.525549    
+2023-12-07 16:47:34,946 - Epoch: [60][ 8200/12168]    Overall Loss 0.013269    Objective Loss 0.000000    Distill Loss 0.013269                                        LR 0.000008    Time 0.525550    
+2023-12-07 16:48:27,508 - Epoch: [60][ 8300/12168]    Overall Loss 0.013270    Objective Loss 0.000000    Distill Loss 0.013270                                        LR 0.000008    Time 0.525550    
+2023-12-07 16:49:19,993 - Epoch: [60][ 8400/12168]    Overall Loss 0.013270    Objective Loss 0.000000    Distill Loss 0.013270                                        LR 0.000008    Time 0.525542    
+2023-12-07 16:50:12,468 - Epoch: [60][ 8500/12168]    Overall Loss 0.013271    Objective Loss 0.000000    Distill Loss 0.013271                                        LR 0.000008    Time 0.525532    
+2023-12-07 16:51:04,968 - Epoch: [60][ 8600/12168]    Overall Loss 0.013271    Objective Loss 0.000000    Distill Loss 0.013271                                        LR 0.000008    Time 0.525525    
+2023-12-07 16:51:57,493 - Epoch: [60][ 8700/12168]    Overall Loss 0.013271    Objective Loss 0.000000    Distill Loss 0.013271                                        LR 0.000008    Time 0.525522    
+2023-12-07 16:52:50,006 - Epoch: [60][ 8800/12168]    Overall Loss 0.013271    Objective Loss 0.000000    Distill Loss 0.013271                                        LR 0.000008    Time 0.525517    
+2023-12-07 16:53:42,492 - Epoch: [60][ 8900/12168]    Overall Loss 0.013271    Objective Loss 0.000000    Distill Loss 0.013271                                        LR 0.000008    Time 0.525509    
+2023-12-07 16:54:34,905 - Epoch: [60][ 9000/12168]    Overall Loss 0.013271    Objective Loss 0.000000    Distill Loss 0.013271                                        LR 0.000008    Time 0.525493    
+2023-12-07 16:55:27,355 - Epoch: [60][ 9100/12168]    Overall Loss 0.013272    Objective Loss 0.000000    Distill Loss 0.013272                                        LR 0.000008    Time 0.525482    
+2023-12-07 16:56:19,829 - Epoch: [60][ 9200/12168]    Overall Loss 0.013272    Objective Loss 0.000000    Distill Loss 0.013272                                        LR 0.000008    Time 0.525474    
+2023-12-07 16:57:12,321 - Epoch: [60][ 9300/12168]    Overall Loss 0.013272    Objective Loss 0.000000    Distill Loss 0.013272                                        LR 0.000008    Time 0.525467    
+2023-12-07 16:58:04,780 - Epoch: [60][ 9400/12168]    Overall Loss 0.013273    Objective Loss 0.000000    Distill Loss 0.013273                                        LR 0.000008    Time 0.525458    
+2023-12-07 16:58:57,253 - Epoch: [60][ 9500/12168]    Overall Loss 0.013273    Objective Loss 0.000000    Distill Loss 0.013273                                        LR 0.000008    Time 0.525450    
+2023-12-07 16:59:49,696 - Epoch: [60][ 9600/12168]    Overall Loss 0.013273    Objective Loss 0.000000    Distill Loss 0.013273                                        LR 0.000008    Time 0.525439    
+2023-12-07 17:00:42,110 - Epoch: [60][ 9700/12168]    Overall Loss 0.013275    Objective Loss 0.000000    Distill Loss 0.013275                                        LR 0.000008    Time 0.525425    
+2023-12-07 17:01:34,485 - Epoch: [60][ 9800/12168]    Overall Loss 0.013275    Objective Loss 0.000000    Distill Loss 0.013275                                        LR 0.000008    Time 0.525407    
+2023-12-07 17:02:27,133 - Epoch: [60][ 9900/12168]    Overall Loss 0.013275    Objective Loss 0.000000    Distill Loss 0.013275                                        LR 0.000008    Time 0.525418    
+2023-12-07 17:03:19,695 - Epoch: [60][10000/12168]    Overall Loss 0.013275    Objective Loss 0.000000    Distill Loss 0.013275                                        LR 0.000008    Time 0.525420    
+2023-12-07 17:04:12,207 - Epoch: [60][10100/12168]    Overall Loss 0.013276    Objective Loss 0.000000    Distill Loss 0.013276                                        LR 0.000008    Time 0.525416    
+2023-12-07 17:05:04,738 - Epoch: [60][10200/12168]    Overall Loss 0.013276    Objective Loss 0.000000    Distill Loss 0.013276                                        LR 0.000008    Time 0.525415    
+2023-12-07 17:05:57,152 - Epoch: [60][10300/12168]    Overall Loss 0.013276    Objective Loss 0.000000    Distill Loss 0.013276                                        LR 0.000008    Time 0.525402    
+2023-12-07 17:06:49,589 - Epoch: [60][10400/12168]    Overall Loss 0.013276    Objective Loss 0.000000    Distill Loss 0.013276                                        LR 0.000008    Time 0.525392    
+2023-12-07 17:07:42,040 - Epoch: [60][10500/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.000008    Time 0.525383    
+2023-12-07 17:08:34,547 - Epoch: [60][10600/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.000008    Time 0.525380    
+2023-12-07 17:09:27,027 - Epoch: [60][10700/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.000008    Time 0.525374    
+2023-12-07 17:10:19,546 - Epoch: [60][10800/12168]    Overall Loss 0.013278    Objective Loss 0.000000    Distill Loss 0.013278                                        LR 0.000008    Time 0.525372    
+2023-12-07 17:11:11,973 - Epoch: [60][10900/12168]    Overall Loss 0.013279    Objective Loss 0.000000    Distill Loss 0.013279                                        LR 0.000008    Time 0.525362    
+2023-12-07 17:12:04,406 - Epoch: [60][11000/12168]    Overall Loss 0.013279    Objective Loss 0.000000    Distill Loss 0.013279                                        LR 0.000008    Time 0.525352    
+2023-12-07 17:12:56,907 - Epoch: [60][11100/12168]    Overall Loss 0.013280    Objective Loss 0.000000    Distill Loss 0.013280                                        LR 0.000008    Time 0.525349    
+2023-12-07 17:13:49,361 - Epoch: [60][11200/12168]    Overall Loss 0.013281    Objective Loss 0.000000    Distill Loss 0.013281                                        LR 0.000008    Time 0.525341    
+2023-12-07 17:14:41,862 - Epoch: [60][11300/12168]    Overall Loss 0.013281    Objective Loss 0.000000    Distill Loss 0.013281                                        LR 0.000008    Time 0.525338    
+2023-12-07 17:15:34,311 - Epoch: [60][11400/12168]    Overall Loss 0.013282    Objective Loss 0.000000    Distill Loss 0.013282                                        LR 0.000008    Time 0.525330    
+2023-12-07 17:16:26,761 - Epoch: [60][11500/12168]    Overall Loss 0.013281    Objective Loss 0.000000    Distill Loss 0.013281                                        LR 0.000008    Time 0.525323    
+2023-12-07 17:17:19,228 - Epoch: [60][11600/12168]    Overall Loss 0.013282    Objective Loss 0.000000    Distill Loss 0.013282                                        LR 0.000008    Time 0.525317    
+2023-12-07 17:18:11,763 - Epoch: [60][11700/12168]    Overall Loss 0.013283    Objective Loss 0.000000    Distill Loss 0.013283                                        LR 0.000008    Time 0.525317    
+2023-12-07 17:19:04,256 - Epoch: [60][11800/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.525313    
+2023-12-07 17:19:56,759 - Epoch: [60][11900/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.525311    
+2023-12-07 17:20:49,326 - Epoch: [60][12000/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.525313    
+2023-12-07 17:21:41,853 - Epoch: [60][12100/12168]    Overall Loss 0.013285    Objective Loss 0.000000    Distill Loss 0.013285                                        LR 0.000008    Time 0.525313    
+2023-12-07 17:22:17,455 - Epoch: [60][12168/12168]    Overall Loss 0.013285    Objective Loss 0.000000    Distill Loss 0.013285                                        LR 0.000008    Time 0.525303    
+2023-12-07 17:22:17,841 - --- validate (epoch=60)-----------
+2023-12-07 17:22:17,841 - 167951 samples (256 per mini-batch)
+2023-12-07 17:23:08,654 - Epoch: [60][  100/  657]    Loss 0.000000    Overall Loss 0.014010    
+2023-12-07 17:23:57,239 - Epoch: [60][  200/  657]    Loss 0.000000    Overall Loss 0.014012    
+2023-12-07 17:24:45,823 - Epoch: [60][  300/  657]    Loss 0.000000    Overall Loss 0.014020    
+2023-12-07 17:25:34,393 - Epoch: [60][  400/  657]    Loss 0.000000    Overall Loss 0.014006    
+2023-12-07 17:26:22,993 - Epoch: [60][  500/  657]    Loss 0.000000    Overall Loss 0.014007    
+2023-12-07 17:27:11,552 - Epoch: [60][  600/  657]    Loss 0.000000    Overall Loss 0.014002    
+2023-12-07 17:27:38,799 - Epoch: [60][  657/  657]    Loss 0.000000    Overall Loss 0.014005    
+2023-12-07 17:27:38,997 - ==> Overall Loss: 0.014
+
+2023-12-07 17:27:38,999 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 17:27:38,999 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 17:27:39,020 - 
+
+2023-12-07 17:27:39,020 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 17:28:40,848 - Epoch: [61][  100/12168]    Overall Loss 0.013280    Objective Loss 0.000000    Distill Loss 0.013280                                        LR 0.000008    Time 0.618236    
+2023-12-07 17:29:33,224 - Epoch: [61][  200/12168]    Overall Loss 0.013250    Objective Loss 0.000000    Distill Loss 0.013250                                        LR 0.000008    Time 0.570984    
+2023-12-07 17:30:25,669 - Epoch: [61][  300/12168]    Overall Loss 0.013290    Objective Loss 0.000000    Distill Loss 0.013290                                        LR 0.000008    Time 0.555462    
+2023-12-07 17:31:18,150 - Epoch: [61][  400/12168]    Overall Loss 0.013293    Objective Loss 0.000000    Distill Loss 0.013293                                        LR 0.000008    Time 0.547788    
+2023-12-07 17:32:10,567 - Epoch: [61][  500/12168]    Overall Loss 0.013285    Objective Loss 0.000000    Distill Loss 0.013285                                        LR 0.000008    Time 0.543058    
+2023-12-07 17:33:03,025 - Epoch: [61][  600/12168]    Overall Loss 0.013278    Objective Loss 0.000000    Distill Loss 0.013278                                        LR 0.000008    Time 0.539974    
+2023-12-07 17:33:55,428 - Epoch: [61][  700/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.537691    
+2023-12-07 17:34:47,831 - Epoch: [61][  800/12168]    Overall Loss 0.013286    Objective Loss 0.000000    Distill Loss 0.013286                                        LR 0.000008    Time 0.535979    
+2023-12-07 17:35:40,276 - Epoch: [61][  900/12168]    Overall Loss 0.013293    Objective Loss 0.000000    Distill Loss 0.013293                                        LR 0.000008    Time 0.534694    
+2023-12-07 17:36:32,733 - Epoch: [61][ 1000/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.533678    
+2023-12-07 17:37:25,140 - Epoch: [61][ 1100/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.532802    
+2023-12-07 17:38:17,572 - Epoch: [61][ 1200/12168]    Overall Loss 0.013304    Objective Loss 0.000000    Distill Loss 0.013304                                        LR 0.000008    Time 0.532092    
+2023-12-07 17:39:09,966 - Epoch: [61][ 1300/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.531462    
+2023-12-07 17:40:02,389 - Epoch: [61][ 1400/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.530943    
+2023-12-07 17:40:54,854 - Epoch: [61][ 1500/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.530522    
+2023-12-07 17:41:47,343 - Epoch: [61][ 1600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.530168    
+2023-12-07 17:42:39,937 - Epoch: [61][ 1700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529917    
+2023-12-07 17:43:32,420 - Epoch: [61][ 1800/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.529632    
+2023-12-07 17:44:24,933 - Epoch: [61][ 1900/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.529394    
+2023-12-07 17:45:17,443 - Epoch: [61][ 2000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.529177    
+2023-12-07 17:46:09,922 - Epoch: [61][ 2100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.528966    
+2023-12-07 17:47:02,418 - Epoch: [61][ 2200/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.528783    
+2023-12-07 17:47:54,857 - Epoch: [61][ 2300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.528590    
+2023-12-07 17:48:47,292 - Epoch: [61][ 2400/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.528412    
+2023-12-07 17:49:39,756 - Epoch: [61][ 2500/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.528260    
+2023-12-07 17:50:32,205 - Epoch: [61][ 2600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.528114    
+2023-12-07 17:51:24,661 - Epoch: [61][ 2700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527981    
+2023-12-07 17:52:17,117 - Epoch: [61][ 2800/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.527858    
+2023-12-07 17:53:09,581 - Epoch: [61][ 2900/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.527745    
+2023-12-07 17:54:02,039 - Epoch: [61][ 3000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.527639    
+2023-12-07 17:54:54,520 - Epoch: [61][ 3100/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527546    
+2023-12-07 17:55:46,925 - Epoch: [61][ 3200/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.527436    
+2023-12-07 17:56:39,279 - Epoch: [61][ 3300/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.527317    
+2023-12-07 17:57:31,676 - Epoch: [61][ 3400/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.527217    
+2023-12-07 17:58:24,069 - Epoch: [61][ 3500/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.527123    
+2023-12-07 17:59:16,591 - Epoch: [61][ 3600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527069    
+2023-12-07 18:00:09,041 - Epoch: [61][ 3700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.526998    
+2023-12-07 18:01:01,469 - Epoch: [61][ 3800/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.526926    
+2023-12-07 18:01:53,928 - Epoch: [61][ 3900/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526865    
+2023-12-07 18:02:46,368 - Epoch: [61][ 4000/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526803    
+2023-12-07 18:03:38,814 - Epoch: [61][ 4100/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526745    
+2023-12-07 18:04:31,287 - Epoch: [61][ 4200/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526696    
+2023-12-07 18:05:23,710 - Epoch: [61][ 4300/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526638    
+2023-12-07 18:06:16,296 - Epoch: [61][ 4400/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526619    
+2023-12-07 18:07:08,778 - Epoch: [61][ 4500/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526579    
+2023-12-07 18:08:01,234 - Epoch: [61][ 4600/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526534    
+2023-12-07 18:08:53,786 - Epoch: [61][ 4700/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526512    
+2023-12-07 18:09:46,227 - Epoch: [61][ 4800/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526467    
+2023-12-07 18:10:38,666 - Epoch: [61][ 4900/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526424    
+2023-12-07 18:11:31,156 - Epoch: [61][ 5000/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.526393    
+2023-12-07 18:12:23,633 - Epoch: [61][ 5100/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526360    
+2023-12-07 18:13:16,081 - Epoch: [61][ 5200/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526323    
+2023-12-07 18:14:08,562 - Epoch: [61][ 5300/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526294    
+2023-12-07 18:15:01,136 - Epoch: [61][ 5400/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526283    
+2023-12-07 18:15:53,560 - Epoch: [61][ 5500/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526246    
+2023-12-07 18:16:46,007 - Epoch: [61][ 5600/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526213    
+2023-12-07 18:17:38,494 - Epoch: [61][ 5700/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526189    
+2023-12-07 18:18:30,985 - Epoch: [61][ 5800/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526167    
+2023-12-07 18:19:23,435 - Epoch: [61][ 5900/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526138    
+2023-12-07 18:20:15,884 - Epoch: [61][ 6000/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526110    
+2023-12-07 18:21:08,418 - Epoch: [61][ 6100/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526096    
+2023-12-07 18:22:00,844 - Epoch: [61][ 6200/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526066    
+2023-12-07 18:22:53,296 - Epoch: [61][ 6300/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526041    
+2023-12-07 18:23:45,830 - Epoch: [61][ 6400/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526030    
+2023-12-07 18:24:38,263 - Epoch: [61][ 6500/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526003    
+2023-12-07 18:25:30,721 - Epoch: [61][ 6600/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525981    
+2023-12-07 18:26:23,192 - Epoch: [61][ 6700/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525962    
+2023-12-07 18:27:15,691 - Epoch: [61][ 6800/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525947    
+2023-12-07 18:28:08,129 - Epoch: [61][ 6900/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.525924    
+2023-12-07 18:29:00,609 - Epoch: [61][ 7000/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.525907    
+2023-12-07 18:29:53,129 - Epoch: [61][ 7100/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.525897    
+2023-12-07 18:30:45,598 - Epoch: [61][ 7200/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525879    
+2023-12-07 18:31:38,086 - Epoch: [61][ 7300/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525865    
+2023-12-07 18:32:30,571 - Epoch: [61][ 7400/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525851    
+2023-12-07 18:33:23,094 - Epoch: [61][ 7500/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525842    
+2023-12-07 18:34:15,594 - Epoch: [61][ 7600/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525831    
+2023-12-07 18:35:08,151 - Epoch: [61][ 7700/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525827    
+2023-12-07 18:36:00,621 - Epoch: [61][ 7800/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525812    
+2023-12-07 18:36:53,065 - Epoch: [61][ 7900/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525794    
+2023-12-07 18:37:45,583 - Epoch: [61][ 8000/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525786    
+2023-12-07 18:38:38,076 - Epoch: [61][ 8100/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525775    
+2023-12-07 18:39:30,591 - Epoch: [61][ 8200/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525767    
+2023-12-07 18:40:23,018 - Epoch: [61][ 8300/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525749    
+2023-12-07 18:41:15,548 - Epoch: [61][ 8400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525743    
+2023-12-07 18:42:08,021 - Epoch: [61][ 8500/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525731    
+2023-12-07 18:43:00,555 - Epoch: [61][ 8600/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525726    
+2023-12-07 18:43:53,045 - Epoch: [61][ 8700/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525716    
+2023-12-07 18:44:45,504 - Epoch: [61][ 8800/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525703    
+2023-12-07 18:45:37,980 - Epoch: [61][ 8900/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525692    
+2023-12-07 18:46:30,479 - Epoch: [61][ 9000/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525684    
+2023-12-07 18:47:22,936 - Epoch: [61][ 9100/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525671    
+2023-12-07 18:48:15,373 - Epoch: [61][ 9200/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525656    
+2023-12-07 18:49:07,855 - Epoch: [61][ 9300/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525647    
+2023-12-07 18:50:00,299 - Epoch: [61][ 9400/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525634    
+2023-12-07 18:50:52,771 - Epoch: [61][ 9500/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525624    
+2023-12-07 18:51:45,232 - Epoch: [61][ 9600/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525613    
+2023-12-07 18:52:37,758 - Epoch: [61][ 9700/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525609    
+2023-12-07 18:53:30,234 - Epoch: [61][ 9800/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525600    
+2023-12-07 18:54:22,726 - Epoch: [61][ 9900/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525593    
+2023-12-07 18:55:15,152 - Epoch: [61][10000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525579    
+2023-12-07 18:56:07,636 - Epoch: [61][10100/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525572    
+2023-12-07 18:57:00,172 - Epoch: [61][10200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525569    
+2023-12-07 18:57:52,623 - Epoch: [61][10300/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525559    
+2023-12-07 18:58:45,069 - Epoch: [61][10400/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525548    
+2023-12-07 18:59:37,480 - Epoch: [61][10500/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525534    
+2023-12-07 19:00:29,941 - Epoch: [61][10600/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525525    
+2023-12-07 19:01:22,392 - Epoch: [61][10700/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525515    
+2023-12-07 19:02:14,912 - Epoch: [61][10800/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525512    
+2023-12-07 19:03:07,371 - Epoch: [61][10900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525503    
+2023-12-07 19:03:59,850 - Epoch: [61][11000/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525496    
+2023-12-07 19:04:52,276 - Epoch: [61][11100/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525485    
+2023-12-07 19:05:44,776 - Epoch: [61][11200/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525480    
+2023-12-07 19:06:37,201 - Epoch: [61][11300/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525469    
+2023-12-07 19:07:29,662 - Epoch: [61][11400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525461    
+2023-12-07 19:08:22,139 - Epoch: [61][11500/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525455    
+2023-12-07 19:09:14,743 - Epoch: [61][11600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525459    
+2023-12-07 19:10:07,201 - Epoch: [61][11700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525452    
+2023-12-07 19:10:59,748 - Epoch: [61][11800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525452    
+2023-12-07 19:11:52,215 - Epoch: [61][11900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525445    
+2023-12-07 19:12:44,761 - Epoch: [61][12000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525444    
+2023-12-07 19:13:37,288 - Epoch: [61][12100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525443    
+2023-12-07 19:14:12,946 - Epoch: [61][12168/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525436    
+2023-12-07 19:14:13,359 - --- validate (epoch=61)-----------
+2023-12-07 19:14:13,359 - 167951 samples (256 per mini-batch)
+2023-12-07 19:15:04,236 - Epoch: [61][  100/  657]    Loss 0.000000    Overall Loss 0.014010    
+2023-12-07 19:15:52,853 - Epoch: [61][  200/  657]    Loss 0.000000    Overall Loss 0.014007    
+2023-12-07 19:16:41,475 - Epoch: [61][  300/  657]    Loss 0.000000    Overall Loss 0.014021    
+2023-12-07 19:17:30,097 - Epoch: [61][  400/  657]    Loss 0.000000    Overall Loss 0.014022    
+2023-12-07 19:18:18,730 - Epoch: [61][  500/  657]    Loss 0.000000    Overall Loss 0.014015    
+2023-12-07 19:19:07,350 - Epoch: [61][  600/  657]    Loss 0.000000    Overall Loss 0.014009    
+2023-12-07 19:19:34,601 - Epoch: [61][  657/  657]    Loss 0.000000    Overall Loss 0.014010    
+2023-12-07 19:19:34,806 - ==> Overall Loss: 0.014
+
+2023-12-07 19:19:34,808 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 19:19:34,808 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 19:19:34,829 - 
+
+2023-12-07 19:19:34,829 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 19:20:36,665 - Epoch: [62][  100/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.618314    
+2023-12-07 19:21:29,117 - Epoch: [62][  200/12168]    Overall Loss 0.013297    Objective Loss 0.000000    Distill Loss 0.013297                                        LR 0.000008    Time 0.571404    
+2023-12-07 19:22:21,587 - Epoch: [62][  300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.555824    
+2023-12-07 19:23:14,073 - Epoch: [62][  400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.548076    
+2023-12-07 19:24:06,523 - Epoch: [62][  500/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.543354    
+2023-12-07 19:24:59,020 - Epoch: [62][  600/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.540283    
+2023-12-07 19:25:51,426 - Epoch: [62][  700/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.537961    
+2023-12-07 19:26:43,901 - Epoch: [62][  800/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.536305    
+2023-12-07 19:27:36,368 - Epoch: [62][  900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.535009    
+2023-12-07 19:28:28,826 - Epoch: [62][ 1000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.533963    
+2023-12-07 19:29:21,305 - Epoch: [62][ 1100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.533126    
+2023-12-07 19:30:13,753 - Epoch: [62][ 1200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.532403    
+2023-12-07 19:31:06,197 - Epoch: [62][ 1300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.531788    
+2023-12-07 19:31:58,714 - Epoch: [62][ 1400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.531312    
+2023-12-07 19:32:51,173 - Epoch: [62][ 1500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.530862    
+2023-12-07 19:33:43,653 - Epoch: [62][ 1600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.530481    
+2023-12-07 19:34:36,063 - Epoch: [62][ 1700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.530104    
+2023-12-07 19:35:28,512 - Epoch: [62][ 1800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.529790    
+2023-12-07 19:36:20,992 - Epoch: [62][ 1900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.529526    
+2023-12-07 19:37:13,478 - Epoch: [62][ 2000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.529291    
+2023-12-07 19:38:05,896 - Epoch: [62][ 2100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.529046    
+2023-12-07 19:38:58,400 - Epoch: [62][ 2200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.528862    
+2023-12-07 19:39:50,799 - Epoch: [62][ 2300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.528649    
+2023-12-07 19:40:43,252 - Epoch: [62][ 2400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.528476    
+2023-12-07 19:41:35,705 - Epoch: [62][ 2500/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.528317    
+2023-12-07 19:42:28,206 - Epoch: [62][ 2600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.528188    
+2023-12-07 19:43:20,737 - Epoch: [62][ 2700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.528080    
+2023-12-07 19:44:13,218 - Epoch: [62][ 2800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.527962    
+2023-12-07 19:45:05,658 - Epoch: [62][ 2900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.527838    
+2023-12-07 19:45:58,145 - Epoch: [62][ 3000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527738    
+2023-12-07 19:46:50,596 - Epoch: [62][ 3100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527633    
+2023-12-07 19:47:43,051 - Epoch: [62][ 3200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527536    
+2023-12-07 19:48:35,497 - Epoch: [62][ 3300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527442    
+2023-12-07 19:49:27,969 - Epoch: [62][ 3400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527360    
+2023-12-07 19:50:20,443 - Epoch: [62][ 3500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527285    
+2023-12-07 19:51:12,908 - Epoch: [62][ 3600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527211    
+2023-12-07 19:52:05,609 - Epoch: [62][ 3700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527204    
+2023-12-07 19:52:58,201 - Epoch: [62][ 3800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527169    
+2023-12-07 19:53:50,821 - Epoch: [62][ 3900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527143    
+2023-12-07 19:54:43,420 - Epoch: [62][ 4000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527114    
+2023-12-07 19:55:36,102 - Epoch: [62][ 4100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527106    
+2023-12-07 19:56:42,561 - Epoch: [62][ 4200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.530378    
+2023-12-07 19:57:36,004 - Epoch: [62][ 4300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.530472    
+2023-12-07 19:58:55,810 - Epoch: [62][ 4400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.536552    
+2023-12-07 20:00:28,963 - Epoch: [62][ 4500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.545328    
+2023-12-07 20:01:21,443 - Epoch: [62][ 4600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.544881    
+2023-12-07 20:02:14,055 - Epoch: [62][ 4700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.544482    
+2023-12-07 20:03:06,617 - Epoch: [62][ 4800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.544088    
+2023-12-07 20:03:59,863 - Epoch: [62][ 4900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.543850    
+2023-12-07 20:05:18,703 - Epoch: [62][ 5000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.548740    
+2023-12-07 20:06:11,106 - Epoch: [62][ 5100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.548255    
+2023-12-07 20:07:03,623 - Epoch: [62][ 5200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.547810    
+2023-12-07 20:08:00,230 - Epoch: [62][ 5300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.548154    
+2023-12-07 20:08:59,844 - Epoch: [62][ 5400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.549042    
+2023-12-07 20:09:59,450 - Epoch: [62][ 5500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.549897    
+2023-12-07 20:10:53,252 - Epoch: [62][ 5600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.549684    
+2023-12-07 20:11:45,798 - Epoch: [62][ 5700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.549258    
+2023-12-07 20:12:38,274 - Epoch: [62][ 5800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.548835    
+2023-12-07 20:13:30,709 - Epoch: [62][ 5900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.548420    
+2023-12-07 20:14:23,169 - Epoch: [62][ 6000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.548022    
+2023-12-07 20:15:15,608 - Epoch: [62][ 6100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.547634    
+2023-12-07 20:16:08,085 - Epoch: [62][ 6200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.547265    
+2023-12-07 20:17:00,521 - Epoch: [62][ 6300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.546901    
+2023-12-07 20:17:52,959 - Epoch: [62][ 6400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.546549    
+2023-12-07 20:18:45,515 - Epoch: [62][ 6500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.546225    
+2023-12-07 20:19:38,041 - Epoch: [62][ 6600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.545907    
+2023-12-07 20:20:30,580 - Epoch: [62][ 6700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.545600    
+2023-12-07 20:21:23,144 - Epoch: [62][ 6800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.545306    
+2023-12-07 20:22:15,576 - Epoch: [62][ 6900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.545002    
+2023-12-07 20:23:08,065 - Epoch: [62][ 7000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.544714    
+2023-12-07 20:24:00,502 - Epoch: [62][ 7100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.544427    
+2023-12-07 20:24:53,081 - Epoch: [62][ 7200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.544167    
+2023-12-07 20:25:45,533 - Epoch: [62][ 7300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.543898    
+2023-12-07 20:26:38,016 - Epoch: [62][ 7400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.543640    
+2023-12-07 20:27:30,536 - Epoch: [62][ 7500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.543393    
+2023-12-07 20:28:22,983 - Epoch: [62][ 7600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.543144    
+2023-12-07 20:29:15,471 - Epoch: [62][ 7700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.542906    
+2023-12-07 20:30:08,006 - Epoch: [62][ 7800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.542681    
+2023-12-07 20:31:00,437 - Epoch: [62][ 7900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.542448    
+2023-12-07 20:31:52,934 - Epoch: [62][ 8000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.542229    
+2023-12-07 20:32:45,458 - Epoch: [62][ 8100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.542019    
+2023-12-07 20:33:37,967 - Epoch: [62][ 8200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.541812    
+2023-12-07 20:34:30,401 - Epoch: [62][ 8300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.541601    
+2023-12-07 20:35:22,899 - Epoch: [62][ 8400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.541403    
+2023-12-07 20:36:15,476 - Epoch: [62][ 8500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.541218    
+2023-12-07 20:37:07,987 - Epoch: [62][ 8600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.541031    
+2023-12-07 20:38:00,545 - Epoch: [62][ 8700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.540853    
+2023-12-07 20:38:53,016 - Epoch: [62][ 8800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.540669    
+2023-12-07 20:39:45,582 - Epoch: [62][ 8900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.540500    
+2023-12-07 20:40:38,084 - Epoch: [62][ 9000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.540328    
+2023-12-07 20:41:30,516 - Epoch: [62][ 9100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.540151    
+2023-12-07 20:42:22,994 - Epoch: [62][ 9200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.539983    
+2023-12-07 20:43:15,450 - Epoch: [62][ 9300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.539817    
+2023-12-07 20:44:07,918 - Epoch: [62][ 9400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.539655    
+2023-12-07 20:45:00,439 - Epoch: [62][ 9500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.539503    
+2023-12-07 20:45:52,912 - Epoch: [62][ 9600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.539348    
+2023-12-07 20:46:45,305 - Epoch: [62][ 9700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.539189    
+2023-12-07 20:47:37,824 - Epoch: [62][ 9800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.539046    
+2023-12-07 20:48:30,721 - Epoch: [62][ 9900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.538944    
+2023-12-07 20:49:23,203 - Epoch: [62][10000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.538802    
+2023-12-07 20:50:15,661 - Epoch: [62][10100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.538661    
+2023-12-07 20:51:08,121 - Epoch: [62][10200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.538523    
+2023-12-07 20:52:00,614 - Epoch: [62][10300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.538391    
+2023-12-07 20:52:53,128 - Epoch: [62][10400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.538263    
+2023-12-07 20:53:45,535 - Epoch: [62][10500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.538127    
+2023-12-07 20:54:38,063 - Epoch: [62][10600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.538006    
+2023-12-07 20:55:30,470 - Epoch: [62][10700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.537875    
+2023-12-07 20:56:23,019 - Epoch: [62][10800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.537760    
+2023-12-07 20:57:15,455 - Epoch: [62][10900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.537637    
+2023-12-07 20:58:07,983 - Epoch: [62][11000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.537525    
+2023-12-07 20:59:00,392 - Epoch: [62][11100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.537403    
+2023-12-07 20:59:52,872 - Epoch: [62][11200/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.537290    
+2023-12-07 21:00:45,392 - Epoch: [62][11300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.537183    
+2023-12-07 21:01:37,900 - Epoch: [62][11400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.537077    
+2023-12-07 21:02:30,444 - Epoch: [62][11500/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.536975    
+2023-12-07 21:03:22,878 - Epoch: [62][11600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.536866    
+2023-12-07 21:04:15,456 - Epoch: [62][11700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.536771    
+2023-12-07 21:05:07,873 - Epoch: [62][11800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.536664    
+2023-12-07 21:06:00,265 - Epoch: [62][11900/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.536556    
+2023-12-07 21:06:52,704 - Epoch: [62][12000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.536455    
+2023-12-07 21:07:45,229 - Epoch: [62][12100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.536362    
+2023-12-07 21:08:20,892 - Epoch: [62][12168/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.536295    
+2023-12-07 21:08:21,278 - --- validate (epoch=62)-----------
+2023-12-07 21:08:21,279 - 167951 samples (256 per mini-batch)
+2023-12-07 21:09:12,182 - Epoch: [62][  100/  657]    Loss 0.000000    Overall Loss 0.013972    
+2023-12-07 21:10:00,831 - Epoch: [62][  200/  657]    Loss 0.000000    Overall Loss 0.013955    
+2023-12-07 21:10:49,466 - Epoch: [62][  300/  657]    Loss 0.000000    Overall Loss 0.013956    
+2023-12-07 21:11:38,096 - Epoch: [62][  400/  657]    Loss 0.000000    Overall Loss 0.013953    
+2023-12-07 21:12:26,734 - Epoch: [62][  500/  657]    Loss 0.000000    Overall Loss 0.013964    
+2023-12-07 21:13:15,348 - Epoch: [62][  600/  657]    Loss 0.000000    Overall Loss 0.013960    
+2023-12-07 21:13:42,607 - Epoch: [62][  657/  657]    Loss 0.000000    Overall Loss 0.013962    
+2023-12-07 21:13:42,807 - ==> Overall Loss: 0.014
+
+2023-12-07 21:13:42,810 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 21:13:42,810 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 21:13:42,831 - 
+
+2023-12-07 21:13:42,831 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 21:14:43,291 - Epoch: [63][  100/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.604560    
+2023-12-07 21:15:35,731 - Epoch: [63][  200/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.564462    
+2023-12-07 21:16:28,199 - Epoch: [63][  300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.551191    
+2023-12-07 21:17:20,693 - Epoch: [63][  400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.544619    
+2023-12-07 21:18:13,140 - Epoch: [63][  500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.540583    
+2023-12-07 21:19:05,613 - Epoch: [63][  600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.537934    
+2023-12-07 21:19:58,113 - Epoch: [63][  700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.536081    
+2023-12-07 21:20:50,585 - Epoch: [63][  800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.534658    
+2023-12-07 21:21:42,953 - Epoch: [63][  900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.533434    
+2023-12-07 21:22:35,358 - Epoch: [63][ 1000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.532493    
+2023-12-07 21:23:27,833 - Epoch: [63][ 1100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.531786    
+2023-12-07 21:24:20,296 - Epoch: [63][ 1200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.531186    
+2023-12-07 21:25:12,778 - Epoch: [63][ 1300/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.530694    
+2023-12-07 21:26:05,187 - Epoch: [63][ 1400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.530220    
+2023-12-07 21:26:57,653 - Epoch: [63][ 1500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.529847    
+2023-12-07 21:27:50,063 - Epoch: [63][ 1600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.529486    
+2023-12-07 21:28:42,518 - Epoch: [63][ 1700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.529194    
+2023-12-07 21:29:34,985 - Epoch: [63][ 1800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.528941    
+2023-12-07 21:30:27,386 - Epoch: [63][ 1900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.528679    
+2023-12-07 21:31:19,811 - Epoch: [63][ 2000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.528456    
+2023-12-07 21:32:12,208 - Epoch: [63][ 2100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.528241    
+2023-12-07 21:33:04,661 - Epoch: [63][ 2200/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.528071    
+2023-12-07 21:33:57,179 - Epoch: [63][ 2300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.527944    
+2023-12-07 21:34:49,650 - Epoch: [63][ 2400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.527807    
+2023-12-07 21:35:42,071 - Epoch: [63][ 2500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.527663    
+2023-12-07 21:36:34,609 - Epoch: [63][ 2600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527573    
+2023-12-07 21:37:27,103 - Epoch: [63][ 2700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.527474    
+2023-12-07 21:38:19,539 - Epoch: [63][ 2800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.527362    
+2023-12-07 21:39:11,999 - Epoch: [63][ 2900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.527266    
+2023-12-07 21:40:04,430 - Epoch: [63][ 3000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.527166    
+2023-12-07 21:40:56,858 - Epoch: [63][ 3100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527072    
+2023-12-07 21:41:49,327 - Epoch: [63][ 3200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526996    
+2023-12-07 21:42:41,815 - Epoch: [63][ 3300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526931    
+2023-12-07 21:43:34,252 - Epoch: [63][ 3400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526855    
+2023-12-07 21:44:26,668 - Epoch: [63][ 3500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526777    
+2023-12-07 21:45:19,090 - Epoch: [63][ 3600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526705    
+2023-12-07 21:46:11,533 - Epoch: [63][ 3700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526643    
+2023-12-07 21:47:04,010 - Epoch: [63][ 3800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526593    
+2023-12-07 21:47:56,409 - Epoch: [63][ 3900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526525    
+2023-12-07 21:48:48,842 - Epoch: [63][ 4000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526469    
+2023-12-07 21:49:41,311 - Epoch: [63][ 4100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526425    
+2023-12-07 21:50:33,780 - Epoch: [63][ 4200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526383    
+2023-12-07 21:51:26,249 - Epoch: [63][ 4300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526343    
+2023-12-07 21:52:18,722 - Epoch: [63][ 4400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.526305    
+2023-12-07 21:53:11,200 - Epoch: [63][ 4500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526271    
+2023-12-07 21:54:03,616 - Epoch: [63][ 4600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526224    
+2023-12-07 21:54:56,103 - Epoch: [63][ 4700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526195    
+2023-12-07 21:55:48,544 - Epoch: [63][ 4800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526157    
+2023-12-07 21:56:40,892 - Epoch: [63][ 4900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526102    
+2023-12-07 21:57:33,377 - Epoch: [63][ 5000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.526076    
+2023-12-07 21:58:25,846 - Epoch: [63][ 5100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526048    
+2023-12-07 21:59:18,331 - Epoch: [63][ 5200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526024    
+2023-12-07 22:00:10,785 - Epoch: [63][ 5300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525996    
+2023-12-07 22:01:03,263 - Epoch: [63][ 5400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525972    
+2023-12-07 22:01:55,705 - Epoch: [63][ 5500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525944    
+2023-12-07 22:02:48,205 - Epoch: [63][ 5600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525926    
+2023-12-07 22:03:40,629 - Epoch: [63][ 5700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525896    
+2023-12-07 22:04:33,123 - Epoch: [63][ 5800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525879    
+2023-12-07 22:05:25,553 - Epoch: [63][ 5900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525852    
+2023-12-07 22:06:17,935 - Epoch: [63][ 6000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525817    
+2023-12-07 22:07:10,374 - Epoch: [63][ 6100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525793    
+2023-12-07 22:08:02,840 - Epoch: [63][ 6200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525774    
+2023-12-07 22:08:55,344 - Epoch: [63][ 6300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525762    
+2023-12-07 22:09:47,877 - Epoch: [63][ 6400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525755    
+2023-12-07 22:10:40,350 - Epoch: [63][ 6500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525739    
+2023-12-07 22:11:32,831 - Epoch: [63][ 6600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525724    
+2023-12-07 22:12:25,274 - Epoch: [63][ 6700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525704    
+2023-12-07 22:13:17,766 - Epoch: [63][ 6800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525692    
+2023-12-07 22:14:10,276 - Epoch: [63][ 6900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525683    
+2023-12-07 22:15:02,743 - Epoch: [63][ 7000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525668    
+2023-12-07 22:15:55,244 - Epoch: [63][ 7100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525658    
+2023-12-07 22:16:47,724 - Epoch: [63][ 7200/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525646    
+2023-12-07 22:17:40,176 - Epoch: [63][ 7300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525630    
+2023-12-07 22:18:32,610 - Epoch: [63][ 7400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525612    
+2023-12-07 22:19:25,129 - Epoch: [63][ 7500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525606    
+2023-12-07 22:20:17,572 - Epoch: [63][ 7600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525590    
+2023-12-07 22:21:10,039 - Epoch: [63][ 7700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525578    
+2023-12-07 22:22:02,475 - Epoch: [63][ 7800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525562    
+2023-12-07 22:22:54,885 - Epoch: [63][ 7900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525543    
+2023-12-07 22:23:47,338 - Epoch: [63][ 8000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525530    
+2023-12-07 22:24:39,780 - Epoch: [63][ 8100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525516    
+2023-12-07 22:25:32,278 - Epoch: [63][ 8200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525509    
+2023-12-07 22:26:24,642 - Epoch: [63][ 8300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525486    
+2023-12-07 22:27:17,111 - Epoch: [63][ 8400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525476    
+2023-12-07 22:28:09,594 - Epoch: [63][ 8500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525468    
+2023-12-07 22:29:02,062 - Epoch: [63][ 8600/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525458    
+2023-12-07 22:29:54,519 - Epoch: [63][ 8700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525448    
+2023-12-07 22:30:47,009 - Epoch: [63][ 8800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525441    
+2023-12-07 22:31:39,485 - Epoch: [63][ 8900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525433    
+2023-12-07 22:32:31,966 - Epoch: [63][ 9000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525426    
+2023-12-07 22:33:24,407 - Epoch: [63][ 9100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525414    
+2023-12-07 22:34:16,819 - Epoch: [63][ 9200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525400    
+2023-12-07 22:35:09,243 - Epoch: [63][ 9300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525387    
+2023-12-07 22:36:01,688 - Epoch: [63][ 9400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525377    
+2023-12-07 22:36:54,167 - Epoch: [63][ 9500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525370    
+2023-12-07 22:37:46,666 - Epoch: [63][ 9600/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525366    
+2023-12-07 22:38:39,090 - Epoch: [63][ 9700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525354    
+2023-12-07 22:39:31,532 - Epoch: [63][ 9800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525344    
+2023-12-07 22:40:23,974 - Epoch: [63][ 9900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525334    
+2023-12-07 22:41:16,435 - Epoch: [63][10000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525327    
+2023-12-07 22:42:08,816 - Epoch: [63][10100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525311    
+2023-12-07 22:43:01,299 - Epoch: [63][10200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525306    
+2023-12-07 22:43:53,709 - Epoch: [63][10300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525294    
+2023-12-07 22:44:46,177 - Epoch: [63][10400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525288    
+2023-12-07 22:45:38,624 - Epoch: [63][10500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525280    
+2023-12-07 22:46:31,118 - Epoch: [63][10600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525277    
+2023-12-07 22:47:23,713 - Epoch: [63][10700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525283    
+2023-12-07 22:48:16,191 - Epoch: [63][10800/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525277    
+2023-12-07 22:49:08,648 - Epoch: [63][10900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525271    
+2023-12-07 22:50:01,085 - Epoch: [63][11000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525262    
+2023-12-07 22:50:53,539 - Epoch: [63][11100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525255    
+2023-12-07 22:51:45,953 - Epoch: [63][11200/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525245    
+2023-12-07 22:52:38,385 - Epoch: [63][11300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525237    
+2023-12-07 22:53:30,865 - Epoch: [63][11400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525232    
+2023-12-07 22:54:23,295 - Epoch: [63][11500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525224    
+2023-12-07 22:55:15,733 - Epoch: [63][11600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525217    
+2023-12-07 22:56:08,166 - Epoch: [63][11700/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525209    
+2023-12-07 22:57:00,674 - Epoch: [63][11800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525207    
+2023-12-07 22:57:53,125 - Epoch: [63][11900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525201    
+2023-12-07 22:58:45,640 - Epoch: [63][12000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525201    
+2023-12-07 22:59:38,086 - Epoch: [63][12100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525194    
+2023-12-07 23:00:13,623 - Epoch: [63][12168/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525179    
+2023-12-07 23:00:14,026 - --- validate (epoch=63)-----------
+2023-12-07 23:00:14,027 - 167951 samples (256 per mini-batch)
+2023-12-07 23:01:04,583 - Epoch: [63][  100/  657]    Loss 0.000000    Overall Loss 0.014247    
+2023-12-07 23:01:53,204 - Epoch: [63][  200/  657]    Loss 0.000000    Overall Loss 0.014225    
+2023-12-07 23:02:41,789 - Epoch: [63][  300/  657]    Loss 0.000000    Overall Loss 0.014219    
+2023-12-07 23:03:30,401 - Epoch: [63][  400/  657]    Loss 0.000000    Overall Loss 0.014210    
+2023-12-07 23:04:18,965 - Epoch: [63][  500/  657]    Loss 0.000000    Overall Loss 0.014211    
+2023-12-07 23:05:07,549 - Epoch: [63][  600/  657]    Loss 0.000000    Overall Loss 0.014208    
+2023-12-07 23:05:34,785 - Epoch: [63][  657/  657]    Loss 0.000000    Overall Loss 0.014206    
+2023-12-07 23:05:35,007 - ==> Overall Loss: 0.014
+
+2023-12-07 23:05:35,009 - ==> Best [Overall Loss: 0.013942 on epoch: 51]
+2023-12-07 23:05:35,009 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-07 23:05:35,030 - 
+
+2023-12-07 23:05:35,030 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-07 23:06:37,129 - Epoch: [64][  100/12168]    Overall Loss 0.013362    Objective Loss 0.000000    Distill Loss 0.013362                                        LR 0.000008    Time 0.620950    
+2023-12-07 23:07:29,532 - Epoch: [64][  200/12168]    Overall Loss 0.013358    Objective Loss 0.000000    Distill Loss 0.013358                                        LR 0.000008    Time 0.572471    
+2023-12-07 23:08:21,944 - Epoch: [64][  300/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000008    Time 0.556345    
+2023-12-07 23:09:14,376 - Epoch: [64][  400/12168]    Overall Loss 0.013353    Objective Loss 0.000000    Distill Loss 0.013353                                        LR 0.000008    Time 0.548330    
+2023-12-07 23:10:06,780 - Epoch: [64][  500/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.543466    
+2023-12-07 23:10:59,169 - Epoch: [64][  600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.540197    
+2023-12-07 23:11:51,640 - Epoch: [64][  700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.537980    
+2023-12-07 23:12:44,076 - Epoch: [64][  800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.536273    
+2023-12-07 23:13:36,484 - Epoch: [64][  900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.534914    
+2023-12-07 23:14:28,838 - Epoch: [64][ 1000/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000008    Time 0.533774    
+2023-12-07 23:15:21,276 - Epoch: [64][ 1100/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.532917    
+2023-12-07 23:16:13,772 - Epoch: [64][ 1200/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.532251    
+2023-12-07 23:17:06,231 - Epoch: [64][ 1300/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.531659    
+2023-12-07 23:17:58,643 - Epoch: [64][ 1400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.531118    
+2023-12-07 23:18:51,051 - Epoch: [64][ 1500/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.530647    
+2023-12-07 23:19:43,418 - Epoch: [64][ 1600/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.530209    
+2023-12-07 23:20:35,876 - Epoch: [64][ 1700/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000008    Time 0.529875    
+2023-12-07 23:21:28,338 - Epoch: [64][ 1800/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.529582    
+2023-12-07 23:22:20,792 - Epoch: [64][ 1900/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.529315    
+2023-12-07 23:23:13,221 - Epoch: [64][ 2000/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.529062    
+2023-12-07 23:24:05,609 - Epoch: [64][ 2100/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.528813    
+2023-12-07 23:24:58,026 - Epoch: [64][ 2200/12168]    Overall Loss 0.013346    Objective Loss 0.000000    Distill Loss 0.013346                                        LR 0.000008    Time 0.528600    
+2023-12-07 23:25:50,411 - Epoch: [64][ 2300/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.528392    
+2023-12-07 23:26:42,817 - Epoch: [64][ 2400/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.528210    
+2023-12-07 23:27:35,261 - Epoch: [64][ 2500/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528058    
+2023-12-07 23:28:27,672 - Epoch: [64][ 2600/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.527905    
+2023-12-07 23:29:20,049 - Epoch: [64][ 2700/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.527751    
+2023-12-07 23:30:12,430 - Epoch: [64][ 2800/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.527609    
+2023-12-07 23:31:04,906 - Epoch: [64][ 2900/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.527510    
+2023-12-07 23:31:57,311 - Epoch: [64][ 3000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527393    
+2023-12-07 23:32:49,745 - Epoch: [64][ 3100/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.527293    
+2023-12-07 23:33:42,250 - Epoch: [64][ 3200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.527222    
+2023-12-07 23:34:34,679 - Epoch: [64][ 3300/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527132    
+2023-12-07 23:35:27,106 - Epoch: [64][ 3400/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527047    
+2023-12-07 23:36:19,508 - Epoch: [64][ 3500/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.526960    
+2023-12-07 23:37:11,924 - Epoch: [64][ 3600/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.526881    
+2023-12-07 23:38:04,331 - Epoch: [64][ 3700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.526804    
+2023-12-07 23:38:56,714 - Epoch: [64][ 3800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.526725    
+2023-12-07 23:39:49,142 - Epoch: [64][ 3900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.526662    
+2023-12-07 23:40:41,576 - Epoch: [64][ 4000/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.526603    
+2023-12-07 23:41:33,981 - Epoch: [64][ 4100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.526540    
+2023-12-07 23:42:26,478 - Epoch: [64][ 4200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.526502    
+2023-12-07 23:43:18,870 - Epoch: [64][ 4300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.526441    
+2023-12-07 23:44:11,250 - Epoch: [64][ 4400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.526380    
+2023-12-07 23:45:03,689 - Epoch: [64][ 4500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.526335    
+2023-12-07 23:45:56,118 - Epoch: [64][ 4600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.526290    
+2023-12-07 23:46:48,547 - Epoch: [64][ 4700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.526247    
+2023-12-07 23:47:40,939 - Epoch: [64][ 4800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526197    
+2023-12-07 23:48:33,412 - Epoch: [64][ 4900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526167    
+2023-12-07 23:49:25,836 - Epoch: [64][ 5000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526128    
+2023-12-07 23:50:18,197 - Epoch: [64][ 5100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526077    
+2023-12-07 23:51:10,606 - Epoch: [64][ 5200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526039    
+2023-12-07 23:52:02,990 - Epoch: [64][ 5300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525997    
+2023-12-07 23:52:55,414 - Epoch: [64][ 5400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525963    
+2023-12-07 23:53:47,816 - Epoch: [64][ 5500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525927    
+2023-12-07 23:54:40,235 - Epoch: [64][ 5600/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525896    
+2023-12-07 23:55:32,676 - Epoch: [64][ 5700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525869    
+2023-12-07 23:56:25,192 - Epoch: [64][ 5800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525856    
+2023-12-07 23:57:17,617 - Epoch: [64][ 5900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525829    
+2023-12-07 23:58:09,957 - Epoch: [64][ 6000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525787    
+2023-12-07 23:59:02,335 - Epoch: [64][ 6100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525754    
+2023-12-07 23:59:54,773 - Epoch: [64][ 6200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525731    
+2023-12-08 00:00:47,242 - Epoch: [64][ 6300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525714    
+2023-12-08 00:01:39,714 - Epoch: [64][ 6400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525698    
+2023-12-08 00:02:32,128 - Epoch: [64][ 6500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525674    
+2023-12-08 00:03:24,599 - Epoch: [64][ 6600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525659    
+2023-12-08 00:04:17,046 - Epoch: [64][ 6700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525640    
+2023-12-08 00:05:09,443 - Epoch: [64][ 6800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525615    
+2023-12-08 00:06:01,867 - Epoch: [64][ 6900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525595    
+2023-12-08 00:06:54,302 - Epoch: [64][ 7000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525577    
+2023-12-08 00:07:46,759 - Epoch: [64][ 7100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525562    
+2023-12-08 00:08:39,189 - Epoch: [64][ 7200/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525544    
+2023-12-08 00:09:31,605 - Epoch: [64][ 7300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525525    
+2023-12-08 00:10:24,068 - Epoch: [64][ 7400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525512    
+2023-12-08 00:11:16,578 - Epoch: [64][ 7500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525506    
+2023-12-08 00:12:08,987 - Epoch: [64][ 7600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525487    
+2023-12-08 00:13:01,477 - Epoch: [64][ 7700/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525479    
+2023-12-08 00:13:53,891 - Epoch: [64][ 7800/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525461    
+2023-12-08 00:14:46,302 - Epoch: [64][ 7900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525444    
+2023-12-08 00:15:38,715 - Epoch: [64][ 8000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525427    
+2023-12-08 00:16:31,091 - Epoch: [64][ 8100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525406    
+2023-12-08 00:17:23,453 - Epoch: [64][ 8200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525384    
+2023-12-08 00:18:15,871 - Epoch: [64][ 8300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525369    
+2023-12-08 00:19:08,278 - Epoch: [64][ 8400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525353    
+2023-12-08 00:20:00,698 - Epoch: [64][ 8500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525339    
+2023-12-08 00:20:53,134 - Epoch: [64][ 8600/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525327    
+2023-12-08 00:21:45,557 - Epoch: [64][ 8700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525314    
+2023-12-08 00:22:38,044 - Epoch: [64][ 8800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525309    
+2023-12-08 00:23:30,490 - Epoch: [64][ 8900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525299    
+2023-12-08 00:24:22,923 - Epoch: [64][ 9000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525287    
+2023-12-08 00:25:15,389 - Epoch: [64][ 9100/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525280    
+2023-12-08 00:26:07,812 - Epoch: [64][ 9200/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525268    
+2023-12-08 00:27:00,233 - Epoch: [64][ 9300/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525256    
+2023-12-08 00:27:52,641 - Epoch: [64][ 9400/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525243    
+2023-12-08 00:28:45,071 - Epoch: [64][ 9500/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525233    
+2023-12-08 00:29:37,473 - Epoch: [64][ 9600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525220    
+2023-12-08 00:30:29,874 - Epoch: [64][ 9700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525207    
+2023-12-08 00:31:22,293 - Epoch: [64][ 9800/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525196    
+2023-12-08 00:32:14,732 - Epoch: [64][ 9900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525188    
+2023-12-08 00:33:07,144 - Epoch: [64][10000/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525177    
+2023-12-08 00:33:59,638 - Epoch: [64][10100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525174    
+2023-12-08 00:34:52,112 - Epoch: [64][10200/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525169    
+2023-12-08 00:35:44,516 - Epoch: [64][10300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525158    
+2023-12-08 00:36:36,996 - Epoch: [64][10400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525154    
+2023-12-08 00:37:29,449 - Epoch: [64][10500/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525148    
+2023-12-08 00:38:21,920 - Epoch: [64][10600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525144    
+2023-12-08 00:39:14,375 - Epoch: [64][10700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525138    
+2023-12-08 00:40:06,750 - Epoch: [64][10800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525125    
+2023-12-08 00:40:59,124 - Epoch: [64][10900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525112    
+2023-12-08 00:41:51,623 - Epoch: [64][11000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525110    
+2023-12-08 00:42:44,097 - Epoch: [64][11100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525106    
+2023-12-08 00:43:36,561 - Epoch: [64][11200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525102    
+2023-12-08 00:44:28,958 - Epoch: [64][11300/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525092    
+2023-12-08 00:45:21,369 - Epoch: [64][11400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525083    
+2023-12-08 00:46:13,813 - Epoch: [64][11500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525077    
+2023-12-08 00:47:06,289 - Epoch: [64][11600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525074    
+2023-12-08 00:47:58,713 - Epoch: [64][11700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525066    
+2023-12-08 00:48:51,203 - Epoch: [64][11800/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525065    
+2023-12-08 00:49:43,638 - Epoch: [64][11900/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525058    
+2023-12-08 00:50:36,121 - Epoch: [64][12000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525056    
+2023-12-08 00:51:28,492 - Epoch: [64][12100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525045    
+2023-12-08 00:52:04,082 - Epoch: [64][12168/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525036    
+2023-12-08 00:52:04,494 - --- validate (epoch=64)-----------
+2023-12-08 00:52:04,495 - 167951 samples (256 per mini-batch)
+2023-12-08 00:52:54,991 - Epoch: [64][  100/  657]    Loss 0.000000    Overall Loss 0.013893    
+2023-12-08 00:53:43,577 - Epoch: [64][  200/  657]    Loss 0.000000    Overall Loss 0.013909    
+2023-12-08 00:54:32,161 - Epoch: [64][  300/  657]    Loss 0.000000    Overall Loss 0.013906    
+2023-12-08 00:55:20,729 - Epoch: [64][  400/  657]    Loss 0.000000    Overall Loss 0.013910    
+2023-12-08 00:56:09,308 - Epoch: [64][  500/  657]    Loss 0.000000    Overall Loss 0.013913    
+2023-12-08 00:56:57,849 - Epoch: [64][  600/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-08 00:57:25,072 - Epoch: [64][  657/  657]    Loss 0.000000    Overall Loss 0.013911    
+2023-12-08 00:57:25,288 - ==> Overall Loss: 0.014
+
+2023-12-08 00:57:25,291 - ==> Best [Overall Loss: 0.013911 on epoch: 64]
+2023-12-08 00:57:25,291 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 00:57:25,328 - 
+
+2023-12-08 00:57:25,328 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 00:58:26,359 - Epoch: [65][  100/12168]    Overall Loss 0.013274    Objective Loss 0.000000    Distill Loss 0.013274                                        LR 0.000008    Time 0.610269    
+2023-12-08 00:59:18,844 - Epoch: [65][  200/12168]    Overall Loss 0.013268    Objective Loss 0.000000    Distill Loss 0.013268                                        LR 0.000008    Time 0.567541    
+2023-12-08 01:00:11,219 - Epoch: [65][  300/12168]    Overall Loss 0.013298    Objective Loss 0.000000    Distill Loss 0.013298                                        LR 0.000008    Time 0.552934    
+2023-12-08 01:01:03,549 - Epoch: [65][  400/12168]    Overall Loss 0.013287    Objective Loss 0.000000    Distill Loss 0.013287                                        LR 0.000008    Time 0.545516    
+2023-12-08 01:01:55,997 - Epoch: [65][  500/12168]    Overall Loss 0.013285    Objective Loss 0.000000    Distill Loss 0.013285                                        LR 0.000008    Time 0.541304    
+2023-12-08 01:02:48,400 - Epoch: [65][  600/12168]    Overall Loss 0.013289    Objective Loss 0.000000    Distill Loss 0.013289                                        LR 0.000008    Time 0.538419    
+2023-12-08 01:03:40,788 - Epoch: [65][  700/12168]    Overall Loss 0.013298    Objective Loss 0.000000    Distill Loss 0.013298                                        LR 0.000008    Time 0.536337    
+2023-12-08 01:04:33,176 - Epoch: [65][  800/12168]    Overall Loss 0.013304    Objective Loss 0.000000    Distill Loss 0.013304                                        LR 0.000008    Time 0.534775    
+2023-12-08 01:05:25,520 - Epoch: [65][  900/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.533512    
+2023-12-08 01:06:18,024 - Epoch: [65][ 1000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.532662    
+2023-12-08 01:07:10,466 - Epoch: [65][ 1100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.531910    
+2023-12-08 01:08:02,884 - Epoch: [65][ 1200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.531262    
+2023-12-08 01:08:55,278 - Epoch: [65][ 1300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.530696    
+2023-12-08 01:09:47,752 - Epoch: [65][ 1400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.530269    
+2023-12-08 01:10:40,170 - Epoch: [65][ 1500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.529861    
+2023-12-08 01:11:32,587 - Epoch: [65][ 1600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.529503    
+2023-12-08 01:12:25,063 - Epoch: [65][ 1700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.529222    
+2023-12-08 01:13:17,444 - Epoch: [65][ 1800/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528920    
+2023-12-08 01:14:09,860 - Epoch: [65][ 1900/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528667    
+2023-12-08 01:15:02,281 - Epoch: [65][ 2000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.528443    
+2023-12-08 01:15:54,663 - Epoch: [65][ 2100/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528221    
+2023-12-08 01:16:47,140 - Epoch: [65][ 2200/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.528063    
+2023-12-08 01:17:39,528 - Epoch: [65][ 2300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.527880    
+2023-12-08 01:18:31,938 - Epoch: [65][ 2400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.527721    
+2023-12-08 01:19:24,386 - Epoch: [65][ 2500/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.527590    
+2023-12-08 01:20:16,833 - Epoch: [65][ 2600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527469    
+2023-12-08 01:21:09,326 - Epoch: [65][ 2700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527373    
+2023-12-08 01:22:01,784 - Epoch: [65][ 2800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527272    
+2023-12-08 01:22:54,176 - Epoch: [65][ 2900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527156    
+2023-12-08 01:23:46,584 - Epoch: [65][ 3000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527052    
+2023-12-08 01:24:38,970 - Epoch: [65][ 3100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526948    
+2023-12-08 01:25:31,388 - Epoch: [65][ 3200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526860    
+2023-12-08 01:26:23,863 - Epoch: [65][ 3300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526795    
+2023-12-08 01:27:16,310 - Epoch: [65][ 3400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526726    
+2023-12-08 01:28:08,724 - Epoch: [65][ 3500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526651    
+2023-12-08 01:29:01,073 - Epoch: [65][ 3600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526562    
+2023-12-08 01:29:53,482 - Epoch: [65][ 3700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526495    
+2023-12-08 01:30:45,851 - Epoch: [65][ 3800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526420    
+2023-12-08 01:31:38,259 - Epoch: [65][ 3900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526358    
+2023-12-08 01:32:30,700 - Epoch: [65][ 4000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526308    
+2023-12-08 01:33:23,117 - Epoch: [65][ 4100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526256    
+2023-12-08 01:34:15,574 - Epoch: [65][ 4200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526215    
+2023-12-08 01:35:07,986 - Epoch: [65][ 4300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.526165    
+2023-12-08 01:36:00,381 - Epoch: [65][ 4400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.526114    
+2023-12-08 01:36:52,834 - Epoch: [65][ 4500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526078    
+2023-12-08 01:37:45,195 - Epoch: [65][ 4600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526024    
+2023-12-08 01:38:37,632 - Epoch: [65][ 4700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525988    
+2023-12-08 01:39:30,087 - Epoch: [65][ 4800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525957    
+2023-12-08 01:40:22,552 - Epoch: [65][ 4900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525930    
+2023-12-08 01:41:14,975 - Epoch: [65][ 5000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525895    
+2023-12-08 01:42:07,385 - Epoch: [65][ 5100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525859    
+2023-12-08 01:42:59,802 - Epoch: [65][ 5200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525826    
+2023-12-08 01:43:52,182 - Epoch: [65][ 5300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525787    
+2023-12-08 01:44:44,602 - Epoch: [65][ 5400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525757    
+2023-12-08 01:45:36,983 - Epoch: [65][ 5500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525721    
+2023-12-08 01:46:29,367 - Epoch: [65][ 5600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525687    
+2023-12-08 01:47:21,780 - Epoch: [65][ 5700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525659    
+2023-12-08 01:48:14,231 - Epoch: [65][ 5800/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525639    
+2023-12-08 01:49:06,563 - Epoch: [65][ 5900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525599    
+2023-12-08 01:49:59,013 - Epoch: [65][ 6000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525580    
+2023-12-08 01:50:51,462 - Epoch: [65][ 6100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525562    
+2023-12-08 01:51:43,912 - Epoch: [65][ 6200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525544    
+2023-12-08 01:52:36,366 - Epoch: [65][ 6300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525528    
+2023-12-08 01:53:28,885 - Epoch: [65][ 6400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525522    
+2023-12-08 01:54:21,288 - Epoch: [65][ 6500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525498    
+2023-12-08 01:55:13,739 - Epoch: [65][ 6600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525483    
+2023-12-08 01:56:06,209 - Epoch: [65][ 6700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525471    
+2023-12-08 01:56:58,634 - Epoch: [65][ 6800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525452    
+2023-12-08 01:57:51,064 - Epoch: [65][ 6900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525435    
+2023-12-08 01:58:43,480 - Epoch: [65][ 7000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525416    
+2023-12-08 01:59:35,954 - Epoch: [65][ 7100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525406    
+2023-12-08 02:00:28,343 - Epoch: [65][ 7200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525385    
+2023-12-08 02:01:20,781 - Epoch: [65][ 7300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525371    
+2023-12-08 02:02:13,141 - Epoch: [65][ 7400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525346    
+2023-12-08 02:03:05,566 - Epoch: [65][ 7500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525331    
+2023-12-08 02:03:58,019 - Epoch: [65][ 7600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525320    
+2023-12-08 02:04:50,408 - Epoch: [65][ 7700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525301    
+2023-12-08 02:05:42,828 - Epoch: [65][ 7800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525287    
+2023-12-08 02:06:35,258 - Epoch: [65][ 7900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525274    
+2023-12-08 02:07:27,706 - Epoch: [65][ 8000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525263    
+2023-12-08 02:08:20,133 - Epoch: [65][ 8100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525251    
+2023-12-08 02:09:12,561 - Epoch: [65][ 8200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525239    
+2023-12-08 02:10:04,989 - Epoch: [65][ 8300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525227    
+2023-12-08 02:10:57,387 - Epoch: [65][ 8400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525211    
+2023-12-08 02:11:49,766 - Epoch: [65][ 8500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525194    
+2023-12-08 02:12:42,180 - Epoch: [65][ 8600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525182    
+2023-12-08 02:13:34,611 - Epoch: [65][ 8700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525171    
+2023-12-08 02:14:27,112 - Epoch: [65][ 8800/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525169    
+2023-12-08 02:15:19,628 - Epoch: [65][ 8900/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525168    
+2023-12-08 02:16:12,063 - Epoch: [65][ 9000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525159    
+2023-12-08 02:17:04,520 - Epoch: [65][ 9100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525152    
+2023-12-08 02:17:56,942 - Epoch: [65][ 9200/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525142    
+2023-12-08 02:18:49,401 - Epoch: [65][ 9300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525135    
+2023-12-08 02:19:41,811 - Epoch: [65][ 9400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525124    
+2023-12-08 02:20:34,301 - Epoch: [65][ 9500/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525121    
+2023-12-08 02:21:26,717 - Epoch: [65][ 9600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525111    
+2023-12-08 02:22:19,104 - Epoch: [65][ 9700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525098    
+2023-12-08 02:23:11,490 - Epoch: [65][ 9800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525085    
+2023-12-08 02:24:03,932 - Epoch: [65][ 9900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525078    
+2023-12-08 02:24:56,321 - Epoch: [65][10000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525066    
+2023-12-08 02:25:48,741 - Epoch: [65][10100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525057    
+2023-12-08 02:26:41,147 - Epoch: [65][10200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525047    
+2023-12-08 02:27:33,606 - Epoch: [65][10300/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525042    
+2023-12-08 02:28:26,001 - Epoch: [65][10400/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525031    
+2023-12-08 02:29:18,510 - Epoch: [65][10500/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525031    
+2023-12-08 02:30:10,935 - Epoch: [65][10600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525024    
+2023-12-08 02:31:03,413 - Epoch: [65][10700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525021    
+2023-12-08 02:31:55,907 - Epoch: [65][10800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525020    
+2023-12-08 02:32:48,378 - Epoch: [65][10900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525017    
+2023-12-08 02:33:40,796 - Epoch: [65][11000/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525009    
+2023-12-08 02:34:33,217 - Epoch: [65][11100/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525001    
+2023-12-08 02:35:25,649 - Epoch: [65][11200/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.524995    
+2023-12-08 02:36:18,089 - Epoch: [65][11300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.524989    
+2023-12-08 02:37:10,572 - Epoch: [65][11400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.524988    
+2023-12-08 02:38:03,047 - Epoch: [65][11500/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.524985    
+2023-12-08 02:38:55,438 - Epoch: [65][11600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524976    
+2023-12-08 02:39:47,894 - Epoch: [65][11700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524972    
+2023-12-08 02:40:40,341 - Epoch: [65][11800/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524968    
+2023-12-08 02:41:32,803 - Epoch: [65][11900/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524964    
+2023-12-08 02:42:25,293 - Epoch: [65][12000/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524964    
+2023-12-08 02:43:17,676 - Epoch: [65][12100/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524954    
+2023-12-08 02:43:53,282 - Epoch: [65][12168/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524946    
+2023-12-08 02:43:53,692 - --- validate (epoch=65)-----------
+2023-12-08 02:43:53,692 - 167951 samples (256 per mini-batch)
+2023-12-08 02:44:44,282 - Epoch: [65][  100/  657]    Loss 0.000000    Overall Loss 0.014023    
+2023-12-08 02:45:32,887 - Epoch: [65][  200/  657]    Loss 0.000000    Overall Loss 0.014011    
+2023-12-08 02:46:21,475 - Epoch: [65][  300/  657]    Loss 0.000000    Overall Loss 0.014025    
+2023-12-08 02:47:10,040 - Epoch: [65][  400/  657]    Loss 0.000000    Overall Loss 0.014038    
+2023-12-08 02:47:58,628 - Epoch: [65][  500/  657]    Loss 0.000000    Overall Loss 0.014047    
+2023-12-08 02:48:47,207 - Epoch: [65][  600/  657]    Loss 0.000000    Overall Loss 0.014041    
+2023-12-08 02:49:14,437 - Epoch: [65][  657/  657]    Loss 0.000000    Overall Loss 0.014046    
+2023-12-08 02:49:14,656 - ==> Overall Loss: 0.014
+
+2023-12-08 02:49:14,658 - ==> Best [Overall Loss: 0.013911 on epoch: 64]
+2023-12-08 02:49:14,658 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 02:49:14,679 - 
+
+2023-12-08 02:49:14,680 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 02:50:15,730 - Epoch: [66][  100/12168]    Overall Loss 0.013274    Objective Loss 0.000000    Distill Loss 0.013274                                        LR 0.000008    Time 0.610460    
+2023-12-08 02:51:08,139 - Epoch: [66][  200/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.567260    
+2023-12-08 02:52:00,600 - Epoch: [66][  300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.553032    
+2023-12-08 02:52:53,009 - Epoch: [66][  400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.545788    
+2023-12-08 02:53:45,409 - Epoch: [66][  500/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.541423    
+2023-12-08 02:54:37,836 - Epoch: [66][  600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.538559    
+2023-12-08 02:55:30,268 - Epoch: [66][  700/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.536521    
+2023-12-08 02:56:22,638 - Epoch: [66][  800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.534915    
+2023-12-08 02:57:15,021 - Epoch: [66][  900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.533679    
+2023-12-08 02:58:07,449 - Epoch: [66][ 1000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.532736    
+2023-12-08 02:58:59,841 - Epoch: [66][ 1100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.531931    
+2023-12-08 02:59:52,260 - Epoch: [66][ 1200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.531284    
+2023-12-08 03:00:44,672 - Epoch: [66][ 1300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.530729    
+2023-12-08 03:01:37,115 - Epoch: [66][ 1400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.530277    
+2023-12-08 03:02:29,484 - Epoch: [66][ 1500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.529836    
+2023-12-08 03:03:21,868 - Epoch: [66][ 1600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.529459    
+2023-12-08 03:04:14,264 - Epoch: [66][ 1700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.529134    
+2023-12-08 03:05:06,624 - Epoch: [66][ 1800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.528825    
+2023-12-08 03:05:59,057 - Epoch: [66][ 1900/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.528586    
+2023-12-08 03:06:51,445 - Epoch: [66][ 2000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.528349    
+2023-12-08 03:07:43,775 - Epoch: [66][ 2100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.528107    
+2023-12-08 03:08:36,246 - Epoch: [66][ 2200/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.527951    
+2023-12-08 03:09:28,666 - Epoch: [66][ 2300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.527787    
+2023-12-08 03:10:21,106 - Epoch: [66][ 2400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.527644    
+2023-12-08 03:11:13,553 - Epoch: [66][ 2500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527516    
+2023-12-08 03:12:05,916 - Epoch: [66][ 2600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527365    
+2023-12-08 03:12:58,347 - Epoch: [66][ 2700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527251    
+2023-12-08 03:13:50,833 - Epoch: [66][ 2800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.527164    
+2023-12-08 03:14:43,224 - Epoch: [66][ 2900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527051    
+2023-12-08 03:15:35,665 - Epoch: [66][ 3000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526961    
+2023-12-08 03:16:28,106 - Epoch: [66][ 3100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526878    
+2023-12-08 03:17:20,575 - Epoch: [66][ 3200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526809    
+2023-12-08 03:18:13,009 - Epoch: [66][ 3300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526733    
+2023-12-08 03:19:05,365 - Epoch: [66][ 3400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526638    
+2023-12-08 03:19:57,737 - Epoch: [66][ 3500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526554    
+2023-12-08 03:20:50,190 - Epoch: [66][ 3600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526497    
+2023-12-08 03:21:42,576 - Epoch: [66][ 3700/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526425    
+2023-12-08 03:22:35,007 - Epoch: [66][ 3800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526368    
+2023-12-08 03:23:27,445 - Epoch: [66][ 3900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526316    
+2023-12-08 03:24:19,921 - Epoch: [66][ 4000/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526276    
+2023-12-08 03:25:12,265 - Epoch: [66][ 4100/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526206    
+2023-12-08 03:26:04,653 - Epoch: [66][ 4200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526150    
+2023-12-08 03:26:57,019 - Epoch: [66][ 4300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526092    
+2023-12-08 03:27:49,472 - Epoch: [66][ 4400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526055    
+2023-12-08 03:28:41,866 - Epoch: [66][ 4500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526008    
+2023-12-08 03:29:34,264 - Epoch: [66][ 4600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525963    
+2023-12-08 03:30:26,648 - Epoch: [66][ 4700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525917    
+2023-12-08 03:31:19,096 - Epoch: [66][ 4800/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525886    
+2023-12-08 03:32:11,600 - Epoch: [66][ 4900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525868    
+2023-12-08 03:33:04,071 - Epoch: [66][ 5000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525845    
+2023-12-08 03:33:56,608 - Epoch: [66][ 5100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525835    
+2023-12-08 03:34:49,079 - Epoch: [66][ 5200/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525812    
+2023-12-08 03:35:41,491 - Epoch: [66][ 5300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525780    
+2023-12-08 03:36:33,898 - Epoch: [66][ 5400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525747    
+2023-12-08 03:37:26,338 - Epoch: [66][ 5500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525722    
+2023-12-08 03:38:18,741 - Epoch: [66][ 5600/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525692    
+2023-12-08 03:39:11,155 - Epoch: [66][ 5700/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525664    
+2023-12-08 03:40:03,537 - Epoch: [66][ 5800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525631    
+2023-12-08 03:40:55,951 - Epoch: [66][ 5900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525606    
+2023-12-08 03:41:48,399 - Epoch: [66][ 6000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525586    
+2023-12-08 03:42:40,900 - Epoch: [66][ 6100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525576    
+2023-12-08 03:43:33,290 - Epoch: [66][ 6200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525549    
+2023-12-08 03:44:25,667 - Epoch: [66][ 6300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525520    
+2023-12-08 03:45:18,088 - Epoch: [66][ 6400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525499    
+2023-12-08 03:46:10,492 - Epoch: [66][ 6500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525476    
+2023-12-08 03:47:02,932 - Epoch: [66][ 6600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525459    
+2023-12-08 03:47:55,364 - Epoch: [66][ 6700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525442    
+2023-12-08 03:48:47,764 - Epoch: [66][ 6800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525420    
+2023-12-08 03:49:40,242 - Epoch: [66][ 6900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525410    
+2023-12-08 03:50:32,660 - Epoch: [66][ 7000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525392    
+2023-12-08 03:51:25,071 - Epoch: [66][ 7100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525373    
+2023-12-08 03:52:17,520 - Epoch: [66][ 7200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525361    
+2023-12-08 03:53:09,908 - Epoch: [66][ 7300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525340    
+2023-12-08 03:54:02,384 - Epoch: [66][ 7400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525332    
+2023-12-08 03:54:54,790 - Epoch: [66][ 7500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525314    
+2023-12-08 03:55:47,207 - Epoch: [66][ 7600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525299    
+2023-12-08 03:56:39,621 - Epoch: [66][ 7700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525283    
+2023-12-08 03:57:32,087 - Epoch: [66][ 7800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525275    
+2023-12-08 03:58:24,498 - Epoch: [66][ 7900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525260    
+2023-12-08 03:59:16,909 - Epoch: [66][ 8000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525245    
+2023-12-08 04:00:09,336 - Epoch: [66][ 8100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525233    
+2023-12-08 04:01:01,745 - Epoch: [66][ 8200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525218    
+2023-12-08 04:01:54,137 - Epoch: [66][ 8300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525202    
+2023-12-08 04:02:46,626 - Epoch: [66][ 8400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525198    
+2023-12-08 04:03:39,039 - Epoch: [66][ 8500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525185    
+2023-12-08 04:04:31,451 - Epoch: [66][ 8600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525172    
+2023-12-08 04:05:23,900 - Epoch: [66][ 8700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525164    
+2023-12-08 04:06:16,307 - Epoch: [66][ 8800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525151    
+2023-12-08 04:07:08,716 - Epoch: [66][ 8900/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525139    
+2023-12-08 04:08:01,134 - Epoch: [66][ 9000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525128    
+2023-12-08 04:08:53,548 - Epoch: [66][ 9100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525117    
+2023-12-08 04:09:45,925 - Epoch: [66][ 9200/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525102    
+2023-12-08 04:10:38,409 - Epoch: [66][ 9300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525099    
+2023-12-08 04:11:30,817 - Epoch: [66][ 9400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525087    
+2023-12-08 04:12:23,378 - Epoch: [66][ 9500/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525093    
+2023-12-08 04:13:15,803 - Epoch: [66][ 9600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525083    
+2023-12-08 04:14:08,223 - Epoch: [66][ 9700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525074    
+2023-12-08 04:15:00,589 - Epoch: [66][ 9800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525059    
+2023-12-08 04:15:52,987 - Epoch: [66][ 9900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525048    
+2023-12-08 04:16:45,395 - Epoch: [66][10000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525038    
+2023-12-08 04:17:37,812 - Epoch: [66][10100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525029    
+2023-12-08 04:18:30,233 - Epoch: [66][10200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525021    
+2023-12-08 04:19:22,702 - Epoch: [66][10300/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525017    
+2023-12-08 04:20:15,107 - Epoch: [66][10400/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525007    
+2023-12-08 04:21:07,500 - Epoch: [66][10500/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524997    
+2023-12-08 04:21:59,921 - Epoch: [66][10600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524989    
+2023-12-08 04:22:52,387 - Epoch: [66][10700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524986    
+2023-12-08 04:23:44,795 - Epoch: [66][10800/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.524977    
+2023-12-08 04:24:37,186 - Epoch: [66][10900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.524967    
+2023-12-08 04:25:29,613 - Epoch: [66][11000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524960    
+2023-12-08 04:26:22,052 - Epoch: [66][11100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524955    
+2023-12-08 04:27:14,419 - Epoch: [66][11200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524943    
+2023-12-08 04:28:06,852 - Epoch: [66][11300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524937    
+2023-12-08 04:28:59,257 - Epoch: [66][11400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524929    
+2023-12-08 04:29:51,680 - Epoch: [66][11500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524923    
+2023-12-08 04:30:44,068 - Epoch: [66][11600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524914    
+2023-12-08 04:31:36,474 - Epoch: [66][11700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524906    
+2023-12-08 04:32:28,904 - Epoch: [66][11800/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524901    
+2023-12-08 04:33:21,278 - Epoch: [66][11900/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524891    
+2023-12-08 04:34:13,759 - Epoch: [66][12000/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524890    
+2023-12-08 04:35:06,178 - Epoch: [66][12100/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524884    
+2023-12-08 04:35:41,683 - Epoch: [66][12168/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524868    
+2023-12-08 04:35:42,085 - --- validate (epoch=66)-----------
+2023-12-08 04:35:42,085 - 167951 samples (256 per mini-batch)
+2023-12-08 04:36:32,587 - Epoch: [66][  100/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-08 04:37:21,153 - Epoch: [66][  200/  657]    Loss 0.000000    Overall Loss 0.013940    
+2023-12-08 04:38:09,739 - Epoch: [66][  300/  657]    Loss 0.000000    Overall Loss 0.013920    
+2023-12-08 04:38:58,312 - Epoch: [66][  400/  657]    Loss 0.000000    Overall Loss 0.013907    
+2023-12-08 04:39:46,850 - Epoch: [66][  500/  657]    Loss 0.000000    Overall Loss 0.013894    
+2023-12-08 04:40:35,407 - Epoch: [66][  600/  657]    Loss 0.000000    Overall Loss 0.013899    
+2023-12-08 04:41:02,630 - Epoch: [66][  657/  657]    Loss 0.000000    Overall Loss 0.013900    
+2023-12-08 04:41:02,856 - ==> Overall Loss: 0.014
+
+2023-12-08 04:41:02,859 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 04:41:02,859 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 04:41:02,886 - 
+
+2023-12-08 04:41:02,886 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 04:42:05,763 - Epoch: [67][  100/12168]    Overall Loss 0.013350    Objective Loss 0.000000    Distill Loss 0.013350                                        LR 0.000008    Time 0.628733    
+2023-12-08 04:42:58,169 - Epoch: [67][  200/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.576382    
+2023-12-08 04:43:50,638 - Epoch: [67][  300/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.559138    
+2023-12-08 04:44:43,126 - Epoch: [67][  400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.550564    
+2023-12-08 04:45:35,540 - Epoch: [67][  500/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.545272    
+2023-12-08 04:46:27,893 - Epoch: [67][  600/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.541643    
+2023-12-08 04:47:20,223 - Epoch: [67][  700/12168]    Overall Loss 0.013304    Objective Loss 0.000000    Distill Loss 0.013304                                        LR 0.000008    Time 0.539018    
+2023-12-08 04:48:12,627 - Epoch: [67][  800/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.537143    
+2023-12-08 04:49:05,033 - Epoch: [67][  900/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.535685    
+2023-12-08 04:49:57,422 - Epoch: [67][ 1000/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.534502    
+2023-12-08 04:50:49,834 - Epoch: [67][ 1100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.533555    
+2023-12-08 04:51:42,266 - Epoch: [67][ 1200/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.532783    
+2023-12-08 04:52:34,646 - Epoch: [67][ 1300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.532089    
+2023-12-08 04:53:27,039 - Epoch: [67][ 1400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.531504    
+2023-12-08 04:54:19,405 - Epoch: [67][ 1500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.530979    
+2023-12-08 04:55:11,781 - Epoch: [67][ 1600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.530526    
+2023-12-08 04:56:04,158 - Epoch: [67][ 1700/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.530127    
+2023-12-08 04:56:56,595 - Epoch: [67][ 1800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.529805    
+2023-12-08 04:57:48,956 - Epoch: [67][ 1900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.529477    
+2023-12-08 04:58:41,373 - Epoch: [67][ 2000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.529210    
+2023-12-08 04:59:33,737 - Epoch: [67][ 2100/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528943    
+2023-12-08 05:00:26,124 - Epoch: [67][ 2200/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.528711    
+2023-12-08 05:01:18,496 - Epoch: [67][ 2300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.528493    
+2023-12-08 05:02:10,922 - Epoch: [67][ 2400/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.528315    
+2023-12-08 05:03:03,401 - Epoch: [67][ 2500/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.528172    
+2023-12-08 05:03:55,806 - Epoch: [67][ 2600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.528013    
+2023-12-08 05:04:48,235 - Epoch: [67][ 2700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527873    
+2023-12-08 05:05:40,705 - Epoch: [67][ 2800/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527759    
+2023-12-08 05:06:33,134 - Epoch: [67][ 2900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527638    
+2023-12-08 05:07:25,553 - Epoch: [67][ 3000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527522    
+2023-12-08 05:08:17,918 - Epoch: [67][ 3100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527396    
+2023-12-08 05:09:10,366 - Epoch: [67][ 3200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527304    
+2023-12-08 05:10:02,784 - Epoch: [67][ 3300/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.527208    
+2023-12-08 05:10:55,152 - Epoch: [67][ 3400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527103    
+2023-12-08 05:11:47,558 - Epoch: [67][ 3500/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.527015    
+2023-12-08 05:12:40,005 - Epoch: [67][ 3600/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.526944    
+2023-12-08 05:13:32,406 - Epoch: [67][ 3700/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526864    
+2023-12-08 05:14:24,842 - Epoch: [67][ 3800/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.526797    
+2023-12-08 05:15:17,233 - Epoch: [67][ 3900/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.526722    
+2023-12-08 05:16:09,693 - Epoch: [67][ 4000/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526668    
+2023-12-08 05:17:02,170 - Epoch: [67][ 4100/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526621    
+2023-12-08 05:17:54,528 - Epoch: [67][ 4200/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.526548    
+2023-12-08 05:18:46,889 - Epoch: [67][ 4300/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.526479    
+2023-12-08 05:19:39,304 - Epoch: [67][ 4400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526425    
+2023-12-08 05:20:31,719 - Epoch: [67][ 4500/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526374    
+2023-12-08 05:21:24,083 - Epoch: [67][ 4600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.526313    
+2023-12-08 05:22:16,480 - Epoch: [67][ 4700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.526263    
+2023-12-08 05:23:08,838 - Epoch: [67][ 4800/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.526206    
+2023-12-08 05:24:01,193 - Epoch: [67][ 4900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.526151    
+2023-12-08 05:24:53,586 - Epoch: [67][ 5000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.526106    
+2023-12-08 05:25:46,004 - Epoch: [67][ 5100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.526068    
+2023-12-08 05:26:38,394 - Epoch: [67][ 5200/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.526026    
+2023-12-08 05:27:30,804 - Epoch: [67][ 5300/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525989    
+2023-12-08 05:28:23,243 - Epoch: [67][ 5400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525958    
+2023-12-08 05:29:15,618 - Epoch: [67][ 5500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525918    
+2023-12-08 05:30:08,134 - Epoch: [67][ 5600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525903    
+2023-12-08 05:31:00,510 - Epoch: [67][ 5700/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525865    
+2023-12-08 05:31:52,995 - Epoch: [67][ 5800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525847    
+2023-12-08 05:32:45,411 - Epoch: [67][ 5900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525818    
+2023-12-08 05:33:37,834 - Epoch: [67][ 6000/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525791    
+2023-12-08 05:34:30,370 - Epoch: [67][ 6100/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525783    
+2023-12-08 05:35:22,776 - Epoch: [67][ 6200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525755    
+2023-12-08 05:36:15,243 - Epoch: [67][ 6300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525737    
+2023-12-08 05:37:07,621 - Epoch: [67][ 6400/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525706    
+2023-12-08 05:38:00,004 - Epoch: [67][ 6500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525677    
+2023-12-08 05:38:52,410 - Epoch: [67][ 6600/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525652    
+2023-12-08 05:39:44,868 - Epoch: [67][ 6700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525635    
+2023-12-08 05:40:37,249 - Epoch: [67][ 6800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525608    
+2023-12-08 05:41:29,617 - Epoch: [67][ 6900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525579    
+2023-12-08 05:42:21,940 - Epoch: [67][ 7000/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525546    
+2023-12-08 05:43:14,316 - Epoch: [67][ 7100/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525520    
+2023-12-08 05:44:06,682 - Epoch: [67][ 7200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525494    
+2023-12-08 05:44:59,072 - Epoch: [67][ 7300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525471    
+2023-12-08 05:45:51,507 - Epoch: [67][ 7400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525456    
+2023-12-08 05:46:43,830 - Epoch: [67][ 7500/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525426    
+2023-12-08 05:47:36,234 - Epoch: [67][ 7600/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525407    
+2023-12-08 05:48:28,677 - Epoch: [67][ 7700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525394    
+2023-12-08 05:49:21,114 - Epoch: [67][ 7800/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525380    
+2023-12-08 05:50:13,510 - Epoch: [67][ 7900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525362    
+2023-12-08 05:51:05,956 - Epoch: [67][ 8000/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525350    
+2023-12-08 05:51:58,437 - Epoch: [67][ 8100/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.525343    
+2023-12-08 05:52:50,848 - Epoch: [67][ 8200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525328    
+2023-12-08 05:53:43,244 - Epoch: [67][ 8300/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525311    
+2023-12-08 05:54:35,700 - Epoch: [67][ 8400/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525301    
+2023-12-08 05:55:28,150 - Epoch: [67][ 8500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.525292    
+2023-12-08 05:56:20,559 - Epoch: [67][ 8600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525277    
+2023-12-08 05:57:13,041 - Epoch: [67][ 8700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525272    
+2023-12-08 05:58:05,449 - Epoch: [67][ 8800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525258    
+2023-12-08 05:58:57,873 - Epoch: [67][ 8900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525246    
+2023-12-08 05:59:50,285 - Epoch: [67][ 9000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525233    
+2023-12-08 06:00:42,726 - Epoch: [67][ 9100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525224    
+2023-12-08 06:01:35,101 - Epoch: [67][ 9200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525207    
+2023-12-08 06:02:27,469 - Epoch: [67][ 9300/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525191    
+2023-12-08 06:03:19,817 - Epoch: [67][ 9400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525172    
+2023-12-08 06:04:12,264 - Epoch: [67][ 9500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525164    
+2023-12-08 06:05:04,685 - Epoch: [67][ 9600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525154    
+2023-12-08 06:05:57,250 - Epoch: [67][ 9700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525159    
+2023-12-08 06:06:49,667 - Epoch: [67][ 9800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525148    
+2023-12-08 06:07:42,062 - Epoch: [67][ 9900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525136    
+2023-12-08 06:08:34,532 - Epoch: [67][10000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525131    
+2023-12-08 06:09:26,927 - Epoch: [67][10100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525119    
+2023-12-08 06:10:19,329 - Epoch: [67][10200/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525108    
+2023-12-08 06:11:11,770 - Epoch: [67][10300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525101    
+2023-12-08 06:12:04,254 - Epoch: [67][10400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525098    
+2023-12-08 06:12:56,658 - Epoch: [67][10500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525088    
+2023-12-08 06:13:49,080 - Epoch: [67][10600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525079    
+2023-12-08 06:14:41,529 - Epoch: [67][10700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525073    
+2023-12-08 06:15:33,919 - Epoch: [67][10800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525062    
+2023-12-08 06:16:26,408 - Epoch: [67][10900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525060    
+2023-12-08 06:17:18,819 - Epoch: [67][11000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525051    
+2023-12-08 06:18:11,279 - Epoch: [67][11100/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525047    
+2023-12-08 06:19:03,761 - Epoch: [67][11200/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525045    
+2023-12-08 06:19:56,178 - Epoch: [67][11300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525037    
+2023-12-08 06:20:48,573 - Epoch: [67][11400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525027    
+2023-12-08 06:21:41,006 - Epoch: [67][11500/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.525020    
+2023-12-08 06:22:33,466 - Epoch: [67][11600/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.525017    
+2023-12-08 06:23:25,918 - Epoch: [67][11700/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.525012    
+2023-12-08 06:24:18,310 - Epoch: [67][11800/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.525002    
+2023-12-08 06:25:10,741 - Epoch: [67][11900/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524996    
+2023-12-08 06:26:03,144 - Epoch: [67][12000/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.524988    
+2023-12-08 06:26:55,554 - Epoch: [67][12100/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.524980    
+2023-12-08 06:27:31,115 - Epoch: [67][12168/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524969    
+2023-12-08 06:27:31,560 - --- validate (epoch=67)-----------
+2023-12-08 06:27:31,561 - 167951 samples (256 per mini-batch)
+2023-12-08 06:28:22,904 - Epoch: [67][  100/  657]    Loss 0.000000    Overall Loss 0.014059    
+2023-12-08 06:29:11,443 - Epoch: [67][  200/  657]    Loss 0.000000    Overall Loss 0.014022    
+2023-12-08 06:30:00,016 - Epoch: [67][  300/  657]    Loss 0.000000    Overall Loss 0.014000    
+2023-12-08 06:30:48,592 - Epoch: [67][  400/  657]    Loss 0.000000    Overall Loss 0.013991    
+2023-12-08 06:31:37,139 - Epoch: [67][  500/  657]    Loss 0.000000    Overall Loss 0.014001    
+2023-12-08 06:32:25,690 - Epoch: [67][  600/  657]    Loss 0.000000    Overall Loss 0.014001    
+2023-12-08 06:32:52,936 - Epoch: [67][  657/  657]    Loss 0.000000    Overall Loss 0.014006    
+2023-12-08 06:32:53,149 - ==> Overall Loss: 0.014
+
+2023-12-08 06:32:53,151 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 06:32:53,151 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 06:32:53,172 - 
+
+2023-12-08 06:32:53,172 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 06:33:55,330 - Epoch: [68][  100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.621543    
+2023-12-08 06:34:47,747 - Epoch: [68][  200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.572838    
+2023-12-08 06:35:40,201 - Epoch: [68][  300/12168]    Overall Loss 0.013352    Objective Loss 0.000000    Distill Loss 0.013352                                        LR 0.000008    Time 0.556727    
+2023-12-08 06:36:32,567 - Epoch: [68][  400/12168]    Overall Loss 0.013352    Objective Loss 0.000000    Distill Loss 0.013352                                        LR 0.000008    Time 0.548453    
+2023-12-08 06:37:25,035 - Epoch: [68][  500/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.543692    
+2023-12-08 06:38:17,473 - Epoch: [68][  600/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000008    Time 0.540467    
+2023-12-08 06:39:09,845 - Epoch: [68][  700/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.538070    
+2023-12-08 06:40:02,190 - Epoch: [68][  800/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.536238    
+2023-12-08 06:40:54,577 - Epoch: [68][  900/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.534860    
+2023-12-08 06:41:46,958 - Epoch: [68][ 1000/12168]    Overall Loss 0.013349    Objective Loss 0.000000    Distill Loss 0.013349                                        LR 0.000008    Time 0.533753    
+2023-12-08 06:42:39,318 - Epoch: [68][ 1100/12168]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                                        LR 0.000008    Time 0.532826    
+2023-12-08 06:43:31,707 - Epoch: [68][ 1200/12168]    Overall Loss 0.013350    Objective Loss 0.000000    Distill Loss 0.013350                                        LR 0.000008    Time 0.532079    
+2023-12-08 06:44:24,124 - Epoch: [68][ 1300/12168]    Overall Loss 0.013348    Objective Loss 0.000000    Distill Loss 0.013348                                        LR 0.000008    Time 0.531468    
+2023-12-08 06:45:16,486 - Epoch: [68][ 1400/12168]    Overall Loss 0.013349    Objective Loss 0.000000    Distill Loss 0.013349                                        LR 0.000008    Time 0.530905    
+2023-12-08 06:46:08,934 - Epoch: [68][ 1500/12168]    Overall Loss 0.013350    Objective Loss 0.000000    Distill Loss 0.013350                                        LR 0.000008    Time 0.530474    
+2023-12-08 06:47:01,433 - Epoch: [68][ 1600/12168]    Overall Loss 0.013349    Objective Loss 0.000000    Distill Loss 0.013349                                        LR 0.000008    Time 0.530129    
+2023-12-08 06:47:53,882 - Epoch: [68][ 1700/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000008    Time 0.529796    
+2023-12-08 06:48:46,265 - Epoch: [68][ 1800/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000008    Time 0.529463    
+2023-12-08 06:49:38,677 - Epoch: [68][ 1900/12168]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                                        LR 0.000008    Time 0.529179    
+2023-12-08 06:50:31,053 - Epoch: [68][ 2000/12168]    Overall Loss 0.013353    Objective Loss 0.000000    Distill Loss 0.013353                                        LR 0.000008    Time 0.528907    
+2023-12-08 06:51:23,477 - Epoch: [68][ 2100/12168]    Overall Loss 0.013355    Objective Loss 0.000000    Distill Loss 0.013355                                        LR 0.000008    Time 0.528683    
+2023-12-08 06:52:15,904 - Epoch: [68][ 2200/12168]    Overall Loss 0.013355    Objective Loss 0.000000    Distill Loss 0.013355                                        LR 0.000008    Time 0.528481    
+2023-12-08 06:53:08,331 - Epoch: [68][ 2300/12168]    Overall Loss 0.013353    Objective Loss 0.000000    Distill Loss 0.013353                                        LR 0.000008    Time 0.528296    
+2023-12-08 06:54:00,786 - Epoch: [68][ 2400/12168]    Overall Loss 0.013350    Objective Loss 0.000000    Distill Loss 0.013350                                        LR 0.000008    Time 0.528139    
+2023-12-08 06:54:53,251 - Epoch: [68][ 2500/12168]    Overall Loss 0.013348    Objective Loss 0.000000    Distill Loss 0.013348                                        LR 0.000008    Time 0.527997    
+2023-12-08 06:55:45,659 - Epoch: [68][ 2600/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.527846    
+2023-12-08 06:56:38,019 - Epoch: [68][ 2700/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.527687    
+2023-12-08 06:57:30,349 - Epoch: [68][ 2800/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.527530    
+2023-12-08 06:58:22,714 - Epoch: [68][ 2900/12168]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                                        LR 0.000008    Time 0.527394    
+2023-12-08 06:59:15,087 - Epoch: [68][ 3000/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.527271    
+2023-12-08 07:00:07,449 - Epoch: [68][ 3100/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.527153    
+2023-12-08 07:00:59,859 - Epoch: [68][ 3200/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.527056    
+2023-12-08 07:01:52,288 - Epoch: [68][ 3300/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.526972    
+2023-12-08 07:02:44,649 - Epoch: [68][ 3400/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.526871    
+2023-12-08 07:03:37,093 - Epoch: [68][ 3500/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.526801    
+2023-12-08 07:04:29,461 - Epoch: [68][ 3600/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.526713    
+2023-12-08 07:05:21,826 - Epoch: [68][ 3700/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526630    
+2023-12-08 07:06:14,258 - Epoch: [68][ 3800/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526568    
+2023-12-08 07:07:06,678 - Epoch: [68][ 3900/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526507    
+2023-12-08 07:07:59,017 - Epoch: [68][ 4000/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526428    
+2023-12-08 07:08:51,471 - Epoch: [68][ 4100/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526381    
+2023-12-08 07:09:43,851 - Epoch: [68][ 4200/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.526319    
+2023-12-08 07:10:36,225 - Epoch: [68][ 4300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526258    
+2023-12-08 07:11:28,528 - Epoch: [68][ 4400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526184    
+2023-12-08 07:12:20,859 - Epoch: [68][ 4500/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526119    
+2023-12-08 07:13:13,241 - Epoch: [68][ 4600/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.526069    
+2023-12-08 07:14:05,617 - Epoch: [68][ 4700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.526019    
+2023-12-08 07:14:58,037 - Epoch: [68][ 4800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525980    
+2023-12-08 07:15:50,409 - Epoch: [68][ 4900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525933    
+2023-12-08 07:16:42,786 - Epoch: [68][ 5000/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525889    
+2023-12-08 07:17:35,155 - Epoch: [68][ 5100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525846    
+2023-12-08 07:18:27,564 - Epoch: [68][ 5200/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525811    
+2023-12-08 07:19:19,972 - Epoch: [68][ 5300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525778    
+2023-12-08 07:20:12,377 - Epoch: [68][ 5400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525745    
+2023-12-08 07:21:04,740 - Epoch: [68][ 5500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525706    
+2023-12-08 07:21:57,238 - Epoch: [68][ 5600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525693    
+2023-12-08 07:22:49,695 - Epoch: [68][ 5700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525672    
+2023-12-08 07:23:42,151 - Epoch: [68][ 5800/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525653    
+2023-12-08 07:24:34,562 - Epoch: [68][ 5900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525626    
+2023-12-08 07:25:26,966 - Epoch: [68][ 6000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525599    
+2023-12-08 07:26:19,402 - Epoch: [68][ 6100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525578    
+2023-12-08 07:27:11,819 - Epoch: [68][ 6200/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525555    
+2023-12-08 07:28:04,181 - Epoch: [68][ 6300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525523    
+2023-12-08 07:28:56,608 - Epoch: [68][ 6400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525503    
+2023-12-08 07:29:49,014 - Epoch: [68][ 6500/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525481    
+2023-12-08 07:30:41,422 - Epoch: [68][ 6600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525459    
+2023-12-08 07:31:33,826 - Epoch: [68][ 6700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525437    
+2023-12-08 07:32:26,188 - Epoch: [68][ 6800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525410    
+2023-12-08 07:33:18,552 - Epoch: [68][ 6900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525384    
+2023-12-08 07:34:10,956 - Epoch: [68][ 7000/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525364    
+2023-12-08 07:35:03,317 - Epoch: [68][ 7100/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525339    
+2023-12-08 07:35:55,778 - Epoch: [68][ 7200/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.525328    
+2023-12-08 07:36:48,114 - Epoch: [68][ 7300/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525301    
+2023-12-08 07:37:40,611 - Epoch: [68][ 7400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525296    
+2023-12-08 07:38:33,021 - Epoch: [68][ 7500/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525280    
+2023-12-08 07:39:25,428 - Epoch: [68][ 7600/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525263    
+2023-12-08 07:40:17,828 - Epoch: [68][ 7700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525246    
+2023-12-08 07:41:10,273 - Epoch: [68][ 7800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525236    
+2023-12-08 07:42:02,749 - Epoch: [68][ 7900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525229    
+2023-12-08 07:42:55,098 - Epoch: [68][ 8000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525207    
+2023-12-08 07:43:47,474 - Epoch: [68][ 8100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525189    
+2023-12-08 07:44:39,958 - Epoch: [68][ 8200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525184    
+2023-12-08 07:45:32,370 - Epoch: [68][ 8300/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525171    
+2023-12-08 07:46:24,741 - Epoch: [68][ 8400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525153    
+2023-12-08 07:47:17,211 - Epoch: [68][ 8500/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525148    
+2023-12-08 07:48:09,592 - Epoch: [68][ 8600/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525132    
+2023-12-08 07:49:02,061 - Epoch: [68][ 8700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525126    
+2023-12-08 07:49:54,501 - Epoch: [68][ 8800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525117    
+2023-12-08 07:50:46,845 - Epoch: [68][ 8900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525098    
+2023-12-08 07:51:39,262 - Epoch: [68][ 9000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.525087    
+2023-12-08 07:52:31,648 - Epoch: [68][ 9100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525074    
+2023-12-08 07:53:24,066 - Epoch: [68][ 9200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525064    
+2023-12-08 07:54:16,369 - Epoch: [68][ 9300/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.525041    
+2023-12-08 07:55:08,873 - Epoch: [68][ 9400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525041    
+2023-12-08 07:56:01,267 - Epoch: [68][ 9500/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525029    
+2023-12-08 07:56:53,630 - Epoch: [68][ 9600/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525014    
+2023-12-08 07:57:46,011 - Epoch: [68][ 9700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.525001    
+2023-12-08 07:58:38,386 - Epoch: [68][ 9800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524988    
+2023-12-08 07:59:30,765 - Epoch: [68][ 9900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524976    
+2023-12-08 08:00:23,104 - Epoch: [68][10000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524960    
+2023-12-08 08:01:15,527 - Epoch: [68][10100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524952    
+2023-12-08 08:02:07,913 - Epoch: [68][10200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524941    
+2023-12-08 08:03:00,397 - Epoch: [68][10300/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524940    
+2023-12-08 08:03:52,823 - Epoch: [68][10400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524933    
+2023-12-08 08:04:45,189 - Epoch: [68][10500/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524920    
+2023-12-08 08:05:37,547 - Epoch: [68][10600/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524907    
+2023-12-08 08:06:30,019 - Epoch: [68][10700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524905    
+2023-12-08 08:07:22,418 - Epoch: [68][10800/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524897    
+2023-12-08 08:08:14,843 - Epoch: [68][10900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524890    
+2023-12-08 08:09:07,209 - Epoch: [68][11000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524879    
+2023-12-08 08:09:59,615 - Epoch: [68][11100/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.524871    
+2023-12-08 08:10:51,979 - Epoch: [68][11200/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524860    
+2023-12-08 08:11:44,415 - Epoch: [68][11300/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524855    
+2023-12-08 08:12:36,842 - Epoch: [68][11400/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524850    
+2023-12-08 08:13:29,251 - Epoch: [68][11500/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524843    
+2023-12-08 08:14:21,625 - Epoch: [68][11600/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524833    
+2023-12-08 08:15:14,056 - Epoch: [68][11700/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.524828    
+2023-12-08 08:16:06,416 - Epoch: [68][11800/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524818    
+2023-12-08 08:16:58,778 - Epoch: [68][11900/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524807    
+2023-12-08 08:17:51,254 - Epoch: [68][12000/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524807    
+2023-12-08 08:18:43,688 - Epoch: [68][12100/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.524803    
+2023-12-08 08:19:19,233 - Epoch: [68][12168/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.524791    
+2023-12-08 08:19:19,674 - --- validate (epoch=68)-----------
+2023-12-08 08:19:19,674 - 167951 samples (256 per mini-batch)
+2023-12-08 08:20:10,115 - Epoch: [68][  100/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-08 08:20:58,668 - Epoch: [68][  200/  657]    Loss 0.000000    Overall Loss 0.013908    
+2023-12-08 08:21:47,240 - Epoch: [68][  300/  657]    Loss 0.000000    Overall Loss 0.013903    
+2023-12-08 08:22:35,815 - Epoch: [68][  400/  657]    Loss 0.000000    Overall Loss 0.013909    
+2023-12-08 08:23:24,335 - Epoch: [68][  500/  657]    Loss 0.000000    Overall Loss 0.013918    
+2023-12-08 08:24:12,879 - Epoch: [68][  600/  657]    Loss 0.000000    Overall Loss 0.013914    
+2023-12-08 08:24:40,092 - Epoch: [68][  657/  657]    Loss 0.000000    Overall Loss 0.013914    
+2023-12-08 08:24:40,317 - ==> Overall Loss: 0.014
+
+2023-12-08 08:24:40,319 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 08:24:40,319 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 08:24:40,340 - 
+
+2023-12-08 08:24:40,340 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 08:25:41,545 - Epoch: [69][  100/12168]    Overall Loss 0.013279    Objective Loss 0.000000    Distill Loss 0.013279                                        LR 0.000008    Time 0.612009    
+2023-12-08 08:26:33,884 - Epoch: [69][  200/12168]    Overall Loss 0.013285    Objective Loss 0.000000    Distill Loss 0.013285                                        LR 0.000008    Time 0.567681    
+2023-12-08 08:27:26,295 - Epoch: [69][  300/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.553146    
+2023-12-08 08:28:18,737 - Epoch: [69][  400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.545958    
+2023-12-08 08:29:11,089 - Epoch: [69][  500/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.541463    
+2023-12-08 08:30:03,540 - Epoch: [69][  600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.538631    
+2023-12-08 08:30:55,947 - Epoch: [69][  700/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.536547    
+2023-12-08 08:31:48,334 - Epoch: [69][  800/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.534958    
+2023-12-08 08:32:40,746 - Epoch: [69][  900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.533749    
+2023-12-08 08:33:33,088 - Epoch: [69][ 1000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.532714    
+2023-12-08 08:34:25,439 - Epoch: [69][ 1100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.531874    
+2023-12-08 08:35:17,805 - Epoch: [69][ 1200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.531187    
+2023-12-08 08:36:10,215 - Epoch: [69][ 1300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.530638    
+2023-12-08 08:37:02,588 - Epoch: [69][ 1400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.530143    
+2023-12-08 08:37:54,953 - Epoch: [69][ 1500/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.529707    
+2023-12-08 08:38:47,335 - Epoch: [69][ 1600/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.529337    
+2023-12-08 08:39:39,692 - Epoch: [69][ 1700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.528996    
+2023-12-08 08:40:32,091 - Epoch: [69][ 1800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.528716    
+2023-12-08 08:41:24,535 - Epoch: [69][ 1900/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.528490    
+2023-12-08 08:42:16,921 - Epoch: [69][ 2000/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.528256    
+2023-12-08 08:43:09,331 - Epoch: [69][ 2100/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.528057    
+2023-12-08 08:44:01,670 - Epoch: [69][ 2200/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.527843    
+2023-12-08 08:44:54,045 - Epoch: [69][ 2300/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.527663    
+2023-12-08 08:45:46,453 - Epoch: [69][ 2400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.527513    
+2023-12-08 08:46:38,831 - Epoch: [69][ 2500/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.527362    
+2023-12-08 08:47:31,292 - Epoch: [69][ 2600/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527255    
+2023-12-08 08:48:23,724 - Epoch: [69][ 2700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.527145    
+2023-12-08 08:49:16,160 - Epoch: [69][ 2800/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.527044    
+2023-12-08 08:50:08,542 - Epoch: [69][ 2900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.526932    
+2023-12-08 08:51:00,946 - Epoch: [69][ 3000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.526835    
+2023-12-08 08:51:53,284 - Epoch: [69][ 3100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526722    
+2023-12-08 08:52:45,672 - Epoch: [69][ 3200/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526632    
+2023-12-08 08:53:38,046 - Epoch: [69][ 3300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526544    
+2023-12-08 08:54:30,387 - Epoch: [69][ 3400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526451    
+2023-12-08 08:55:22,806 - Epoch: [69][ 3500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526385    
+2023-12-08 08:56:15,163 - Epoch: [69][ 3600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526306    
+2023-12-08 08:57:07,555 - Epoch: [69][ 3700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526241    
+2023-12-08 08:57:59,935 - Epoch: [69][ 3800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.526175    
+2023-12-08 08:58:52,255 - Epoch: [69][ 3900/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.526098    
+2023-12-08 08:59:44,625 - Epoch: [69][ 4000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526038    
+2023-12-08 09:00:37,031 - Epoch: [69][ 4100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525989    
+2023-12-08 09:01:29,431 - Epoch: [69][ 4200/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525940    
+2023-12-08 09:02:21,854 - Epoch: [69][ 4300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525900    
+2023-12-08 09:03:14,217 - Epoch: [69][ 4400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525848    
+2023-12-08 09:04:06,577 - Epoch: [69][ 4500/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525797    
+2023-12-08 09:04:58,970 - Epoch: [69][ 4600/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525756    
+2023-12-08 09:05:51,305 - Epoch: [69][ 4700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525703    
+2023-12-08 09:06:43,661 - Epoch: [69][ 4800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525658    
+2023-12-08 09:07:36,005 - Epoch: [69][ 4900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525612    
+2023-12-08 09:08:28,444 - Epoch: [69][ 5000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525587    
+2023-12-08 09:09:20,751 - Epoch: [69][ 5100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525537    
+2023-12-08 09:10:13,243 - Epoch: [69][ 5200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525524    
+2023-12-08 09:11:05,627 - Epoch: [69][ 5300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525492    
+2023-12-08 09:11:58,034 - Epoch: [69][ 5400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525465    
+2023-12-08 09:12:50,404 - Epoch: [69][ 5500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525432    
+2023-12-08 09:13:42,782 - Epoch: [69][ 5600/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525402    
+2023-12-08 09:14:35,230 - Epoch: [69][ 5700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525385    
+2023-12-08 09:15:27,630 - Epoch: [69][ 5800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525361    
+2023-12-08 09:16:19,992 - Epoch: [69][ 5900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525331    
+2023-12-08 09:17:12,395 - Epoch: [69][ 6000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525309    
+2023-12-08 09:18:04,814 - Epoch: [69][ 6100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525290    
+2023-12-08 09:18:57,172 - Epoch: [69][ 6200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525262    
+2023-12-08 09:19:49,570 - Epoch: [69][ 6300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525241    
+2023-12-08 09:20:41,932 - Epoch: [69][ 6400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525215    
+2023-12-08 09:21:34,282 - Epoch: [69][ 6500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525188    
+2023-12-08 09:22:26,677 - Epoch: [69][ 6600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525169    
+2023-12-08 09:23:19,031 - Epoch: [69][ 6700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525144    
+2023-12-08 09:24:11,411 - Epoch: [69][ 6800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525124    
+2023-12-08 09:25:03,797 - Epoch: [69][ 6900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525105    
+2023-12-08 09:25:56,149 - Epoch: [69][ 7000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525082    
+2023-12-08 09:26:48,469 - Epoch: [69][ 7100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525055    
+2023-12-08 09:27:40,829 - Epoch: [69][ 7200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525034    
+2023-12-08 09:28:33,179 - Epoch: [69][ 7300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525013    
+2023-12-08 09:29:25,608 - Epoch: [69][ 7400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525003    
+2023-12-08 09:30:18,010 - Epoch: [69][ 7500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524989    
+2023-12-08 09:31:10,383 - Epoch: [69][ 7600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524972    
+2023-12-08 09:32:02,834 - Epoch: [69][ 7700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524966    
+2023-12-08 09:32:55,228 - Epoch: [69][ 7800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524952    
+2023-12-08 09:33:47,553 - Epoch: [69][ 7900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524930    
+2023-12-08 09:34:39,953 - Epoch: [69][ 8000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524918    
+2023-12-08 09:35:32,414 - Epoch: [69][ 8100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524914    
+2023-12-08 09:36:24,943 - Epoch: [69][ 8200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524918    
+2023-12-08 09:37:17,360 - Epoch: [69][ 8300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524909    
+2023-12-08 09:38:09,793 - Epoch: [69][ 8400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524901    
+2023-12-08 09:39:02,274 - Epoch: [69][ 8500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524900    
+2023-12-08 09:39:54,687 - Epoch: [69][ 8600/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524890    
+2023-12-08 09:40:47,125 - Epoch: [69][ 8700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524884    
+2023-12-08 09:41:39,523 - Epoch: [69][ 8800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524873    
+2023-12-08 09:42:31,941 - Epoch: [69][ 8900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524865    
+2023-12-08 09:43:24,287 - Epoch: [69][ 9000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524849    
+2023-12-08 09:44:16,662 - Epoch: [69][ 9100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524837    
+2023-12-08 09:45:09,054 - Epoch: [69][ 9200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524827    
+2023-12-08 09:46:01,413 - Epoch: [69][ 9300/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524813    
+2023-12-08 09:46:53,782 - Epoch: [69][ 9400/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524801    
+2023-12-08 09:47:46,211 - Epoch: [69][ 9500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524795    
+2023-12-08 09:48:38,625 - Epoch: [69][ 9600/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524788    
+2023-12-08 09:49:31,065 - Epoch: [69][ 9700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524783    
+2023-12-08 09:50:23,509 - Epoch: [69][ 9800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524780    
+2023-12-08 09:51:15,957 - Epoch: [69][ 9900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524776    
+2023-12-08 09:52:08,381 - Epoch: [69][10000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524770    
+2023-12-08 09:53:00,751 - Epoch: [69][10100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524759    
+2023-12-08 09:53:53,174 - Epoch: [69][10200/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524754    
+2023-12-08 09:54:45,570 - Epoch: [69][10300/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524746    
+2023-12-08 09:55:37,989 - Epoch: [69][10400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524740    
+2023-12-08 09:56:30,399 - Epoch: [69][10500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524734    
+2023-12-08 09:57:22,776 - Epoch: [69][10600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524725    
+2023-12-08 09:58:15,111 - Epoch: [69][10700/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524711    
+2023-12-08 09:59:07,509 - Epoch: [69][10800/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524704    
+2023-12-08 09:59:59,847 - Epoch: [69][10900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524692    
+2023-12-08 10:00:52,201 - Epoch: [69][11000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524681    
+2023-12-08 10:01:44,738 - Epoch: [69][11100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524687    
+2023-12-08 10:02:37,185 - Epoch: [69][11200/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.524685    
+2023-12-08 10:03:29,511 - Epoch: [69][11300/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524672    
+2023-12-08 10:04:21,933 - Epoch: [69][11400/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524668    
+2023-12-08 10:05:14,337 - Epoch: [69][11500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524662    
+2023-12-08 10:06:06,727 - Epoch: [69][11600/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524655    
+2023-12-08 10:06:59,143 - Epoch: [69][11700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524651    
+2023-12-08 10:07:51,566 - Epoch: [69][11800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524647    
+2023-12-08 10:08:43,925 - Epoch: [69][11900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524637    
+2023-12-08 10:09:36,328 - Epoch: [69][12000/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.524632    
+2023-12-08 10:10:28,804 - Epoch: [69][12100/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524633    
+2023-12-08 10:11:04,477 - Epoch: [69][12168/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.524633    
+2023-12-08 10:11:04,879 - --- validate (epoch=69)-----------
+2023-12-08 10:11:04,879 - 167951 samples (256 per mini-batch)
+2023-12-08 10:11:55,292 - Epoch: [69][  100/  657]    Loss 0.000000    Overall Loss 0.013917    
+2023-12-08 10:12:43,899 - Epoch: [69][  200/  657]    Loss 0.000000    Overall Loss 0.013936    
+2023-12-08 10:13:32,465 - Epoch: [69][  300/  657]    Loss 0.000000    Overall Loss 0.013930    
+2023-12-08 10:14:21,005 - Epoch: [69][  400/  657]    Loss 0.000000    Overall Loss 0.013928    
+2023-12-08 10:15:09,546 - Epoch: [69][  500/  657]    Loss 0.000000    Overall Loss 0.013935    
+2023-12-08 10:15:58,106 - Epoch: [69][  600/  657]    Loss 0.000000    Overall Loss 0.013941    
+2023-12-08 10:16:25,336 - Epoch: [69][  657/  657]    Loss 0.000000    Overall Loss 0.013942    
+2023-12-08 10:16:25,550 - ==> Overall Loss: 0.014
+
+2023-12-08 10:16:25,552 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 10:16:25,552 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 10:16:25,573 - 
+
+2023-12-08 10:16:25,573 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 10:17:28,630 - Epoch: [70][  100/12168]    Overall Loss 0.013298    Objective Loss 0.000000    Distill Loss 0.013298                                        LR 0.000008    Time 0.630527    
+2023-12-08 10:18:20,972 - Epoch: [70][  200/12168]    Overall Loss 0.013306    Objective Loss 0.000000    Distill Loss 0.013306                                        LR 0.000008    Time 0.576956    
+2023-12-08 10:19:13,369 - Epoch: [70][  300/12168]    Overall Loss 0.013302    Objective Loss 0.000000    Distill Loss 0.013302                                        LR 0.000008    Time 0.559286    
+2023-12-08 10:20:05,750 - Epoch: [70][  400/12168]    Overall Loss 0.013304    Objective Loss 0.000000    Distill Loss 0.013304                                        LR 0.000008    Time 0.550408    
+2023-12-08 10:20:58,162 - Epoch: [70][  500/12168]    Overall Loss 0.013299    Objective Loss 0.000000    Distill Loss 0.013299                                        LR 0.000008    Time 0.545144    
+2023-12-08 10:21:50,542 - Epoch: [70][  600/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.000008    Time 0.541581    
+2023-12-08 10:22:42,904 - Epoch: [70][  700/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.539010    
+2023-12-08 10:23:35,308 - Epoch: [70][  800/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.537135    
+2023-12-08 10:24:27,750 - Epoch: [70][  900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.535718    
+2023-12-08 10:25:20,087 - Epoch: [70][ 1000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.534480    
+2023-12-08 10:26:12,420 - Epoch: [70][ 1100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.533463    
+2023-12-08 10:27:04,854 - Epoch: [70][ 1200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.532701    
+2023-12-08 10:27:57,233 - Epoch: [70][ 1300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.532012    
+2023-12-08 10:28:49,604 - Epoch: [70][ 1400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.531417    
+2023-12-08 10:29:41,961 - Epoch: [70][ 1500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.530892    
+2023-12-08 10:30:34,296 - Epoch: [70][ 1600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.530418    
+2023-12-08 10:31:26,657 - Epoch: [70][ 1700/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.530016    
+2023-12-08 10:32:19,060 - Epoch: [70][ 1800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.529681    
+2023-12-08 10:33:11,391 - Epoch: [70][ 1900/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.529344    
+2023-12-08 10:34:03,754 - Epoch: [70][ 2000/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.529057    
+2023-12-08 10:34:56,092 - Epoch: [70][ 2100/12168]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                                        LR 0.000008    Time 0.528785    
+2023-12-08 10:35:48,552 - Epoch: [70][ 2200/12168]    Overall Loss 0.013344    Objective Loss 0.000000    Distill Loss 0.013344                                        LR 0.000008    Time 0.528593    
+2023-12-08 10:36:40,954 - Epoch: [70][ 2300/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528393    
+2023-12-08 10:37:33,405 - Epoch: [70][ 2400/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.528230    
+2023-12-08 10:38:25,780 - Epoch: [70][ 2500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.528049    
+2023-12-08 10:39:18,182 - Epoch: [70][ 2600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.527893    
+2023-12-08 10:40:10,576 - Epoch: [70][ 2700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.527745    
+2023-12-08 10:41:02,938 - Epoch: [70][ 2800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.527597    
+2023-12-08 10:41:55,324 - Epoch: [70][ 2900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.527467    
+2023-12-08 10:42:47,716 - Epoch: [70][ 3000/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.527347    
+2023-12-08 10:43:40,126 - Epoch: [70][ 3100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527242    
+2023-12-08 10:44:32,556 - Epoch: [70][ 3200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527149    
+2023-12-08 10:45:24,953 - Epoch: [70][ 3300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527051    
+2023-12-08 10:46:17,283 - Epoch: [70][ 3400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526940    
+2023-12-08 10:47:09,666 - Epoch: [70][ 3500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526850    
+2023-12-08 10:48:01,988 - Epoch: [70][ 3600/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526749    
+2023-12-08 10:48:54,385 - Epoch: [70][ 3700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526673    
+2023-12-08 10:49:46,798 - Epoch: [70][ 3800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.526605    
+2023-12-08 10:50:39,254 - Epoch: [70][ 3900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.526551    
+2023-12-08 10:51:31,697 - Epoch: [70][ 4000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526498    
+2023-12-08 10:52:24,065 - Epoch: [70][ 4100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526428    
+2023-12-08 10:53:16,474 - Epoch: [70][ 4200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526372    
+2023-12-08 10:54:08,822 - Epoch: [70][ 4300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526304    
+2023-12-08 10:55:01,212 - Epoch: [70][ 4400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526248    
+2023-12-08 10:55:53,543 - Epoch: [70][ 4500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526182    
+2023-12-08 10:56:45,856 - Epoch: [70][ 4600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526115    
+2023-12-08 10:57:38,257 - Epoch: [70][ 4700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526070    
+2023-12-08 10:58:30,565 - Epoch: [70][ 4800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526007    
+2023-12-08 10:59:22,939 - Epoch: [70][ 4900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525960    
+2023-12-08 11:00:15,368 - Epoch: [70][ 5000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525926    
+2023-12-08 11:01:07,776 - Epoch: [70][ 5100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525889    
+2023-12-08 11:02:00,181 - Epoch: [70][ 5200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525853    
+2023-12-08 11:02:52,508 - Epoch: [70][ 5300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525803    
+2023-12-08 11:03:44,828 - Epoch: [70][ 5400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525755    
+2023-12-08 11:04:37,242 - Epoch: [70][ 5500/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525725    
+2023-12-08 11:05:29,624 - Epoch: [70][ 5600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525690    
+2023-12-08 11:06:22,004 - Epoch: [70][ 5700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525656    
+2023-12-08 11:07:14,511 - Epoch: [70][ 5800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525646    
+2023-12-08 11:08:06,858 - Epoch: [70][ 5900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525608    
+2023-12-08 11:08:59,252 - Epoch: [70][ 6000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525580    
+2023-12-08 11:09:51,638 - Epoch: [70][ 6100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525551    
+2023-12-08 11:10:44,045 - Epoch: [70][ 6200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525527    
+2023-12-08 11:11:36,405 - Epoch: [70][ 6300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525496    
+2023-12-08 11:12:28,765 - Epoch: [70][ 6400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525465    
+2023-12-08 11:13:21,242 - Epoch: [70][ 6500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525454    
+2023-12-08 11:14:13,703 - Epoch: [70][ 6600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525441    
+2023-12-08 11:15:06,112 - Epoch: [70][ 6700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525420    
+2023-12-08 11:15:58,463 - Epoch: [70][ 6800/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525392    
+2023-12-08 11:16:50,896 - Epoch: [70][ 6900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525376    
+2023-12-08 11:17:43,272 - Epoch: [70][ 7000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525352    
+2023-12-08 11:18:35,723 - Epoch: [70][ 7100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525340    
+2023-12-08 11:19:28,100 - Epoch: [70][ 7200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525318    
+2023-12-08 11:20:20,553 - Epoch: [70][ 7300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525306    
+2023-12-08 11:21:12,921 - Epoch: [70][ 7400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525284    
+2023-12-08 11:22:05,298 - Epoch: [70][ 7500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525263    
+2023-12-08 11:22:57,661 - Epoch: [70][ 7600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525241    
+2023-12-08 11:23:50,047 - Epoch: [70][ 7700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525223    
+2023-12-08 11:24:42,467 - Epoch: [70][ 7800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525210    
+2023-12-08 11:25:34,855 - Epoch: [70][ 7900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525192    
+2023-12-08 11:26:27,192 - Epoch: [70][ 8000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525169    
+2023-12-08 11:27:19,572 - Epoch: [70][ 8100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525152    
+2023-12-08 11:28:11,939 - Epoch: [70][ 8200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525133    
+2023-12-08 11:29:04,315 - Epoch: [70][ 8300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525116    
+2023-12-08 11:29:56,688 - Epoch: [70][ 8400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525100    
+2023-12-08 11:30:49,067 - Epoch: [70][ 8500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525084    
+2023-12-08 11:31:41,462 - Epoch: [70][ 8600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525070    
+2023-12-08 11:32:33,828 - Epoch: [70][ 8700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525054    
+2023-12-08 11:33:26,265 - Epoch: [70][ 8800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525045    
+2023-12-08 11:34:18,712 - Epoch: [70][ 8900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525039    
+2023-12-08 11:35:11,111 - Epoch: [70][ 9000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525027    
+2023-12-08 11:36:03,522 - Epoch: [70][ 9100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525016    
+2023-12-08 11:36:55,967 - Epoch: [70][ 9200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525010    
+2023-12-08 11:37:48,407 - Epoch: [70][ 9300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525003    
+2023-12-08 11:38:40,782 - Epoch: [70][ 9400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524989    
+2023-12-08 11:39:33,196 - Epoch: [70][ 9500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524980    
+2023-12-08 11:40:25,580 - Epoch: [70][ 9600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524967    
+2023-12-08 11:41:17,886 - Epoch: [70][ 9700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524948    
+2023-12-08 11:42:10,269 - Epoch: [70][ 9800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524936    
+2023-12-08 11:43:02,624 - Epoch: [70][ 9900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524921    
+2023-12-08 11:43:55,045 - Epoch: [70][10000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524914    
+2023-12-08 11:44:47,401 - Epoch: [70][10100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524900    
+2023-12-08 11:45:39,865 - Epoch: [70][10200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524897    
+2023-12-08 11:46:32,306 - Epoch: [70][10300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524892    
+2023-12-08 11:47:24,728 - Epoch: [70][10400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524885    
+2023-12-08 11:48:17,123 - Epoch: [70][10500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524876    
+2023-12-08 11:49:09,507 - Epoch: [70][10600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524866    
+2023-12-08 11:50:01,952 - Epoch: [70][10700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524862    
+2023-12-08 11:50:54,407 - Epoch: [70][10800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524859    
+2023-12-08 11:51:46,773 - Epoch: [70][10900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524847    
+2023-12-08 11:52:39,176 - Epoch: [70][11000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524840    
+2023-12-08 11:53:31,633 - Epoch: [70][11100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524837    
+2023-12-08 11:54:23,927 - Epoch: [70][11200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524820    
+2023-12-08 11:55:16,312 - Epoch: [70][11300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524811    
+2023-12-08 11:56:08,722 - Epoch: [70][11400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524804    
+2023-12-08 11:57:01,072 - Epoch: [70][11500/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524793    
+2023-12-08 11:57:53,461 - Epoch: [70][11600/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524785    
+2023-12-08 11:58:45,905 - Epoch: [70][11700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524781    
+2023-12-08 11:59:38,305 - Epoch: [70][11800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524775    
+2023-12-08 12:00:30,722 - Epoch: [70][11900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524769    
+2023-12-08 12:01:23,155 - Epoch: [70][12000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524765    
+2023-12-08 12:02:15,497 - Epoch: [70][12100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524754    
+2023-12-08 12:02:51,173 - Epoch: [70][12168/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524753    
+2023-12-08 12:02:51,588 - --- validate (epoch=70)-----------
+2023-12-08 12:02:51,588 - 167951 samples (256 per mini-batch)
+2023-12-08 12:03:42,032 - Epoch: [70][  100/  657]    Loss 0.000000    Overall Loss 0.014028    
+2023-12-08 12:04:30,563 - Epoch: [70][  200/  657]    Loss 0.000000    Overall Loss 0.013997    
+2023-12-08 12:05:19,099 - Epoch: [70][  300/  657]    Loss 0.000000    Overall Loss 0.013991    
+2023-12-08 12:06:07,622 - Epoch: [70][  400/  657]    Loss 0.000000    Overall Loss 0.014005    
+2023-12-08 12:06:56,158 - Epoch: [70][  500/  657]    Loss 0.000000    Overall Loss 0.014001    
+2023-12-08 12:07:44,694 - Epoch: [70][  600/  657]    Loss 0.000000    Overall Loss 0.014006    
+2023-12-08 12:08:11,909 - Epoch: [70][  657/  657]    Loss 0.000000    Overall Loss 0.014012    
+2023-12-08 12:08:12,135 - ==> Overall Loss: 0.014
+
+2023-12-08 12:08:12,137 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 12:08:12,137 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 12:08:12,165 - 
+
+2023-12-08 12:08:12,165 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 12:09:13,248 - Epoch: [71][  100/12168]    Overall Loss 0.013280    Objective Loss 0.000000    Distill Loss 0.013280                                        LR 0.000008    Time 0.610786    
+2023-12-08 12:10:05,602 - Epoch: [71][  200/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.000008    Time 0.567149    
+2023-12-08 12:10:58,024 - Epoch: [71][  300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.552827    
+2023-12-08 12:11:50,390 - Epoch: [71][  400/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.545528    
+2023-12-08 12:12:42,801 - Epoch: [71][  500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.541237    
+2023-12-08 12:13:35,138 - Epoch: [71][  600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.538254    
+2023-12-08 12:14:27,489 - Epoch: [71][  700/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.536143    
+2023-12-08 12:15:19,846 - Epoch: [71][  800/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.534567    
+2023-12-08 12:16:12,231 - Epoch: [71][  900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.533373    
+2023-12-08 12:17:04,640 - Epoch: [71][ 1000/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.532441    
+2023-12-08 12:17:57,160 - Epoch: [71][ 1100/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.531779    
+2023-12-08 12:18:49,632 - Epoch: [71][ 1200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.531189    
+2023-12-08 12:19:41,978 - Epoch: [71][ 1300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.530592    
+2023-12-08 12:20:34,416 - Epoch: [71][ 1400/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.530145    
+2023-12-08 12:21:26,855 - Epoch: [71][ 1500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.529759    
+2023-12-08 12:22:19,271 - Epoch: [71][ 1600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.529407    
+2023-12-08 12:23:11,734 - Epoch: [71][ 1700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.529124    
+2023-12-08 12:24:04,086 - Epoch: [71][ 1800/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.528811    
+2023-12-08 12:24:56,420 - Epoch: [71][ 1900/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.528521    
+2023-12-08 12:25:48,762 - Epoch: [71][ 2000/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.528264    
+2023-12-08 12:26:41,172 - Epoch: [71][ 2100/12168]    Overall Loss 0.013341    Objective Loss 0.000000    Distill Loss 0.013341                                        LR 0.000008    Time 0.528065    
+2023-12-08 12:27:33,509 - Epoch: [71][ 2200/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.527850    
+2023-12-08 12:28:25,846 - Epoch: [71][ 2300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.527654    
+2023-12-08 12:29:18,198 - Epoch: [71][ 2400/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527480    
+2023-12-08 12:30:10,667 - Epoch: [71][ 2500/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527367    
+2023-12-08 12:31:03,043 - Epoch: [71][ 2600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.527227    
+2023-12-08 12:31:55,427 - Epoch: [71][ 2700/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527100    
+2023-12-08 12:32:47,801 - Epoch: [71][ 2800/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.526979    
+2023-12-08 12:33:40,157 - Epoch: [71][ 2900/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.526860    
+2023-12-08 12:34:32,563 - Epoch: [71][ 3000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.526766    
+2023-12-08 12:35:25,041 - Epoch: [71][ 3100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526700    
+2023-12-08 12:36:17,456 - Epoch: [71][ 3200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526620    
+2023-12-08 12:37:09,790 - Epoch: [71][ 3300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526519    
+2023-12-08 12:38:02,202 - Epoch: [71][ 3400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526447    
+2023-12-08 12:38:54,548 - Epoch: [71][ 3500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526361    
+2023-12-08 12:39:46,897 - Epoch: [71][ 3600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.526281    
+2023-12-08 12:40:39,229 - Epoch: [71][ 3700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526200    
+2023-12-08 12:41:31,712 - Epoch: [71][ 3800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526163    
+2023-12-08 12:42:24,117 - Epoch: [71][ 3900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526108    
+2023-12-08 12:43:16,481 - Epoch: [71][ 4000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526045    
+2023-12-08 12:44:08,797 - Epoch: [71][ 4100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525974    
+2023-12-08 12:45:01,206 - Epoch: [71][ 4200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525928    
+2023-12-08 12:45:53,649 - Epoch: [71][ 4300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525893    
+2023-12-08 12:46:46,039 - Epoch: [71][ 4400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525847    
+2023-12-08 12:47:38,382 - Epoch: [71][ 4500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525792    
+2023-12-08 12:48:30,772 - Epoch: [71][ 4600/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525750    
+2023-12-08 12:49:23,134 - Epoch: [71][ 4700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525704    
+2023-12-08 12:50:15,650 - Epoch: [71][ 4800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525692    
+2023-12-08 12:51:08,099 - Epoch: [71][ 4900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525667    
+2023-12-08 12:52:00,441 - Epoch: [71][ 5000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525621    
+2023-12-08 12:52:52,811 - Epoch: [71][ 5100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525583    
+2023-12-08 12:53:45,135 - Epoch: [71][ 5200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525537    
+2023-12-08 12:54:37,547 - Epoch: [71][ 5300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525510    
+2023-12-08 12:55:29,915 - Epoch: [71][ 5400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525475    
+2023-12-08 12:56:22,298 - Epoch: [71][ 5500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525445    
+2023-12-08 12:57:14,673 - Epoch: [71][ 5600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525414    
+2023-12-08 12:58:07,069 - Epoch: [71][ 5700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525388    
+2023-12-08 12:58:59,522 - Epoch: [71][ 5800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525372    
+2023-12-08 12:59:51,971 - Epoch: [71][ 5900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525357    
+2023-12-08 13:00:44,345 - Epoch: [71][ 6000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525330    
+2023-12-08 13:01:36,762 - Epoch: [71][ 6100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525310    
+2023-12-08 13:02:29,147 - Epoch: [71][ 6200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525286    
+2023-12-08 13:03:21,489 - Epoch: [71][ 6300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525256    
+2023-12-08 13:04:13,810 - Epoch: [71][ 6400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525223    
+2023-12-08 13:05:06,154 - Epoch: [71][ 6500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525195    
+2023-12-08 13:05:58,512 - Epoch: [71][ 6600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525170    
+2023-12-08 13:06:50,904 - Epoch: [71][ 6700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525151    
+2023-12-08 13:07:43,260 - Epoch: [71][ 6800/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525127    
+2023-12-08 13:08:35,641 - Epoch: [71][ 6900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525108    
+2023-12-08 13:09:28,072 - Epoch: [71][ 7000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525096    
+2023-12-08 13:10:20,397 - Epoch: [71][ 7100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525069    
+2023-12-08 13:11:12,753 - Epoch: [71][ 7200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525048    
+2023-12-08 13:12:05,111 - Epoch: [71][ 7300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525027    
+2023-12-08 13:12:57,519 - Epoch: [71][ 7400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525014    
+2023-12-08 13:13:49,851 - Epoch: [71][ 7500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524991    
+2023-12-08 13:14:42,218 - Epoch: [71][ 7600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524973    
+2023-12-08 13:15:34,618 - Epoch: [71][ 7700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524960    
+2023-12-08 13:16:26,968 - Epoch: [71][ 7800/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524941    
+2023-12-08 13:17:19,373 - Epoch: [71][ 7900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524929    
+2023-12-08 13:18:11,675 - Epoch: [71][ 8000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524905    
+2023-12-08 13:19:04,037 - Epoch: [71][ 8100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524889    
+2023-12-08 13:19:56,397 - Epoch: [71][ 8200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524873    
+2023-12-08 13:20:48,800 - Epoch: [71][ 8300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524862    
+2023-12-08 13:21:41,143 - Epoch: [71][ 8400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524845    
+2023-12-08 13:22:33,502 - Epoch: [71][ 8500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524830    
+2023-12-08 13:23:25,963 - Epoch: [71][ 8600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524827    
+2023-12-08 13:24:18,422 - Epoch: [71][ 8700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524824    
+2023-12-08 13:25:10,792 - Epoch: [71][ 8800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524810    
+2023-12-08 13:26:03,282 - Epoch: [71][ 8900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524811    
+2023-12-08 13:26:55,675 - Epoch: [71][ 9000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524801    
+2023-12-08 13:27:48,042 - Epoch: [71][ 9100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524788    
+2023-12-08 13:28:40,466 - Epoch: [71][ 9200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524782    
+2023-12-08 13:29:32,827 - Epoch: [71][ 9300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524769    
+2023-12-08 13:30:25,328 - Epoch: [71][ 9400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524771    
+2023-12-08 13:31:17,736 - Epoch: [71][ 9500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524763    
+2023-12-08 13:32:10,194 - Epoch: [71][ 9600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524761    
+2023-12-08 13:33:02,592 - Epoch: [71][ 9700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524753    
+2023-12-08 13:33:54,993 - Epoch: [71][ 9800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524745    
+2023-12-08 13:34:47,377 - Epoch: [71][ 9900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524735    
+2023-12-08 13:35:39,745 - Epoch: [71][10000/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524724    
+2023-12-08 13:36:32,144 - Epoch: [71][10100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524717    
+2023-12-08 13:37:24,513 - Epoch: [71][10200/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524706    
+2023-12-08 13:38:16,900 - Epoch: [71][10300/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524698    
+2023-12-08 13:39:09,278 - Epoch: [71][10400/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524689    
+2023-12-08 13:40:01,572 - Epoch: [71][10500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524672    
+2023-12-08 13:40:53,952 - Epoch: [71][10600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524663    
+2023-12-08 13:41:46,388 - Epoch: [71][10700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524660    
+2023-12-08 13:42:38,850 - Epoch: [71][10800/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524659    
+2023-12-08 13:43:31,261 - Epoch: [71][10900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524654    
+2023-12-08 13:44:23,585 - Epoch: [71][11000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524641    
+2023-12-08 13:45:15,979 - Epoch: [71][11100/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.524634    
+2023-12-08 13:46:08,389 - Epoch: [71][11200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524629    
+2023-12-08 13:47:00,787 - Epoch: [71][11300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524623    
+2023-12-08 13:47:53,140 - Epoch: [71][11400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524613    
+2023-12-08 13:48:45,575 - Epoch: [71][11500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.524611    
+2023-12-08 13:49:37,966 - Epoch: [71][11600/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524604    
+2023-12-08 13:50:30,360 - Epoch: [71][11700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524598    
+2023-12-08 13:51:22,716 - Epoch: [71][11800/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524589    
+2023-12-08 13:52:15,056 - Epoch: [71][11900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524579    
+2023-12-08 13:53:07,442 - Epoch: [71][12000/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524573    
+2023-12-08 13:53:59,878 - Epoch: [71][12100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524571    
+2023-12-08 13:54:35,426 - Epoch: [71][12168/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.524561    
+2023-12-08 13:54:35,849 - --- validate (epoch=71)-----------
+2023-12-08 13:54:35,849 - 167951 samples (256 per mini-batch)
+2023-12-08 13:55:26,249 - Epoch: [71][  100/  657]    Loss 0.000000    Overall Loss 0.013988    
+2023-12-08 13:56:14,794 - Epoch: [71][  200/  657]    Loss 0.000000    Overall Loss 0.013993    
+2023-12-08 13:57:03,387 - Epoch: [71][  300/  657]    Loss 0.000000    Overall Loss 0.014001    
+2023-12-08 13:57:51,910 - Epoch: [71][  400/  657]    Loss 0.000000    Overall Loss 0.013998    
+2023-12-08 13:58:40,444 - Epoch: [71][  500/  657]    Loss 0.000000    Overall Loss 0.013998    
+2023-12-08 13:59:28,981 - Epoch: [71][  600/  657]    Loss 0.000000    Overall Loss 0.014001    
+2023-12-08 13:59:56,198 - Epoch: [71][  657/  657]    Loss 0.000000    Overall Loss 0.014004    
+2023-12-08 13:59:56,416 - ==> Overall Loss: 0.014
+
+2023-12-08 13:59:56,419 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 13:59:56,419 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 13:59:56,440 - 
+
+2023-12-08 13:59:56,440 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 14:00:57,853 - Epoch: [72][  100/12168]    Overall Loss 0.013279    Objective Loss 0.000000    Distill Loss 0.013279                                        LR 0.000008    Time 0.614095    
+2023-12-08 14:01:50,199 - Epoch: [72][  200/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.568757    
+2023-12-08 14:02:42,539 - Epoch: [72][  300/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.553629    
+2023-12-08 14:03:34,843 - Epoch: [72][  400/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.545973    
+2023-12-08 14:04:27,221 - Epoch: [72][  500/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.541528    
+2023-12-08 14:05:19,587 - Epoch: [72][  600/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.538543    
+2023-12-08 14:06:11,880 - Epoch: [72][  700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.536309    
+2023-12-08 14:07:04,194 - Epoch: [72][  800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.534659    
+2023-12-08 14:07:56,509 - Epoch: [72][  900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.533376    
+2023-12-08 14:08:48,940 - Epoch: [72][ 1000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.532466    
+2023-12-08 14:09:41,254 - Epoch: [72][ 1100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.531616    
+2023-12-08 14:10:33,628 - Epoch: [72][ 1200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.530957    
+2023-12-08 14:11:25,964 - Epoch: [72][ 1300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.530370    
+2023-12-08 14:12:18,342 - Epoch: [72][ 1400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.529896    
+2023-12-08 14:13:10,731 - Epoch: [72][ 1500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.529494    
+2023-12-08 14:14:03,116 - Epoch: [72][ 1600/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.529139    
+2023-12-08 14:14:55,418 - Epoch: [72][ 1700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.528777    
+2023-12-08 14:15:47,760 - Epoch: [72][ 1800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.528478    
+2023-12-08 14:16:40,087 - Epoch: [72][ 1900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.528202    
+2023-12-08 14:17:32,469 - Epoch: [72][ 2000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527981    
+2023-12-08 14:18:24,818 - Epoch: [72][ 2100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527766    
+2023-12-08 14:19:17,182 - Epoch: [72][ 2200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527576    
+2023-12-08 14:20:09,510 - Epoch: [72][ 2300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.527388    
+2023-12-08 14:21:01,894 - Epoch: [72][ 2400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.527239    
+2023-12-08 14:21:54,261 - Epoch: [72][ 2500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.527095    
+2023-12-08 14:22:46,599 - Epoch: [72][ 2600/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526951    
+2023-12-08 14:23:38,995 - Epoch: [72][ 2700/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526839    
+2023-12-08 14:24:31,378 - Epoch: [72][ 2800/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526730    
+2023-12-08 14:25:23,698 - Epoch: [72][ 2900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526607    
+2023-12-08 14:26:16,101 - Epoch: [72][ 3000/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526520    
+2023-12-08 14:27:08,529 - Epoch: [72][ 3100/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.526447    
+2023-12-08 14:28:01,010 - Epoch: [72][ 3200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.526394    
+2023-12-08 14:28:53,383 - Epoch: [72][ 3300/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526313    
+2023-12-08 14:29:45,753 - Epoch: [72][ 3400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526235    
+2023-12-08 14:30:38,136 - Epoch: [72][ 3500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526165    
+2023-12-08 14:31:30,564 - Epoch: [72][ 3600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526112    
+2023-12-08 14:32:23,012 - Epoch: [72][ 3700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526067    
+2023-12-08 14:33:15,415 - Epoch: [72][ 3800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526012    
+2023-12-08 14:34:07,759 - Epoch: [72][ 3900/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525946    
+2023-12-08 14:35:00,238 - Epoch: [72][ 4000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525916    
+2023-12-08 14:35:52,739 - Epoch: [72][ 4100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525893    
+2023-12-08 14:36:45,333 - Epoch: [72][ 4200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525893    
+2023-12-08 14:37:37,918 - Epoch: [72][ 4300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525891    
+2023-12-08 14:38:30,425 - Epoch: [72][ 4400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525872    
+2023-12-08 14:39:22,826 - Epoch: [72][ 4500/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525830    
+2023-12-08 14:40:15,378 - Epoch: [72][ 4600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525822    
+2023-12-08 14:41:07,973 - Epoch: [72][ 4700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525824    
+2023-12-08 14:42:00,492 - Epoch: [72][ 4800/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525810    
+2023-12-08 14:42:52,962 - Epoch: [72][ 4900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525787    
+2023-12-08 14:43:45,450 - Epoch: [72][ 5000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525768    
+2023-12-08 14:44:38,091 - Epoch: [72][ 5100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525780    
+2023-12-08 14:45:30,651 - Epoch: [72][ 5200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525776    
+2023-12-08 14:46:23,073 - Epoch: [72][ 5300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525746    
+2023-12-08 14:47:15,495 - Epoch: [72][ 5400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525717    
+2023-12-08 14:48:07,918 - Epoch: [72][ 5500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525689    
+2023-12-08 14:49:00,385 - Epoch: [72][ 5600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525670    
+2023-12-08 14:49:52,835 - Epoch: [72][ 5700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525649    
+2023-12-08 14:50:45,364 - Epoch: [72][ 5800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525642    
+2023-12-08 14:51:37,834 - Epoch: [72][ 5900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525626    
+2023-12-08 14:52:30,311 - Epoch: [72][ 6000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525611    
+2023-12-08 14:53:22,934 - Epoch: [72][ 6100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525621    
+2023-12-08 14:54:15,515 - Epoch: [72][ 6200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525623    
+2023-12-08 14:55:08,051 - Epoch: [72][ 6300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525618    
+2023-12-08 14:56:00,674 - Epoch: [72][ 6400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525627    
+2023-12-08 14:56:53,192 - Epoch: [72][ 6500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525620    
+2023-12-08 14:57:45,681 - Epoch: [72][ 6600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525608    
+2023-12-08 14:58:38,166 - Epoch: [72][ 6700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525596    
+2023-12-08 14:59:30,637 - Epoch: [72][ 6800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525583    
+2023-12-08 15:00:23,126 - Epoch: [72][ 6900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525572    
+2023-12-08 15:01:15,614 - Epoch: [72][ 7000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525562    
+2023-12-08 15:02:08,158 - Epoch: [72][ 7100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525560    
+2023-12-08 15:03:00,747 - Epoch: [72][ 7200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525564    
+2023-12-08 15:03:53,232 - Epoch: [72][ 7300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525554    
+2023-12-08 15:04:45,749 - Epoch: [72][ 7400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525548    
+2023-12-08 15:05:38,264 - Epoch: [72][ 7500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525542    
+2023-12-08 15:06:30,715 - Epoch: [72][ 7600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525528    
+2023-12-08 15:07:23,262 - Epoch: [72][ 7700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525527    
+2023-12-08 15:08:15,859 - Epoch: [72][ 7800/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525532    
+2023-12-08 15:09:08,499 - Epoch: [72][ 7900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525543    
+2023-12-08 15:10:01,010 - Epoch: [72][ 8000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525537    
+2023-12-08 15:10:53,526 - Epoch: [72][ 8100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525532    
+2023-12-08 15:11:46,026 - Epoch: [72][ 8200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525525    
+2023-12-08 15:12:38,754 - Epoch: [72][ 8300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525546    
+2023-12-08 15:13:31,192 - Epoch: [72][ 8400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525531    
+2023-12-08 15:14:23,664 - Epoch: [72][ 8500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525521    
+2023-12-08 15:15:16,123 - Epoch: [72][ 8600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525510    
+2023-12-08 15:16:08,512 - Epoch: [72][ 8700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525491    
+2023-12-08 15:17:00,875 - Epoch: [72][ 8800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525470    
+2023-12-08 15:17:53,279 - Epoch: [72][ 8900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525453    
+2023-12-08 15:18:45,742 - Epoch: [72][ 9000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525444    
+2023-12-08 15:19:38,358 - Epoch: [72][ 9100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525451    
+2023-12-08 15:20:30,833 - Epoch: [72][ 9200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525443    
+2023-12-08 15:21:23,294 - Epoch: [72][ 9300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525434    
+2023-12-08 15:22:15,697 - Epoch: [72][ 9400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525418    
+2023-12-08 15:23:08,172 - Epoch: [72][ 9500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525411    
+2023-12-08 15:24:00,592 - Epoch: [72][ 9600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525398    
+2023-12-08 15:24:53,009 - Epoch: [72][ 9700/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525385    
+2023-12-08 15:25:45,440 - Epoch: [72][ 9800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525374    
+2023-12-08 15:26:37,889 - Epoch: [72][ 9900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525365    
+2023-12-08 15:27:30,310 - Epoch: [72][10000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525353    
+2023-12-08 15:28:22,754 - Epoch: [72][10100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.525343    
+2023-12-08 15:29:15,223 - Epoch: [72][10200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525337    
+2023-12-08 15:30:07,739 - Epoch: [72][10300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525334    
+2023-12-08 15:31:00,122 - Epoch: [72][10400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525320    
+2023-12-08 15:31:52,542 - Epoch: [72][10500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525309    
+2023-12-08 15:32:44,960 - Epoch: [72][10600/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525298    
+2023-12-08 15:33:37,424 - Epoch: [72][10700/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525291    
+2023-12-08 15:34:29,871 - Epoch: [72][10800/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525283    
+2023-12-08 15:35:22,289 - Epoch: [72][10900/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525273    
+2023-12-08 15:36:14,691 - Epoch: [72][11000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.525261    
+2023-12-08 15:37:07,162 - Epoch: [72][11100/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525256    
+2023-12-08 15:37:59,593 - Epoch: [72][11200/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525247    
+2023-12-08 15:38:52,036 - Epoch: [72][11300/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525240    
+2023-12-08 15:39:44,456 - Epoch: [72][11400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525230    
+2023-12-08 15:40:36,869 - Epoch: [72][11500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525220    
+2023-12-08 15:41:29,216 - Epoch: [72][11600/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525205    
+2023-12-08 15:42:21,592 - Epoch: [72][11700/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525192    
+2023-12-08 15:43:13,989 - Epoch: [72][11800/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525182    
+2023-12-08 15:44:06,447 - Epoch: [72][11900/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525176    
+2023-12-08 15:44:58,865 - Epoch: [72][12000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.525168    
+2023-12-08 15:45:51,289 - Epoch: [72][12100/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525160    
+2023-12-08 15:46:26,810 - Epoch: [72][12168/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.525144    
+2023-12-08 15:46:27,264 - --- validate (epoch=72)-----------
+2023-12-08 15:46:27,264 - 167951 samples (256 per mini-batch)
+2023-12-08 15:47:18,130 - Epoch: [72][  100/  657]    Loss 0.000000    Overall Loss 0.014078    
+2023-12-08 15:48:06,740 - Epoch: [72][  200/  657]    Loss 0.000000    Overall Loss 0.014066    
+2023-12-08 15:48:55,329 - Epoch: [72][  300/  657]    Loss 0.000000    Overall Loss 0.014069    
+2023-12-08 15:49:43,938 - Epoch: [72][  400/  657]    Loss 0.000000    Overall Loss 0.014077    
+2023-12-08 15:50:32,517 - Epoch: [72][  500/  657]    Loss 0.000000    Overall Loss 0.014073    
+2023-12-08 15:51:21,119 - Epoch: [72][  600/  657]    Loss 0.000000    Overall Loss 0.014065    
+2023-12-08 15:51:48,376 - Epoch: [72][  657/  657]    Loss 0.000000    Overall Loss 0.014070    
+2023-12-08 15:51:48,579 - ==> Overall Loss: 0.014
+
+2023-12-08 15:51:48,580 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 15:51:48,581 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 15:51:48,601 - 
+
+2023-12-08 15:51:48,601 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 15:52:50,280 - Epoch: [73][  100/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.616752    
+2023-12-08 15:53:42,658 - Epoch: [73][  200/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.000008    Time 0.570247    
+2023-12-08 15:54:35,045 - Epoch: [73][  300/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.554778    
+2023-12-08 15:55:27,353 - Epoch: [73][  400/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.546846    
+2023-12-08 15:56:19,778 - Epoch: [73][  500/12168]    Overall Loss 0.013301    Objective Loss 0.000000    Distill Loss 0.013301                                        LR 0.000008    Time 0.542318    
+2023-12-08 15:57:12,150 - Epoch: [73][  600/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.539213    
+2023-12-08 15:58:04,497 - Epoch: [73][  700/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.536959    
+2023-12-08 15:58:56,947 - Epoch: [73][  800/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.535397    
+2023-12-08 15:59:49,325 - Epoch: [73][  900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.534104    
+2023-12-08 16:00:41,710 - Epoch: [73][ 1000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.533075    
+2023-12-08 16:01:34,129 - Epoch: [73][ 1100/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.532264    
+2023-12-08 16:02:26,535 - Epoch: [73][ 1200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.531578    
+2023-12-08 16:03:18,965 - Epoch: [73][ 1300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.531015    
+2023-12-08 16:04:11,341 - Epoch: [73][ 1400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.530495    
+2023-12-08 16:05:03,720 - Epoch: [73][ 1500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.530045    
+2023-12-08 16:05:56,089 - Epoch: [73][ 1600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.529646    
+2023-12-08 16:06:48,514 - Epoch: [73][ 1700/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.529327    
+2023-12-08 16:07:40,869 - Epoch: [73][ 1800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.529004    
+2023-12-08 16:08:33,287 - Epoch: [73][ 1900/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.528749    
+2023-12-08 16:09:25,609 - Epoch: [73][ 2000/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.528470    
+2023-12-08 16:10:18,101 - Epoch: [73][ 2100/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.528299    
+2023-12-08 16:11:10,505 - Epoch: [73][ 2200/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.528105    
+2023-12-08 16:12:02,932 - Epoch: [73][ 2300/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.527936    
+2023-12-08 16:12:55,332 - Epoch: [73][ 2400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527771    
+2023-12-08 16:13:47,709 - Epoch: [73][ 2500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527609    
+2023-12-08 16:14:40,147 - Epoch: [73][ 2600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.527484    
+2023-12-08 16:15:32,482 - Epoch: [73][ 2700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.527330    
+2023-12-08 16:16:24,824 - Epoch: [73][ 2800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527189    
+2023-12-08 16:17:17,308 - Epoch: [73][ 2900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.527107    
+2023-12-08 16:18:09,672 - Epoch: [73][ 3000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526990    
+2023-12-08 16:19:02,030 - Epoch: [73][ 3100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526879    
+2023-12-08 16:19:54,467 - Epoch: [73][ 3200/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526800    
+2023-12-08 16:20:46,847 - Epoch: [73][ 3300/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526708    
+2023-12-08 16:21:39,228 - Epoch: [73][ 3400/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526621    
+2023-12-08 16:22:31,758 - Epoch: [73][ 3500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526583    
+2023-12-08 16:23:27,343 - Epoch: [73][ 3600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.527394    
+2023-12-08 16:24:19,833 - Epoch: [73][ 3700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.527326    
+2023-12-08 16:25:12,330 - Epoch: [73][ 3800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.527263    
+2023-12-08 16:26:04,835 - Epoch: [73][ 3900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.527205    
+2023-12-08 16:26:57,514 - Epoch: [73][ 4000/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.527194    
+2023-12-08 16:28:46,054 - Epoch: [73][ 4100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.540807    
+2023-12-08 16:31:14,100 - Epoch: [73][ 4200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.563177    
+2023-12-08 16:33:41,609 - Epoch: [73][ 4300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.584382    
+2023-12-08 16:36:13,154 - Epoch: [73][ 4400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.605540    
+2023-12-08 16:38:43,095 - Epoch: [73][ 4500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.625402    
+2023-12-08 16:41:22,849 - Epoch: [73][ 4600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.646533    
+2023-12-08 16:44:00,039 - Epoch: [73][ 4700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.666220    
+2023-12-08 16:46:56,128 - Epoch: [73][ 4800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.689023    
+2023-12-08 16:49:22,888 - Epoch: [73][ 4900/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.704911    
+2023-12-08 16:50:46,110 - Epoch: [73][ 5000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.707456    
+2023-12-08 16:51:42,744 - Epoch: [73][ 5100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.704688    
+2023-12-08 16:52:37,377 - Epoch: [73][ 5200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.701642    
+2023-12-08 16:53:31,823 - Epoch: [73][ 5300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.698675    
+2023-12-08 16:54:26,984 - Epoch: [73][ 5400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.695951    
+2023-12-08 16:55:22,020 - Epoch: [73][ 5500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.693303    
+2023-12-08 16:56:15,582 - Epoch: [73][ 5600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.690486    
+2023-12-08 16:57:09,455 - Epoch: [73][ 5700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.687823    
+2023-12-08 16:58:02,846 - Epoch: [73][ 5800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.685168    
+2023-12-08 16:58:56,475 - Epoch: [73][ 5900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.682644    
+2023-12-08 16:59:52,206 - Epoch: [73][ 6000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.680555    
+2023-12-08 17:00:45,175 - Epoch: [73][ 6100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.678081    
+2023-12-08 17:01:37,639 - Epoch: [73][ 6200/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.675605    
+2023-12-08 17:02:30,153 - Epoch: [73][ 6300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.673216    
+2023-12-08 17:03:22,615 - Epoch: [73][ 6400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.670894    
+2023-12-08 17:04:15,157 - Epoch: [73][ 6500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.668655    
+2023-12-08 17:05:07,740 - Epoch: [73][ 6600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.666491    
+2023-12-08 17:06:00,254 - Epoch: [73][ 6700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.664380    
+2023-12-08 17:06:52,907 - Epoch: [73][ 6800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.662353    
+2023-12-08 17:07:45,421 - Epoch: [73][ 6900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.660364    
+2023-12-08 17:08:37,985 - Epoch: [73][ 7000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.658438    
+2023-12-08 17:09:30,474 - Epoch: [73][ 7100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.656557    
+2023-12-08 17:10:22,967 - Epoch: [73][ 7200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.654728    
+2023-12-08 17:11:15,461 - Epoch: [73][ 7300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.652950    
+2023-12-08 17:12:08,041 - Epoch: [73][ 7400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.651231    
+2023-12-08 17:13:00,523 - Epoch: [73][ 7500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.649545    
+2023-12-08 17:13:53,158 - Epoch: [73][ 7600/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.647924    
+2023-12-08 17:14:45,681 - Epoch: [73][ 7700/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.646330    
+2023-12-08 17:15:38,286 - Epoch: [73][ 7800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.644787    
+2023-12-08 17:16:30,788 - Epoch: [73][ 7900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.643271    
+2023-12-08 17:17:23,302 - Epoch: [73][ 8000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.641794    
+2023-12-08 17:18:15,861 - Epoch: [73][ 8100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.640359    
+2023-12-08 17:19:08,324 - Epoch: [73][ 8200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.638947    
+2023-12-08 17:20:00,933 - Epoch: [73][ 8300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.637587    
+2023-12-08 17:20:53,421 - Epoch: [73][ 8400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.636244    
+2023-12-08 17:21:45,951 - Epoch: [73][ 8500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.634939    
+2023-12-08 17:22:38,377 - Epoch: [73][ 8600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.633652    
+2023-12-08 17:23:30,827 - Epoch: [73][ 8700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.632397    
+2023-12-08 17:24:23,273 - Epoch: [73][ 8800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.631170    
+2023-12-08 17:25:15,645 - Epoch: [73][ 8900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.629962    
+2023-12-08 17:26:08,116 - Epoch: [73][ 9000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.628792    
+2023-12-08 17:27:00,542 - Epoch: [73][ 9100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.627643    
+2023-12-08 17:27:52,957 - Epoch: [73][ 9200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.626518    
+2023-12-08 17:28:45,400 - Epoch: [73][ 9300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.625420    
+2023-12-08 17:29:37,871 - Epoch: [73][ 9400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.624348    
+2023-12-08 17:30:30,321 - Epoch: [73][ 9500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.623297    
+2023-12-08 17:31:22,815 - Epoch: [73][ 9600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.622272    
+2023-12-08 17:32:15,233 - Epoch: [73][ 9700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.621260    
+2023-12-08 17:33:07,702 - Epoch: [73][ 9800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.620274    
+2023-12-08 17:34:00,119 - Epoch: [73][ 9900/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.619303    
+2023-12-08 17:34:52,601 - Epoch: [73][10000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.618358    
+2023-12-08 17:35:45,079 - Epoch: [73][10100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.617431    
+2023-12-08 17:36:37,524 - Epoch: [73][10200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.616519    
+2023-12-08 17:37:29,978 - Epoch: [73][10300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.615626    
+2023-12-08 17:38:22,388 - Epoch: [73][10400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.614746    
+2023-12-08 17:39:14,824 - Epoch: [73][10500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.613884    
+2023-12-08 17:40:07,205 - Epoch: [73][10600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.613034    
+2023-12-08 17:40:59,700 - Epoch: [73][10700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.612211    
+2023-12-08 17:41:52,168 - Epoch: [73][10800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.611400    
+2023-12-08 17:42:44,612 - Epoch: [73][10900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.610602    
+2023-12-08 17:43:37,064 - Epoch: [73][11000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.609819    
+2023-12-08 17:44:29,482 - Epoch: [73][11100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.609047    
+2023-12-08 17:45:21,878 - Epoch: [73][11200/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.608287    
+2023-12-08 17:46:14,369 - Epoch: [73][11300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.607549    
+2023-12-08 17:47:06,815 - Epoch: [73][11400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.606820    
+2023-12-08 17:47:59,272 - Epoch: [73][11500/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.606104    
+2023-12-08 17:48:51,709 - Epoch: [73][11600/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.605399    
+2023-12-08 17:49:44,199 - Epoch: [73][11700/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.604711    
+2023-12-08 17:50:36,718 - Epoch: [73][11800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.604037    
+2023-12-08 17:51:29,234 - Epoch: [73][11900/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.603374    
+2023-12-08 17:52:21,640 - Epoch: [73][12000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.602713    
+2023-12-08 17:53:14,111 - Epoch: [73][12100/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.602068    
+2023-12-08 17:53:49,787 - Epoch: [73][12168/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.601635    
+2023-12-08 17:53:50,211 - --- validate (epoch=73)-----------
+2023-12-08 17:53:50,211 - 167951 samples (256 per mini-batch)
+2023-12-08 17:54:41,417 - Epoch: [73][  100/  657]    Loss 0.000000    Overall Loss 0.014010    
+2023-12-08 17:55:30,061 - Epoch: [73][  200/  657]    Loss 0.000000    Overall Loss 0.013998    
+2023-12-08 17:56:18,675 - Epoch: [73][  300/  657]    Loss 0.000000    Overall Loss 0.013999    
+2023-12-08 17:57:07,267 - Epoch: [73][  400/  657]    Loss 0.000000    Overall Loss 0.014003    
+2023-12-08 17:57:55,852 - Epoch: [73][  500/  657]    Loss 0.000000    Overall Loss 0.014000    
+2023-12-08 17:58:44,451 - Epoch: [73][  600/  657]    Loss 0.000000    Overall Loss 0.014000    
+2023-12-08 17:59:11,703 - Epoch: [73][  657/  657]    Loss 0.000000    Overall Loss 0.014003    
+2023-12-08 17:59:11,925 - ==> Overall Loss: 0.014
+
+2023-12-08 17:59:11,927 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 17:59:11,927 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 17:59:11,948 - 
+
+2023-12-08 17:59:11,948 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 18:00:12,321 - Epoch: [74][  100/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.603686    
+2023-12-08 18:01:04,680 - Epoch: [74][  200/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.563618    
+2023-12-08 18:01:57,084 - Epoch: [74][  300/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.550414    
+2023-12-08 18:02:49,441 - Epoch: [74][  400/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.543695    
+2023-12-08 18:03:41,826 - Epoch: [74][  500/12168]    Overall Loss 0.013304    Objective Loss 0.000000    Distill Loss 0.013304                                        LR 0.000008    Time 0.539720    
+2023-12-08 18:04:34,136 - Epoch: [74][  600/12168]    Overall Loss 0.013303    Objective Loss 0.000000    Distill Loss 0.013303                                        LR 0.000008    Time 0.536944    
+2023-12-08 18:05:26,480 - Epoch: [74][  700/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.535010    
+2023-12-08 18:06:18,880 - Epoch: [74][  800/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.533630    
+2023-12-08 18:07:11,225 - Epoch: [74][  900/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.532495    
+2023-12-08 18:08:03,653 - Epoch: [74][ 1000/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.531670    
+2023-12-08 18:08:56,556 - Epoch: [74][ 1100/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.531426    
+2023-12-08 18:09:48,868 - Epoch: [74][ 1200/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.530732    
+2023-12-08 18:10:41,268 - Epoch: [74][ 1300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.530212    
+2023-12-08 18:11:33,699 - Epoch: [74][ 1400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.529787    
+2023-12-08 18:12:26,121 - Epoch: [74][ 1500/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.529414    
+2023-12-08 18:13:18,499 - Epoch: [74][ 1600/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.529060    
+2023-12-08 18:14:10,897 - Epoch: [74][ 1700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.528759    
+2023-12-08 18:15:03,294 - Epoch: [74][ 1800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528491    
+2023-12-08 18:15:55,664 - Epoch: [74][ 1900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528237    
+2023-12-08 18:16:48,072 - Epoch: [74][ 2000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528028    
+2023-12-08 18:17:40,464 - Epoch: [74][ 2100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.527831    
+2023-12-08 18:18:32,901 - Epoch: [74][ 2200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.527672    
+2023-12-08 18:19:25,387 - Epoch: [74][ 2300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.527548    
+2023-12-08 18:20:17,717 - Epoch: [74][ 2400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.527370    
+2023-12-08 18:21:10,059 - Epoch: [74][ 2500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.527210    
+2023-12-08 18:22:02,509 - Epoch: [74][ 2600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.527105    
+2023-12-08 18:22:54,915 - Epoch: [74][ 2700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526991    
+2023-12-08 18:23:47,337 - Epoch: [74][ 2800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526890    
+2023-12-08 18:24:39,698 - Epoch: [74][ 2900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526776    
+2023-12-08 18:25:32,025 - Epoch: [74][ 3000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526658    
+2023-12-08 18:26:24,460 - Epoch: [74][ 3100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526583    
+2023-12-08 18:27:16,925 - Epoch: [74][ 3200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526521    
+2023-12-08 18:28:09,281 - Epoch: [74][ 3300/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526431    
+2023-12-08 18:29:01,640 - Epoch: [74][ 3400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526346    
+2023-12-08 18:29:54,043 - Epoch: [74][ 3500/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526279    
+2023-12-08 18:30:46,429 - Epoch: [74][ 3600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526211    
+2023-12-08 18:31:38,844 - Epoch: [74][ 3700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526154    
+2023-12-08 18:32:31,263 - Epoch: [74][ 3800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526102    
+2023-12-08 18:33:23,648 - Epoch: [74][ 3900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.526043    
+2023-12-08 18:34:16,086 - Epoch: [74][ 4000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526001    
+2023-12-08 18:35:08,491 - Epoch: [74][ 4100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525952    
+2023-12-08 18:36:00,907 - Epoch: [74][ 4200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525909    
+2023-12-08 18:36:53,335 - Epoch: [74][ 4300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525870    
+2023-12-08 18:37:45,770 - Epoch: [74][ 4400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525835    
+2023-12-08 18:38:38,350 - Epoch: [74][ 4500/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525833    
+2023-12-08 18:39:30,754 - Epoch: [74][ 4600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525793    
+2023-12-08 18:40:23,194 - Epoch: [74][ 4700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525763    
+2023-12-08 18:41:15,645 - Epoch: [74][ 4800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525736    
+2023-12-08 18:42:08,047 - Epoch: [74][ 4900/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525701    
+2023-12-08 18:43:00,457 - Epoch: [74][ 5000/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525668    
+2023-12-08 18:43:52,849 - Epoch: [74][ 5100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525633    
+2023-12-08 18:44:45,315 - Epoch: [74][ 5200/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525613    
+2023-12-08 18:45:37,754 - Epoch: [74][ 5300/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525590    
+2023-12-08 18:46:30,108 - Epoch: [74][ 5400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525551    
+2023-12-08 18:47:22,472 - Epoch: [74][ 5500/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525516    
+2023-12-08 18:48:14,949 - Epoch: [74][ 5600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525502    
+2023-12-08 18:49:07,445 - Epoch: [74][ 5700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525492    
+2023-12-08 18:49:59,837 - Epoch: [74][ 5800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525464    
+2023-12-08 18:50:52,239 - Epoch: [74][ 5900/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525439    
+2023-12-08 18:51:44,712 - Epoch: [74][ 6000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525427    
+2023-12-08 18:52:37,093 - Epoch: [74][ 6100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525400    
+2023-12-08 18:53:29,504 - Epoch: [74][ 6200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525378    
+2023-12-08 18:54:21,941 - Epoch: [74][ 6300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525362    
+2023-12-08 18:55:14,357 - Epoch: [74][ 6400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525343    
+2023-12-08 18:56:06,766 - Epoch: [74][ 6500/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525323    
+2023-12-08 18:56:59,235 - Epoch: [74][ 6600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525313    
+2023-12-08 18:57:51,634 - Epoch: [74][ 6700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525292    
+2023-12-08 18:58:44,086 - Epoch: [74][ 6800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525281    
+2023-12-08 18:59:36,484 - Epoch: [74][ 6900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525261    
+2023-12-08 19:00:28,979 - Epoch: [74][ 7000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525256    
+2023-12-08 19:01:21,456 - Epoch: [74][ 7100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525249    
+2023-12-08 19:02:13,904 - Epoch: [74][ 7200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525238    
+2023-12-08 19:03:06,297 - Epoch: [74][ 7300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525220    
+2023-12-08 19:03:58,723 - Epoch: [74][ 7400/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525206    
+2023-12-08 19:04:51,106 - Epoch: [74][ 7500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525187    
+2023-12-08 19:05:43,599 - Epoch: [74][ 7600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525183    
+2023-12-08 19:06:36,034 - Epoch: [74][ 7700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525172    
+2023-12-08 19:07:28,517 - Epoch: [74][ 7800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525167    
+2023-12-08 19:08:21,080 - Epoch: [74][ 7900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525173    
+2023-12-08 19:09:13,476 - Epoch: [74][ 8000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525157    
+2023-12-08 19:10:05,918 - Epoch: [74][ 8100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525148    
+2023-12-08 19:10:58,325 - Epoch: [74][ 8200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525134    
+2023-12-08 19:11:50,778 - Epoch: [74][ 8300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525126    
+2023-12-08 19:12:43,225 - Epoch: [74][ 8400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525118    
+2023-12-08 19:13:35,708 - Epoch: [74][ 8500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525114    
+2023-12-08 19:14:28,155 - Epoch: [74][ 8600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525107    
+2023-12-08 19:15:20,660 - Epoch: [74][ 8700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525105    
+2023-12-08 19:16:13,117 - Epoch: [74][ 8800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525099    
+2023-12-08 19:17:05,588 - Epoch: [74][ 8900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525094    
+2023-12-08 19:17:58,006 - Epoch: [74][ 9000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525084    
+2023-12-08 19:18:50,421 - Epoch: [74][ 9100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525073    
+2023-12-08 19:19:42,840 - Epoch: [74][ 9200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525063    
+2023-12-08 19:20:35,271 - Epoch: [74][ 9300/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525055    
+2023-12-08 19:21:27,756 - Epoch: [74][ 9400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525052    
+2023-12-08 19:22:20,178 - Epoch: [74][ 9500/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525043    
+2023-12-08 19:23:12,625 - Epoch: [74][ 9600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525037    
+2023-12-08 19:24:05,054 - Epoch: [74][ 9700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525029    
+2023-12-08 19:24:57,507 - Epoch: [74][ 9800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525023    
+2023-12-08 19:25:50,003 - Epoch: [74][ 9900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.525022    
+2023-12-08 19:26:42,406 - Epoch: [74][10000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525012    
+2023-12-08 19:27:34,815 - Epoch: [74][10100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525003    
+2023-12-08 19:28:27,277 - Epoch: [74][10200/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524998    
+2023-12-08 19:29:19,732 - Epoch: [74][10300/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524994    
+2023-12-08 19:30:12,283 - Epoch: [74][10400/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.524998    
+2023-12-08 19:31:04,953 - Epoch: [74][10500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525014    
+2023-12-08 19:31:57,425 - Epoch: [74][10600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525011    
+2023-12-08 19:32:49,916 - Epoch: [74][10700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525010    
+2023-12-08 19:33:42,405 - Epoch: [74][10800/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525008    
+2023-12-08 19:34:34,887 - Epoch: [74][10900/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.525006    
+2023-12-08 19:35:27,331 - Epoch: [74][11000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.525001    
+2023-12-08 19:36:19,800 - Epoch: [74][11100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.524998    
+2023-12-08 19:37:12,370 - Epoch: [74][11200/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.525004    
+2023-12-08 19:38:04,774 - Epoch: [74][11300/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524995    
+2023-12-08 19:38:57,153 - Epoch: [74][11400/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524984    
+2023-12-08 19:39:49,554 - Epoch: [74][11500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524975    
+2023-12-08 19:40:41,950 - Epoch: [74][11600/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524966    
+2023-12-08 19:41:34,351 - Epoch: [74][11700/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.524958    
+2023-12-08 19:42:26,817 - Epoch: [74][11800/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524955    
+2023-12-08 19:43:19,334 - Epoch: [74][11900/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524957    
+2023-12-08 19:44:11,756 - Epoch: [74][12000/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524950    
+2023-12-08 19:45:04,332 - Epoch: [74][12100/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524957    
+2023-12-08 19:45:39,909 - Epoch: [74][12168/12168]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                                        LR 0.000008    Time 0.524947    
+2023-12-08 19:45:40,288 - --- validate (epoch=74)-----------
+2023-12-08 19:45:40,288 - 167951 samples (256 per mini-batch)
+2023-12-08 19:46:31,029 - Epoch: [74][  100/  657]    Loss 0.000000    Overall Loss 0.013896    
+2023-12-08 19:47:19,605 - Epoch: [74][  200/  657]    Loss 0.000000    Overall Loss 0.013901    
+2023-12-08 19:48:08,149 - Epoch: [74][  300/  657]    Loss 0.000000    Overall Loss 0.013894    
+2023-12-08 19:48:56,693 - Epoch: [74][  400/  657]    Loss 0.000000    Overall Loss 0.013899    
+2023-12-08 19:49:45,248 - Epoch: [74][  500/  657]    Loss 0.000000    Overall Loss 0.013907    
+2023-12-08 19:50:33,790 - Epoch: [74][  600/  657]    Loss 0.000000    Overall Loss 0.013919    
+2023-12-08 19:51:01,026 - Epoch: [74][  657/  657]    Loss 0.000000    Overall Loss 0.013922    
+2023-12-08 19:51:01,226 - ==> Overall Loss: 0.014
+
+2023-12-08 19:51:01,228 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 19:51:01,228 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 19:51:01,249 - 
+
+2023-12-08 19:51:01,249 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 19:52:04,261 - Epoch: [75][  100/12168]    Overall Loss 0.013262    Objective Loss 0.000000    Distill Loss 0.013262                                        LR 0.000008    Time 0.630090    
+2023-12-08 19:52:56,676 - Epoch: [75][  200/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.577103    
+2023-12-08 19:53:49,054 - Epoch: [75][  300/12168]    Overall Loss 0.013301    Objective Loss 0.000000    Distill Loss 0.013301                                        LR 0.000008    Time 0.559316    
+2023-12-08 19:54:41,487 - Epoch: [75][  400/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.550560    
+2023-12-08 19:55:33,909 - Epoch: [75][  500/12168]    Overall Loss 0.013304    Objective Loss 0.000000    Distill Loss 0.013304                                        LR 0.000008    Time 0.545287    
+2023-12-08 19:56:26,385 - Epoch: [75][  600/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.541860    
+2023-12-08 19:57:18,882 - Epoch: [75][  700/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.539441    
+2023-12-08 19:58:11,295 - Epoch: [75][  800/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.537523    
+2023-12-08 19:59:03,694 - Epoch: [75][  900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.536016    
+2023-12-08 19:59:56,141 - Epoch: [75][ 1000/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.534858    
+2023-12-08 20:00:48,486 - Epoch: [75][ 1100/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.533818    
+2023-12-08 20:01:40,891 - Epoch: [75][ 1200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.533001    
+2023-12-08 20:02:33,373 - Epoch: [75][ 1300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.532369    
+2023-12-08 20:03:25,822 - Epoch: [75][ 1400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.531804    
+2023-12-08 20:04:18,242 - Epoch: [75][ 1500/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.531295    
+2023-12-08 20:05:10,738 - Epoch: [75][ 1600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.530896    
+2023-12-08 20:06:03,088 - Epoch: [75][ 1700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.530460    
+2023-12-08 20:06:55,459 - Epoch: [75][ 1800/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.530082    
+2023-12-08 20:07:47,829 - Epoch: [75][ 1900/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.529745    
+2023-12-08 20:08:40,226 - Epoch: [75][ 2000/12168]    Overall Loss 0.013340    Objective Loss 0.000000    Distill Loss 0.013340                                        LR 0.000008    Time 0.529455    
+2023-12-08 20:09:32,606 - Epoch: [75][ 2100/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.529184    
+2023-12-08 20:10:25,030 - Epoch: [75][ 2200/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.528958    
+2023-12-08 20:11:17,485 - Epoch: [75][ 2300/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.528764    
+2023-12-08 20:12:09,895 - Epoch: [75][ 2400/12168]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                                        LR 0.000008    Time 0.528569    
+2023-12-08 20:13:02,291 - Epoch: [75][ 2500/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.528383    
+2023-12-08 20:13:54,709 - Epoch: [75][ 2600/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.528220    
+2023-12-08 20:14:47,063 - Epoch: [75][ 2700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.528046    
+2023-12-08 20:15:39,447 - Epoch: [75][ 2800/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527894    
+2023-12-08 20:16:31,875 - Epoch: [75][ 2900/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.527769    
+2023-12-08 20:17:24,298 - Epoch: [75][ 3000/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.527650    
+2023-12-08 20:18:16,687 - Epoch: [75][ 3100/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527527    
+2023-12-08 20:19:09,028 - Epoch: [75][ 3200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527397    
+2023-12-08 20:20:01,419 - Epoch: [75][ 3300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.527291    
+2023-12-08 20:20:53,775 - Epoch: [75][ 3400/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527180    
+2023-12-08 20:21:46,131 - Epoch: [75][ 3500/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.527076    
+2023-12-08 20:22:38,564 - Epoch: [75][ 3600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.526998    
+2023-12-08 20:23:30,998 - Epoch: [75][ 3700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526925    
+2023-12-08 20:24:23,359 - Epoch: [75][ 3800/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.526838    
+2023-12-08 20:25:15,747 - Epoch: [75][ 3900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.526761    
+2023-12-08 20:26:08,142 - Epoch: [75][ 4000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526690    
+2023-12-08 20:27:00,555 - Epoch: [75][ 4100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526626    
+2023-12-08 20:27:52,967 - Epoch: [75][ 4200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.526566    
+2023-12-08 20:28:45,380 - Epoch: [75][ 4300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526509    
+2023-12-08 20:29:37,750 - Epoch: [75][ 4400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526444    
+2023-12-08 20:30:30,129 - Epoch: [75][ 4500/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526384    
+2023-12-08 20:31:22,615 - Epoch: [75][ 4600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526350    
+2023-12-08 20:32:15,056 - Epoch: [75][ 4700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526308    
+2023-12-08 20:33:07,499 - Epoch: [75][ 4800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526268    
+2023-12-08 20:33:59,888 - Epoch: [75][ 4900/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526219    
+2023-12-08 20:34:52,262 - Epoch: [75][ 5000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526169    
+2023-12-08 20:35:44,708 - Epoch: [75][ 5100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526135    
+2023-12-08 20:36:37,190 - Epoch: [75][ 5200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526109    
+2023-12-08 20:37:29,556 - Epoch: [75][ 5300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526062    
+2023-12-08 20:38:21,962 - Epoch: [75][ 5400/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526024    
+2023-12-08 20:39:14,343 - Epoch: [75][ 5500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525983    
+2023-12-08 20:40:06,796 - Epoch: [75][ 5600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525957    
+2023-12-08 20:40:59,208 - Epoch: [75][ 5700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525924    
+2023-12-08 20:41:51,623 - Epoch: [75][ 5800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525893    
+2023-12-08 20:42:44,102 - Epoch: [75][ 5900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525873    
+2023-12-08 20:43:36,536 - Epoch: [75][ 6000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525847    
+2023-12-08 20:44:28,884 - Epoch: [75][ 6100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525808    
+2023-12-08 20:45:21,385 - Epoch: [75][ 6200/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525795    
+2023-12-08 20:46:13,778 - Epoch: [75][ 6300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525765    
+2023-12-08 20:47:06,183 - Epoch: [75][ 6400/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525737    
+2023-12-08 20:47:58,597 - Epoch: [75][ 6500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525712    
+2023-12-08 20:48:51,004 - Epoch: [75][ 6600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525687    
+2023-12-08 20:49:43,471 - Epoch: [75][ 6700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525671    
+2023-12-08 20:50:35,842 - Epoch: [75][ 6800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525642    
+2023-12-08 20:51:28,234 - Epoch: [75][ 6900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525616    
+2023-12-08 20:52:20,566 - Epoch: [75][ 7000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525583    
+2023-12-08 20:53:12,965 - Epoch: [75][ 7100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525560    
+2023-12-08 20:54:05,364 - Epoch: [75][ 7200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525538    
+2023-12-08 20:54:57,773 - Epoch: [75][ 7300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525518    
+2023-12-08 20:55:50,126 - Epoch: [75][ 7400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525490    
+2023-12-08 20:56:42,496 - Epoch: [75][ 7500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525466    
+2023-12-08 20:57:34,975 - Epoch: [75][ 7600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525457    
+2023-12-08 20:58:27,376 - Epoch: [75][ 7700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525437    
+2023-12-08 20:59:19,813 - Epoch: [75][ 7800/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525423    
+2023-12-08 21:00:12,279 - Epoch: [75][ 7900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525413    
+2023-12-08 21:01:04,777 - Epoch: [75][ 8000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525407    
+2023-12-08 21:01:57,236 - Epoch: [75][ 8100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525397    
+2023-12-08 21:02:49,601 - Epoch: [75][ 8200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525375    
+2023-12-08 21:03:42,057 - Epoch: [75][ 8300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525365    
+2023-12-08 21:04:34,449 - Epoch: [75][ 8400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525347    
+2023-12-08 21:05:27,020 - Epoch: [75][ 8500/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525351    
+2023-12-08 21:06:19,452 - Epoch: [75][ 8600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525339    
+2023-12-08 21:07:11,913 - Epoch: [75][ 8700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525330    
+2023-12-08 21:08:04,337 - Epoch: [75][ 8800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525317    
+2023-12-08 21:08:56,762 - Epoch: [75][ 8900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525305    
+2023-12-08 21:09:49,192 - Epoch: [75][ 9000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525293    
+2023-12-08 21:10:41,585 - Epoch: [75][ 9100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525278    
+2023-12-08 21:11:34,029 - Epoch: [75][ 9200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525269    
+2023-12-08 21:12:26,425 - Epoch: [75][ 9300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525254    
+2023-12-08 21:13:18,825 - Epoch: [75][ 9400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525240    
+2023-12-08 21:14:11,257 - Epoch: [75][ 9500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525230    
+2023-12-08 21:15:03,677 - Epoch: [75][ 9600/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525219    
+2023-12-08 21:15:56,088 - Epoch: [75][ 9700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525207    
+2023-12-08 21:16:48,570 - Epoch: [75][ 9800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525203    
+2023-12-08 21:17:41,016 - Epoch: [75][ 9900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525195    
+2023-12-08 21:18:33,471 - Epoch: [75][10000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525188    
+2023-12-08 21:19:25,857 - Epoch: [75][10100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525175    
+2023-12-08 21:20:18,276 - Epoch: [75][10200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525165    
+2023-12-08 21:21:10,752 - Epoch: [75][10300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525161    
+2023-12-08 21:22:03,202 - Epoch: [75][10400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525154    
+2023-12-08 21:22:55,659 - Epoch: [75][10500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525148    
+2023-12-08 21:23:48,052 - Epoch: [75][10600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525136    
+2023-12-08 21:24:40,475 - Epoch: [75][10700/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525128    
+2023-12-08 21:25:32,929 - Epoch: [75][10800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525122    
+2023-12-08 21:26:25,331 - Epoch: [75][10900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525111    
+2023-12-08 21:27:17,713 - Epoch: [75][11000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525099    
+2023-12-08 21:28:10,169 - Epoch: [75][11100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525094    
+2023-12-08 21:29:02,665 - Epoch: [75][11200/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525093    
+2023-12-08 21:29:55,136 - Epoch: [75][11300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525089    
+2023-12-08 21:30:47,681 - Epoch: [75][11400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525092    
+2023-12-08 21:31:40,133 - Epoch: [75][11500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525087    
+2023-12-08 21:32:32,564 - Epoch: [75][11600/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525080    
+2023-12-08 21:33:25,040 - Epoch: [75][11700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525077    
+2023-12-08 21:34:17,506 - Epoch: [75][11800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525073    
+2023-12-08 21:35:09,961 - Epoch: [75][11900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525068    
+2023-12-08 21:36:02,410 - Epoch: [75][12000/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525063    
+2023-12-08 21:36:54,812 - Epoch: [75][12100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525054    
+2023-12-08 21:37:30,417 - Epoch: [75][12168/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.525046    
+2023-12-08 21:37:30,786 - --- validate (epoch=75)-----------
+2023-12-08 21:37:30,787 - 167951 samples (256 per mini-batch)
+2023-12-08 21:38:22,053 - Epoch: [75][  100/  657]    Loss 0.000000    Overall Loss 0.014156    
+2023-12-08 21:39:10,629 - Epoch: [75][  200/  657]    Loss 0.000000    Overall Loss 0.014146    
+2023-12-08 21:39:59,194 - Epoch: [75][  300/  657]    Loss 0.000000    Overall Loss 0.014139    
+2023-12-08 21:40:47,738 - Epoch: [75][  400/  657]    Loss 0.000000    Overall Loss 0.014141    
+2023-12-08 21:41:36,283 - Epoch: [75][  500/  657]    Loss 0.000000    Overall Loss 0.014143    
+2023-12-08 21:42:24,845 - Epoch: [75][  600/  657]    Loss 0.000000    Overall Loss 0.014139    
+2023-12-08 21:42:52,056 - Epoch: [75][  657/  657]    Loss 0.000000    Overall Loss 0.014142    
+2023-12-08 21:42:52,259 - ==> Overall Loss: 0.014
+
+2023-12-08 21:42:52,261 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 21:42:52,261 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 21:42:52,275 - 
+
+2023-12-08 21:42:52,275 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 21:43:53,688 - Epoch: [76][  100/12168]    Overall Loss 0.013290    Objective Loss 0.000000    Distill Loss 0.013290                                        LR 0.000008    Time 0.614089    
+2023-12-08 21:44:46,094 - Epoch: [76][  200/12168]    Overall Loss 0.013291    Objective Loss 0.000000    Distill Loss 0.013291                                        LR 0.000008    Time 0.569056    
+2023-12-08 21:45:38,497 - Epoch: [76][  300/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.554037    
+2023-12-08 21:46:30,851 - Epoch: [76][  400/12168]    Overall Loss 0.013302    Objective Loss 0.000000    Distill Loss 0.013302                                        LR 0.000008    Time 0.546403    
+2023-12-08 21:47:23,270 - Epoch: [76][  500/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.541953    
+2023-12-08 21:48:15,689 - Epoch: [76][  600/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.538988    
+2023-12-08 21:49:08,121 - Epoch: [76][  700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.536887    
+2023-12-08 21:50:00,595 - Epoch: [76][  800/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.535365    
+2023-12-08 21:50:52,967 - Epoch: [76][  900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.534066    
+2023-12-08 21:51:45,354 - Epoch: [76][ 1000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.533044    
+2023-12-08 21:52:37,774 - Epoch: [76][ 1100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.532236    
+2023-12-08 21:53:30,183 - Epoch: [76][ 1200/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.531555    
+2023-12-08 21:54:22,570 - Epoch: [76][ 1300/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.530961    
+2023-12-08 21:55:14,955 - Epoch: [76][ 1400/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.530451    
+2023-12-08 21:56:07,306 - Epoch: [76][ 1500/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.529986    
+2023-12-08 21:56:59,636 - Epoch: [76][ 1600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.529566    
+2023-12-08 21:57:52,106 - Epoch: [76][ 1700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.529278    
+2023-12-08 21:58:44,437 - Epoch: [76][ 1800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.528944    
+2023-12-08 21:59:36,742 - Epoch: [76][ 1900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.528632    
+2023-12-08 22:00:29,192 - Epoch: [76][ 2000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.528424    
+2023-12-08 22:01:21,629 - Epoch: [76][ 2100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.528229    
+2023-12-08 22:02:14,036 - Epoch: [76][ 2200/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.528039    
+2023-12-08 22:03:06,452 - Epoch: [76][ 2300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.527868    
+2023-12-08 22:03:58,831 - Epoch: [76][ 2400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.527697    
+2023-12-08 22:04:51,236 - Epoch: [76][ 2500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.527550    
+2023-12-08 22:05:43,679 - Epoch: [76][ 2600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.527429    
+2023-12-08 22:06:36,080 - Epoch: [76][ 2700/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.527301    
+2023-12-08 22:07:28,518 - Epoch: [76][ 2800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.527195    
+2023-12-08 22:08:20,929 - Epoch: [76][ 2900/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.527088    
+2023-12-08 22:09:13,343 - Epoch: [76][ 3000/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.526989    
+2023-12-08 22:10:05,734 - Epoch: [76][ 3100/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526888    
+2023-12-08 22:10:58,181 - Epoch: [76][ 3200/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526811    
+2023-12-08 22:11:50,567 - Epoch: [76][ 3300/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526721    
+2023-12-08 22:12:42,974 - Epoch: [76][ 3400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526642    
+2023-12-08 22:13:35,492 - Epoch: [76][ 3500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526599    
+2023-12-08 22:14:27,888 - Epoch: [76][ 3600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526525    
+2023-12-08 22:15:20,301 - Epoch: [76][ 3700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.526459    
+2023-12-08 22:16:12,739 - Epoch: [76][ 3800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.526404    
+2023-12-08 22:17:05,211 - Epoch: [76][ 3900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526359    
+2023-12-08 22:17:57,592 - Epoch: [76][ 4000/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.526295    
+2023-12-08 22:18:50,034 - Epoch: [76][ 4100/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.526248    
+2023-12-08 22:19:42,479 - Epoch: [76][ 4200/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.526205    
+2023-12-08 22:20:35,003 - Epoch: [76][ 4300/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.526182    
+2023-12-08 22:21:27,427 - Epoch: [76][ 4400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.526136    
+2023-12-08 22:22:19,831 - Epoch: [76][ 4500/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.526089    
+2023-12-08 22:23:12,245 - Epoch: [76][ 4600/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.526046    
+2023-12-08 22:24:04,737 - Epoch: [76][ 4700/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.526021    
+2023-12-08 22:24:57,152 - Epoch: [76][ 4800/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525982    
+2023-12-08 22:25:49,562 - Epoch: [76][ 4900/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525943    
+2023-12-08 22:26:41,951 - Epoch: [76][ 5000/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525901    
+2023-12-08 22:27:34,354 - Epoch: [76][ 5100/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525864    
+2023-12-08 22:28:26,749 - Epoch: [76][ 5200/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525826    
+2023-12-08 22:29:19,153 - Epoch: [76][ 5300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525792    
+2023-12-08 22:30:11,602 - Epoch: [76][ 5400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525767    
+2023-12-08 22:31:03,968 - Epoch: [76][ 5500/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525728    
+2023-12-08 22:31:57,331 - Epoch: [76][ 5600/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525869    
+2023-12-08 22:32:49,713 - Epoch: [76][ 5700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525832    
+2023-12-08 22:33:42,207 - Epoch: [76][ 5800/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525816    
+2023-12-08 22:34:34,648 - Epoch: [76][ 5900/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525792    
+2023-12-08 22:35:27,057 - Epoch: [76][ 6000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525763    
+2023-12-08 22:36:24,253 - Epoch: [76][ 6100/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.526519    
+2023-12-08 22:37:22,877 - Epoch: [76][ 6200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.527482    
+2023-12-08 22:38:15,349 - Epoch: [76][ 6300/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.527438    
+2023-12-08 22:39:07,902 - Epoch: [76][ 6400/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.527407    
+2023-12-08 22:40:00,456 - Epoch: [76][ 6500/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.527378    
+2023-12-08 22:40:58,087 - Epoch: [76][ 6600/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.528119    
+2023-12-08 22:41:53,894 - Epoch: [76][ 6700/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.528566    
+2023-12-08 22:42:46,400 - Epoch: [76][ 6800/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.528514    
+2023-12-08 22:43:38,913 - Epoch: [76][ 6900/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.528464    
+2023-12-08 22:44:31,468 - Epoch: [76][ 7000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.528422    
+2023-12-08 22:45:31,074 - Epoch: [76][ 7100/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.529374    
+2023-12-08 22:46:25,048 - Epoch: [76][ 7200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.529518    
+2023-12-08 22:47:17,515 - Epoch: [76][ 7300/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.529451    
+2023-12-08 22:48:09,955 - Epoch: [76][ 7400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.529382    
+2023-12-08 22:49:02,595 - Epoch: [76][ 7500/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.529342    
+2023-12-08 22:50:02,433 - Epoch: [76][ 7600/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.530250    
+2023-12-08 22:50:59,342 - Epoch: [76][ 7700/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.530754    
+2023-12-08 22:51:52,185 - Epoch: [76][ 7800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.530724    
+2023-12-08 22:52:44,589 - Epoch: [76][ 7900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530638    
+2023-12-08 22:53:36,986 - Epoch: [76][ 8000/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.530555    
+2023-12-08 22:54:29,397 - Epoch: [76][ 8100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530475    
+2023-12-08 22:55:21,806 - Epoch: [76][ 8200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530396    
+2023-12-08 22:56:14,290 - Epoch: [76][ 8300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530329    
+2023-12-08 22:57:06,728 - Epoch: [76][ 8400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530258    
+2023-12-08 22:57:59,194 - Epoch: [76][ 8500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530192    
+2023-12-08 22:58:51,653 - Epoch: [76][ 8600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530126    
+2023-12-08 22:59:44,026 - Epoch: [76][ 8700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.530052    
+2023-12-08 23:00:36,417 - Epoch: [76][ 8800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529982    
+2023-12-08 23:01:28,900 - Epoch: [76][ 8900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529924    
+2023-12-08 23:02:21,407 - Epoch: [76][ 9000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529869    
+2023-12-08 23:03:13,813 - Epoch: [76][ 9100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529805    
+2023-12-08 23:04:06,313 - Epoch: [76][ 9200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529753    
+2023-12-08 23:04:58,745 - Epoch: [76][ 9300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529694    
+2023-12-08 23:05:51,112 - Epoch: [76][ 9400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529629    
+2023-12-08 23:06:43,553 - Epoch: [76][ 9500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529574    
+2023-12-08 23:07:35,947 - Epoch: [76][ 9600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529515    
+2023-12-08 23:08:28,406 - Epoch: [76][ 9700/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529464    
+2023-12-08 23:09:20,845 - Epoch: [76][ 9800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.529412    
+2023-12-08 23:10:13,253 - Epoch: [76][ 9900/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.529358    
+2023-12-08 23:11:05,668 - Epoch: [76][10000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529305    
+2023-12-08 23:11:58,118 - Epoch: [76][10100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529257    
+2023-12-08 23:12:50,598 - Epoch: [76][10200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.529213    
+2023-12-08 23:13:43,042 - Epoch: [76][10300/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.529167    
+2023-12-08 23:14:35,445 - Epoch: [76][10400/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.529117    
+2023-12-08 23:15:27,833 - Epoch: [76][10500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.529067    
+2023-12-08 23:16:20,289 - Epoch: [76][10600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.529024    
+2023-12-08 23:17:12,718 - Epoch: [76][10700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.528979    
+2023-12-08 23:18:05,250 - Epoch: [76][10800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.528945    
+2023-12-08 23:18:57,661 - Epoch: [76][10900/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.528900    
+2023-12-08 23:19:50,094 - Epoch: [76][11000/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.528859    
+2023-12-08 23:20:42,498 - Epoch: [76][11100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.528815    
+2023-12-08 23:21:34,926 - Epoch: [76][11200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.528774    
+2023-12-08 23:22:27,331 - Epoch: [76][11300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.528732    
+2023-12-08 23:23:19,781 - Epoch: [76][11400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.528695    
+2023-12-08 23:24:12,158 - Epoch: [76][11500/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.528651    
+2023-12-08 23:25:04,607 - Epoch: [76][11600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.528615    
+2023-12-08 23:25:57,045 - Epoch: [76][11700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.528579    
+2023-12-08 23:26:49,500 - Epoch: [76][11800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528544    
+2023-12-08 23:27:41,944 - Epoch: [76][11900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528510    
+2023-12-08 23:28:34,349 - Epoch: [76][12000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528472    
+2023-12-08 23:29:26,761 - Epoch: [76][12100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.528436    
+2023-12-08 23:30:02,345 - Epoch: [76][12168/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.528407    
+2023-12-08 23:30:02,731 - --- validate (epoch=76)-----------
+2023-12-08 23:30:02,731 - 167951 samples (256 per mini-batch)
+2023-12-08 23:30:53,484 - Epoch: [76][  100/  657]    Loss 0.000000    Overall Loss 0.013928    
+2023-12-08 23:31:42,071 - Epoch: [76][  200/  657]    Loss 0.000000    Overall Loss 0.013922    
+2023-12-08 23:32:30,641 - Epoch: [76][  300/  657]    Loss 0.000000    Overall Loss 0.013919    
+2023-12-08 23:33:19,241 - Epoch: [76][  400/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-08 23:34:07,810 - Epoch: [76][  500/  657]    Loss 0.000000    Overall Loss 0.013911    
+2023-12-08 23:34:56,378 - Epoch: [76][  600/  657]    Loss 0.000000    Overall Loss 0.013916    
+2023-12-08 23:35:23,603 - Epoch: [76][  657/  657]    Loss 0.000000    Overall Loss 0.013922    
+2023-12-08 23:35:23,809 - ==> Overall Loss: 0.014
+
+2023-12-08 23:35:23,811 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-08 23:35:23,811 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-08 23:35:23,832 - 
+
+2023-12-08 23:35:23,832 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-08 23:36:25,439 - Epoch: [77][  100/12168]    Overall Loss 0.013283    Objective Loss 0.000000    Distill Loss 0.013283                                        LR 0.000008    Time 0.616030    
+2023-12-08 23:37:17,847 - Epoch: [77][  200/12168]    Overall Loss 0.013293    Objective Loss 0.000000    Distill Loss 0.013293                                        LR 0.000008    Time 0.570014    
+2023-12-08 23:38:10,250 - Epoch: [77][  300/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.554676    
+2023-12-08 23:39:02,646 - Epoch: [77][  400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.546988    
+2023-12-08 23:39:55,031 - Epoch: [77][  500/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.542354    
+2023-12-08 23:40:47,440 - Epoch: [77][  600/12168]    Overall Loss 0.013297    Objective Loss 0.000000    Distill Loss 0.013297                                        LR 0.000008    Time 0.539304    
+2023-12-08 23:41:39,842 - Epoch: [77][  700/12168]    Overall Loss 0.013301    Objective Loss 0.000000    Distill Loss 0.013301                                        LR 0.000008    Time 0.537116    
+2023-12-08 23:42:32,246 - Epoch: [77][  800/12168]    Overall Loss 0.013295    Objective Loss 0.000000    Distill Loss 0.013295                                        LR 0.000008    Time 0.535476    
+2023-12-08 23:43:24,672 - Epoch: [77][  900/12168]    Overall Loss 0.013300    Objective Loss 0.000000    Distill Loss 0.013300                                        LR 0.000008    Time 0.534227    
+2023-12-08 23:44:17,000 - Epoch: [77][ 1000/12168]    Overall Loss 0.013301    Objective Loss 0.000000    Distill Loss 0.013301                                        LR 0.000008    Time 0.533129    
+2023-12-08 23:45:09,363 - Epoch: [77][ 1100/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.532262    
+2023-12-08 23:46:01,786 - Epoch: [77][ 1200/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.531590    
+2023-12-08 23:46:54,130 - Epoch: [77][ 1300/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.530960    
+2023-12-08 23:47:46,571 - Epoch: [77][ 1400/12168]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                                        LR 0.000008    Time 0.530490    
+2023-12-08 23:48:38,901 - Epoch: [77][ 1500/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.530009    
+2023-12-08 23:49:31,273 - Epoch: [77][ 1600/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.529614    
+2023-12-08 23:50:23,689 - Epoch: [77][ 1700/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.529290    
+2023-12-08 23:51:16,082 - Epoch: [77][ 1800/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.528991    
+2023-12-08 23:52:08,485 - Epoch: [77][ 1900/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.528728    
+2023-12-08 23:53:00,877 - Epoch: [77][ 2000/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.528486    
+2023-12-08 23:53:53,321 - Epoch: [77][ 2100/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.528291    
+2023-12-08 23:54:45,665 - Epoch: [77][ 2200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.528070    
+2023-12-08 23:55:38,028 - Epoch: [77][ 2300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.527875    
+2023-12-08 23:56:30,489 - Epoch: [77][ 2400/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527738    
+2023-12-08 23:57:22,880 - Epoch: [77][ 2500/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.527583    
+2023-12-08 23:58:15,253 - Epoch: [77][ 2600/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.527434    
+2023-12-08 23:59:07,749 - Epoch: [77][ 2700/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.527341    
+2023-12-09 00:00:00,133 - Epoch: [77][ 2800/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.527215    
+2023-12-09 00:00:52,501 - Epoch: [77][ 2900/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.527092    
+2023-12-09 00:01:44,861 - Epoch: [77][ 3000/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526974    
+2023-12-09 00:02:37,297 - Epoch: [77][ 3100/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526889    
+2023-12-09 00:03:29,675 - Epoch: [77][ 3200/12168]    Overall Loss 0.013306    Objective Loss 0.000000    Distill Loss 0.013306                                        LR 0.000008    Time 0.526791    
+2023-12-09 00:04:22,136 - Epoch: [77][ 3300/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.526724    
+2023-12-09 00:05:14,628 - Epoch: [77][ 3400/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.526669    
+2023-12-09 00:06:07,053 - Epoch: [77][ 3500/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526599    
+2023-12-09 00:06:59,466 - Epoch: [77][ 3600/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526529    
+2023-12-09 00:07:51,893 - Epoch: [77][ 3700/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.526467    
+2023-12-09 00:08:44,261 - Epoch: [77][ 3800/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526393    
+2023-12-09 00:09:36,615 - Epoch: [77][ 3900/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526319    
+2023-12-09 00:10:28,927 - Epoch: [77][ 4000/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526238    
+2023-12-09 00:11:21,329 - Epoch: [77][ 4100/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526183    
+2023-12-09 00:12:13,668 - Epoch: [77][ 4200/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526116    
+2023-12-09 00:13:06,041 - Epoch: [77][ 4300/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526060    
+2023-12-09 00:13:58,454 - Epoch: [77][ 4400/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526015    
+2023-12-09 00:14:50,841 - Epoch: [77][ 4500/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525967    
+2023-12-09 00:15:43,320 - Epoch: [77][ 4600/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525940    
+2023-12-09 00:16:35,699 - Epoch: [77][ 4700/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525894    
+2023-12-09 00:17:28,071 - Epoch: [77][ 4800/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525848    
+2023-12-09 00:18:20,486 - Epoch: [77][ 4900/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525813    
+2023-12-09 00:19:12,915 - Epoch: [77][ 5000/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.525782    
+2023-12-09 00:20:05,276 - Epoch: [77][ 5100/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525738    
+2023-12-09 00:20:57,701 - Epoch: [77][ 5200/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525709    
+2023-12-09 00:21:50,134 - Epoch: [77][ 5300/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525682    
+2023-12-09 00:22:42,560 - Epoch: [77][ 5400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525655    
+2023-12-09 00:23:34,936 - Epoch: [77][ 5500/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525620    
+2023-12-09 00:24:27,290 - Epoch: [77][ 5600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525583    
+2023-12-09 00:25:19,669 - Epoch: [77][ 5700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525551    
+2023-12-09 00:26:12,057 - Epoch: [77][ 5800/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525521    
+2023-12-09 00:27:04,402 - Epoch: [77][ 5900/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525485    
+2023-12-09 00:27:56,830 - Epoch: [77][ 6000/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525465    
+2023-12-09 00:28:49,254 - Epoch: [77][ 6100/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525444    
+2023-12-09 00:29:41,669 - Epoch: [77][ 6200/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525423    
+2023-12-09 00:30:34,084 - Epoch: [77][ 6300/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525402    
+2023-12-09 00:31:26,482 - Epoch: [77][ 6400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525379    
+2023-12-09 00:32:18,884 - Epoch: [77][ 6500/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525358    
+2023-12-09 00:33:11,289 - Epoch: [77][ 6600/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525338    
+2023-12-09 00:34:03,729 - Epoch: [77][ 6700/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525323    
+2023-12-09 00:34:56,189 - Epoch: [77][ 6800/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525312    
+2023-12-09 00:35:48,547 - Epoch: [77][ 6900/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525286    
+2023-12-09 00:36:40,938 - Epoch: [77][ 7000/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525266    
+2023-12-09 00:37:33,377 - Epoch: [77][ 7100/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525253    
+2023-12-09 00:38:25,750 - Epoch: [77][ 7200/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525232    
+2023-12-09 00:39:18,144 - Epoch: [77][ 7300/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525213    
+2023-12-09 00:40:10,544 - Epoch: [77][ 7400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525197    
+2023-12-09 00:41:03,039 - Epoch: [77][ 7500/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525193    
+2023-12-09 00:41:55,476 - Epoch: [77][ 7600/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525182    
+2023-12-09 00:42:47,899 - Epoch: [77][ 7700/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525169    
+2023-12-09 00:43:40,302 - Epoch: [77][ 7800/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525154    
+2023-12-09 00:44:32,727 - Epoch: [77][ 7900/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525141    
+2023-12-09 00:45:25,121 - Epoch: [77][ 8000/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525125    
+2023-12-09 00:46:17,575 - Epoch: [77][ 8100/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525118    
+2023-12-09 00:47:09,969 - Epoch: [77][ 8200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525103    
+2023-12-09 00:48:02,381 - Epoch: [77][ 8300/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525091    
+2023-12-09 00:48:54,815 - Epoch: [77][ 8400/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525081    
+2023-12-09 00:49:47,203 - Epoch: [77][ 8500/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525067    
+2023-12-09 00:50:39,585 - Epoch: [77][ 8600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525052    
+2023-12-09 00:51:31,969 - Epoch: [77][ 8700/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525038    
+2023-12-09 00:52:24,343 - Epoch: [77][ 8800/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525022    
+2023-12-09 00:53:16,783 - Epoch: [77][ 8900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525015    
+2023-12-09 00:54:09,217 - Epoch: [77][ 9000/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525007    
+2023-12-09 00:55:01,610 - Epoch: [77][ 9100/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.524995    
+2023-12-09 00:55:54,027 - Epoch: [77][ 9200/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.524986    
+2023-12-09 00:56:46,525 - Epoch: [77][ 9300/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.524985    
+2023-12-09 00:57:38,978 - Epoch: [77][ 9400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.524980    
+2023-12-09 00:58:31,442 - Epoch: [77][ 9500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.524976    
+2023-12-09 00:59:23,816 - Epoch: [77][ 9600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.524963    
+2023-12-09 01:00:16,223 - Epoch: [77][ 9700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.524953    
+2023-12-09 01:01:08,622 - Epoch: [77][ 9800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.524943    
+2023-12-09 01:02:01,008 - Epoch: [77][ 9900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.524932    
+2023-12-09 01:02:53,452 - Epoch: [77][10000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.524927    
+2023-12-09 01:03:45,833 - Epoch: [77][10100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.524915    
+2023-12-09 01:04:38,206 - Epoch: [77][10200/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.524903    
+2023-12-09 01:05:30,649 - Epoch: [77][10300/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.524898    
+2023-12-09 01:06:23,038 - Epoch: [77][10400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524888    
+2023-12-09 01:07:15,449 - Epoch: [77][10500/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524881    
+2023-12-09 01:08:07,858 - Epoch: [77][10600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524873    
+2023-12-09 01:09:00,220 - Epoch: [77][10700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524861    
+2023-12-09 01:09:52,603 - Epoch: [77][10800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524851    
+2023-12-09 01:10:45,006 - Epoch: [77][10900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524843    
+2023-12-09 01:11:37,404 - Epoch: [77][11000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524835    
+2023-12-09 01:12:29,910 - Epoch: [77][11100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524837    
+2023-12-09 01:13:22,424 - Epoch: [77][11200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524839    
+2023-12-09 01:14:14,883 - Epoch: [77][11300/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.524836    
+2023-12-09 01:15:07,277 - Epoch: [77][11400/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.524828    
+2023-12-09 01:15:59,661 - Epoch: [77][11500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.524819    
+2023-12-09 01:16:52,003 - Epoch: [77][11600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.524807    
+2023-12-09 01:17:44,411 - Epoch: [77][11700/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524801    
+2023-12-09 01:18:36,851 - Epoch: [77][11800/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524797    
+2023-12-09 01:19:29,280 - Epoch: [77][11900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524792    
+2023-12-09 01:20:21,715 - Epoch: [77][12000/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524788    
+2023-12-09 01:21:14,182 - Epoch: [77][12100/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524787    
+2023-12-09 01:21:49,985 - Epoch: [77][12168/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.524797    
+2023-12-09 01:21:50,358 - --- validate (epoch=77)-----------
+2023-12-09 01:21:50,358 - 167951 samples (256 per mini-batch)
+2023-12-09 01:22:40,952 - Epoch: [77][  100/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-09 01:23:29,535 - Epoch: [77][  200/  657]    Loss 0.000000    Overall Loss 0.013907    
+2023-12-09 01:24:18,098 - Epoch: [77][  300/  657]    Loss 0.000000    Overall Loss 0.013908    
+2023-12-09 01:25:06,647 - Epoch: [77][  400/  657]    Loss 0.000000    Overall Loss 0.013905    
+2023-12-09 01:25:55,192 - Epoch: [77][  500/  657]    Loss 0.000000    Overall Loss 0.013903    
+2023-12-09 01:26:43,742 - Epoch: [77][  600/  657]    Loss 0.000000    Overall Loss 0.013901    
+2023-12-09 01:27:10,959 - Epoch: [77][  657/  657]    Loss 0.000000    Overall Loss 0.013902    
+2023-12-09 01:27:11,165 - ==> Overall Loss: 0.014
+
+2023-12-09 01:27:11,167 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-09 01:27:11,167 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-09 01:27:11,188 - 
+
+2023-12-09 01:27:11,188 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-09 01:28:12,743 - Epoch: [78][  100/12168]    Overall Loss 0.013277    Objective Loss 0.000000    Distill Loss 0.013277                                        LR 0.000008    Time 0.615501    
+2023-12-09 01:29:05,139 - Epoch: [78][  200/12168]    Overall Loss 0.013281    Objective Loss 0.000000    Distill Loss 0.013281                                        LR 0.000008    Time 0.569716    
+2023-12-09 01:29:57,560 - Epoch: [78][  300/12168]    Overall Loss 0.013298    Objective Loss 0.000000    Distill Loss 0.013298                                        LR 0.000008    Time 0.554534    
+2023-12-09 01:30:49,991 - Epoch: [78][  400/12168]    Overall Loss 0.013283    Objective Loss 0.000000    Distill Loss 0.013283                                        LR 0.000008    Time 0.546970    
+2023-12-09 01:31:42,394 - Epoch: [78][  500/12168]    Overall Loss 0.013270    Objective Loss 0.000000    Distill Loss 0.013270                                        LR 0.000008    Time 0.542375    
+2023-12-09 01:32:34,747 - Epoch: [78][  600/12168]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                                        LR 0.000008    Time 0.539229    
+2023-12-09 01:33:27,072 - Epoch: [78][  700/12168]    Overall Loss 0.013282    Objective Loss 0.000000    Distill Loss 0.013282                                        LR 0.000008    Time 0.536940    
+2023-12-09 01:34:19,533 - Epoch: [78][  800/12168]    Overall Loss 0.013286    Objective Loss 0.000000    Distill Loss 0.013286                                        LR 0.000008    Time 0.535395    
+2023-12-09 01:35:11,873 - Epoch: [78][  900/12168]    Overall Loss 0.013302    Objective Loss 0.000000    Distill Loss 0.013302                                        LR 0.000008    Time 0.534059    
+2023-12-09 01:36:04,254 - Epoch: [78][ 1000/12168]    Overall Loss 0.013307    Objective Loss 0.000000    Distill Loss 0.013307                                        LR 0.000008    Time 0.533031    
+2023-12-09 01:36:56,648 - Epoch: [78][ 1100/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.532201    
+2023-12-09 01:37:49,057 - Epoch: [78][ 1200/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.531522    
+2023-12-09 01:38:41,469 - Epoch: [78][ 1300/12168]    Overall Loss 0.013308    Objective Loss 0.000000    Distill Loss 0.013308                                        LR 0.000008    Time 0.530950    
+2023-12-09 01:39:33,883 - Epoch: [78][ 1400/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.530462    
+2023-12-09 01:40:26,267 - Epoch: [78][ 1500/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.530018    
+2023-12-09 01:41:18,646 - Epoch: [78][ 1600/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.529627    
+2023-12-09 01:42:11,020 - Epoch: [78][ 1700/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.529278    
+2023-12-09 01:43:03,440 - Epoch: [78][ 1800/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.528994    
+2023-12-09 01:43:55,849 - Epoch: [78][ 1900/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.528734    
+2023-12-09 01:44:48,233 - Epoch: [78][ 2000/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.528488    
+2023-12-09 01:45:40,695 - Epoch: [78][ 2100/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.528302    
+2023-12-09 01:46:33,091 - Epoch: [78][ 2200/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.528103    
+2023-12-09 01:47:25,491 - Epoch: [78][ 2300/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.527923    
+2023-12-09 01:48:17,907 - Epoch: [78][ 2400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.527765    
+2023-12-09 01:49:10,313 - Epoch: [78][ 2500/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527616    
+2023-12-09 01:50:02,717 - Epoch: [78][ 2600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527477    
+2023-12-09 01:50:55,103 - Epoch: [78][ 2700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.527342    
+2023-12-09 01:51:47,527 - Epoch: [78][ 2800/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.527229    
+2023-12-09 01:52:39,963 - Epoch: [78][ 2900/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.527129    
+2023-12-09 01:53:32,373 - Epoch: [78][ 3000/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.527027    
+2023-12-09 01:54:24,784 - Epoch: [78][ 3100/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.526932    
+2023-12-09 01:55:17,162 - Epoch: [78][ 3200/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526832    
+2023-12-09 01:56:09,507 - Epoch: [78][ 3300/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526727    
+2023-12-09 01:57:01,893 - Epoch: [78][ 3400/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.526642    
+2023-12-09 01:57:54,329 - Epoch: [78][ 3500/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.526576    
+2023-12-09 01:58:46,743 - Epoch: [78][ 3600/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526507    
+2023-12-09 01:59:39,091 - Epoch: [78][ 3700/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.526425    
+2023-12-09 02:00:31,487 - Epoch: [78][ 3800/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526359    
+2023-12-09 02:01:23,841 - Epoch: [78][ 3900/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526286    
+2023-12-09 02:02:16,252 - Epoch: [78][ 4000/12168]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                                        LR 0.000008    Time 0.526230    
+2023-12-09 02:03:08,730 - Epoch: [78][ 4100/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526194    
+2023-12-09 02:04:01,157 - Epoch: [78][ 4200/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526148    
+2023-12-09 02:04:53,486 - Epoch: [78][ 4300/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.526080    
+2023-12-09 02:05:45,931 - Epoch: [78][ 4400/12168]    Overall Loss 0.013310    Objective Loss 0.000000    Distill Loss 0.013310                                        LR 0.000008    Time 0.526043    
+2023-12-09 02:06:38,305 - Epoch: [78][ 4500/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525991    
+2023-12-09 02:07:30,700 - Epoch: [78][ 4600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525946    
+2023-12-09 02:08:23,125 - Epoch: [78][ 4700/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525909    
+2023-12-09 02:09:15,566 - Epoch: [78][ 4800/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525877    
+2023-12-09 02:10:07,913 - Epoch: [78][ 4900/12168]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                                        LR 0.000008    Time 0.525827    
+2023-12-09 02:11:00,305 - Epoch: [78][ 5000/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525788    
+2023-12-09 02:11:52,851 - Epoch: [78][ 5100/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525781    
+2023-12-09 02:12:45,339 - Epoch: [78][ 5200/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525763    
+2023-12-09 02:13:37,846 - Epoch: [78][ 5300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525749    
+2023-12-09 02:14:30,352 - Epoch: [78][ 5400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525736    
+2023-12-09 02:15:22,822 - Epoch: [78][ 5500/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525716    
+2023-12-09 02:16:15,265 - Epoch: [78][ 5600/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525693    
+2023-12-09 02:17:07,669 - Epoch: [78][ 5700/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525663    
+2023-12-09 02:18:00,193 - Epoch: [78][ 5800/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525655    
+2023-12-09 02:18:52,627 - Epoch: [78][ 5900/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525633    
+2023-12-09 02:19:45,177 - Epoch: [78][ 6000/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525630    
+2023-12-09 02:20:37,609 - Epoch: [78][ 6100/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525608    
+2023-12-09 02:21:30,055 - Epoch: [78][ 6200/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525589    
+2023-12-09 02:22:22,643 - Epoch: [78][ 6300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525593    
+2023-12-09 02:23:15,187 - Epoch: [78][ 6400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525590    
+2023-12-09 02:24:07,677 - Epoch: [78][ 6500/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525579    
+2023-12-09 02:25:00,122 - Epoch: [78][ 6600/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525561    
+2023-12-09 02:25:52,629 - Epoch: [78][ 6700/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525553    
+2023-12-09 02:26:45,138 - Epoch: [78][ 6800/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525546    
+2023-12-09 02:27:37,665 - Epoch: [78][ 6900/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525541    
+2023-12-09 02:28:30,153 - Epoch: [78][ 7000/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525531    
+2023-12-09 02:29:22,655 - Epoch: [78][ 7100/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525524    
+2023-12-09 02:30:15,100 - Epoch: [78][ 7200/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525508    
+2023-12-09 02:31:07,635 - Epoch: [78][ 7300/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525506    
+2023-12-09 02:32:00,147 - Epoch: [78][ 7400/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525500    
+2023-12-09 02:32:52,610 - Epoch: [78][ 7500/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525488    
+2023-12-09 02:33:44,971 - Epoch: [78][ 7600/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525463    
+2023-12-09 02:34:37,474 - Epoch: [78][ 7700/12168]    Overall Loss 0.013312    Objective Loss 0.000000    Distill Loss 0.013312                                        LR 0.000008    Time 0.525457    
+2023-12-09 02:35:29,914 - Epoch: [78][ 7800/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525443    
+2023-12-09 02:36:22,448 - Epoch: [78][ 7900/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525441    
+2023-12-09 02:37:14,988 - Epoch: [78][ 8000/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525440    
+2023-12-09 02:38:07,425 - Epoch: [78][ 8100/12168]    Overall Loss 0.013313    Objective Loss 0.000000    Distill Loss 0.013313                                        LR 0.000008    Time 0.525426    
+2023-12-09 02:38:59,992 - Epoch: [78][ 8200/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525429    
+2023-12-09 02:39:52,496 - Epoch: [78][ 8300/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525424    
+2023-12-09 02:40:44,970 - Epoch: [78][ 8400/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525415    
+2023-12-09 02:41:37,572 - Epoch: [78][ 8500/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525422    
+2023-12-09 02:42:30,003 - Epoch: [78][ 8600/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525408    
+2023-12-09 02:43:22,437 - Epoch: [78][ 8700/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525396    
+2023-12-09 02:44:14,953 - Epoch: [78][ 8800/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525393    
+2023-12-09 02:45:07,394 - Epoch: [78][ 8900/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525381    
+2023-12-09 02:45:59,909 - Epoch: [78][ 9000/12168]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                                        LR 0.000008    Time 0.525378    
+2023-12-09 02:46:52,391 - Epoch: [78][ 9100/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525372    
+2023-12-09 02:47:44,972 - Epoch: [78][ 9200/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525376    
+2023-12-09 02:48:37,410 - Epoch: [78][ 9300/12168]    Overall Loss 0.013315    Objective Loss 0.000000    Distill Loss 0.013315                                        LR 0.000008    Time 0.525365    
+2023-12-09 02:49:29,911 - Epoch: [78][ 9400/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525361    
+2023-12-09 02:50:22,350 - Epoch: [78][ 9500/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525350    
+2023-12-09 02:51:14,857 - Epoch: [78][ 9600/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525347    
+2023-12-09 02:52:07,487 - Epoch: [78][ 9700/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525357    
+2023-12-09 02:52:59,969 - Epoch: [78][ 9800/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525351    
+2023-12-09 02:53:52,432 - Epoch: [78][ 9900/12168]    Overall Loss 0.013316    Objective Loss 0.000000    Distill Loss 0.013316                                        LR 0.000008    Time 0.525343    
+2023-12-09 02:54:44,860 - Epoch: [78][10000/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525332    
+2023-12-09 02:55:37,357 - Epoch: [78][10100/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525328    
+2023-12-09 02:56:29,788 - Epoch: [78][10200/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525318    
+2023-12-09 02:57:22,236 - Epoch: [78][10300/12168]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                                        LR 0.000008    Time 0.525309    
+2023-12-09 02:58:14,599 - Epoch: [78][10400/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525293    
+2023-12-09 02:59:06,987 - Epoch: [78][10500/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525279    
+2023-12-09 02:59:59,444 - Epoch: [78][10600/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525272    
+2023-12-09 03:00:51,872 - Epoch: [78][10700/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525263    
+2023-12-09 03:01:44,326 - Epoch: [78][10800/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525256    
+2023-12-09 03:02:36,763 - Epoch: [78][10900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525247    
+2023-12-09 03:03:29,301 - Epoch: [78][11000/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525248    
+2023-12-09 03:04:21,767 - Epoch: [78][11100/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525242    
+2023-12-09 03:05:14,209 - Epoch: [78][11200/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525235    
+2023-12-09 03:06:06,680 - Epoch: [78][11300/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525230    
+2023-12-09 03:06:59,039 - Epoch: [78][11400/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525215    
+2023-12-09 03:07:51,440 - Epoch: [78][11500/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525204    
+2023-12-09 03:08:43,855 - Epoch: [78][11600/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525195    
+2023-12-09 03:09:36,311 - Epoch: [78][11700/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525189    
+2023-12-09 03:10:28,774 - Epoch: [78][11800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525184    
+2023-12-09 03:11:21,242 - Epoch: [78][11900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525180    
+2023-12-09 03:12:13,622 - Epoch: [78][12000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525168    
+2023-12-09 03:13:06,051 - Epoch: [78][12100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525160    
+2023-12-09 03:13:41,647 - Epoch: [78][12168/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525151    
+2023-12-09 03:13:42,039 - --- validate (epoch=78)-----------
+2023-12-09 03:13:42,039 - 167951 samples (256 per mini-batch)
+2023-12-09 03:14:32,732 - Epoch: [78][  100/  657]    Loss 0.000000    Overall Loss 0.013938    
+2023-12-09 03:15:21,376 - Epoch: [78][  200/  657]    Loss 0.000000    Overall Loss 0.013937    
+2023-12-09 03:16:09,959 - Epoch: [78][  300/  657]    Loss 0.000000    Overall Loss 0.013927    
+2023-12-09 03:16:58,548 - Epoch: [78][  400/  657]    Loss 0.000000    Overall Loss 0.013927    
+2023-12-09 03:17:47,116 - Epoch: [78][  500/  657]    Loss 0.000000    Overall Loss 0.013934    
+2023-12-09 03:18:35,706 - Epoch: [78][  600/  657]    Loss 0.000000    Overall Loss 0.013930    
+2023-12-09 03:19:02,941 - Epoch: [78][  657/  657]    Loss 0.000000    Overall Loss 0.013933    
+2023-12-09 03:19:03,143 - ==> Overall Loss: 0.014
+
+2023-12-09 03:19:03,144 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-09 03:19:03,144 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-09 03:19:03,165 - 
+
+2023-12-09 03:19:03,165 - Training epoch: 3114790 samples (256 per mini-batch)
+2023-12-09 03:20:03,598 - Epoch: [79][  100/12168]    Overall Loss 0.013356    Objective Loss 0.000000    Distill Loss 0.013356                                        LR 0.000008    Time 0.604245    
+2023-12-09 03:20:55,997 - Epoch: [79][  200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.564099    
+2023-12-09 03:21:48,420 - Epoch: [79][  300/12168]    Overall Loss 0.013343    Objective Loss 0.000000    Distill Loss 0.013343                                        LR 0.000008    Time 0.550799    
+2023-12-09 03:22:40,876 - Epoch: [79][  400/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.544229    
+2023-12-09 03:23:33,324 - Epoch: [79][  500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.540272    
+2023-12-09 03:24:25,667 - Epoch: [79][  600/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.537460    
+2023-12-09 03:25:18,045 - Epoch: [79][  700/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.535501    
+2023-12-09 03:26:10,496 - Epoch: [79][  800/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.534123    
+2023-12-09 03:27:02,905 - Epoch: [79][  900/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.533005    
+2023-12-09 03:27:55,280 - Epoch: [79][ 1000/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.532076    
+2023-12-09 03:28:47,613 - Epoch: [79][ 1100/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.531278    
+2023-12-09 03:29:40,002 - Epoch: [79][ 1200/12168]    Overall Loss 0.013331    Objective Loss 0.000000    Distill Loss 0.013331                                        LR 0.000008    Time 0.530659    
+2023-12-09 03:30:32,384 - Epoch: [79][ 1300/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.530130    
+2023-12-09 03:31:24,775 - Epoch: [79][ 1400/12168]    Overall Loss 0.013328    Objective Loss 0.000000    Distill Loss 0.013328                                        LR 0.000008    Time 0.529683    
+2023-12-09 03:32:17,162 - Epoch: [79][ 1500/12168]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                                        LR 0.000008    Time 0.529294    
+2023-12-09 03:33:09,560 - Epoch: [79][ 1600/12168]    Overall Loss 0.013334    Objective Loss 0.000000    Distill Loss 0.013334                                        LR 0.000008    Time 0.528960    
+2023-12-09 03:34:01,948 - Epoch: [79][ 1700/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.528659    
+2023-12-09 03:34:54,358 - Epoch: [79][ 1800/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.528404    
+2023-12-09 03:35:46,735 - Epoch: [79][ 1900/12168]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                                        LR 0.000008    Time 0.528158    
+2023-12-09 03:36:39,153 - Epoch: [79][ 2000/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527958    
+2023-12-09 03:37:31,554 - Epoch: [79][ 2100/12168]    Overall Loss 0.013337    Objective Loss 0.000000    Distill Loss 0.013337                                        LR 0.000008    Time 0.527768    
+2023-12-09 03:38:23,958 - Epoch: [79][ 2200/12168]    Overall Loss 0.013338    Objective Loss 0.000000    Distill Loss 0.013338                                        LR 0.000008    Time 0.527597    
+2023-12-09 03:39:16,358 - Epoch: [79][ 2300/12168]    Overall Loss 0.013335    Objective Loss 0.000000    Distill Loss 0.013335                                        LR 0.000008    Time 0.527439    
+2023-12-09 03:40:08,762 - Epoch: [79][ 2400/12168]    Overall Loss 0.013332    Objective Loss 0.000000    Distill Loss 0.013332                                        LR 0.000008    Time 0.527296    
+2023-12-09 03:41:01,145 - Epoch: [79][ 2500/12168]    Overall Loss 0.013329    Objective Loss 0.000000    Distill Loss 0.013329                                        LR 0.000008    Time 0.527156    
+2023-12-09 03:41:53,538 - Epoch: [79][ 2600/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.527031    
+2023-12-09 03:42:45,990 - Epoch: [79][ 2700/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526937    
+2023-12-09 03:43:38,395 - Epoch: [79][ 2800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526832    
+2023-12-09 03:44:30,830 - Epoch: [79][ 2900/12168]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                                        LR 0.000008    Time 0.526745    
+2023-12-09 03:45:23,226 - Epoch: [79][ 3000/12168]    Overall Loss 0.013327    Objective Loss 0.000000    Distill Loss 0.013327                                        LR 0.000008    Time 0.526652    
+2023-12-09 03:46:15,668 - Epoch: [79][ 3100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526579    
+2023-12-09 03:47:08,071 - Epoch: [79][ 3200/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526498    
+2023-12-09 03:48:00,474 - Epoch: [79][ 3300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.526422    
+2023-12-09 03:48:52,850 - Epoch: [79][ 3400/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526343    
+2023-12-09 03:49:45,215 - Epoch: [79][ 3500/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526265    
+2023-12-09 03:50:37,519 - Epoch: [79][ 3600/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.526174    
+2023-12-09 03:51:29,942 - Epoch: [79][ 3700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.526121    
+2023-12-09 03:52:22,345 - Epoch: [79][ 3800/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526065    
+2023-12-09 03:53:14,752 - Epoch: [79][ 3900/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.526013    
+2023-12-09 03:54:07,209 - Epoch: [79][ 4000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525976    
+2023-12-09 03:54:59,619 - Epoch: [79][ 4100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.525929    
+2023-12-09 03:55:52,054 - Epoch: [79][ 4200/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525891    
+2023-12-09 03:56:44,444 - Epoch: [79][ 4300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525844    
+2023-12-09 03:57:36,827 - Epoch: [79][ 4400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525797    
+2023-12-09 03:58:29,270 - Epoch: [79][ 4500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525766    
+2023-12-09 03:59:21,672 - Epoch: [79][ 4600/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525727    
+2023-12-09 04:00:14,128 - Epoch: [79][ 4700/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525702    
+2023-12-09 04:01:06,500 - Epoch: [79][ 4800/12168]    Overall Loss 0.013319    Objective Loss 0.000000    Distill Loss 0.013319                                        LR 0.000008    Time 0.525660    
+2023-12-09 04:01:58,875 - Epoch: [79][ 4900/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525620    
+2023-12-09 04:02:51,250 - Epoch: [79][ 5000/12168]    Overall Loss 0.013318    Objective Loss 0.000000    Distill Loss 0.013318                                        LR 0.000008    Time 0.525582    
+2023-12-09 04:03:43,636 - Epoch: [79][ 5100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525548    
+2023-12-09 04:04:35,963 - Epoch: [79][ 5200/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525503    
+2023-12-09 04:05:28,336 - Epoch: [79][ 5300/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525469    
+2023-12-09 04:06:20,823 - Epoch: [79][ 5400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525457    
+2023-12-09 04:07:13,229 - Epoch: [79][ 5500/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.525432    
+2023-12-09 04:08:05,625 - Epoch: [79][ 5600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525405    
+2023-12-09 04:08:58,011 - Epoch: [79][ 5700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525377    
+2023-12-09 04:09:50,355 - Epoch: [79][ 5800/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525343    
+2023-12-09 04:10:42,776 - Epoch: [79][ 5900/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525323    
+2023-12-09 04:11:35,089 - Epoch: [79][ 6000/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525286    
+2023-12-09 04:12:27,434 - Epoch: [79][ 6100/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525255    
+2023-12-09 04:13:19,864 - Epoch: [79][ 6200/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525240    
+2023-12-09 04:14:12,312 - Epoch: [79][ 6300/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525227    
+2023-12-09 04:15:04,755 - Epoch: [79][ 6400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.525214    
+2023-12-09 04:15:57,241 - Epoch: [79][ 6500/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525208    
+2023-12-09 04:16:49,557 - Epoch: [79][ 6600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525177    
+2023-12-09 04:17:42,014 - Epoch: [79][ 6700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525167    
+2023-12-09 04:18:34,353 - Epoch: [79][ 6800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525140    
+2023-12-09 04:19:26,684 - Epoch: [79][ 6900/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525113    
+2023-12-09 04:20:19,031 - Epoch: [79][ 7000/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525089    
+2023-12-09 04:21:11,428 - Epoch: [79][ 7100/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525073    
+2023-12-09 04:22:03,880 - Epoch: [79][ 7200/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525065    
+2023-12-09 04:22:56,307 - Epoch: [79][ 7300/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525054    
+2023-12-09 04:23:48,742 - Epoch: [79][ 7400/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525044    
+2023-12-09 04:24:41,158 - Epoch: [79][ 7500/12168]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                                        LR 0.000008    Time 0.525031    
+2023-12-09 04:25:33,603 - Epoch: [79][ 7600/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525023    
+2023-12-09 04:26:26,025 - Epoch: [79][ 7700/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525013    
+2023-12-09 04:27:18,522 - Epoch: [79][ 7800/12168]    Overall Loss 0.013321    Objective Loss 0.000000    Distill Loss 0.013321                                        LR 0.000008    Time 0.525012    
+2023-12-09 04:28:10,931 - Epoch: [79][ 7900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524999    
+2023-12-09 04:29:03,270 - Epoch: [79][ 8000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524979    
+2023-12-09 04:29:55,721 - Epoch: [79][ 8100/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524973    
+2023-12-09 04:30:48,071 - Epoch: [79][ 8200/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524954    
+2023-12-09 04:31:40,489 - Epoch: [79][ 8300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524945    
+2023-12-09 04:32:32,886 - Epoch: [79][ 8400/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524933    
+2023-12-09 04:33:25,344 - Epoch: [79][ 8500/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524928    
+2023-12-09 04:34:17,861 - Epoch: [79][ 8600/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524930    
+2023-12-09 04:35:10,339 - Epoch: [79][ 8700/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524928    
+2023-12-09 04:36:02,792 - Epoch: [79][ 8800/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524923    
+2023-12-09 04:36:55,242 - Epoch: [79][ 8900/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524918    
+2023-12-09 04:37:47,631 - Epoch: [79][ 9000/12168]    Overall Loss 0.013322    Objective Loss 0.000000    Distill Loss 0.013322                                        LR 0.000008    Time 0.524907    
+2023-12-09 04:38:40,105 - Epoch: [79][ 9100/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524904    
+2023-12-09 04:39:32,564 - Epoch: [79][ 9200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524901    
+2023-12-09 04:40:24,949 - Epoch: [79][ 9300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524889    
+2023-12-09 04:41:17,339 - Epoch: [79][ 9400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524878    
+2023-12-09 04:42:09,785 - Epoch: [79][ 9500/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524873    
+2023-12-09 04:43:02,139 - Epoch: [79][ 9600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524859    
+2023-12-09 04:43:54,528 - Epoch: [79][ 9700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524849    
+2023-12-09 04:44:46,969 - Epoch: [79][ 9800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524844    
+2023-12-09 04:45:39,462 - Epoch: [79][ 9900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524844    
+2023-12-09 04:46:31,856 - Epoch: [79][10000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524835    
+2023-12-09 04:47:24,342 - Epoch: [79][10100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524835    
+2023-12-09 04:48:16,732 - Epoch: [79][10200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524825    
+2023-12-09 04:49:09,148 - Epoch: [79][10300/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524819    
+2023-12-09 04:50:01,603 - Epoch: [79][10400/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524816    
+2023-12-09 04:50:54,007 - Epoch: [79][10500/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524808    
+2023-12-09 04:51:46,373 - Epoch: [79][10600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524797    
+2023-12-09 04:52:38,815 - Epoch: [79][10700/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524793    
+2023-12-09 04:53:31,281 - Epoch: [79][10800/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524791    
+2023-12-09 04:54:23,735 - Epoch: [79][10900/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524789    
+2023-12-09 04:55:16,128 - Epoch: [79][11000/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524781    
+2023-12-09 04:56:08,552 - Epoch: [79][11100/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524776    
+2023-12-09 04:57:00,920 - Epoch: [79][11200/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524765    
+2023-12-09 04:57:53,384 - Epoch: [79][11300/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524764    
+2023-12-09 04:58:45,775 - Epoch: [79][11400/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524756    
+2023-12-09 04:59:38,191 - Epoch: [79][11500/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524751    
+2023-12-09 05:00:30,768 - Epoch: [79][11600/12168]    Overall Loss 0.013323    Objective Loss 0.000000    Distill Loss 0.013323                                        LR 0.000008    Time 0.524759    
+2023-12-09 05:01:23,155 - Epoch: [79][11700/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524751    
+2023-12-09 05:02:15,600 - Epoch: [79][11800/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524749    
+2023-12-09 05:03:08,054 - Epoch: [79][11900/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524747    
+2023-12-09 05:04:00,453 - Epoch: [79][12000/12168]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                                        LR 0.000008    Time 0.524740    
+2023-12-09 05:04:52,934 - Epoch: [79][12100/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.524740    
+2023-12-09 05:05:28,601 - Epoch: [79][12168/12168]    Overall Loss 0.013325    Objective Loss 0.000000    Distill Loss 0.013325                                        LR 0.000008    Time 0.524739    
+2023-12-09 05:05:29,011 - --- validate (epoch=79)-----------
+2023-12-09 05:05:29,011 - 167951 samples (256 per mini-batch)
+2023-12-09 05:06:20,740 - Epoch: [79][  100/  657]    Loss 0.000000    Overall Loss 0.013940    
+2023-12-09 05:07:09,279 - Epoch: [79][  200/  657]    Loss 0.000000    Overall Loss 0.013920    
+2023-12-09 05:07:57,819 - Epoch: [79][  300/  657]    Loss 0.000000    Overall Loss 0.013919    
+2023-12-09 05:08:46,377 - Epoch: [79][  400/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-09 05:09:34,925 - Epoch: [79][  500/  657]    Loss 0.000000    Overall Loss 0.013915    
+2023-12-09 05:10:23,482 - Epoch: [79][  600/  657]    Loss 0.000000    Overall Loss 0.013914    
+2023-12-09 05:10:50,718 - Epoch: [79][  657/  657]    Loss 0.000000    Overall Loss 0.013914    
+2023-12-09 05:10:50,923 - ==> Overall Loss: 0.014
+
+2023-12-09 05:10:50,924 - ==> Best [Overall Loss: 0.013900 on epoch: 66]
+2023-12-09 05:10:50,924 - Saving checkpoint to: logs/2023.11.30-202919/qat_checkpoint.pth.tar
+2023-12-09 05:10:50,946 - --- test ---------------------
+2023-12-09 05:10:50,946 - 167951 samples (256 per mini-batch)
+2023-12-09 05:11:41,205 - Test: [  100/  657]    Loss 0.000000    Overall Loss 0.013918    
+2023-12-09 05:12:29,736 - Test: [  200/  657]    Loss 0.000000    Overall Loss 0.013897    
+2023-12-09 05:13:18,280 - Test: [  300/  657]    Loss 0.000000    Overall Loss 0.013900    
+2023-12-09 05:14:06,796 - Test: [  400/  657]    Loss 0.000000    Overall Loss 0.013899    
+2023-12-09 05:14:55,321 - Test: [  500/  657]    Loss 0.000000    Overall Loss 0.013903    
+2023-12-09 05:15:43,835 - Test: [  600/  657]    Loss 0.000000    Overall Loss 0.013909    
+2023-12-09 05:16:11,040 - Test: [  657/  657]    Loss 0.000000    Overall Loss 0.013908    
+2023-12-09 05:16:11,259 - ==> Overall Loss: 0.014
+
+2023-12-09 05:16:12,319 - 
+2023-12-09 05:16:12,319 - Log file for this run: /home/oguzhanbuyuksolak/Repos/pr271/ai8x-training/logs/2023.11.30-202919/2023.11.30-202919.log
diff --git a/trained/ai85-faceid_112-qat.pth.tar b/trained/ai85-faceid_112-qat.pth.tar
new file mode 100644
index 00000000..0dc42b1f
Binary files /dev/null and b/trained/ai85-faceid_112-qat.pth.tar differ
diff --git a/trained/ai85-fakepass-faceid_112-qat-q.pth.tar b/trained/ai85-fakepass-faceid_112-qat-q.pth.tar
new file mode 100644
index 00000000..216b098f
Binary files /dev/null and b/trained/ai85-fakepass-faceid_112-qat-q.pth.tar differ
diff --git a/trained/ai87-dot_emb_112_checkpoint-q.pth.tar b/trained/ai87-dot_emb_112_checkpoint-q.pth.tar
new file mode 100644
index 00000000..46d73e37
Binary files /dev/null and b/trained/ai87-dot_emb_112_checkpoint-q.pth.tar differ
diff --git a/trained/ai87-mobilefacenet-112-qat-q.pth.tar b/trained/ai87-mobilefacenet-112-qat-q.pth.tar
new file mode 100644
index 00000000..d81a22dd
Binary files /dev/null and b/trained/ai87-mobilefacenet-112-qat-q.pth.tar differ
diff --git a/trained/ai87-mobilefacenet-112-qat.log b/trained/ai87-mobilefacenet-112-qat.log
new file mode 100644
index 00000000..f9826ab9
--- /dev/null
+++ b/trained/ai87-mobilefacenet-112-qat.log
@@ -0,0 +1,11900 @@
+2023-11-30 01:53:35,653 - Log file for this run: /home/oguzhanbuyuksolak/Repos/pr271/ai8x-training/logs/2023.11.30-015335/2023.11.30-015335.log
+2023-11-30 01:53:37,252 - WARNING: kd_student_wt == 0, Overwriting criterion with a dummy loss
+2023-11-30 01:53:37,257 - Optimizer Type: <class 'torch.optim.adam.Adam'>
+2023-11-30 01:53:37,257 - Optimizer Args: {'lr': 0.001, 'betas': (0.9, 0.999), 'eps': 1e-08, 'weight_decay': 0.0, 'amsgrad': False}
+2023-11-30 01:53:43,988 - Dataset sizes:
+	training=3114790
+	validation=167951
+	test=167951
+2023-11-30 01:53:43,988 - Reading compression schedule from: policies/schedule-mobilefacenet_112.yaml
+2023-11-30 01:53:44,463 - => loading checkpoint pretrained/ir152_dim64/best.pth.tar
+2023-11-30 01:53:44,549 - => Checkpoint contents:
++----------------------+-------------+---------+
+| Key                  | Type        | Value   |
+|----------------------+-------------+---------|
+| arch                 | str         | ir_152  |
+| compression_sched    | dict        |         |
+| epoch                | int         | 3       |
+| extras               | dict        |         |
+| optimizer_state_dict | dict        |         |
+| optimizer_type       | type        | Adam    |
+| state_dict           | OrderedDict |         |
++----------------------+-------------+---------+
+
+2023-11-30 01:53:44,549 - => Checkpoint['extras'] contents:
++---------------------------+-----------+----------+
+| Key                       | Type      |    Value |
+|---------------------------+-----------+----------|
+| best_epoch                | int       | 3        |
+| best_mAP                  | int       | 0        |
+| best_top1                 | float     | 0.964031 |
+| current_mAP               | int       | 0        |
+| current_top1              | float     | 0.964031 |
+| loss_optimizer_state_dict | dict      |          |
+| loss_weights              | Parameter |          |
++---------------------------+-----------+----------+
+
+2023-11-30 01:53:44,550 - Loaded compression schedule from checkpoint (epoch 3)
+2023-11-30 01:53:44,594 - => loaded 'state_dict' from checkpoint 'pretrained/ir152_dim64/best.pth.tar'
+2023-11-30 01:53:44,596 - 
+Student-Teacher knowledge distillation enabled:
+2023-11-30 01:53:44,596 - 	Teacher Model: ir_152
+2023-11-30 01:53:44,596 - 	Temperature: 1.0
+2023-11-30 01:53:44,596 - 	Loss Weights (distillation | student | teacher): 1.00 | 0.00 | 0.00
+2023-11-30 01:53:44,596 - 	Starting from Epoch: 0
+2023-11-30 01:53:44,596 - 
+
+2023-11-30 01:53:44,596 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 01:54:16,787 - Epoch: [0][  100/31148]    Overall Loss 0.029978    Objective Loss 0.000000    Distill Loss 0.029978                     LR 0.001000    Time 0.321881    
+2023-11-30 01:54:42,471 - Epoch: [0][  200/31148]    Overall Loss 0.029508    Objective Loss 0.000000    Distill Loss 0.029508                     LR 0.001000    Time 0.289345    
+2023-11-30 01:55:08,218 - Epoch: [0][  300/31148]    Overall Loss 0.029161    Objective Loss 0.000000    Distill Loss 0.029161                     LR 0.001000    Time 0.278712    
+2023-11-30 01:55:33,971 - Epoch: [0][  400/31148]    Overall Loss 0.028883    Objective Loss 0.000000    Distill Loss 0.028883                     LR 0.001000    Time 0.273410    
+2023-11-30 01:55:59,723 - Epoch: [0][  500/31148]    Overall Loss 0.028614    Objective Loss 0.000000    Distill Loss 0.028614                     LR 0.001000    Time 0.270226    
+2023-11-30 01:56:25,494 - Epoch: [0][  600/31148]    Overall Loss 0.028377    Objective Loss 0.000000    Distill Loss 0.028377                     LR 0.001000    Time 0.268135    
+2023-11-30 01:56:51,209 - Epoch: [0][  700/31148]    Overall Loss 0.028163    Objective Loss 0.000000    Distill Loss 0.028163                     LR 0.001000    Time 0.266563    
+2023-11-30 01:57:16,952 - Epoch: [0][  800/31148]    Overall Loss 0.027952    Objective Loss 0.000000    Distill Loss 0.027952                     LR 0.001000    Time 0.265418    
+2023-11-30 01:57:42,654 - Epoch: [0][  900/31148]    Overall Loss 0.027757    Objective Loss 0.000000    Distill Loss 0.027757                     LR 0.001000    Time 0.264482    
+2023-11-30 01:58:08,400 - Epoch: [0][ 1000/31148]    Overall Loss 0.027576    Objective Loss 0.000000    Distill Loss 0.027576                     LR 0.001000    Time 0.263777    
+2023-11-30 01:58:34,160 - Epoch: [0][ 1100/31148]    Overall Loss 0.027407    Objective Loss 0.000000    Distill Loss 0.027407                     LR 0.001000    Time 0.263213    
+2023-11-30 01:58:59,901 - Epoch: [0][ 1200/31148]    Overall Loss 0.027250    Objective Loss 0.000000    Distill Loss 0.027250                     LR 0.001000    Time 0.262727    
+2023-11-30 01:59:25,656 - Epoch: [0][ 1300/31148]    Overall Loss 0.027097    Objective Loss 0.000000    Distill Loss 0.027097                     LR 0.001000    Time 0.262327    
+2023-11-30 01:59:51,435 - Epoch: [0][ 1400/31148]    Overall Loss 0.026955    Objective Loss 0.000000    Distill Loss 0.026955                     LR 0.001000    Time 0.262001    
+2023-11-30 02:00:17,226 - Epoch: [0][ 1500/31148]    Overall Loss 0.026821    Objective Loss 0.000000    Distill Loss 0.026821                     LR 0.001000    Time 0.261727    
+2023-11-30 02:00:42,975 - Epoch: [0][ 1600/31148]    Overall Loss 0.026687    Objective Loss 0.000000    Distill Loss 0.026687                     LR 0.001000    Time 0.261460    
+2023-11-30 02:01:08,705 - Epoch: [0][ 1700/31148]    Overall Loss 0.026562    Objective Loss 0.000000    Distill Loss 0.026562                     LR 0.001000    Time 0.261214    
+2023-11-30 02:01:34,392 - Epoch: [0][ 1800/31148]    Overall Loss 0.026435    Objective Loss 0.000000    Distill Loss 0.026435                     LR 0.001000    Time 0.260971    
+2023-11-30 02:02:00,126 - Epoch: [0][ 1900/31148]    Overall Loss 0.026316    Objective Loss 0.000000    Distill Loss 0.026316                     LR 0.001000    Time 0.260779    
+2023-11-30 02:02:25,803 - Epoch: [0][ 2000/31148]    Overall Loss 0.026205    Objective Loss 0.000000    Distill Loss 0.026205                     LR 0.001000    Time 0.260577    
+2023-11-30 02:02:51,792 - Epoch: [0][ 2100/31148]    Overall Loss 0.026096    Objective Loss 0.000000    Distill Loss 0.026096                     LR 0.001000    Time 0.260543    
+2023-11-30 02:03:17,491 - Epoch: [0][ 2200/31148]    Overall Loss 0.025992    Objective Loss 0.000000    Distill Loss 0.025992                     LR 0.001000    Time 0.260380    
+2023-11-30 02:03:43,242 - Epoch: [0][ 2300/31148]    Overall Loss 0.025892    Objective Loss 0.000000    Distill Loss 0.025892                     LR 0.001000    Time 0.260254    
+2023-11-30 02:04:09,604 - Epoch: [0][ 2400/31148]    Overall Loss 0.025794    Objective Loss 0.000000    Distill Loss 0.025794                     LR 0.001000    Time 0.260393    
+2023-11-30 02:04:36,028 - Epoch: [0][ 2500/31148]    Overall Loss 0.025696    Objective Loss 0.000000    Distill Loss 0.025696                     LR 0.001000    Time 0.260546    
+2023-11-30 02:05:01,751 - Epoch: [0][ 2600/31148]    Overall Loss 0.025605    Objective Loss 0.000000    Distill Loss 0.025605                     LR 0.001000    Time 0.260418    
+2023-11-30 02:05:27,516 - Epoch: [0][ 2700/31148]    Overall Loss 0.025513    Objective Loss 0.000000    Distill Loss 0.025513                     LR 0.001000    Time 0.260314    
+2023-11-30 02:05:53,240 - Epoch: [0][ 2800/31148]    Overall Loss 0.025422    Objective Loss 0.000000    Distill Loss 0.025422                     LR 0.001000    Time 0.260203    
+2023-11-30 02:06:18,898 - Epoch: [0][ 2900/31148]    Overall Loss 0.025335    Objective Loss 0.000000    Distill Loss 0.025335                     LR 0.001000    Time 0.260078    
+2023-11-30 02:06:44,653 - Epoch: [0][ 3000/31148]    Overall Loss 0.025252    Objective Loss 0.000000    Distill Loss 0.025252                     LR 0.001000    Time 0.259993    
+2023-11-30 02:07:10,448 - Epoch: [0][ 3100/31148]    Overall Loss 0.025167    Objective Loss 0.000000    Distill Loss 0.025167                     LR 0.001000    Time 0.259926    
+2023-11-30 02:07:36,173 - Epoch: [0][ 3200/31148]    Overall Loss 0.025086    Objective Loss 0.000000    Distill Loss 0.025086                     LR 0.001000    Time 0.259842    
+2023-11-30 02:08:01,935 - Epoch: [0][ 3300/31148]    Overall Loss 0.025003    Objective Loss 0.000000    Distill Loss 0.025003                     LR 0.001000    Time 0.259773    
+2023-11-30 02:08:27,661 - Epoch: [0][ 3400/31148]    Overall Loss 0.024926    Objective Loss 0.000000    Distill Loss 0.024926                     LR 0.001000    Time 0.259699    
+2023-11-30 02:08:53,454 - Epoch: [0][ 3500/31148]    Overall Loss 0.024850    Objective Loss 0.000000    Distill Loss 0.024850                     LR 0.001000    Time 0.259647    
+2023-11-30 02:09:19,205 - Epoch: [0][ 3600/31148]    Overall Loss 0.024778    Objective Loss 0.000000    Distill Loss 0.024778                     LR 0.001000    Time 0.259587    
+2023-11-30 02:09:44,931 - Epoch: [0][ 3700/31148]    Overall Loss 0.024704    Objective Loss 0.000000    Distill Loss 0.024704                     LR 0.001000    Time 0.259524    
+2023-11-30 02:10:10,691 - Epoch: [0][ 3800/31148]    Overall Loss 0.024631    Objective Loss 0.000000    Distill Loss 0.024631                     LR 0.001000    Time 0.259472    
+2023-11-30 02:10:36,479 - Epoch: [0][ 3900/31148]    Overall Loss 0.024560    Objective Loss 0.000000    Distill Loss 0.024560                     LR 0.001000    Time 0.259431    
+2023-11-30 02:11:02,175 - Epoch: [0][ 4000/31148]    Overall Loss 0.024489    Objective Loss 0.000000    Distill Loss 0.024489                     LR 0.001000    Time 0.259368    
+2023-11-30 02:11:27,933 - Epoch: [0][ 4100/31148]    Overall Loss 0.024421    Objective Loss 0.000000    Distill Loss 0.024421                     LR 0.001000    Time 0.259324    
+2023-11-30 02:11:53,656 - Epoch: [0][ 4200/31148]    Overall Loss 0.024355    Objective Loss 0.000000    Distill Loss 0.024355                     LR 0.001000    Time 0.259273    
+2023-11-30 02:12:19,434 - Epoch: [0][ 4300/31148]    Overall Loss 0.024292    Objective Loss 0.000000    Distill Loss 0.024292                     LR 0.001000    Time 0.259238    
+2023-11-30 02:12:45,196 - Epoch: [0][ 4400/31148]    Overall Loss 0.024227    Objective Loss 0.000000    Distill Loss 0.024227                     LR 0.001000    Time 0.259201    
+2023-11-30 02:13:10,951 - Epoch: [0][ 4500/31148]    Overall Loss 0.024163    Objective Loss 0.000000    Distill Loss 0.024163                     LR 0.001000    Time 0.259163    
+2023-11-30 02:13:36,703 - Epoch: [0][ 4600/31148]    Overall Loss 0.024101    Objective Loss 0.000000    Distill Loss 0.024101                     LR 0.001000    Time 0.259127    
+2023-11-30 02:14:03,026 - Epoch: [0][ 4700/31148]    Overall Loss 0.024039    Objective Loss 0.000000    Distill Loss 0.024039                     LR 0.001000    Time 0.259214    
+2023-11-30 02:14:28,811 - Epoch: [0][ 4800/31148]    Overall Loss 0.023979    Objective Loss 0.000000    Distill Loss 0.023979                     LR 0.001000    Time 0.259185    
+2023-11-30 02:14:54,561 - Epoch: [0][ 4900/31148]    Overall Loss 0.023919    Objective Loss 0.000000    Distill Loss 0.023919                     LR 0.001000    Time 0.259150    
+2023-11-30 02:15:20,240 - Epoch: [0][ 5000/31148]    Overall Loss 0.023861    Objective Loss 0.000000    Distill Loss 0.023861                     LR 0.001000    Time 0.259102    
+2023-11-30 02:15:45,985 - Epoch: [0][ 5100/31148]    Overall Loss 0.023803    Objective Loss 0.000000    Distill Loss 0.023803                     LR 0.001000    Time 0.259069    
+2023-11-30 02:16:11,733 - Epoch: [0][ 5200/31148]    Overall Loss 0.023748    Objective Loss 0.000000    Distill Loss 0.023748                     LR 0.001000    Time 0.259038    
+2023-11-30 02:16:37,535 - Epoch: [0][ 5300/31148]    Overall Loss 0.023691    Objective Loss 0.000000    Distill Loss 0.023691                     LR 0.001000    Time 0.259018    
+2023-11-30 02:17:03,288 - Epoch: [0][ 5400/31148]    Overall Loss 0.023638    Objective Loss 0.000000    Distill Loss 0.023638                     LR 0.001000    Time 0.258990    
+2023-11-30 02:17:29,001 - Epoch: [0][ 5500/31148]    Overall Loss 0.023583    Objective Loss 0.000000    Distill Loss 0.023583                     LR 0.001000    Time 0.258956    
+2023-11-30 02:17:54,908 - Epoch: [0][ 5600/31148]    Overall Loss 0.023529    Objective Loss 0.000000    Distill Loss 0.023529                     LR 0.001000    Time 0.258958    
+2023-11-30 02:18:20,650 - Epoch: [0][ 5700/31148]    Overall Loss 0.023477    Objective Loss 0.000000    Distill Loss 0.023477                     LR 0.001000    Time 0.258930    
+2023-11-30 02:18:46,340 - Epoch: [0][ 5800/31148]    Overall Loss 0.023423    Objective Loss 0.000000    Distill Loss 0.023423                     LR 0.001000    Time 0.258895    
+2023-11-30 02:19:12,105 - Epoch: [0][ 5900/31148]    Overall Loss 0.023370    Objective Loss 0.000000    Distill Loss 0.023370                     LR 0.001000    Time 0.258873    
+2023-11-30 02:19:37,867 - Epoch: [0][ 6000/31148]    Overall Loss 0.023320    Objective Loss 0.000000    Distill Loss 0.023320                     LR 0.001000    Time 0.258852    
+2023-11-30 02:20:03,634 - Epoch: [0][ 6100/31148]    Overall Loss 0.023270    Objective Loss 0.000000    Distill Loss 0.023270                     LR 0.001000    Time 0.258832    
+2023-11-30 02:20:29,336 - Epoch: [0][ 6200/31148]    Overall Loss 0.023218    Objective Loss 0.000000    Distill Loss 0.023218                     LR 0.001000    Time 0.258803    
+2023-11-30 02:20:55,138 - Epoch: [0][ 6300/31148]    Overall Loss 0.023169    Objective Loss 0.000000    Distill Loss 0.023169                     LR 0.001000    Time 0.258790    
+2023-11-30 02:21:20,849 - Epoch: [0][ 6400/31148]    Overall Loss 0.023121    Objective Loss 0.000000    Distill Loss 0.023121                     LR 0.001000    Time 0.258763    
+2023-11-30 02:21:46,595 - Epoch: [0][ 6500/31148]    Overall Loss 0.023072    Objective Loss 0.000000    Distill Loss 0.023072                     LR 0.001000    Time 0.258742    
+2023-11-30 02:22:12,354 - Epoch: [0][ 6600/31148]    Overall Loss 0.023024    Objective Loss 0.000000    Distill Loss 0.023024                     LR 0.001000    Time 0.258725    
+2023-11-30 02:22:38,072 - Epoch: [0][ 6700/31148]    Overall Loss 0.022978    Objective Loss 0.000000    Distill Loss 0.022978                     LR 0.001000    Time 0.258701    
+2023-11-30 02:23:03,802 - Epoch: [0][ 6800/31148]    Overall Loss 0.022933    Objective Loss 0.000000    Distill Loss 0.022933                     LR 0.001000    Time 0.258680    
+2023-11-30 02:23:29,561 - Epoch: [0][ 6900/31148]    Overall Loss 0.022887    Objective Loss 0.000000    Distill Loss 0.022887                     LR 0.001000    Time 0.258664    
+2023-11-30 02:23:55,271 - Epoch: [0][ 7000/31148]    Overall Loss 0.022841    Objective Loss 0.000000    Distill Loss 0.022841                     LR 0.001000    Time 0.258641    
+2023-11-30 02:24:21,060 - Epoch: [0][ 7100/31148]    Overall Loss 0.022797    Objective Loss 0.000000    Distill Loss 0.022797                     LR 0.001000    Time 0.258630    
+2023-11-30 02:24:46,832 - Epoch: [0][ 7200/31148]    Overall Loss 0.022754    Objective Loss 0.000000    Distill Loss 0.022754                     LR 0.001000    Time 0.258617    
+2023-11-30 02:25:12,646 - Epoch: [0][ 7300/31148]    Overall Loss 0.022711    Objective Loss 0.000000    Distill Loss 0.022711                     LR 0.001000    Time 0.258610    
+2023-11-30 02:25:38,399 - Epoch: [0][ 7400/31148]    Overall Loss 0.022668    Objective Loss 0.000000    Distill Loss 0.022668                     LR 0.001000    Time 0.258595    
+2023-11-30 02:26:04,143 - Epoch: [0][ 7500/31148]    Overall Loss 0.022626    Objective Loss 0.000000    Distill Loss 0.022626                     LR 0.001000    Time 0.258580    
+2023-11-30 02:26:29,899 - Epoch: [0][ 7600/31148]    Overall Loss 0.022584    Objective Loss 0.000000    Distill Loss 0.022584                     LR 0.001000    Time 0.258566    
+2023-11-30 02:26:55,644 - Epoch: [0][ 7700/31148]    Overall Loss 0.022542    Objective Loss 0.000000    Distill Loss 0.022542                     LR 0.001000    Time 0.258551    
+2023-11-30 02:27:21,329 - Epoch: [0][ 7800/31148]    Overall Loss 0.022499    Objective Loss 0.000000    Distill Loss 0.022499                     LR 0.001000    Time 0.258529    
+2023-11-30 02:27:47,097 - Epoch: [0][ 7900/31148]    Overall Loss 0.022458    Objective Loss 0.000000    Distill Loss 0.022458                     LR 0.001000    Time 0.258518    
+2023-11-30 02:28:12,870 - Epoch: [0][ 8000/31148]    Overall Loss 0.022416    Objective Loss 0.000000    Distill Loss 0.022416                     LR 0.001000    Time 0.258508    
+2023-11-30 02:28:39,262 - Epoch: [0][ 8100/31148]    Overall Loss 0.022377    Objective Loss 0.000000    Distill Loss 0.022377                     LR 0.001000    Time 0.258574    
+2023-11-30 02:29:05,036 - Epoch: [0][ 8200/31148]    Overall Loss 0.022337    Objective Loss 0.000000    Distill Loss 0.022337                     LR 0.001000    Time 0.258564    
+2023-11-30 02:29:30,852 - Epoch: [0][ 8300/31148]    Overall Loss 0.022299    Objective Loss 0.000000    Distill Loss 0.022299                     LR 0.001000    Time 0.258559    
+2023-11-30 02:29:56,647 - Epoch: [0][ 8400/31148]    Overall Loss 0.022260    Objective Loss 0.000000    Distill Loss 0.022260                     LR 0.001000    Time 0.258551    
+2023-11-30 02:30:22,391 - Epoch: [0][ 8500/31148]    Overall Loss 0.022222    Objective Loss 0.000000    Distill Loss 0.022222                     LR 0.001000    Time 0.258538    
+2023-11-30 02:30:48,149 - Epoch: [0][ 8600/31148]    Overall Loss 0.022184    Objective Loss 0.000000    Distill Loss 0.022184                     LR 0.001000    Time 0.258526    
+2023-11-30 02:31:13,953 - Epoch: [0][ 8700/31148]    Overall Loss 0.022147    Objective Loss 0.000000    Distill Loss 0.022147                     LR 0.001000    Time 0.258520    
+2023-11-30 02:31:39,729 - Epoch: [0][ 8800/31148]    Overall Loss 0.022110    Objective Loss 0.000000    Distill Loss 0.022110                     LR 0.001000    Time 0.258511    
+2023-11-30 02:32:05,437 - Epoch: [0][ 8900/31148]    Overall Loss 0.022073    Objective Loss 0.000000    Distill Loss 0.022073                     LR 0.001000    Time 0.258495    
+2023-11-30 02:32:31,171 - Epoch: [0][ 9000/31148]    Overall Loss 0.022036    Objective Loss 0.000000    Distill Loss 0.022036                     LR 0.001000    Time 0.258482    
+2023-11-30 02:32:56,920 - Epoch: [0][ 9100/31148]    Overall Loss 0.022000    Objective Loss 0.000000    Distill Loss 0.022000                     LR 0.001000    Time 0.258471    
+2023-11-30 02:33:22,670 - Epoch: [0][ 9200/31148]    Overall Loss 0.021964    Objective Loss 0.000000    Distill Loss 0.021964                     LR 0.001000    Time 0.258460    
+2023-11-30 02:33:48,442 - Epoch: [0][ 9300/31148]    Overall Loss 0.021930    Objective Loss 0.000000    Distill Loss 0.021930                     LR 0.001000    Time 0.258452    
+2023-11-30 02:34:14,146 - Epoch: [0][ 9400/31148]    Overall Loss 0.021894    Objective Loss 0.000000    Distill Loss 0.021894                     LR 0.001000    Time 0.258436    
+2023-11-30 02:34:40,219 - Epoch: [0][ 9500/31148]    Overall Loss 0.021858    Objective Loss 0.000000    Distill Loss 0.021858                     LR 0.001000    Time 0.258460    
+2023-11-30 02:35:05,930 - Epoch: [0][ 9600/31148]    Overall Loss 0.021825    Objective Loss 0.000000    Distill Loss 0.021825                     LR 0.001000    Time 0.258446    
+2023-11-30 02:35:31,663 - Epoch: [0][ 9700/31148]    Overall Loss 0.021791    Objective Loss 0.000000    Distill Loss 0.021791                     LR 0.001000    Time 0.258434    
+2023-11-30 02:35:57,388 - Epoch: [0][ 9800/31148]    Overall Loss 0.021758    Objective Loss 0.000000    Distill Loss 0.021758                     LR 0.001000    Time 0.258422    
+2023-11-30 02:36:23,157 - Epoch: [0][ 9900/31148]    Overall Loss 0.021724    Objective Loss 0.000000    Distill Loss 0.021724                     LR 0.001000    Time 0.258414    
+2023-11-30 02:36:48,926 - Epoch: [0][10000/31148]    Overall Loss 0.021691    Objective Loss 0.000000    Distill Loss 0.021691                     LR 0.001000    Time 0.258407    
+2023-11-30 02:37:14,616 - Epoch: [0][10100/31148]    Overall Loss 0.021659    Objective Loss 0.000000    Distill Loss 0.021659                     LR 0.001000    Time 0.258391    
+2023-11-30 02:37:40,337 - Epoch: [0][10200/31148]    Overall Loss 0.021626    Objective Loss 0.000000    Distill Loss 0.021626                     LR 0.001000    Time 0.258380    
+2023-11-30 02:38:06,089 - Epoch: [0][10300/31148]    Overall Loss 0.021594    Objective Loss 0.000000    Distill Loss 0.021594                     LR 0.001000    Time 0.258371    
+2023-11-30 02:38:31,811 - Epoch: [0][10400/31148]    Overall Loss 0.021562    Objective Loss 0.000000    Distill Loss 0.021562                     LR 0.001000    Time 0.258360    
+2023-11-30 02:38:57,486 - Epoch: [0][10500/31148]    Overall Loss 0.021530    Objective Loss 0.000000    Distill Loss 0.021530                     LR 0.001000    Time 0.258344    
+2023-11-30 02:39:23,205 - Epoch: [0][10600/31148]    Overall Loss 0.021499    Objective Loss 0.000000    Distill Loss 0.021499                     LR 0.001000    Time 0.258333    
+2023-11-30 02:39:48,925 - Epoch: [0][10700/31148]    Overall Loss 0.021467    Objective Loss 0.000000    Distill Loss 0.021467                     LR 0.001000    Time 0.258322    
+2023-11-30 02:40:15,651 - Epoch: [0][10800/31148]    Overall Loss 0.021436    Objective Loss 0.000000    Distill Loss 0.021436                     LR 0.001000    Time 0.258405    
+2023-11-30 02:40:41,840 - Epoch: [0][10900/31148]    Overall Loss 0.021406    Objective Loss 0.000000    Distill Loss 0.021406                     LR 0.001000    Time 0.258436    
+2023-11-30 02:41:07,601 - Epoch: [0][11000/31148]    Overall Loss 0.021375    Objective Loss 0.000000    Distill Loss 0.021375                     LR 0.001000    Time 0.258429    
+2023-11-30 02:41:33,293 - Epoch: [0][11100/31148]    Overall Loss 0.021344    Objective Loss 0.000000    Distill Loss 0.021344                     LR 0.001000    Time 0.258415    
+2023-11-30 02:42:01,494 - Epoch: [0][11200/31148]    Overall Loss 0.021313    Objective Loss 0.000000    Distill Loss 0.021313                     LR 0.001000    Time 0.258625    
+2023-11-30 02:42:27,212 - Epoch: [0][11300/31148]    Overall Loss 0.021284    Objective Loss 0.000000    Distill Loss 0.021284                     LR 0.001000    Time 0.258612    
+2023-11-30 02:42:52,993 - Epoch: [0][11400/31148]    Overall Loss 0.021255    Objective Loss 0.000000    Distill Loss 0.021255                     LR 0.001000    Time 0.258605    
+2023-11-30 02:43:18,781 - Epoch: [0][11500/31148]    Overall Loss 0.021227    Objective Loss 0.000000    Distill Loss 0.021227                     LR 0.001000    Time 0.258598    
+2023-11-30 02:43:44,521 - Epoch: [0][11600/31148]    Overall Loss 0.021198    Objective Loss 0.000000    Distill Loss 0.021198                     LR 0.001000    Time 0.258588    
+2023-11-30 02:44:10,302 - Epoch: [0][11700/31148]    Overall Loss 0.021168    Objective Loss 0.000000    Distill Loss 0.021168                     LR 0.001000    Time 0.258581    
+2023-11-30 02:44:36,047 - Epoch: [0][11800/31148]    Overall Loss 0.021140    Objective Loss 0.000000    Distill Loss 0.021140                     LR 0.001000    Time 0.258571    
+2023-11-30 02:45:01,811 - Epoch: [0][11900/31148]    Overall Loss 0.021112    Objective Loss 0.000000    Distill Loss 0.021112                     LR 0.001000    Time 0.258563    
+2023-11-30 02:45:27,502 - Epoch: [0][12000/31148]    Overall Loss 0.021084    Objective Loss 0.000000    Distill Loss 0.021084                     LR 0.001000    Time 0.258549    
+2023-11-30 02:45:53,307 - Epoch: [0][12100/31148]    Overall Loss 0.021056    Objective Loss 0.000000    Distill Loss 0.021056                     LR 0.001000    Time 0.258545    
+2023-11-30 02:46:19,061 - Epoch: [0][12200/31148]    Overall Loss 0.021028    Objective Loss 0.000000    Distill Loss 0.021028                     LR 0.001000    Time 0.258536    
+2023-11-30 02:46:44,788 - Epoch: [0][12300/31148]    Overall Loss 0.021001    Objective Loss 0.000000    Distill Loss 0.021001                     LR 0.001000    Time 0.258526    
+2023-11-30 02:47:10,517 - Epoch: [0][12400/31148]    Overall Loss 0.020973    Objective Loss 0.000000    Distill Loss 0.020973                     LR 0.001000    Time 0.258516    
+2023-11-30 02:47:36,292 - Epoch: [0][12500/31148]    Overall Loss 0.020946    Objective Loss 0.000000    Distill Loss 0.020946                     LR 0.001000    Time 0.258509    
+2023-11-30 02:48:02,043 - Epoch: [0][12600/31148]    Overall Loss 0.020919    Objective Loss 0.000000    Distill Loss 0.020919                     LR 0.001000    Time 0.258501    
+2023-11-30 02:48:27,800 - Epoch: [0][12700/31148]    Overall Loss 0.020892    Objective Loss 0.000000    Distill Loss 0.020892                     LR 0.001000    Time 0.258494    
+2023-11-30 02:48:53,575 - Epoch: [0][12800/31148]    Overall Loss 0.020866    Objective Loss 0.000000    Distill Loss 0.020866                     LR 0.001000    Time 0.258488    
+2023-11-30 02:49:19,314 - Epoch: [0][12900/31148]    Overall Loss 0.020840    Objective Loss 0.000000    Distill Loss 0.020840                     LR 0.001000    Time 0.258479    
+2023-11-30 02:49:45,027 - Epoch: [0][13000/31148]    Overall Loss 0.020815    Objective Loss 0.000000    Distill Loss 0.020815                     LR 0.001000    Time 0.258468    
+2023-11-30 02:50:10,846 - Epoch: [0][13100/31148]    Overall Loss 0.020789    Objective Loss 0.000000    Distill Loss 0.020789                     LR 0.001000    Time 0.258466    
+2023-11-30 02:50:36,638 - Epoch: [0][13200/31148]    Overall Loss 0.020764    Objective Loss 0.000000    Distill Loss 0.020764                     LR 0.001000    Time 0.258462    
+2023-11-30 02:51:02,380 - Epoch: [0][13300/31148]    Overall Loss 0.020739    Objective Loss 0.000000    Distill Loss 0.020739                     LR 0.001000    Time 0.258454    
+2023-11-30 02:51:28,161 - Epoch: [0][13400/31148]    Overall Loss 0.020713    Objective Loss 0.000000    Distill Loss 0.020713                     LR 0.001000    Time 0.258449    
+2023-11-30 02:51:53,926 - Epoch: [0][13500/31148]    Overall Loss 0.020687    Objective Loss 0.000000    Distill Loss 0.020687                     LR 0.001000    Time 0.258442    
+2023-11-30 02:52:19,719 - Epoch: [0][13600/31148]    Overall Loss 0.020663    Objective Loss 0.000000    Distill Loss 0.020663                     LR 0.001000    Time 0.258438    
+2023-11-30 02:52:45,498 - Epoch: [0][13700/31148]    Overall Loss 0.020638    Objective Loss 0.000000    Distill Loss 0.020638                     LR 0.001000    Time 0.258434    
+2023-11-30 02:53:11,236 - Epoch: [0][13800/31148]    Overall Loss 0.020613    Objective Loss 0.000000    Distill Loss 0.020613                     LR 0.001000    Time 0.258426    
+2023-11-30 02:53:37,021 - Epoch: [0][13900/31148]    Overall Loss 0.020589    Objective Loss 0.000000    Distill Loss 0.020589                     LR 0.001000    Time 0.258421    
+2023-11-30 02:54:02,793 - Epoch: [0][14000/31148]    Overall Loss 0.020565    Objective Loss 0.000000    Distill Loss 0.020565                     LR 0.001000    Time 0.258416    
+2023-11-30 02:54:28,542 - Epoch: [0][14100/31148]    Overall Loss 0.020541    Objective Loss 0.000000    Distill Loss 0.020541                     LR 0.001000    Time 0.258409    
+2023-11-30 02:54:54,266 - Epoch: [0][14200/31148]    Overall Loss 0.020517    Objective Loss 0.000000    Distill Loss 0.020517                     LR 0.001000    Time 0.258401    
+2023-11-30 02:55:20,020 - Epoch: [0][14300/31148]    Overall Loss 0.020493    Objective Loss 0.000000    Distill Loss 0.020493                     LR 0.001000    Time 0.258395    
+2023-11-30 02:55:45,706 - Epoch: [0][14400/31148]    Overall Loss 0.020468    Objective Loss 0.000000    Distill Loss 0.020468                     LR 0.001000    Time 0.258384    
+2023-11-30 02:56:12,099 - Epoch: [0][14500/31148]    Overall Loss 0.020445    Objective Loss 0.000000    Distill Loss 0.020445                     LR 0.001000    Time 0.258422    
+2023-11-30 02:56:38,299 - Epoch: [0][14600/31148]    Overall Loss 0.020421    Objective Loss 0.000000    Distill Loss 0.020421                     LR 0.001000    Time 0.258446    
+2023-11-30 02:57:04,027 - Epoch: [0][14700/31148]    Overall Loss 0.020398    Objective Loss 0.000000    Distill Loss 0.020398                     LR 0.001000    Time 0.258438    
+2023-11-30 02:57:29,765 - Epoch: [0][14800/31148]    Overall Loss 0.020375    Objective Loss 0.000000    Distill Loss 0.020375                     LR 0.001000    Time 0.258431    
+2023-11-30 02:57:55,470 - Epoch: [0][14900/31148]    Overall Loss 0.020352    Objective Loss 0.000000    Distill Loss 0.020352                     LR 0.001000    Time 0.258422    
+2023-11-30 02:58:21,262 - Epoch: [0][15000/31148]    Overall Loss 0.020329    Objective Loss 0.000000    Distill Loss 0.020329                     LR 0.001000    Time 0.258418    
+2023-11-30 02:58:46,994 - Epoch: [0][15100/31148]    Overall Loss 0.020307    Objective Loss 0.000000    Distill Loss 0.020307                     LR 0.001000    Time 0.258411    
+2023-11-30 02:59:12,706 - Epoch: [0][15200/31148]    Overall Loss 0.020285    Objective Loss 0.000000    Distill Loss 0.020285                     LR 0.001000    Time 0.258402    
+2023-11-30 02:59:38,468 - Epoch: [0][15300/31148]    Overall Loss 0.020263    Objective Loss 0.000000    Distill Loss 0.020263                     LR 0.001000    Time 0.258397    
+2023-11-30 03:00:04,188 - Epoch: [0][15400/31148]    Overall Loss 0.020240    Objective Loss 0.000000    Distill Loss 0.020240                     LR 0.001000    Time 0.258389    
+2023-11-30 03:00:29,935 - Epoch: [0][15500/31148]    Overall Loss 0.020219    Objective Loss 0.000000    Distill Loss 0.020219                     LR 0.001000    Time 0.258383    
+2023-11-30 03:00:55,684 - Epoch: [0][15600/31148]    Overall Loss 0.020197    Objective Loss 0.000000    Distill Loss 0.020197                     LR 0.001000    Time 0.258377    
+2023-11-30 03:01:21,424 - Epoch: [0][15700/31148]    Overall Loss 0.020175    Objective Loss 0.000000    Distill Loss 0.020175                     LR 0.001000    Time 0.258370    
+2023-11-30 03:01:47,175 - Epoch: [0][15800/31148]    Overall Loss 0.020154    Objective Loss 0.000000    Distill Loss 0.020154                     LR 0.001000    Time 0.258365    
+2023-11-30 03:02:12,953 - Epoch: [0][15900/31148]    Overall Loss 0.020132    Objective Loss 0.000000    Distill Loss 0.020132                     LR 0.001000    Time 0.258361    
+2023-11-30 03:02:38,737 - Epoch: [0][16000/31148]    Overall Loss 0.020111    Objective Loss 0.000000    Distill Loss 0.020111                     LR 0.001000    Time 0.258357    
+2023-11-30 03:03:04,472 - Epoch: [0][16100/31148]    Overall Loss 0.020089    Objective Loss 0.000000    Distill Loss 0.020089                     LR 0.001000    Time 0.258351    
+2023-11-30 03:03:30,256 - Epoch: [0][16200/31148]    Overall Loss 0.020069    Objective Loss 0.000000    Distill Loss 0.020069                     LR 0.001000    Time 0.258348    
+2023-11-30 03:03:55,962 - Epoch: [0][16300/31148]    Overall Loss 0.020047    Objective Loss 0.000000    Distill Loss 0.020047                     LR 0.001000    Time 0.258340    
+2023-11-30 03:04:21,696 - Epoch: [0][16400/31148]    Overall Loss 0.020027    Objective Loss 0.000000    Distill Loss 0.020027                     LR 0.001000    Time 0.258333    
+2023-11-30 03:04:47,474 - Epoch: [0][16500/31148]    Overall Loss 0.020005    Objective Loss 0.000000    Distill Loss 0.020005                     LR 0.001000    Time 0.258330    
+2023-11-30 03:05:13,214 - Epoch: [0][16600/31148]    Overall Loss 0.019985    Objective Loss 0.000000    Distill Loss 0.019985                     LR 0.001000    Time 0.258324    
+2023-11-30 03:05:38,990 - Epoch: [0][16700/31148]    Overall Loss 0.019964    Objective Loss 0.000000    Distill Loss 0.019964                     LR 0.001000    Time 0.258320    
+2023-11-30 03:06:04,731 - Epoch: [0][16800/31148]    Overall Loss 0.019943    Objective Loss 0.000000    Distill Loss 0.019943                     LR 0.001000    Time 0.258315    
+2023-11-30 03:06:30,485 - Epoch: [0][16900/31148]    Overall Loss 0.019923    Objective Loss 0.000000    Distill Loss 0.019923                     LR 0.001000    Time 0.258310    
+2023-11-30 03:06:56,225 - Epoch: [0][17000/31148]    Overall Loss 0.019902    Objective Loss 0.000000    Distill Loss 0.019902                     LR 0.001000    Time 0.258305    
+2023-11-30 03:07:21,961 - Epoch: [0][17100/31148]    Overall Loss 0.019882    Objective Loss 0.000000    Distill Loss 0.019882                     LR 0.001000    Time 0.258299    
+2023-11-30 03:07:47,700 - Epoch: [0][17200/31148]    Overall Loss 0.019862    Objective Loss 0.000000    Distill Loss 0.019862                     LR 0.001000    Time 0.258294    
+2023-11-30 03:08:13,425 - Epoch: [0][17300/31148]    Overall Loss 0.019842    Objective Loss 0.000000    Distill Loss 0.019842                     LR 0.001000    Time 0.258287    
+2023-11-30 03:08:39,121 - Epoch: [0][17400/31148]    Overall Loss 0.019823    Objective Loss 0.000000    Distill Loss 0.019823                     LR 0.001000    Time 0.258280    
+2023-11-30 03:09:04,894 - Epoch: [0][17500/31148]    Overall Loss 0.019803    Objective Loss 0.000000    Distill Loss 0.019803                     LR 0.001000    Time 0.258276    
+2023-11-30 03:09:30,609 - Epoch: [0][17600/31148]    Overall Loss 0.019782    Objective Loss 0.000000    Distill Loss 0.019782                     LR 0.001000    Time 0.258270    
+2023-11-30 03:09:56,358 - Epoch: [0][17700/31148]    Overall Loss 0.019763    Objective Loss 0.000000    Distill Loss 0.019763                     LR 0.001000    Time 0.258265    
+2023-11-30 03:10:22,114 - Epoch: [0][17800/31148]    Overall Loss 0.019743    Objective Loss 0.000000    Distill Loss 0.019743                     LR 0.001000    Time 0.258261    
+2023-11-30 03:10:47,826 - Epoch: [0][17900/31148]    Overall Loss 0.019723    Objective Loss 0.000000    Distill Loss 0.019723                     LR 0.001000    Time 0.258255    
+2023-11-30 03:11:13,594 - Epoch: [0][18000/31148]    Overall Loss 0.019703    Objective Loss 0.000000    Distill Loss 0.019703                     LR 0.001000    Time 0.258251    
+2023-11-30 03:11:40,060 - Epoch: [0][18100/31148]    Overall Loss 0.019684    Objective Loss 0.000000    Distill Loss 0.019684                     LR 0.001000    Time 0.258286    
+2023-11-30 03:12:05,783 - Epoch: [0][18200/31148]    Overall Loss 0.019665    Objective Loss 0.000000    Distill Loss 0.019665                     LR 0.001000    Time 0.258280    
+2023-11-30 03:12:31,531 - Epoch: [0][18300/31148]    Overall Loss 0.019645    Objective Loss 0.000000    Distill Loss 0.019645                     LR 0.001000    Time 0.258276    
+2023-11-30 03:12:57,215 - Epoch: [0][18400/31148]    Overall Loss 0.019627    Objective Loss 0.000000    Distill Loss 0.019627                     LR 0.001000    Time 0.258268    
+2023-11-30 03:13:22,939 - Epoch: [0][18500/31148]    Overall Loss 0.019607    Objective Loss 0.000000    Distill Loss 0.019607                     LR 0.001000    Time 0.258262    
+2023-11-30 03:13:48,677 - Epoch: [0][18600/31148]    Overall Loss 0.019589    Objective Loss 0.000000    Distill Loss 0.019589                     LR 0.001000    Time 0.258257    
+2023-11-30 03:14:14,378 - Epoch: [0][18700/31148]    Overall Loss 0.019570    Objective Loss 0.000000    Distill Loss 0.019570                     LR 0.001000    Time 0.258251    
+2023-11-30 03:14:40,375 - Epoch: [0][18800/31148]    Overall Loss 0.019551    Objective Loss 0.000000    Distill Loss 0.019551                     LR 0.001000    Time 0.258260    
+2023-11-30 03:15:06,108 - Epoch: [0][18900/31148]    Overall Loss 0.019533    Objective Loss 0.000000    Distill Loss 0.019533                     LR 0.001000    Time 0.258255    
+2023-11-30 03:15:31,891 - Epoch: [0][19000/31148]    Overall Loss 0.019514    Objective Loss 0.000000    Distill Loss 0.019514                     LR 0.001000    Time 0.258252    
+2023-11-30 03:15:57,675 - Epoch: [0][19100/31148]    Overall Loss 0.019495    Objective Loss 0.000000    Distill Loss 0.019495                     LR 0.001000    Time 0.258250    
+2023-11-30 03:16:23,420 - Epoch: [0][19200/31148]    Overall Loss 0.019478    Objective Loss 0.000000    Distill Loss 0.019478                     LR 0.001000    Time 0.258246    
+2023-11-30 03:16:49,103 - Epoch: [0][19300/31148]    Overall Loss 0.019460    Objective Loss 0.000000    Distill Loss 0.019460                     LR 0.001000    Time 0.258238    
+2023-11-30 03:17:14,865 - Epoch: [0][19400/31148]    Overall Loss 0.019442    Objective Loss 0.000000    Distill Loss 0.019442                     LR 0.001000    Time 0.258235    
+2023-11-30 03:17:40,578 - Epoch: [0][19500/31148]    Overall Loss 0.019425    Objective Loss 0.000000    Distill Loss 0.019425                     LR 0.001000    Time 0.258229    
+2023-11-30 03:18:06,290 - Epoch: [0][19600/31148]    Overall Loss 0.019407    Objective Loss 0.000000    Distill Loss 0.019407                     LR 0.001000    Time 0.258223    
+2023-11-30 03:18:32,064 - Epoch: [0][19700/31148]    Overall Loss 0.019389    Objective Loss 0.000000    Distill Loss 0.019389                     LR 0.001000    Time 0.258221    
+2023-11-30 03:18:58,371 - Epoch: [0][19800/31148]    Overall Loss 0.019372    Objective Loss 0.000000    Distill Loss 0.019372                     LR 0.001000    Time 0.258245    
+2023-11-30 03:19:24,185 - Epoch: [0][19900/31148]    Overall Loss 0.019354    Objective Loss 0.000000    Distill Loss 0.019354                     LR 0.001000    Time 0.258244    
+2023-11-30 03:19:50,620 - Epoch: [0][20000/31148]    Overall Loss 0.019337    Objective Loss 0.000000    Distill Loss 0.019337                     LR 0.001000    Time 0.258275    
+2023-11-30 03:20:16,375 - Epoch: [0][20100/31148]    Overall Loss 0.019319    Objective Loss 0.000000    Distill Loss 0.019319                     LR 0.001000    Time 0.258271    
+2023-11-30 03:20:42,070 - Epoch: [0][20200/31148]    Overall Loss 0.019302    Objective Loss 0.000000    Distill Loss 0.019302                     LR 0.001000    Time 0.258264    
+2023-11-30 03:21:07,837 - Epoch: [0][20300/31148]    Overall Loss 0.019285    Objective Loss 0.000000    Distill Loss 0.019285                     LR 0.001000    Time 0.258261    
+2023-11-30 03:21:33,587 - Epoch: [0][20400/31148]    Overall Loss 0.019267    Objective Loss 0.000000    Distill Loss 0.019267                     LR 0.001000    Time 0.258257    
+2023-11-30 03:21:59,321 - Epoch: [0][20500/31148]    Overall Loss 0.019250    Objective Loss 0.000000    Distill Loss 0.019250                     LR 0.001000    Time 0.258253    
+2023-11-30 03:22:25,130 - Epoch: [0][20600/31148]    Overall Loss 0.019232    Objective Loss 0.000000    Distill Loss 0.019232                     LR 0.001000    Time 0.258252    
+2023-11-30 03:22:51,106 - Epoch: [0][20700/31148]    Overall Loss 0.019215    Objective Loss 0.000000    Distill Loss 0.019215                     LR 0.001000    Time 0.258259    
+2023-11-30 03:23:16,810 - Epoch: [0][20800/31148]    Overall Loss 0.019198    Objective Loss 0.000000    Distill Loss 0.019198                     LR 0.001000    Time 0.258253    
+2023-11-30 03:23:42,557 - Epoch: [0][20900/31148]    Overall Loss 0.019181    Objective Loss 0.000000    Distill Loss 0.019181                     LR 0.001000    Time 0.258249    
+2023-11-30 03:24:08,306 - Epoch: [0][21000/31148]    Overall Loss 0.019165    Objective Loss 0.000000    Distill Loss 0.019165                     LR 0.001000    Time 0.258245    
+2023-11-30 03:24:34,041 - Epoch: [0][21100/31148]    Overall Loss 0.019148    Objective Loss 0.000000    Distill Loss 0.019148                     LR 0.001000    Time 0.258241    
+2023-11-30 03:24:59,789 - Epoch: [0][21200/31148]    Overall Loss 0.019132    Objective Loss 0.000000    Distill Loss 0.019132                     LR 0.001000    Time 0.258237    
+2023-11-30 03:25:25,718 - Epoch: [0][21300/31148]    Overall Loss 0.019115    Objective Loss 0.000000    Distill Loss 0.019115                     LR 0.001000    Time 0.258242    
+2023-11-30 03:25:51,748 - Epoch: [0][21400/31148]    Overall Loss 0.019099    Objective Loss 0.000000    Distill Loss 0.019099                     LR 0.001000    Time 0.258252    
+2023-11-30 03:26:17,484 - Epoch: [0][21500/31148]    Overall Loss 0.019083    Objective Loss 0.000000    Distill Loss 0.019083                     LR 0.001000    Time 0.258247    
+2023-11-30 03:26:43,188 - Epoch: [0][21600/31148]    Overall Loss 0.019066    Objective Loss 0.000000    Distill Loss 0.019066                     LR 0.001000    Time 0.258242    
+2023-11-30 03:27:08,910 - Epoch: [0][21700/31148]    Overall Loss 0.019051    Objective Loss 0.000000    Distill Loss 0.019051                     LR 0.001000    Time 0.258237    
+2023-11-30 03:27:34,628 - Epoch: [0][21800/31148]    Overall Loss 0.019034    Objective Loss 0.000000    Distill Loss 0.019034                     LR 0.001000    Time 0.258232    
+2023-11-30 03:28:00,414 - Epoch: [0][21900/31148]    Overall Loss 0.019018    Objective Loss 0.000000    Distill Loss 0.019018                     LR 0.001000    Time 0.258230    
+2023-11-30 03:28:26,142 - Epoch: [0][22000/31148]    Overall Loss 0.019003    Objective Loss 0.000000    Distill Loss 0.019003                     LR 0.001000    Time 0.258226    
+2023-11-30 03:28:51,904 - Epoch: [0][22100/31148]    Overall Loss 0.018987    Objective Loss 0.000000    Distill Loss 0.018987                     LR 0.001000    Time 0.258223    
+2023-11-30 03:29:17,751 - Epoch: [0][22200/31148]    Overall Loss 0.018971    Objective Loss 0.000000    Distill Loss 0.018971                     LR 0.001000    Time 0.258224    
+2023-11-30 03:29:43,510 - Epoch: [0][22300/31148]    Overall Loss 0.018955    Objective Loss 0.000000    Distill Loss 0.018955                     LR 0.001000    Time 0.258221    
+2023-11-30 03:30:09,266 - Epoch: [0][22400/31148]    Overall Loss 0.018939    Objective Loss 0.000000    Distill Loss 0.018939                     LR 0.001000    Time 0.258218    
+2023-11-30 03:30:35,005 - Epoch: [0][22500/31148]    Overall Loss 0.018923    Objective Loss 0.000000    Distill Loss 0.018923                     LR 0.001000    Time 0.258214    
+2023-11-30 03:31:00,790 - Epoch: [0][22600/31148]    Overall Loss 0.018907    Objective Loss 0.000000    Distill Loss 0.018907                     LR 0.001000    Time 0.258212    
+2023-11-30 03:31:26,523 - Epoch: [0][22700/31148]    Overall Loss 0.018891    Objective Loss 0.000000    Distill Loss 0.018891                     LR 0.001000    Time 0.258208    
+2023-11-30 03:31:52,293 - Epoch: [0][22800/31148]    Overall Loss 0.018876    Objective Loss 0.000000    Distill Loss 0.018876                     LR 0.001000    Time 0.258206    
+2023-11-30 03:32:18,077 - Epoch: [0][22900/31148]    Overall Loss 0.018860    Objective Loss 0.000000    Distill Loss 0.018860                     LR 0.001000    Time 0.258204    
+2023-11-30 03:32:43,822 - Epoch: [0][23000/31148]    Overall Loss 0.018845    Objective Loss 0.000000    Distill Loss 0.018845                     LR 0.001000    Time 0.258201    
+2023-11-30 03:33:09,580 - Epoch: [0][23100/31148]    Overall Loss 0.018830    Objective Loss 0.000000    Distill Loss 0.018830                     LR 0.001000    Time 0.258198    
+2023-11-30 03:33:35,303 - Epoch: [0][23200/31148]    Overall Loss 0.018815    Objective Loss 0.000000    Distill Loss 0.018815                     LR 0.001000    Time 0.258194    
+2023-11-30 03:34:00,991 - Epoch: [0][23300/31148]    Overall Loss 0.018800    Objective Loss 0.000000    Distill Loss 0.018800                     LR 0.001000    Time 0.258188    
+2023-11-30 03:34:26,711 - Epoch: [0][23400/31148]    Overall Loss 0.018785    Objective Loss 0.000000    Distill Loss 0.018785                     LR 0.001000    Time 0.258184    
+2023-11-30 03:34:52,451 - Epoch: [0][23500/31148]    Overall Loss 0.018770    Objective Loss 0.000000    Distill Loss 0.018770                     LR 0.001000    Time 0.258180    
+2023-11-30 03:35:18,227 - Epoch: [0][23600/31148]    Overall Loss 0.018755    Objective Loss 0.000000    Distill Loss 0.018755                     LR 0.001000    Time 0.258178    
+2023-11-30 03:35:43,990 - Epoch: [0][23700/31148]    Overall Loss 0.018740    Objective Loss 0.000000    Distill Loss 0.018740                     LR 0.001000    Time 0.258176    
+2023-11-30 03:36:10,388 - Epoch: [0][23800/31148]    Overall Loss 0.018725    Objective Loss 0.000000    Distill Loss 0.018725                     LR 0.001000    Time 0.258200    
+2023-11-30 03:36:36,162 - Epoch: [0][23900/31148]    Overall Loss 0.018711    Objective Loss 0.000000    Distill Loss 0.018711                     LR 0.001000    Time 0.258198    
+2023-11-30 03:37:01,906 - Epoch: [0][24000/31148]    Overall Loss 0.018696    Objective Loss 0.000000    Distill Loss 0.018696                     LR 0.001000    Time 0.258195    
+2023-11-30 03:37:27,621 - Epoch: [0][24100/31148]    Overall Loss 0.018681    Objective Loss 0.000000    Distill Loss 0.018681                     LR 0.001000    Time 0.258190    
+2023-11-30 03:37:53,351 - Epoch: [0][24200/31148]    Overall Loss 0.018667    Objective Loss 0.000000    Distill Loss 0.018667                     LR 0.001000    Time 0.258187    
+2023-11-30 03:38:19,106 - Epoch: [0][24300/31148]    Overall Loss 0.018652    Objective Loss 0.000000    Distill Loss 0.018652                     LR 0.001000    Time 0.258184    
+2023-11-30 03:38:44,905 - Epoch: [0][24400/31148]    Overall Loss 0.018637    Objective Loss 0.000000    Distill Loss 0.018637                     LR 0.001000    Time 0.258183    
+2023-11-30 03:39:10,679 - Epoch: [0][24500/31148]    Overall Loss 0.018623    Objective Loss 0.000000    Distill Loss 0.018623                     LR 0.001000    Time 0.258181    
+2023-11-30 03:39:36,428 - Epoch: [0][24600/31148]    Overall Loss 0.018608    Objective Loss 0.000000    Distill Loss 0.018608                     LR 0.001000    Time 0.258178    
+2023-11-30 03:40:02,173 - Epoch: [0][24700/31148]    Overall Loss 0.018594    Objective Loss 0.000000    Distill Loss 0.018594                     LR 0.001000    Time 0.258175    
+2023-11-30 03:40:27,970 - Epoch: [0][24800/31148]    Overall Loss 0.018580    Objective Loss 0.000000    Distill Loss 0.018580                     LR 0.001000    Time 0.258174    
+2023-11-30 03:40:53,750 - Epoch: [0][24900/31148]    Overall Loss 0.018565    Objective Loss 0.000000    Distill Loss 0.018565                     LR 0.001000    Time 0.258172    
+2023-11-30 03:41:19,501 - Epoch: [0][25000/31148]    Overall Loss 0.018550    Objective Loss 0.000000    Distill Loss 0.018550                     LR 0.001000    Time 0.258170    
+2023-11-30 03:41:45,251 - Epoch: [0][25100/31148]    Overall Loss 0.018536    Objective Loss 0.000000    Distill Loss 0.018536                     LR 0.001000    Time 0.258167    
+2023-11-30 03:42:10,943 - Epoch: [0][25200/31148]    Overall Loss 0.018522    Objective Loss 0.000000    Distill Loss 0.018522                     LR 0.001000    Time 0.258162    
+2023-11-30 03:42:36,688 - Epoch: [0][25300/31148]    Overall Loss 0.018508    Objective Loss 0.000000    Distill Loss 0.018508                     LR 0.001000    Time 0.258159    
+2023-11-30 03:43:02,411 - Epoch: [0][25400/31148]    Overall Loss 0.018494    Objective Loss 0.000000    Distill Loss 0.018494                     LR 0.001000    Time 0.258155    
+2023-11-30 03:43:28,138 - Epoch: [0][25500/31148]    Overall Loss 0.018480    Objective Loss 0.000000    Distill Loss 0.018480                     LR 0.001000    Time 0.258152    
+2023-11-30 03:43:53,945 - Epoch: [0][25600/31148]    Overall Loss 0.018467    Objective Loss 0.000000    Distill Loss 0.018467                     LR 0.001000    Time 0.258151    
+2023-11-30 03:44:19,713 - Epoch: [0][25700/31148]    Overall Loss 0.018453    Objective Loss 0.000000    Distill Loss 0.018453                     LR 0.001000    Time 0.258149    
+2023-11-30 03:44:45,461 - Epoch: [0][25800/31148]    Overall Loss 0.018439    Objective Loss 0.000000    Distill Loss 0.018439                     LR 0.001000    Time 0.258147    
+2023-11-30 03:45:11,181 - Epoch: [0][25900/31148]    Overall Loss 0.018425    Objective Loss 0.000000    Distill Loss 0.018425                     LR 0.001000    Time 0.258143    
+2023-11-30 03:45:36,884 - Epoch: [0][26000/31148]    Overall Loss 0.018411    Objective Loss 0.000000    Distill Loss 0.018411                     LR 0.001000    Time 0.258138    
+2023-11-30 03:46:02,632 - Epoch: [0][26100/31148]    Overall Loss 0.018398    Objective Loss 0.000000    Distill Loss 0.018398                     LR 0.001000    Time 0.258136    
+2023-11-30 03:46:28,356 - Epoch: [0][26200/31148]    Overall Loss 0.018385    Objective Loss 0.000000    Distill Loss 0.018385                     LR 0.001000    Time 0.258132    
+2023-11-30 03:46:54,067 - Epoch: [0][26300/31148]    Overall Loss 0.018371    Objective Loss 0.000000    Distill Loss 0.018371                     LR 0.001000    Time 0.258128    
+2023-11-30 03:47:19,798 - Epoch: [0][26400/31148]    Overall Loss 0.018357    Objective Loss 0.000000    Distill Loss 0.018357                     LR 0.001000    Time 0.258125    
+2023-11-30 03:47:45,544 - Epoch: [0][26500/31148]    Overall Loss 0.018344    Objective Loss 0.000000    Distill Loss 0.018344                     LR 0.001000    Time 0.258122    
+2023-11-30 03:48:11,311 - Epoch: [0][26600/31148]    Overall Loss 0.018331    Objective Loss 0.000000    Distill Loss 0.018331                     LR 0.001000    Time 0.258121    
+2023-11-30 03:48:37,058 - Epoch: [0][26700/31148]    Overall Loss 0.018318    Objective Loss 0.000000    Distill Loss 0.018318                     LR 0.001000    Time 0.258118    
+2023-11-30 03:49:02,769 - Epoch: [0][26800/31148]    Overall Loss 0.018305    Objective Loss 0.000000    Distill Loss 0.018305                     LR 0.001000    Time 0.258114    
+2023-11-30 03:49:28,519 - Epoch: [0][26900/31148]    Overall Loss 0.018291    Objective Loss 0.000000    Distill Loss 0.018291                     LR 0.001000    Time 0.258112    
+2023-11-30 03:49:54,176 - Epoch: [0][27000/31148]    Overall Loss 0.018278    Objective Loss 0.000000    Distill Loss 0.018278                     LR 0.001000    Time 0.258106    
+2023-11-30 03:50:19,929 - Epoch: [0][27100/31148]    Overall Loss 0.018265    Objective Loss 0.000000    Distill Loss 0.018265                     LR 0.001000    Time 0.258104    
+2023-11-30 03:50:45,666 - Epoch: [0][27200/31148]    Overall Loss 0.018251    Objective Loss 0.000000    Distill Loss 0.018251                     LR 0.001000    Time 0.258101    
+2023-11-30 03:51:11,455 - Epoch: [0][27300/31148]    Overall Loss 0.018239    Objective Loss 0.000000    Distill Loss 0.018239                     LR 0.001000    Time 0.258100    
+2023-11-30 03:51:37,198 - Epoch: [0][27400/31148]    Overall Loss 0.018225    Objective Loss 0.000000    Distill Loss 0.018225                     LR 0.001000    Time 0.258098    
+2023-11-30 03:52:02,892 - Epoch: [0][27500/31148]    Overall Loss 0.018212    Objective Loss 0.000000    Distill Loss 0.018212                     LR 0.001000    Time 0.258093    
+2023-11-30 03:52:28,646 - Epoch: [0][27600/31148]    Overall Loss 0.018199    Objective Loss 0.000000    Distill Loss 0.018199                     LR 0.001000    Time 0.258091    
+2023-11-30 03:52:54,324 - Epoch: [0][27700/31148]    Overall Loss 0.018187    Objective Loss 0.000000    Distill Loss 0.018187                     LR 0.001000    Time 0.258086    
+2023-11-30 03:53:20,086 - Epoch: [0][27800/31148]    Overall Loss 0.018174    Objective Loss 0.000000    Distill Loss 0.018174                     LR 0.001000    Time 0.258085    
+2023-11-30 03:53:45,796 - Epoch: [0][27900/31148]    Overall Loss 0.018161    Objective Loss 0.000000    Distill Loss 0.018161                     LR 0.001000    Time 0.258081    
+2023-11-30 03:54:11,563 - Epoch: [0][28000/31148]    Overall Loss 0.018148    Objective Loss 0.000000    Distill Loss 0.018148                     LR 0.001000    Time 0.258079    
+2023-11-30 03:54:37,259 - Epoch: [0][28100/31148]    Overall Loss 0.018135    Objective Loss 0.000000    Distill Loss 0.018135                     LR 0.001000    Time 0.258075    
+2023-11-30 03:55:02,987 - Epoch: [0][28200/31148]    Overall Loss 0.018122    Objective Loss 0.000000    Distill Loss 0.018122                     LR 0.001000    Time 0.258072    
+2023-11-30 03:55:28,718 - Epoch: [0][28300/31148]    Overall Loss 0.018110    Objective Loss 0.000000    Distill Loss 0.018110                     LR 0.001000    Time 0.258070    
+2023-11-30 03:55:54,404 - Epoch: [0][28400/31148]    Overall Loss 0.018098    Objective Loss 0.000000    Distill Loss 0.018098                     LR 0.001000    Time 0.258065    
+2023-11-30 03:56:20,157 - Epoch: [0][28500/31148]    Overall Loss 0.018086    Objective Loss 0.000000    Distill Loss 0.018086                     LR 0.001000    Time 0.258063    
+2023-11-30 03:56:45,865 - Epoch: [0][28600/31148]    Overall Loss 0.018073    Objective Loss 0.000000    Distill Loss 0.018073                     LR 0.001000    Time 0.258060    
+2023-11-30 03:57:11,621 - Epoch: [0][28700/31148]    Overall Loss 0.018061    Objective Loss 0.000000    Distill Loss 0.018061                     LR 0.001000    Time 0.258058    
+2023-11-30 03:57:37,335 - Epoch: [0][28800/31148]    Overall Loss 0.018048    Objective Loss 0.000000    Distill Loss 0.018048                     LR 0.001000    Time 0.258055    
+2023-11-30 03:58:03,062 - Epoch: [0][28900/31148]    Overall Loss 0.018036    Objective Loss 0.000000    Distill Loss 0.018036                     LR 0.001000    Time 0.258052    
+2023-11-30 03:58:28,832 - Epoch: [0][29000/31148]    Overall Loss 0.018024    Objective Loss 0.000000    Distill Loss 0.018024                     LR 0.001000    Time 0.258051    
+2023-11-30 03:58:54,584 - Epoch: [0][29100/31148]    Overall Loss 0.018012    Objective Loss 0.000000    Distill Loss 0.018012                     LR 0.001000    Time 0.258049    
+2023-11-30 03:59:20,345 - Epoch: [0][29200/31148]    Overall Loss 0.018000    Objective Loss 0.000000    Distill Loss 0.018000                     LR 0.001000    Time 0.258047    
+2023-11-30 03:59:46,299 - Epoch: [0][29300/31148]    Overall Loss 0.017988    Objective Loss 0.000000    Distill Loss 0.017988                     LR 0.001000    Time 0.258052    
+2023-11-30 04:00:12,019 - Epoch: [0][29400/31148]    Overall Loss 0.017976    Objective Loss 0.000000    Distill Loss 0.017976                     LR 0.001000    Time 0.258049    
+2023-11-30 04:00:37,749 - Epoch: [0][29500/31148]    Overall Loss 0.017964    Objective Loss 0.000000    Distill Loss 0.017964                     LR 0.001000    Time 0.258047    
+2023-11-30 04:01:03,479 - Epoch: [0][29600/31148]    Overall Loss 0.017952    Objective Loss 0.000000    Distill Loss 0.017952                     LR 0.001000    Time 0.258044    
+2023-11-30 04:01:29,276 - Epoch: [0][29700/31148]    Overall Loss 0.017940    Objective Loss 0.000000    Distill Loss 0.017940                     LR 0.001000    Time 0.258044    
+2023-11-30 04:01:55,088 - Epoch: [0][29800/31148]    Overall Loss 0.017928    Objective Loss 0.000000    Distill Loss 0.017928                     LR 0.001000    Time 0.258044    
+2023-11-30 04:02:20,840 - Epoch: [0][29900/31148]    Overall Loss 0.017916    Objective Loss 0.000000    Distill Loss 0.017916                     LR 0.001000    Time 0.258042    
+2023-11-30 04:02:46,602 - Epoch: [0][30000/31148]    Overall Loss 0.017904    Objective Loss 0.000000    Distill Loss 0.017904                     LR 0.001000    Time 0.258040    
+2023-11-30 04:03:12,363 - Epoch: [0][30100/31148]    Overall Loss 0.017892    Objective Loss 0.000000    Distill Loss 0.017892                     LR 0.001000    Time 0.258039    
+2023-11-30 04:03:38,119 - Epoch: [0][30200/31148]    Overall Loss 0.017881    Objective Loss 0.000000    Distill Loss 0.017881                     LR 0.001000    Time 0.258037    
+2023-11-30 04:04:03,890 - Epoch: [0][30300/31148]    Overall Loss 0.017869    Objective Loss 0.000000    Distill Loss 0.017869                     LR 0.001000    Time 0.258036    
+2023-11-30 04:04:29,603 - Epoch: [0][30400/31148]    Overall Loss 0.017857    Objective Loss 0.000000    Distill Loss 0.017857                     LR 0.001000    Time 0.258033    
+2023-11-30 04:04:55,328 - Epoch: [0][30500/31148]    Overall Loss 0.017846    Objective Loss 0.000000    Distill Loss 0.017846                     LR 0.001000    Time 0.258030    
+2023-11-30 04:05:21,035 - Epoch: [0][30600/31148]    Overall Loss 0.017834    Objective Loss 0.000000    Distill Loss 0.017834                     LR 0.001000    Time 0.258027    
+2023-11-30 04:05:46,754 - Epoch: [0][30700/31148]    Overall Loss 0.017822    Objective Loss 0.000000    Distill Loss 0.017822                     LR 0.001000    Time 0.258024    
+2023-11-30 04:06:12,557 - Epoch: [0][30800/31148]    Overall Loss 0.017810    Objective Loss 0.000000    Distill Loss 0.017810                     LR 0.001000    Time 0.258024    
+2023-11-30 04:06:38,317 - Epoch: [0][30900/31148]    Overall Loss 0.017799    Objective Loss 0.000000    Distill Loss 0.017799                     LR 0.001000    Time 0.258023    
+2023-11-30 04:07:04,089 - Epoch: [0][31000/31148]    Overall Loss 0.017787    Objective Loss 0.000000    Distill Loss 0.017787                     LR 0.001000    Time 0.258022    
+2023-11-30 04:07:29,884 - Epoch: [0][31100/31148]    Overall Loss 0.017776    Objective Loss 0.000000    Distill Loss 0.017776                     LR 0.001000    Time 0.258021    
+2023-11-30 04:07:42,703 - Epoch: [0][31148/31148]    Overall Loss 0.017771    Objective Loss 0.000000    Distill Loss 0.017771                     LR 0.001000    Time 0.258035    
+2023-11-30 04:07:42,999 - --- validate (epoch=0)-----------
+2023-11-30 04:07:42,999 - 167951 samples (100 per mini-batch)
+2023-11-30 04:08:03,859 - Epoch: [0][  100/ 1680]    Loss 0.000000    Overall Loss 0.014899    
+2023-11-30 04:08:23,581 - Epoch: [0][  200/ 1680]    Loss 0.000000    Overall Loss 0.014945    
+2023-11-30 04:08:43,282 - Epoch: [0][  300/ 1680]    Loss 0.000000    Overall Loss 0.014944    
+2023-11-30 04:09:02,979 - Epoch: [0][  400/ 1680]    Loss 0.000000    Overall Loss 0.014956    
+2023-11-30 04:09:22,710 - Epoch: [0][  500/ 1680]    Loss 0.000000    Overall Loss 0.014960    
+2023-11-30 04:09:42,438 - Epoch: [0][  600/ 1680]    Loss 0.000000    Overall Loss 0.014957    
+2023-11-30 04:10:02,138 - Epoch: [0][  700/ 1680]    Loss 0.000000    Overall Loss 0.014955    
+2023-11-30 04:10:21,838 - Epoch: [0][  800/ 1680]    Loss 0.000000    Overall Loss 0.014956    
+2023-11-30 04:10:41,592 - Epoch: [0][  900/ 1680]    Loss 0.000000    Overall Loss 0.014966    
+2023-11-30 04:11:01,290 - Epoch: [0][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.014961    
+2023-11-30 04:11:21,045 - Epoch: [0][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.014962    
+2023-11-30 04:11:40,752 - Epoch: [0][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.014959    
+2023-11-30 04:12:00,489 - Epoch: [0][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.014963    
+2023-11-30 04:12:20,202 - Epoch: [0][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.014961    
+2023-11-30 04:12:39,902 - Epoch: [0][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.014960    
+2023-11-30 04:12:59,610 - Epoch: [0][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.014958    
+2023-11-30 04:13:15,283 - Epoch: [0][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.014956    
+2023-11-30 04:13:15,493 - ==> Overall Loss: 0.015
+
+2023-11-30 04:13:15,497 - ==> Best [Overall Loss: 0.014956 on epoch: 0]
+2023-11-30 04:13:15,497 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 04:13:15,523 - 
+
+2023-11-30 04:13:15,523 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 04:13:48,834 - Epoch: [1][  100/31148]    Overall Loss 0.014131    Objective Loss 0.000000    Distill Loss 0.014131                     LR 0.001000    Time 0.333073    
+2023-11-30 04:14:14,572 - Epoch: [1][  200/31148]    Overall Loss 0.014121    Objective Loss 0.000000    Distill Loss 0.014121                     LR 0.001000    Time 0.295209    
+2023-11-30 04:14:40,333 - Epoch: [1][  300/31148]    Overall Loss 0.014108    Objective Loss 0.000000    Distill Loss 0.014108                     LR 0.001000    Time 0.282669    
+2023-11-30 04:15:06,092 - Epoch: [1][  400/31148]    Overall Loss 0.014083    Objective Loss 0.000000    Distill Loss 0.014083                     LR 0.001000    Time 0.276392    
+2023-11-30 04:15:31,842 - Epoch: [1][  500/31148]    Overall Loss 0.014087    Objective Loss 0.000000    Distill Loss 0.014087                     LR 0.001000    Time 0.272609    
+2023-11-30 04:15:57,596 - Epoch: [1][  600/31148]    Overall Loss 0.014081    Objective Loss 0.000000    Distill Loss 0.014081                     LR 0.001000    Time 0.270094    
+2023-11-30 04:16:23,321 - Epoch: [1][  700/31148]    Overall Loss 0.014096    Objective Loss 0.000000    Distill Loss 0.014096                     LR 0.001000    Time 0.268255    
+2023-11-30 04:16:49,132 - Epoch: [1][  800/31148]    Overall Loss 0.014096    Objective Loss 0.000000    Distill Loss 0.014096                     LR 0.001000    Time 0.266984    
+2023-11-30 04:17:14,916 - Epoch: [1][  900/31148]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                     LR 0.001000    Time 0.265964    
+2023-11-30 04:17:40,666 - Epoch: [1][ 1000/31148]    Overall Loss 0.014085    Objective Loss 0.000000    Distill Loss 0.014085                     LR 0.001000    Time 0.265116    
+2023-11-30 04:18:06,421 - Epoch: [1][ 1100/31148]    Overall Loss 0.014082    Objective Loss 0.000000    Distill Loss 0.014082                     LR 0.001000    Time 0.264425    
+2023-11-30 04:18:32,146 - Epoch: [1][ 1200/31148]    Overall Loss 0.014076    Objective Loss 0.000000    Distill Loss 0.014076                     LR 0.001000    Time 0.263825    
+2023-11-30 04:18:57,861 - Epoch: [1][ 1300/31148]    Overall Loss 0.014074    Objective Loss 0.000000    Distill Loss 0.014074                     LR 0.001000    Time 0.263309    
+2023-11-30 04:19:23,617 - Epoch: [1][ 1400/31148]    Overall Loss 0.014077    Objective Loss 0.000000    Distill Loss 0.014077                     LR 0.001000    Time 0.262897    
+2023-11-30 04:19:49,358 - Epoch: [1][ 1500/31148]    Overall Loss 0.014073    Objective Loss 0.000000    Distill Loss 0.014073                     LR 0.001000    Time 0.262529    
+2023-11-30 04:20:15,136 - Epoch: [1][ 1600/31148]    Overall Loss 0.014073    Objective Loss 0.000000    Distill Loss 0.014073                     LR 0.001000    Time 0.262231    
+2023-11-30 04:20:40,935 - Epoch: [1][ 1700/31148]    Overall Loss 0.014074    Objective Loss 0.000000    Distill Loss 0.014074                     LR 0.001000    Time 0.261980    
+2023-11-30 04:21:06,688 - Epoch: [1][ 1800/31148]    Overall Loss 0.014071    Objective Loss 0.000000    Distill Loss 0.014071                     LR 0.001000    Time 0.261731    
+2023-11-30 04:21:32,423 - Epoch: [1][ 1900/31148]    Overall Loss 0.014070    Objective Loss 0.000000    Distill Loss 0.014070                     LR 0.001000    Time 0.261499    
+2023-11-30 04:21:58,151 - Epoch: [1][ 2000/31148]    Overall Loss 0.014065    Objective Loss 0.000000    Distill Loss 0.014065                     LR 0.001000    Time 0.261287    
+2023-11-30 04:22:23,890 - Epoch: [1][ 2100/31148]    Overall Loss 0.014065    Objective Loss 0.000000    Distill Loss 0.014065                     LR 0.001000    Time 0.261100    
+2023-11-30 04:22:49,635 - Epoch: [1][ 2200/31148]    Overall Loss 0.014063    Objective Loss 0.000000    Distill Loss 0.014063                     LR 0.001000    Time 0.260933    
+2023-11-30 04:23:15,348 - Epoch: [1][ 2300/31148]    Overall Loss 0.014064    Objective Loss 0.000000    Distill Loss 0.014064                     LR 0.001000    Time 0.260767    
+2023-11-30 04:23:41,063 - Epoch: [1][ 2400/31148]    Overall Loss 0.014065    Objective Loss 0.000000    Distill Loss 0.014065                     LR 0.001000    Time 0.260615    
+2023-11-30 04:24:06,817 - Epoch: [1][ 2500/31148]    Overall Loss 0.014064    Objective Loss 0.000000    Distill Loss 0.014064                     LR 0.001000    Time 0.260491    
+2023-11-30 04:24:32,602 - Epoch: [1][ 2600/31148]    Overall Loss 0.014062    Objective Loss 0.000000    Distill Loss 0.014062                     LR 0.001000    Time 0.260388    
+2023-11-30 04:24:58,374 - Epoch: [1][ 2700/31148]    Overall Loss 0.014061    Objective Loss 0.000000    Distill Loss 0.014061                     LR 0.001000    Time 0.260288    
+2023-11-30 04:25:24,159 - Epoch: [1][ 2800/31148]    Overall Loss 0.014057    Objective Loss 0.000000    Distill Loss 0.014057                     LR 0.001000    Time 0.260200    
+2023-11-30 04:25:49,904 - Epoch: [1][ 2900/31148]    Overall Loss 0.014050    Objective Loss 0.000000    Distill Loss 0.014050                     LR 0.001000    Time 0.260105    
+2023-11-30 04:26:15,646 - Epoch: [1][ 3000/31148]    Overall Loss 0.014047    Objective Loss 0.000000    Distill Loss 0.014047                     LR 0.001000    Time 0.260014    
+2023-11-30 04:26:41,358 - Epoch: [1][ 3100/31148]    Overall Loss 0.014038    Objective Loss 0.000000    Distill Loss 0.014038                     LR 0.001000    Time 0.259920    
+2023-11-30 04:27:07,109 - Epoch: [1][ 3200/31148]    Overall Loss 0.014034    Objective Loss 0.000000    Distill Loss 0.014034                     LR 0.001000    Time 0.259844    
+2023-11-30 04:27:32,807 - Epoch: [1][ 3300/31148]    Overall Loss 0.014028    Objective Loss 0.000000    Distill Loss 0.014028                     LR 0.001000    Time 0.259756    
+2023-11-30 04:27:58,533 - Epoch: [1][ 3400/31148]    Overall Loss 0.014024    Objective Loss 0.000000    Distill Loss 0.014024                     LR 0.001000    Time 0.259682    
+2023-11-30 04:28:24,348 - Epoch: [1][ 3500/31148]    Overall Loss 0.014016    Objective Loss 0.000000    Distill Loss 0.014016                     LR 0.001000    Time 0.259638    
+2023-11-30 04:28:50,149 - Epoch: [1][ 3600/31148]    Overall Loss 0.014014    Objective Loss 0.000000    Distill Loss 0.014014                     LR 0.001000    Time 0.259592    
+2023-11-30 04:29:15,896 - Epoch: [1][ 3700/31148]    Overall Loss 0.014012    Objective Loss 0.000000    Distill Loss 0.014012                     LR 0.001000    Time 0.259533    
+2023-11-30 04:29:41,738 - Epoch: [1][ 3800/31148]    Overall Loss 0.014009    Objective Loss 0.000000    Distill Loss 0.014009                     LR 0.001000    Time 0.259504    
+2023-11-30 04:30:07,521 - Epoch: [1][ 3900/31148]    Overall Loss 0.014007    Objective Loss 0.000000    Distill Loss 0.014007                     LR 0.001000    Time 0.259460    
+2023-11-30 04:30:33,258 - Epoch: [1][ 4000/31148]    Overall Loss 0.014001    Objective Loss 0.000000    Distill Loss 0.014001                     LR 0.001000    Time 0.259407    
+2023-11-30 04:30:59,013 - Epoch: [1][ 4100/31148]    Overall Loss 0.013996    Objective Loss 0.000000    Distill Loss 0.013996                     LR 0.001000    Time 0.259361    
+2023-11-30 04:31:24,719 - Epoch: [1][ 4200/31148]    Overall Loss 0.013990    Objective Loss 0.000000    Distill Loss 0.013990                     LR 0.001000    Time 0.259306    
+2023-11-30 04:31:50,477 - Epoch: [1][ 4300/31148]    Overall Loss 0.013989    Objective Loss 0.000000    Distill Loss 0.013989                     LR 0.001000    Time 0.259265    
+2023-11-30 04:32:16,209 - Epoch: [1][ 4400/31148]    Overall Loss 0.013984    Objective Loss 0.000000    Distill Loss 0.013984                     LR 0.001000    Time 0.259220    
+2023-11-30 04:32:41,954 - Epoch: [1][ 4500/31148]    Overall Loss 0.013980    Objective Loss 0.000000    Distill Loss 0.013980                     LR 0.001000    Time 0.259180    
+2023-11-30 04:33:07,757 - Epoch: [1][ 4600/31148]    Overall Loss 0.013974    Objective Loss 0.000000    Distill Loss 0.013974                     LR 0.001000    Time 0.259155    
+2023-11-30 04:33:33,465 - Epoch: [1][ 4700/31148]    Overall Loss 0.013970    Objective Loss 0.000000    Distill Loss 0.013970                     LR 0.001000    Time 0.259110    
+2023-11-30 04:33:59,224 - Epoch: [1][ 4800/31148]    Overall Loss 0.013966    Objective Loss 0.000000    Distill Loss 0.013966                     LR 0.001000    Time 0.259078    
+2023-11-30 04:34:24,917 - Epoch: [1][ 4900/31148]    Overall Loss 0.013960    Objective Loss 0.000000    Distill Loss 0.013960                     LR 0.001000    Time 0.259033    
+2023-11-30 04:34:50,660 - Epoch: [1][ 5000/31148]    Overall Loss 0.013956    Objective Loss 0.000000    Distill Loss 0.013956                     LR 0.001000    Time 0.259001    
+2023-11-30 04:35:16,413 - Epoch: [1][ 5100/31148]    Overall Loss 0.013952    Objective Loss 0.000000    Distill Loss 0.013952                     LR 0.001000    Time 0.258971    
+2023-11-30 04:35:42,157 - Epoch: [1][ 5200/31148]    Overall Loss 0.013951    Objective Loss 0.000000    Distill Loss 0.013951                     LR 0.001000    Time 0.258942    
+2023-11-30 04:36:07,948 - Epoch: [1][ 5300/31148]    Overall Loss 0.013945    Objective Loss 0.000000    Distill Loss 0.013945                     LR 0.001000    Time 0.258921    
+2023-11-30 04:36:33,727 - Epoch: [1][ 5400/31148]    Overall Loss 0.013943    Objective Loss 0.000000    Distill Loss 0.013943                     LR 0.001000    Time 0.258900    
+2023-11-30 04:36:59,458 - Epoch: [1][ 5500/31148]    Overall Loss 0.013939    Objective Loss 0.000000    Distill Loss 0.013939                     LR 0.001000    Time 0.258871    
+2023-11-30 04:37:25,193 - Epoch: [1][ 5600/31148]    Overall Loss 0.013934    Objective Loss 0.000000    Distill Loss 0.013934                     LR 0.001000    Time 0.258843    
+2023-11-30 04:37:50,946 - Epoch: [1][ 5700/31148]    Overall Loss 0.013929    Objective Loss 0.000000    Distill Loss 0.013929                     LR 0.001000    Time 0.258820    
+2023-11-30 04:38:16,679 - Epoch: [1][ 5800/31148]    Overall Loss 0.013923    Objective Loss 0.000000    Distill Loss 0.013923                     LR 0.001000    Time 0.258793    
+2023-11-30 04:38:42,441 - Epoch: [1][ 5900/31148]    Overall Loss 0.013918    Objective Loss 0.000000    Distill Loss 0.013918                     LR 0.001000    Time 0.258773    
+2023-11-30 04:39:08,182 - Epoch: [1][ 6000/31148]    Overall Loss 0.013909    Objective Loss 0.000000    Distill Loss 0.013909                     LR 0.001000    Time 0.258750    
+2023-11-30 04:39:33,952 - Epoch: [1][ 6100/31148]    Overall Loss 0.013906    Objective Loss 0.000000    Distill Loss 0.013906                     LR 0.001000    Time 0.258732    
+2023-11-30 04:39:59,693 - Epoch: [1][ 6200/31148]    Overall Loss 0.013899    Objective Loss 0.000000    Distill Loss 0.013899                     LR 0.001000    Time 0.258711    
+2023-11-30 04:40:25,457 - Epoch: [1][ 6300/31148]    Overall Loss 0.013894    Objective Loss 0.000000    Distill Loss 0.013894                     LR 0.001000    Time 0.258693    
+2023-11-30 04:40:51,238 - Epoch: [1][ 6400/31148]    Overall Loss 0.013888    Objective Loss 0.000000    Distill Loss 0.013888                     LR 0.001000    Time 0.258679    
+2023-11-30 04:41:16,999 - Epoch: [1][ 6500/31148]    Overall Loss 0.013884    Objective Loss 0.000000    Distill Loss 0.013884                     LR 0.001000    Time 0.258662    
+2023-11-30 04:41:42,796 - Epoch: [1][ 6600/31148]    Overall Loss 0.013879    Objective Loss 0.000000    Distill Loss 0.013879                     LR 0.001000    Time 0.258651    
+2023-11-30 04:42:08,514 - Epoch: [1][ 6700/31148]    Overall Loss 0.013874    Objective Loss 0.000000    Distill Loss 0.013874                     LR 0.001000    Time 0.258629    
+2023-11-30 04:42:34,241 - Epoch: [1][ 6800/31148]    Overall Loss 0.013870    Objective Loss 0.000000    Distill Loss 0.013870                     LR 0.001000    Time 0.258609    
+2023-11-30 04:42:59,997 - Epoch: [1][ 6900/31148]    Overall Loss 0.013867    Objective Loss 0.000000    Distill Loss 0.013867                     LR 0.001000    Time 0.258593    
+2023-11-30 04:43:25,807 - Epoch: [1][ 7000/31148]    Overall Loss 0.013864    Objective Loss 0.000000    Distill Loss 0.013864                     LR 0.001000    Time 0.258585    
+2023-11-30 04:43:51,569 - Epoch: [1][ 7100/31148]    Overall Loss 0.013859    Objective Loss 0.000000    Distill Loss 0.013859                     LR 0.001000    Time 0.258571    
+2023-11-30 04:44:17,388 - Epoch: [1][ 7200/31148]    Overall Loss 0.013855    Objective Loss 0.000000    Distill Loss 0.013855                     LR 0.001000    Time 0.258566    
+2023-11-30 04:44:43,103 - Epoch: [1][ 7300/31148]    Overall Loss 0.013852    Objective Loss 0.000000    Distill Loss 0.013852                     LR 0.001000    Time 0.258546    
+2023-11-30 04:45:08,850 - Epoch: [1][ 7400/31148]    Overall Loss 0.013847    Objective Loss 0.000000    Distill Loss 0.013847                     LR 0.001000    Time 0.258531    
+2023-11-30 04:45:34,594 - Epoch: [1][ 7500/31148]    Overall Loss 0.013843    Objective Loss 0.000000    Distill Loss 0.013843                     LR 0.001000    Time 0.258516    
+2023-11-30 04:46:00,365 - Epoch: [1][ 7600/31148]    Overall Loss 0.013838    Objective Loss 0.000000    Distill Loss 0.013838                     LR 0.001000    Time 0.258505    
+2023-11-30 04:46:26,113 - Epoch: [1][ 7700/31148]    Overall Loss 0.013833    Objective Loss 0.000000    Distill Loss 0.013833                     LR 0.001000    Time 0.258492    
+2023-11-30 04:46:51,910 - Epoch: [1][ 7800/31148]    Overall Loss 0.013826    Objective Loss 0.000000    Distill Loss 0.013826                     LR 0.001000    Time 0.258485    
+2023-11-30 04:47:17,666 - Epoch: [1][ 7900/31148]    Overall Loss 0.013822    Objective Loss 0.000000    Distill Loss 0.013822                     LR 0.001000    Time 0.258473    
+2023-11-30 04:47:43,415 - Epoch: [1][ 8000/31148]    Overall Loss 0.013817    Objective Loss 0.000000    Distill Loss 0.013817                     LR 0.001000    Time 0.258460    
+2023-11-30 04:48:09,191 - Epoch: [1][ 8100/31148]    Overall Loss 0.013813    Objective Loss 0.000000    Distill Loss 0.013813                     LR 0.001000    Time 0.258451    
+2023-11-30 04:48:34,964 - Epoch: [1][ 8200/31148]    Overall Loss 0.013808    Objective Loss 0.000000    Distill Loss 0.013808                     LR 0.001000    Time 0.258442    
+2023-11-30 04:49:00,754 - Epoch: [1][ 8300/31148]    Overall Loss 0.013805    Objective Loss 0.000000    Distill Loss 0.013805                     LR 0.001000    Time 0.258435    
+2023-11-30 04:49:26,547 - Epoch: [1][ 8400/31148]    Overall Loss 0.013799    Objective Loss 0.000000    Distill Loss 0.013799                     LR 0.001000    Time 0.258429    
+2023-11-30 04:49:52,307 - Epoch: [1][ 8500/31148]    Overall Loss 0.013795    Objective Loss 0.000000    Distill Loss 0.013795                     LR 0.001000    Time 0.258419    
+2023-11-30 04:50:18,051 - Epoch: [1][ 8600/31148]    Overall Loss 0.013791    Objective Loss 0.000000    Distill Loss 0.013791                     LR 0.001000    Time 0.258407    
+2023-11-30 04:50:43,819 - Epoch: [1][ 8700/31148]    Overall Loss 0.013788    Objective Loss 0.000000    Distill Loss 0.013788                     LR 0.001000    Time 0.258398    
+2023-11-30 04:51:09,600 - Epoch: [1][ 8800/31148]    Overall Loss 0.013784    Objective Loss 0.000000    Distill Loss 0.013784                     LR 0.001000    Time 0.258391    
+2023-11-30 04:51:35,392 - Epoch: [1][ 8900/31148]    Overall Loss 0.013778    Objective Loss 0.000000    Distill Loss 0.013778                     LR 0.001000    Time 0.258386    
+2023-11-30 04:52:01,153 - Epoch: [1][ 9000/31148]    Overall Loss 0.013773    Objective Loss 0.000000    Distill Loss 0.013773                     LR 0.001000    Time 0.258377    
+2023-11-30 04:52:26,933 - Epoch: [1][ 9100/31148]    Overall Loss 0.013768    Objective Loss 0.000000    Distill Loss 0.013768                     LR 0.001000    Time 0.258370    
+2023-11-30 04:52:52,740 - Epoch: [1][ 9200/31148]    Overall Loss 0.013765    Objective Loss 0.000000    Distill Loss 0.013765                     LR 0.001000    Time 0.258367    
+2023-11-30 04:53:18,476 - Epoch: [1][ 9300/31148]    Overall Loss 0.013762    Objective Loss 0.000000    Distill Loss 0.013762                     LR 0.001000    Time 0.258355    
+2023-11-30 04:53:44,252 - Epoch: [1][ 9400/31148]    Overall Loss 0.013758    Objective Loss 0.000000    Distill Loss 0.013758                     LR 0.001000    Time 0.258349    
+2023-11-30 04:54:09,929 - Epoch: [1][ 9500/31148]    Overall Loss 0.013753    Objective Loss 0.000000    Distill Loss 0.013753                     LR 0.001000    Time 0.258332    
+2023-11-30 04:54:35,658 - Epoch: [1][ 9600/31148]    Overall Loss 0.013750    Objective Loss 0.000000    Distill Loss 0.013750                     LR 0.001000    Time 0.258321    
+2023-11-30 04:55:01,411 - Epoch: [1][ 9700/31148]    Overall Loss 0.013747    Objective Loss 0.000000    Distill Loss 0.013747                     LR 0.001000    Time 0.258312    
+2023-11-30 04:55:27,124 - Epoch: [1][ 9800/31148]    Overall Loss 0.013743    Objective Loss 0.000000    Distill Loss 0.013743                     LR 0.001000    Time 0.258300    
+2023-11-30 04:55:52,838 - Epoch: [1][ 9900/31148]    Overall Loss 0.013737    Objective Loss 0.000000    Distill Loss 0.013737                     LR 0.001000    Time 0.258288    
+2023-11-30 04:56:18,549 - Epoch: [1][10000/31148]    Overall Loss 0.013732    Objective Loss 0.000000    Distill Loss 0.013732                     LR 0.001000    Time 0.258276    
+2023-11-30 04:56:44,359 - Epoch: [1][10100/31148]    Overall Loss 0.013728    Objective Loss 0.000000    Distill Loss 0.013728                     LR 0.001000    Time 0.258274    
+2023-11-30 04:57:10,074 - Epoch: [1][10200/31148]    Overall Loss 0.013723    Objective Loss 0.000000    Distill Loss 0.013723                     LR 0.001000    Time 0.258263    
+2023-11-30 04:57:35,816 - Epoch: [1][10300/31148]    Overall Loss 0.013720    Objective Loss 0.000000    Distill Loss 0.013720                     LR 0.001000    Time 0.258254    
+2023-11-30 04:58:01,632 - Epoch: [1][10400/31148]    Overall Loss 0.013716    Objective Loss 0.000000    Distill Loss 0.013716                     LR 0.001000    Time 0.258253    
+2023-11-30 04:58:27,402 - Epoch: [1][10500/31148]    Overall Loss 0.013712    Objective Loss 0.000000    Distill Loss 0.013712                     LR 0.001000    Time 0.258248    
+2023-11-30 04:58:53,128 - Epoch: [1][10600/31148]    Overall Loss 0.013708    Objective Loss 0.000000    Distill Loss 0.013708                     LR 0.001000    Time 0.258238    
+2023-11-30 04:59:18,887 - Epoch: [1][10700/31148]    Overall Loss 0.013704    Objective Loss 0.000000    Distill Loss 0.013704                     LR 0.001000    Time 0.258232    
+2023-11-30 04:59:44,687 - Epoch: [1][10800/31148]    Overall Loss 0.013701    Objective Loss 0.000000    Distill Loss 0.013701                     LR 0.001000    Time 0.258229    
+2023-11-30 05:00:10,434 - Epoch: [1][10900/31148]    Overall Loss 0.013696    Objective Loss 0.000000    Distill Loss 0.013696                     LR 0.001000    Time 0.258222    
+2023-11-30 05:00:36,157 - Epoch: [1][11000/31148]    Overall Loss 0.013692    Objective Loss 0.000000    Distill Loss 0.013692                     LR 0.001000    Time 0.258213    
+2023-11-30 05:01:01,949 - Epoch: [1][11100/31148]    Overall Loss 0.013686    Objective Loss 0.000000    Distill Loss 0.013686                     LR 0.001000    Time 0.258210    
+2023-11-30 05:01:27,739 - Epoch: [1][11200/31148]    Overall Loss 0.013682    Objective Loss 0.000000    Distill Loss 0.013682                     LR 0.001000    Time 0.258207    
+2023-11-30 05:01:53,521 - Epoch: [1][11300/31148]    Overall Loss 0.013678    Objective Loss 0.000000    Distill Loss 0.013678                     LR 0.001000    Time 0.258203    
+2023-11-30 05:02:19,229 - Epoch: [1][11400/31148]    Overall Loss 0.013675    Objective Loss 0.000000    Distill Loss 0.013675                     LR 0.001000    Time 0.258193    
+2023-11-30 05:02:45,007 - Epoch: [1][11500/31148]    Overall Loss 0.013671    Objective Loss 0.000000    Distill Loss 0.013671                     LR 0.001000    Time 0.258189    
+2023-11-30 05:03:10,792 - Epoch: [1][11600/31148]    Overall Loss 0.013668    Objective Loss 0.000000    Distill Loss 0.013668                     LR 0.001000    Time 0.258186    
+2023-11-30 05:03:36,523 - Epoch: [1][11700/31148]    Overall Loss 0.013663    Objective Loss 0.000000    Distill Loss 0.013663                     LR 0.001000    Time 0.258179    
+2023-11-30 05:04:02,267 - Epoch: [1][11800/31148]    Overall Loss 0.013659    Objective Loss 0.000000    Distill Loss 0.013659                     LR 0.001000    Time 0.258172    
+2023-11-30 05:04:28,038 - Epoch: [1][11900/31148]    Overall Loss 0.013655    Objective Loss 0.000000    Distill Loss 0.013655                     LR 0.001000    Time 0.258168    
+2023-11-30 05:04:53,743 - Epoch: [1][12000/31148]    Overall Loss 0.013651    Objective Loss 0.000000    Distill Loss 0.013651                     LR 0.001000    Time 0.258158    
+2023-11-30 05:05:19,511 - Epoch: [1][12100/31148]    Overall Loss 0.013647    Objective Loss 0.000000    Distill Loss 0.013647                     LR 0.001000    Time 0.258154    
+2023-11-30 05:05:45,277 - Epoch: [1][12200/31148]    Overall Loss 0.013643    Objective Loss 0.000000    Distill Loss 0.013643                     LR 0.001000    Time 0.258150    
+2023-11-30 05:06:11,019 - Epoch: [1][12300/31148]    Overall Loss 0.013639    Objective Loss 0.000000    Distill Loss 0.013639                     LR 0.001000    Time 0.258144    
+2023-11-30 05:06:36,802 - Epoch: [1][12400/31148]    Overall Loss 0.013635    Objective Loss 0.000000    Distill Loss 0.013635                     LR 0.001000    Time 0.258141    
+2023-11-30 05:07:02,593 - Epoch: [1][12500/31148]    Overall Loss 0.013631    Objective Loss 0.000000    Distill Loss 0.013631                     LR 0.001000    Time 0.258139    
+2023-11-30 05:07:28,309 - Epoch: [1][12600/31148]    Overall Loss 0.013628    Objective Loss 0.000000    Distill Loss 0.013628                     LR 0.001000    Time 0.258131    
+2023-11-30 05:07:54,084 - Epoch: [1][12700/31148]    Overall Loss 0.013624    Objective Loss 0.000000    Distill Loss 0.013624                     LR 0.001000    Time 0.258128    
+2023-11-30 05:08:19,792 - Epoch: [1][12800/31148]    Overall Loss 0.013620    Objective Loss 0.000000    Distill Loss 0.013620                     LR 0.001000    Time 0.258119    
+2023-11-30 05:08:45,496 - Epoch: [1][12900/31148]    Overall Loss 0.013617    Objective Loss 0.000000    Distill Loss 0.013617                     LR 0.001000    Time 0.258111    
+2023-11-30 05:09:11,253 - Epoch: [1][13000/31148]    Overall Loss 0.013613    Objective Loss 0.000000    Distill Loss 0.013613                     LR 0.001000    Time 0.258107    
+2023-11-30 05:09:36,968 - Epoch: [1][13100/31148]    Overall Loss 0.013610    Objective Loss 0.000000    Distill Loss 0.013610                     LR 0.001000    Time 0.258099    
+2023-11-30 05:10:02,703 - Epoch: [1][13200/31148]    Overall Loss 0.013606    Objective Loss 0.000000    Distill Loss 0.013606                     LR 0.001000    Time 0.258093    
+2023-11-30 05:10:28,456 - Epoch: [1][13300/31148]    Overall Loss 0.013602    Objective Loss 0.000000    Distill Loss 0.013602                     LR 0.001000    Time 0.258089    
+2023-11-30 05:10:54,193 - Epoch: [1][13400/31148]    Overall Loss 0.013599    Objective Loss 0.000000    Distill Loss 0.013599                     LR 0.001000    Time 0.258083    
+2023-11-30 05:11:19,959 - Epoch: [1][13500/31148]    Overall Loss 0.013596    Objective Loss 0.000000    Distill Loss 0.013596                     LR 0.001000    Time 0.258080    
+2023-11-30 05:11:45,757 - Epoch: [1][13600/31148]    Overall Loss 0.013592    Objective Loss 0.000000    Distill Loss 0.013592                     LR 0.001000    Time 0.258079    
+2023-11-30 05:12:11,532 - Epoch: [1][13700/31148]    Overall Loss 0.013588    Objective Loss 0.000000    Distill Loss 0.013588                     LR 0.001000    Time 0.258076    
+2023-11-30 05:12:37,246 - Epoch: [1][13800/31148]    Overall Loss 0.013585    Objective Loss 0.000000    Distill Loss 0.013585                     LR 0.001000    Time 0.258069    
+2023-11-30 05:13:03,045 - Epoch: [1][13900/31148]    Overall Loss 0.013582    Objective Loss 0.000000    Distill Loss 0.013582                     LR 0.001000    Time 0.258069    
+2023-11-30 05:13:28,770 - Epoch: [1][14000/31148]    Overall Loss 0.013578    Objective Loss 0.000000    Distill Loss 0.013578                     LR 0.001000    Time 0.258063    
+2023-11-30 05:13:54,473 - Epoch: [1][14100/31148]    Overall Loss 0.013574    Objective Loss 0.000000    Distill Loss 0.013574                     LR 0.001000    Time 0.258055    
+2023-11-30 05:14:20,231 - Epoch: [1][14200/31148]    Overall Loss 0.013571    Objective Loss 0.000000    Distill Loss 0.013571                     LR 0.001000    Time 0.258051    
+2023-11-30 05:14:46,028 - Epoch: [1][14300/31148]    Overall Loss 0.013566    Objective Loss 0.000000    Distill Loss 0.013566                     LR 0.001000    Time 0.258051    
+2023-11-30 05:15:11,869 - Epoch: [1][14400/31148]    Overall Loss 0.013562    Objective Loss 0.000000    Distill Loss 0.013562                     LR 0.001000    Time 0.258053    
+2023-11-30 05:15:37,598 - Epoch: [1][14500/31148]    Overall Loss 0.013558    Objective Loss 0.000000    Distill Loss 0.013558                     LR 0.001000    Time 0.258048    
+2023-11-30 05:16:03,322 - Epoch: [1][14600/31148]    Overall Loss 0.013554    Objective Loss 0.000000    Distill Loss 0.013554                     LR 0.001000    Time 0.258042    
+2023-11-30 05:16:29,111 - Epoch: [1][14700/31148]    Overall Loss 0.013550    Objective Loss 0.000000    Distill Loss 0.013550                     LR 0.001000    Time 0.258041    
+2023-11-30 05:16:54,947 - Epoch: [1][14800/31148]    Overall Loss 0.013546    Objective Loss 0.000000    Distill Loss 0.013546                     LR 0.001000    Time 0.258043    
+2023-11-30 05:17:20,677 - Epoch: [1][14900/31148]    Overall Loss 0.013543    Objective Loss 0.000000    Distill Loss 0.013543                     LR 0.001000    Time 0.258038    
+2023-11-30 05:17:46,404 - Epoch: [1][15000/31148]    Overall Loss 0.013540    Objective Loss 0.000000    Distill Loss 0.013540                     LR 0.001000    Time 0.258032    
+2023-11-30 05:18:12,175 - Epoch: [1][15100/31148]    Overall Loss 0.013537    Objective Loss 0.000000    Distill Loss 0.013537                     LR 0.001000    Time 0.258030    
+2023-11-30 05:18:37,957 - Epoch: [1][15200/31148]    Overall Loss 0.013534    Objective Loss 0.000000    Distill Loss 0.013534                     LR 0.001000    Time 0.258028    
+2023-11-30 05:19:03,699 - Epoch: [1][15300/31148]    Overall Loss 0.013531    Objective Loss 0.000000    Distill Loss 0.013531                     LR 0.001000    Time 0.258024    
+2023-11-30 05:19:29,392 - Epoch: [1][15400/31148]    Overall Loss 0.013528    Objective Loss 0.000000    Distill Loss 0.013528                     LR 0.001000    Time 0.258017    
+2023-11-30 05:19:55,171 - Epoch: [1][15500/31148]    Overall Loss 0.013525    Objective Loss 0.000000    Distill Loss 0.013525                     LR 0.001000    Time 0.258015    
+2023-11-30 05:20:20,953 - Epoch: [1][15600/31148]    Overall Loss 0.013521    Objective Loss 0.000000    Distill Loss 0.013521                     LR 0.001000    Time 0.258014    
+2023-11-30 05:20:46,671 - Epoch: [1][15700/31148]    Overall Loss 0.013518    Objective Loss 0.000000    Distill Loss 0.013518                     LR 0.001000    Time 0.258008    
+2023-11-30 05:21:12,457 - Epoch: [1][15800/31148]    Overall Loss 0.013514    Objective Loss 0.000000    Distill Loss 0.013514                     LR 0.001000    Time 0.258007    
+2023-11-30 05:21:38,225 - Epoch: [1][15900/31148]    Overall Loss 0.013510    Objective Loss 0.000000    Distill Loss 0.013510                     LR 0.001000    Time 0.258005    
+2023-11-30 05:22:03,961 - Epoch: [1][16000/31148]    Overall Loss 0.013506    Objective Loss 0.000000    Distill Loss 0.013506                     LR 0.001000    Time 0.258001    
+2023-11-30 05:22:29,710 - Epoch: [1][16100/31148]    Overall Loss 0.013503    Objective Loss 0.000000    Distill Loss 0.013503                     LR 0.001000    Time 0.257998    
+2023-11-30 05:22:55,424 - Epoch: [1][16200/31148]    Overall Loss 0.013500    Objective Loss 0.000000    Distill Loss 0.013500                     LR 0.001000    Time 0.257992    
+2023-11-30 05:23:21,170 - Epoch: [1][16300/31148]    Overall Loss 0.013497    Objective Loss 0.000000    Distill Loss 0.013497                     LR 0.001000    Time 0.257989    
+2023-11-30 05:23:46,943 - Epoch: [1][16400/31148]    Overall Loss 0.013494    Objective Loss 0.000000    Distill Loss 0.013494                     LR 0.001000    Time 0.257987    
+2023-11-30 05:24:12,698 - Epoch: [1][16500/31148]    Overall Loss 0.013491    Objective Loss 0.000000    Distill Loss 0.013491                     LR 0.001000    Time 0.257984    
+2023-11-30 05:24:38,474 - Epoch: [1][16600/31148]    Overall Loss 0.013488    Objective Loss 0.000000    Distill Loss 0.013488                     LR 0.001000    Time 0.257983    
+2023-11-30 05:25:04,236 - Epoch: [1][16700/31148]    Overall Loss 0.013483    Objective Loss 0.000000    Distill Loss 0.013483                     LR 0.001000    Time 0.257980    
+2023-11-30 05:25:29,957 - Epoch: [1][16800/31148]    Overall Loss 0.013480    Objective Loss 0.000000    Distill Loss 0.013480                     LR 0.001000    Time 0.257976    
+2023-11-30 05:25:55,758 - Epoch: [1][16900/31148]    Overall Loss 0.013476    Objective Loss 0.000000    Distill Loss 0.013476                     LR 0.001000    Time 0.257976    
+2023-11-30 05:26:21,517 - Epoch: [1][17000/31148]    Overall Loss 0.013472    Objective Loss 0.000000    Distill Loss 0.013472                     LR 0.001000    Time 0.257973    
+2023-11-30 05:26:47,260 - Epoch: [1][17100/31148]    Overall Loss 0.013469    Objective Loss 0.000000    Distill Loss 0.013469                     LR 0.001000    Time 0.257970    
+2023-11-30 05:27:13,003 - Epoch: [1][17200/31148]    Overall Loss 0.013466    Objective Loss 0.000000    Distill Loss 0.013466                     LR 0.001000    Time 0.257966    
+2023-11-30 05:27:38,759 - Epoch: [1][17300/31148]    Overall Loss 0.013463    Objective Loss 0.000000    Distill Loss 0.013463                     LR 0.001000    Time 0.257964    
+2023-11-30 05:28:04,560 - Epoch: [1][17400/31148]    Overall Loss 0.013460    Objective Loss 0.000000    Distill Loss 0.013460                     LR 0.001000    Time 0.257964    
+2023-11-30 05:28:30,295 - Epoch: [1][17500/31148]    Overall Loss 0.013456    Objective Loss 0.000000    Distill Loss 0.013456                     LR 0.001000    Time 0.257960    
+2023-11-30 05:28:56,071 - Epoch: [1][17600/31148]    Overall Loss 0.013453    Objective Loss 0.000000    Distill Loss 0.013453                     LR 0.001000    Time 0.257959    
+2023-11-30 05:29:21,791 - Epoch: [1][17700/31148]    Overall Loss 0.013448    Objective Loss 0.000000    Distill Loss 0.013448                     LR 0.001000    Time 0.257955    
+2023-11-30 05:29:47,527 - Epoch: [1][17800/31148]    Overall Loss 0.013445    Objective Loss 0.000000    Distill Loss 0.013445                     LR 0.001000    Time 0.257951    
+2023-11-30 05:30:13,254 - Epoch: [1][17900/31148]    Overall Loss 0.013442    Objective Loss 0.000000    Distill Loss 0.013442                     LR 0.001000    Time 0.257947    
+2023-11-30 05:30:39,032 - Epoch: [1][18000/31148]    Overall Loss 0.013438    Objective Loss 0.000000    Distill Loss 0.013438                     LR 0.001000    Time 0.257946    
+2023-11-30 05:31:04,771 - Epoch: [1][18100/31148]    Overall Loss 0.013435    Objective Loss 0.000000    Distill Loss 0.013435                     LR 0.001000    Time 0.257943    
+2023-11-30 05:31:30,547 - Epoch: [1][18200/31148]    Overall Loss 0.013431    Objective Loss 0.000000    Distill Loss 0.013431                     LR 0.001000    Time 0.257942    
+2023-11-30 05:31:56,328 - Epoch: [1][18300/31148]    Overall Loss 0.013428    Objective Loss 0.000000    Distill Loss 0.013428                     LR 0.001000    Time 0.257941    
+2023-11-30 05:32:22,054 - Epoch: [1][18400/31148]    Overall Loss 0.013425    Objective Loss 0.000000    Distill Loss 0.013425                     LR 0.001000    Time 0.257937    
+2023-11-30 05:32:47,785 - Epoch: [1][18500/31148]    Overall Loss 0.013421    Objective Loss 0.000000    Distill Loss 0.013421                     LR 0.001000    Time 0.257933    
+2023-11-30 05:33:13,535 - Epoch: [1][18600/31148]    Overall Loss 0.013418    Objective Loss 0.000000    Distill Loss 0.013418                     LR 0.001000    Time 0.257931    
+2023-11-30 05:33:39,307 - Epoch: [1][18700/31148]    Overall Loss 0.013415    Objective Loss 0.000000    Distill Loss 0.013415                     LR 0.001000    Time 0.257930    
+2023-11-30 05:34:05,052 - Epoch: [1][18800/31148]    Overall Loss 0.013412    Objective Loss 0.000000    Distill Loss 0.013412                     LR 0.001000    Time 0.257927    
+2023-11-30 05:34:30,775 - Epoch: [1][18900/31148]    Overall Loss 0.013409    Objective Loss 0.000000    Distill Loss 0.013409                     LR 0.001000    Time 0.257923    
+2023-11-30 05:34:56,561 - Epoch: [1][19000/31148]    Overall Loss 0.013405    Objective Loss 0.000000    Distill Loss 0.013405                     LR 0.001000    Time 0.257923    
+2023-11-30 05:35:22,283 - Epoch: [1][19100/31148]    Overall Loss 0.013402    Objective Loss 0.000000    Distill Loss 0.013402                     LR 0.001000    Time 0.257919    
+2023-11-30 05:35:48,002 - Epoch: [1][19200/31148]    Overall Loss 0.013400    Objective Loss 0.000000    Distill Loss 0.013400                     LR 0.001000    Time 0.257915    
+2023-11-30 05:36:13,721 - Epoch: [1][19300/31148]    Overall Loss 0.013396    Objective Loss 0.000000    Distill Loss 0.013396                     LR 0.001000    Time 0.257911    
+2023-11-30 05:36:39,431 - Epoch: [1][19400/31148]    Overall Loss 0.013394    Objective Loss 0.000000    Distill Loss 0.013394                     LR 0.001000    Time 0.257907    
+2023-11-30 05:37:05,123 - Epoch: [1][19500/31148]    Overall Loss 0.013391    Objective Loss 0.000000    Distill Loss 0.013391                     LR 0.001000    Time 0.257902    
+2023-11-30 05:37:30,921 - Epoch: [1][19600/31148]    Overall Loss 0.013387    Objective Loss 0.000000    Distill Loss 0.013387                     LR 0.001000    Time 0.257902    
+2023-11-30 05:37:56,707 - Epoch: [1][19700/31148]    Overall Loss 0.013384    Objective Loss 0.000000    Distill Loss 0.013384                     LR 0.001000    Time 0.257901    
+2023-11-30 05:38:22,466 - Epoch: [1][19800/31148]    Overall Loss 0.013381    Objective Loss 0.000000    Distill Loss 0.013381                     LR 0.001000    Time 0.257900    
+2023-11-30 05:38:48,189 - Epoch: [1][19900/31148]    Overall Loss 0.013378    Objective Loss 0.000000    Distill Loss 0.013378                     LR 0.001000    Time 0.257896    
+2023-11-30 05:39:13,964 - Epoch: [1][20000/31148]    Overall Loss 0.013376    Objective Loss 0.000000    Distill Loss 0.013376                     LR 0.001000    Time 0.257895    
+2023-11-30 05:39:39,686 - Epoch: [1][20100/31148]    Overall Loss 0.013373    Objective Loss 0.000000    Distill Loss 0.013373                     LR 0.001000    Time 0.257892    
+2023-11-30 05:40:05,502 - Epoch: [1][20200/31148]    Overall Loss 0.013370    Objective Loss 0.000000    Distill Loss 0.013370                     LR 0.001000    Time 0.257893    
+2023-11-30 05:40:31,203 - Epoch: [1][20300/31148]    Overall Loss 0.013367    Objective Loss 0.000000    Distill Loss 0.013367                     LR 0.001000    Time 0.257889    
+2023-11-30 05:40:56,861 - Epoch: [1][20400/31148]    Overall Loss 0.013364    Objective Loss 0.000000    Distill Loss 0.013364                     LR 0.001000    Time 0.257882    
+2023-11-30 05:41:22,577 - Epoch: [1][20500/31148]    Overall Loss 0.013360    Objective Loss 0.000000    Distill Loss 0.013360                     LR 0.001000    Time 0.257878    
+2023-11-30 05:41:48,356 - Epoch: [1][20600/31148]    Overall Loss 0.013357    Objective Loss 0.000000    Distill Loss 0.013357                     LR 0.001000    Time 0.257878    
+2023-11-30 05:42:14,071 - Epoch: [1][20700/31148]    Overall Loss 0.013354    Objective Loss 0.000000    Distill Loss 0.013354                     LR 0.001000    Time 0.257874    
+2023-11-30 05:42:39,828 - Epoch: [1][20800/31148]    Overall Loss 0.013351    Objective Loss 0.000000    Distill Loss 0.013351                     LR 0.001000    Time 0.257873    
+2023-11-30 05:43:05,534 - Epoch: [1][20900/31148]    Overall Loss 0.013348    Objective Loss 0.000000    Distill Loss 0.013348                     LR 0.001000    Time 0.257869    
+2023-11-30 05:43:31,322 - Epoch: [1][21000/31148]    Overall Loss 0.013345    Objective Loss 0.000000    Distill Loss 0.013345                     LR 0.001000    Time 0.257869    
+2023-11-30 05:43:57,026 - Epoch: [1][21100/31148]    Overall Loss 0.013342    Objective Loss 0.000000    Distill Loss 0.013342                     LR 0.001000    Time 0.257864    
+2023-11-30 05:44:22,757 - Epoch: [1][21200/31148]    Overall Loss 0.013339    Objective Loss 0.000000    Distill Loss 0.013339                     LR 0.001000    Time 0.257862    
+2023-11-30 05:44:48,511 - Epoch: [1][21300/31148]    Overall Loss 0.013336    Objective Loss 0.000000    Distill Loss 0.013336                     LR 0.001000    Time 0.257860    
+2023-11-30 05:45:14,255 - Epoch: [1][21400/31148]    Overall Loss 0.013333    Objective Loss 0.000000    Distill Loss 0.013333                     LR 0.001000    Time 0.257858    
+2023-11-30 05:45:40,060 - Epoch: [1][21500/31148]    Overall Loss 0.013330    Objective Loss 0.000000    Distill Loss 0.013330                     LR 0.001000    Time 0.257859    
+2023-11-30 05:46:05,843 - Epoch: [1][21600/31148]    Overall Loss 0.013326    Objective Loss 0.000000    Distill Loss 0.013326                     LR 0.001000    Time 0.257859    
+2023-11-30 05:46:31,564 - Epoch: [1][21700/31148]    Overall Loss 0.013324    Objective Loss 0.000000    Distill Loss 0.013324                     LR 0.001000    Time 0.257855    
+2023-11-30 05:46:57,317 - Epoch: [1][21800/31148]    Overall Loss 0.013320    Objective Loss 0.000000    Distill Loss 0.013320                     LR 0.001000    Time 0.257854    
+2023-11-30 05:47:23,088 - Epoch: [1][21900/31148]    Overall Loss 0.013317    Objective Loss 0.000000    Distill Loss 0.013317                     LR 0.001000    Time 0.257853    
+2023-11-30 05:47:48,810 - Epoch: [1][22000/31148]    Overall Loss 0.013314    Objective Loss 0.000000    Distill Loss 0.013314                     LR 0.001000    Time 0.257850    
+2023-11-30 05:48:14,512 - Epoch: [1][22100/31148]    Overall Loss 0.013311    Objective Loss 0.000000    Distill Loss 0.013311                     LR 0.001000    Time 0.257846    
+2023-11-30 05:48:40,260 - Epoch: [1][22200/31148]    Overall Loss 0.013309    Objective Loss 0.000000    Distill Loss 0.013309                     LR 0.001000    Time 0.257844    
+2023-11-30 05:49:06,038 - Epoch: [1][22300/31148]    Overall Loss 0.013305    Objective Loss 0.000000    Distill Loss 0.013305                     LR 0.001000    Time 0.257844    
+2023-11-30 05:49:31,788 - Epoch: [1][22400/31148]    Overall Loss 0.013302    Objective Loss 0.000000    Distill Loss 0.013302                     LR 0.001000    Time 0.257842    
+2023-11-30 05:49:57,559 - Epoch: [1][22500/31148]    Overall Loss 0.013299    Objective Loss 0.000000    Distill Loss 0.013299                     LR 0.001000    Time 0.257842    
+2023-11-30 05:50:23,246 - Epoch: [1][22600/31148]    Overall Loss 0.013296    Objective Loss 0.000000    Distill Loss 0.013296                     LR 0.001000    Time 0.257837    
+2023-11-30 05:50:49,043 - Epoch: [1][22700/31148]    Overall Loss 0.013292    Objective Loss 0.000000    Distill Loss 0.013292                     LR 0.001000    Time 0.257838    
+2023-11-30 05:51:14,775 - Epoch: [1][22800/31148]    Overall Loss 0.013290    Objective Loss 0.000000    Distill Loss 0.013290                     LR 0.001000    Time 0.257835    
+2023-11-30 05:51:40,537 - Epoch: [1][22900/31148]    Overall Loss 0.013287    Objective Loss 0.000000    Distill Loss 0.013287                     LR 0.001000    Time 0.257834    
+2023-11-30 05:52:06,266 - Epoch: [1][23000/31148]    Overall Loss 0.013284    Objective Loss 0.000000    Distill Loss 0.013284                     LR 0.001000    Time 0.257832    
+2023-11-30 05:52:32,008 - Epoch: [1][23100/31148]    Overall Loss 0.013281    Objective Loss 0.000000    Distill Loss 0.013281                     LR 0.001000    Time 0.257830    
+2023-11-30 05:52:57,799 - Epoch: [1][23200/31148]    Overall Loss 0.013278    Objective Loss 0.000000    Distill Loss 0.013278                     LR 0.001000    Time 0.257830    
+2023-11-30 05:53:23,540 - Epoch: [1][23300/31148]    Overall Loss 0.013276    Objective Loss 0.000000    Distill Loss 0.013276                     LR 0.001000    Time 0.257828    
+2023-11-30 05:53:49,291 - Epoch: [1][23400/31148]    Overall Loss 0.013273    Objective Loss 0.000000    Distill Loss 0.013273                     LR 0.001000    Time 0.257827    
+2023-11-30 05:54:15,067 - Epoch: [1][23500/31148]    Overall Loss 0.013270    Objective Loss 0.000000    Distill Loss 0.013270                     LR 0.001000    Time 0.257826    
+2023-11-30 05:54:40,789 - Epoch: [1][23600/31148]    Overall Loss 0.013267    Objective Loss 0.000000    Distill Loss 0.013267                     LR 0.001000    Time 0.257824    
+2023-11-30 05:55:06,547 - Epoch: [1][23700/31148]    Overall Loss 0.013264    Objective Loss 0.000000    Distill Loss 0.013264                     LR 0.001000    Time 0.257822    
+2023-11-30 05:55:32,289 - Epoch: [1][23800/31148]    Overall Loss 0.013262    Objective Loss 0.000000    Distill Loss 0.013262                     LR 0.001000    Time 0.257821    
+2023-11-30 05:55:58,011 - Epoch: [1][23900/31148]    Overall Loss 0.013259    Objective Loss 0.000000    Distill Loss 0.013259                     LR 0.001000    Time 0.257818    
+2023-11-30 05:56:23,763 - Epoch: [1][24000/31148]    Overall Loss 0.013256    Objective Loss 0.000000    Distill Loss 0.013256                     LR 0.001000    Time 0.257817    
+2023-11-30 05:56:49,508 - Epoch: [1][24100/31148]    Overall Loss 0.013254    Objective Loss 0.000000    Distill Loss 0.013254                     LR 0.001000    Time 0.257815    
+2023-11-30 05:57:15,213 - Epoch: [1][24200/31148]    Overall Loss 0.013251    Objective Loss 0.000000    Distill Loss 0.013251                     LR 0.001000    Time 0.257812    
+2023-11-30 05:57:40,964 - Epoch: [1][24300/31148]    Overall Loss 0.013248    Objective Loss 0.000000    Distill Loss 0.013248                     LR 0.001000    Time 0.257810    
+2023-11-30 05:58:06,700 - Epoch: [1][24400/31148]    Overall Loss 0.013245    Objective Loss 0.000000    Distill Loss 0.013245                     LR 0.001000    Time 0.257809    
+2023-11-30 05:58:32,496 - Epoch: [1][24500/31148]    Overall Loss 0.013242    Objective Loss 0.000000    Distill Loss 0.013242                     LR 0.001000    Time 0.257809    
+2023-11-30 05:58:58,252 - Epoch: [1][24600/31148]    Overall Loss 0.013239    Objective Loss 0.000000    Distill Loss 0.013239                     LR 0.001000    Time 0.257808    
+2023-11-30 05:59:25,677 - Epoch: [1][24700/31148]    Overall Loss 0.013237    Objective Loss 0.000000    Distill Loss 0.013237                     LR 0.001000    Time 0.257874    
+2023-11-30 05:59:51,435 - Epoch: [1][24800/31148]    Overall Loss 0.013234    Objective Loss 0.000000    Distill Loss 0.013234                     LR 0.001000    Time 0.257873    
+2023-11-30 06:00:17,189 - Epoch: [1][24900/31148]    Overall Loss 0.013231    Objective Loss 0.000000    Distill Loss 0.013231                     LR 0.001000    Time 0.257872    
+2023-11-30 06:00:42,934 - Epoch: [1][25000/31148]    Overall Loss 0.013227    Objective Loss 0.000000    Distill Loss 0.013227                     LR 0.001000    Time 0.257870    
+2023-11-30 06:01:08,596 - Epoch: [1][25100/31148]    Overall Loss 0.013225    Objective Loss 0.000000    Distill Loss 0.013225                     LR 0.001000    Time 0.257865    
+2023-11-30 06:01:34,345 - Epoch: [1][25200/31148]    Overall Loss 0.013222    Objective Loss 0.000000    Distill Loss 0.013222                     LR 0.001000    Time 0.257863    
+2023-11-30 06:02:00,113 - Epoch: [1][25300/31148]    Overall Loss 0.013219    Objective Loss 0.000000    Distill Loss 0.013219                     LR 0.001000    Time 0.257862    
+2023-11-30 06:02:25,845 - Epoch: [1][25400/31148]    Overall Loss 0.013216    Objective Loss 0.000000    Distill Loss 0.013216                     LR 0.001000    Time 0.257860    
+2023-11-30 06:02:51,580 - Epoch: [1][25500/31148]    Overall Loss 0.013214    Objective Loss 0.000000    Distill Loss 0.013214                     LR 0.001000    Time 0.257858    
+2023-11-30 06:03:17,353 - Epoch: [1][25600/31148]    Overall Loss 0.013211    Objective Loss 0.000000    Distill Loss 0.013211                     LR 0.001000    Time 0.257857    
+2023-11-30 06:03:43,134 - Epoch: [1][25700/31148]    Overall Loss 0.013208    Objective Loss 0.000000    Distill Loss 0.013208                     LR 0.001000    Time 0.257857    
+2023-11-30 06:04:08,906 - Epoch: [1][25800/31148]    Overall Loss 0.013205    Objective Loss 0.000000    Distill Loss 0.013205                     LR 0.001000    Time 0.257856    
+2023-11-30 06:04:34,662 - Epoch: [1][25900/31148]    Overall Loss 0.013202    Objective Loss 0.000000    Distill Loss 0.013202                     LR 0.001000    Time 0.257855    
+2023-11-30 06:05:00,486 - Epoch: [1][26000/31148]    Overall Loss 0.013199    Objective Loss 0.000000    Distill Loss 0.013199                     LR 0.001000    Time 0.257856    
+2023-11-30 06:05:26,249 - Epoch: [1][26100/31148]    Overall Loss 0.013196    Objective Loss 0.000000    Distill Loss 0.013196                     LR 0.001000    Time 0.257856    
+2023-11-30 06:05:51,995 - Epoch: [1][26200/31148]    Overall Loss 0.013193    Objective Loss 0.000000    Distill Loss 0.013193                     LR 0.001000    Time 0.257854    
+2023-11-30 06:06:17,736 - Epoch: [1][26300/31148]    Overall Loss 0.013190    Objective Loss 0.000000    Distill Loss 0.013190                     LR 0.001000    Time 0.257852    
+2023-11-30 06:06:43,442 - Epoch: [1][26400/31148]    Overall Loss 0.013188    Objective Loss 0.000000    Distill Loss 0.013188                     LR 0.001000    Time 0.257849    
+2023-11-30 06:07:09,245 - Epoch: [1][26500/31148]    Overall Loss 0.013186    Objective Loss 0.000000    Distill Loss 0.013186                     LR 0.001000    Time 0.257850    
+2023-11-30 06:07:35,047 - Epoch: [1][26600/31148]    Overall Loss 0.013183    Objective Loss 0.000000    Distill Loss 0.013183                     LR 0.001000    Time 0.257850    
+2023-11-30 06:08:00,807 - Epoch: [1][26700/31148]    Overall Loss 0.013180    Objective Loss 0.000000    Distill Loss 0.013180                     LR 0.001000    Time 0.257849    
+2023-11-30 06:08:26,485 - Epoch: [1][26800/31148]    Overall Loss 0.013178    Objective Loss 0.000000    Distill Loss 0.013178                     LR 0.001000    Time 0.257845    
+2023-11-30 06:08:52,225 - Epoch: [1][26900/31148]    Overall Loss 0.013175    Objective Loss 0.000000    Distill Loss 0.013175                     LR 0.001000    Time 0.257843    
+2023-11-30 06:09:18,000 - Epoch: [1][27000/31148]    Overall Loss 0.013172    Objective Loss 0.000000    Distill Loss 0.013172                     LR 0.001000    Time 0.257843    
+2023-11-30 06:09:43,791 - Epoch: [1][27100/31148]    Overall Loss 0.013169    Objective Loss 0.000000    Distill Loss 0.013169                     LR 0.001000    Time 0.257843    
+2023-11-30 06:10:09,530 - Epoch: [1][27200/31148]    Overall Loss 0.013166    Objective Loss 0.000000    Distill Loss 0.013166                     LR 0.001000    Time 0.257841    
+2023-11-30 06:10:35,270 - Epoch: [1][27300/31148]    Overall Loss 0.013163    Objective Loss 0.000000    Distill Loss 0.013163                     LR 0.001000    Time 0.257839    
+2023-11-30 06:11:01,030 - Epoch: [1][27400/31148]    Overall Loss 0.013160    Objective Loss 0.000000    Distill Loss 0.013160                     LR 0.001000    Time 0.257839    
+2023-11-30 06:11:26,798 - Epoch: [1][27500/31148]    Overall Loss 0.013158    Objective Loss 0.000000    Distill Loss 0.013158                     LR 0.001000    Time 0.257838    
+2023-11-30 06:11:52,526 - Epoch: [1][27600/31148]    Overall Loss 0.013155    Objective Loss 0.000000    Distill Loss 0.013155                     LR 0.001000    Time 0.257836    
+2023-11-30 06:12:18,284 - Epoch: [1][27700/31148]    Overall Loss 0.013153    Objective Loss 0.000000    Distill Loss 0.013153                     LR 0.001000    Time 0.257835    
+2023-11-30 06:12:44,006 - Epoch: [1][27800/31148]    Overall Loss 0.013150    Objective Loss 0.000000    Distill Loss 0.013150                     LR 0.001000    Time 0.257832    
+2023-11-30 06:13:09,735 - Epoch: [1][27900/31148]    Overall Loss 0.013147    Objective Loss 0.000000    Distill Loss 0.013147                     LR 0.001000    Time 0.257830    
+2023-11-30 06:13:35,511 - Epoch: [1][28000/31148]    Overall Loss 0.013144    Objective Loss 0.000000    Distill Loss 0.013144                     LR 0.001000    Time 0.257830    
+2023-11-30 06:14:01,298 - Epoch: [1][28100/31148]    Overall Loss 0.013141    Objective Loss 0.000000    Distill Loss 0.013141                     LR 0.001000    Time 0.257830    
+2023-11-30 06:14:27,072 - Epoch: [1][28200/31148]    Overall Loss 0.013138    Objective Loss 0.000000    Distill Loss 0.013138                     LR 0.001000    Time 0.257830    
+2023-11-30 06:14:52,818 - Epoch: [1][28300/31148]    Overall Loss 0.013136    Objective Loss 0.000000    Distill Loss 0.013136                     LR 0.001000    Time 0.257828    
+2023-11-30 06:15:18,563 - Epoch: [1][28400/31148]    Overall Loss 0.013133    Objective Loss 0.000000    Distill Loss 0.013133                     LR 0.001000    Time 0.257827    
+2023-11-30 06:15:44,266 - Epoch: [1][28500/31148]    Overall Loss 0.013131    Objective Loss 0.000000    Distill Loss 0.013131                     LR 0.001000    Time 0.257824    
+2023-11-30 06:16:10,023 - Epoch: [1][28600/31148]    Overall Loss 0.013128    Objective Loss 0.000000    Distill Loss 0.013128                     LR 0.001000    Time 0.257823    
+2023-11-30 06:16:35,788 - Epoch: [1][28700/31148]    Overall Loss 0.013126    Objective Loss 0.000000    Distill Loss 0.013126                     LR 0.001000    Time 0.257822    
+2023-11-30 06:17:01,488 - Epoch: [1][28800/31148]    Overall Loss 0.013123    Objective Loss 0.000000    Distill Loss 0.013123                     LR 0.001000    Time 0.257819    
+2023-11-30 06:17:27,197 - Epoch: [1][28900/31148]    Overall Loss 0.013120    Objective Loss 0.000000    Distill Loss 0.013120                     LR 0.001000    Time 0.257817    
+2023-11-30 06:17:52,904 - Epoch: [1][29000/31148]    Overall Loss 0.013118    Objective Loss 0.000000    Distill Loss 0.013118                     LR 0.001000    Time 0.257814    
+2023-11-30 06:18:18,713 - Epoch: [1][29100/31148]    Overall Loss 0.013115    Objective Loss 0.000000    Distill Loss 0.013115                     LR 0.001000    Time 0.257815    
+2023-11-30 06:18:44,454 - Epoch: [1][29200/31148]    Overall Loss 0.013113    Objective Loss 0.000000    Distill Loss 0.013113                     LR 0.001000    Time 0.257813    
+2023-11-30 06:19:10,183 - Epoch: [1][29300/31148]    Overall Loss 0.013110    Objective Loss 0.000000    Distill Loss 0.013110                     LR 0.001000    Time 0.257812    
+2023-11-30 06:19:35,957 - Epoch: [1][29400/31148]    Overall Loss 0.013107    Objective Loss 0.000000    Distill Loss 0.013107                     LR 0.001000    Time 0.257811    
+2023-11-30 06:20:01,691 - Epoch: [1][29500/31148]    Overall Loss 0.013104    Objective Loss 0.000000    Distill Loss 0.013104                     LR 0.001000    Time 0.257810    
+2023-11-30 06:20:27,468 - Epoch: [1][29600/31148]    Overall Loss 0.013101    Objective Loss 0.000000    Distill Loss 0.013101                     LR 0.001000    Time 0.257809    
+2023-11-30 06:20:53,237 - Epoch: [1][29700/31148]    Overall Loss 0.013098    Objective Loss 0.000000    Distill Loss 0.013098                     LR 0.001000    Time 0.257809    
+2023-11-30 06:21:18,966 - Epoch: [1][29800/31148]    Overall Loss 0.013096    Objective Loss 0.000000    Distill Loss 0.013096                     LR 0.001000    Time 0.257807    
+2023-11-30 06:21:44,697 - Epoch: [1][29900/31148]    Overall Loss 0.013094    Objective Loss 0.000000    Distill Loss 0.013094                     LR 0.001000    Time 0.257805    
+2023-11-30 06:22:10,492 - Epoch: [1][30000/31148]    Overall Loss 0.013091    Objective Loss 0.000000    Distill Loss 0.013091                     LR 0.001000    Time 0.257806    
+2023-11-30 06:22:36,268 - Epoch: [1][30100/31148]    Overall Loss 0.013089    Objective Loss 0.000000    Distill Loss 0.013089                     LR 0.001000    Time 0.257805    
+2023-11-30 06:23:02,015 - Epoch: [1][30200/31148]    Overall Loss 0.013087    Objective Loss 0.000000    Distill Loss 0.013087                     LR 0.001000    Time 0.257804    
+2023-11-30 06:23:27,789 - Epoch: [1][30300/31148]    Overall Loss 0.013084    Objective Loss 0.000000    Distill Loss 0.013084                     LR 0.001000    Time 0.257804    
+2023-11-30 06:23:53,605 - Epoch: [1][30400/31148]    Overall Loss 0.013081    Objective Loss 0.000000    Distill Loss 0.013081                     LR 0.001000    Time 0.257805    
+2023-11-30 06:24:19,371 - Epoch: [1][30500/31148]    Overall Loss 0.013079    Objective Loss 0.000000    Distill Loss 0.013079                     LR 0.001000    Time 0.257804    
+2023-11-30 06:24:45,146 - Epoch: [1][30600/31148]    Overall Loss 0.013076    Objective Loss 0.000000    Distill Loss 0.013076                     LR 0.001000    Time 0.257804    
+2023-11-30 06:25:10,944 - Epoch: [1][30700/31148]    Overall Loss 0.013073    Objective Loss 0.000000    Distill Loss 0.013073                     LR 0.001000    Time 0.257805    
+2023-11-30 06:25:36,717 - Epoch: [1][30800/31148]    Overall Loss 0.013071    Objective Loss 0.000000    Distill Loss 0.013071                     LR 0.001000    Time 0.257804    
+2023-11-30 06:26:02,423 - Epoch: [1][30900/31148]    Overall Loss 0.013068    Objective Loss 0.000000    Distill Loss 0.013068                     LR 0.001000    Time 0.257802    
+2023-11-30 06:26:28,157 - Epoch: [1][31000/31148]    Overall Loss 0.013066    Objective Loss 0.000000    Distill Loss 0.013066                     LR 0.001000    Time 0.257800    
+2023-11-30 06:26:53,959 - Epoch: [1][31100/31148]    Overall Loss 0.013063    Objective Loss 0.000000    Distill Loss 0.013063                     LR 0.001000    Time 0.257801    
+2023-11-30 06:27:06,730 - Epoch: [1][31148/31148]    Overall Loss 0.013062    Objective Loss 0.000000    Distill Loss 0.013062                     LR 0.001000    Time 0.257813    
+2023-11-30 06:27:07,084 - --- validate (epoch=1)-----------
+2023-11-30 06:27:07,084 - 167951 samples (100 per mini-batch)
+2023-11-30 06:27:27,938 - Epoch: [1][  100/ 1680]    Loss 0.000000    Overall Loss 0.013007    
+2023-11-30 06:27:47,640 - Epoch: [1][  200/ 1680]    Loss 0.000000    Overall Loss 0.012948    
+2023-11-30 06:28:07,369 - Epoch: [1][  300/ 1680]    Loss 0.000000    Overall Loss 0.012947    
+2023-11-30 06:28:27,098 - Epoch: [1][  400/ 1680]    Loss 0.000000    Overall Loss 0.012942    
+2023-11-30 06:28:46,798 - Epoch: [1][  500/ 1680]    Loss 0.000000    Overall Loss 0.012955    
+2023-11-30 06:29:06,549 - Epoch: [1][  600/ 1680]    Loss 0.000000    Overall Loss 0.012953    
+2023-11-30 06:29:26,277 - Epoch: [1][  700/ 1680]    Loss 0.000000    Overall Loss 0.012962    
+2023-11-30 06:29:46,001 - Epoch: [1][  800/ 1680]    Loss 0.000000    Overall Loss 0.012969    
+2023-11-30 06:30:05,731 - Epoch: [1][  900/ 1680]    Loss 0.000000    Overall Loss 0.012968    
+2023-11-30 06:30:25,434 - Epoch: [1][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.012969    
+2023-11-30 06:30:45,172 - Epoch: [1][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.012968    
+2023-11-30 06:31:04,884 - Epoch: [1][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.012970    
+2023-11-30 06:31:24,584 - Epoch: [1][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.012971    
+2023-11-30 06:31:44,290 - Epoch: [1][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.012970    
+2023-11-30 06:32:04,029 - Epoch: [1][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.012966    
+2023-11-30 06:32:23,753 - Epoch: [1][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.012963    
+2023-11-30 06:32:39,455 - Epoch: [1][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.012968    
+2023-11-30 06:32:39,645 - ==> Overall Loss: 0.013
+
+2023-11-30 06:32:39,649 - ==> Best [Overall Loss: 0.012968 on epoch: 1]
+2023-11-30 06:32:39,649 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 06:32:39,688 - 
+
+2023-11-30 06:32:39,688 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 06:33:12,172 - Epoch: [2][  100/31148]    Overall Loss 0.012134    Objective Loss 0.000000    Distill Loss 0.012134                     LR 0.001000    Time 0.324806    
+2023-11-30 06:33:37,918 - Epoch: [2][  200/31148]    Overall Loss 0.012160    Objective Loss 0.000000    Distill Loss 0.012160                     LR 0.001000    Time 0.291119    
+2023-11-30 06:34:03,669 - Epoch: [2][  300/31148]    Overall Loss 0.012184    Objective Loss 0.000000    Distill Loss 0.012184                     LR 0.001000    Time 0.279908    
+2023-11-30 06:34:29,384 - Epoch: [2][  400/31148]    Overall Loss 0.012174    Objective Loss 0.000000    Distill Loss 0.012174                     LR 0.001000    Time 0.274210    
+2023-11-30 06:34:55,160 - Epoch: [2][  500/31148]    Overall Loss 0.012168    Objective Loss 0.000000    Distill Loss 0.012168                     LR 0.001000    Time 0.270915    
+2023-11-30 06:35:20,864 - Epoch: [2][  600/31148]    Overall Loss 0.012172    Objective Loss 0.000000    Distill Loss 0.012172                     LR 0.001000    Time 0.268599    
+2023-11-30 06:35:46,573 - Epoch: [2][  700/31148]    Overall Loss 0.012191    Objective Loss 0.000000    Distill Loss 0.012191                     LR 0.001000    Time 0.266951    
+2023-11-30 06:36:12,309 - Epoch: [2][  800/31148]    Overall Loss 0.012207    Objective Loss 0.000000    Distill Loss 0.012207                     LR 0.001000    Time 0.265749    
+2023-11-30 06:36:38,036 - Epoch: [2][  900/31148]    Overall Loss 0.012199    Objective Loss 0.000000    Distill Loss 0.012199                     LR 0.001000    Time 0.264804    
+2023-11-30 06:37:03,812 - Epoch: [2][ 1000/31148]    Overall Loss 0.012194    Objective Loss 0.000000    Distill Loss 0.012194                     LR 0.001000    Time 0.264097    
+2023-11-30 06:37:29,569 - Epoch: [2][ 1100/31148]    Overall Loss 0.012196    Objective Loss 0.000000    Distill Loss 0.012196                     LR 0.001000    Time 0.263502    
+2023-11-30 06:37:55,284 - Epoch: [2][ 1200/31148]    Overall Loss 0.012197    Objective Loss 0.000000    Distill Loss 0.012197                     LR 0.001000    Time 0.262970    
+2023-11-30 06:38:20,993 - Epoch: [2][ 1300/31148]    Overall Loss 0.012194    Objective Loss 0.000000    Distill Loss 0.012194                     LR 0.001000    Time 0.262515    
+2023-11-30 06:38:46,716 - Epoch: [2][ 1400/31148]    Overall Loss 0.012198    Objective Loss 0.000000    Distill Loss 0.012198                     LR 0.001000    Time 0.262136    
+2023-11-30 06:39:12,406 - Epoch: [2][ 1500/31148]    Overall Loss 0.012197    Objective Loss 0.000000    Distill Loss 0.012197                     LR 0.001000    Time 0.261786    
+2023-11-30 06:39:38,111 - Epoch: [2][ 1600/31148]    Overall Loss 0.012194    Objective Loss 0.000000    Distill Loss 0.012194                     LR 0.001000    Time 0.261488    
+2023-11-30 06:40:03,853 - Epoch: [2][ 1700/31148]    Overall Loss 0.012194    Objective Loss 0.000000    Distill Loss 0.012194                     LR 0.001000    Time 0.261247    
+2023-11-30 06:40:29,555 - Epoch: [2][ 1800/31148]    Overall Loss 0.012192    Objective Loss 0.000000    Distill Loss 0.012192                     LR 0.001000    Time 0.261011    
+2023-11-30 06:40:55,269 - Epoch: [2][ 1900/31148]    Overall Loss 0.012191    Objective Loss 0.000000    Distill Loss 0.012191                     LR 0.001000    Time 0.260805    
+2023-11-30 06:41:21,049 - Epoch: [2][ 2000/31148]    Overall Loss 0.012190    Objective Loss 0.000000    Distill Loss 0.012190                     LR 0.001000    Time 0.260654    
+2023-11-30 06:41:46,804 - Epoch: [2][ 2100/31148]    Overall Loss 0.012195    Objective Loss 0.000000    Distill Loss 0.012195                     LR 0.001000    Time 0.260505    
+2023-11-30 06:42:12,577 - Epoch: [2][ 2200/31148]    Overall Loss 0.012196    Objective Loss 0.000000    Distill Loss 0.012196                     LR 0.001000    Time 0.260378    
+2023-11-30 06:42:38,276 - Epoch: [2][ 2300/31148]    Overall Loss 0.012194    Objective Loss 0.000000    Distill Loss 0.012194                     LR 0.001000    Time 0.260229    
+2023-11-30 06:43:04,009 - Epoch: [2][ 2400/31148]    Overall Loss 0.012193    Objective Loss 0.000000    Distill Loss 0.012193                     LR 0.001000    Time 0.260107    
+2023-11-30 06:43:29,815 - Epoch: [2][ 2500/31148]    Overall Loss 0.012189    Objective Loss 0.000000    Distill Loss 0.012189                     LR 0.001000    Time 0.260024    
+2023-11-30 06:43:55,514 - Epoch: [2][ 2600/31148]    Overall Loss 0.012191    Objective Loss 0.000000    Distill Loss 0.012191                     LR 0.001000    Time 0.259906    
+2023-11-30 06:44:21,206 - Epoch: [2][ 2700/31148]    Overall Loss 0.012192    Objective Loss 0.000000    Distill Loss 0.012192                     LR 0.001000    Time 0.259795    
+2023-11-30 06:44:46,920 - Epoch: [2][ 2800/31148]    Overall Loss 0.012190    Objective Loss 0.000000    Distill Loss 0.012190                     LR 0.001000    Time 0.259699    
+2023-11-30 06:45:12,604 - Epoch: [2][ 2900/31148]    Overall Loss 0.012187    Objective Loss 0.000000    Distill Loss 0.012187                     LR 0.001000    Time 0.259600    
+2023-11-30 06:45:38,336 - Epoch: [2][ 3000/31148]    Overall Loss 0.012186    Objective Loss 0.000000    Distill Loss 0.012186                     LR 0.001000    Time 0.259523    
+2023-11-30 06:46:04,039 - Epoch: [2][ 3100/31148]    Overall Loss 0.012183    Objective Loss 0.000000    Distill Loss 0.012183                     LR 0.001000    Time 0.259442    
+2023-11-30 06:46:29,809 - Epoch: [2][ 3200/31148]    Overall Loss 0.012184    Objective Loss 0.000000    Distill Loss 0.012184                     LR 0.001000    Time 0.259386    
+2023-11-30 06:46:55,552 - Epoch: [2][ 3300/31148]    Overall Loss 0.012176    Objective Loss 0.000000    Distill Loss 0.012176                     LR 0.001000    Time 0.259326    
+2023-11-30 06:47:21,252 - Epoch: [2][ 3400/31148]    Overall Loss 0.012175    Objective Loss 0.000000    Distill Loss 0.012175                     LR 0.001000    Time 0.259257    
+2023-11-30 06:47:47,026 - Epoch: [2][ 3500/31148]    Overall Loss 0.012172    Objective Loss 0.000000    Distill Loss 0.012172                     LR 0.001000    Time 0.259213    
+2023-11-30 06:48:12,781 - Epoch: [2][ 3600/31148]    Overall Loss 0.012173    Objective Loss 0.000000    Distill Loss 0.012173                     LR 0.001000    Time 0.259166    
+2023-11-30 06:48:38,560 - Epoch: [2][ 3700/31148]    Overall Loss 0.012174    Objective Loss 0.000000    Distill Loss 0.012174                     LR 0.001000    Time 0.259128    
+2023-11-30 06:49:04,348 - Epoch: [2][ 3800/31148]    Overall Loss 0.012170    Objective Loss 0.000000    Distill Loss 0.012170                     LR 0.001000    Time 0.259095    
+2023-11-30 06:49:30,123 - Epoch: [2][ 3900/31148]    Overall Loss 0.012170    Objective Loss 0.000000    Distill Loss 0.012170                     LR 0.001000    Time 0.259059    
+2023-11-30 06:49:55,890 - Epoch: [2][ 4000/31148]    Overall Loss 0.012168    Objective Loss 0.000000    Distill Loss 0.012168                     LR 0.001000    Time 0.259024    
+2023-11-30 06:50:21,656 - Epoch: [2][ 4100/31148]    Overall Loss 0.012169    Objective Loss 0.000000    Distill Loss 0.012169                     LR 0.001000    Time 0.258990    
+2023-11-30 06:50:47,390 - Epoch: [2][ 4200/31148]    Overall Loss 0.012167    Objective Loss 0.000000    Distill Loss 0.012167                     LR 0.001000    Time 0.258950    
+2023-11-30 06:51:13,097 - Epoch: [2][ 4300/31148]    Overall Loss 0.012169    Objective Loss 0.000000    Distill Loss 0.012169                     LR 0.001000    Time 0.258906    
+2023-11-30 06:51:38,828 - Epoch: [2][ 4400/31148]    Overall Loss 0.012165    Objective Loss 0.000000    Distill Loss 0.012165                     LR 0.001000    Time 0.258869    
+2023-11-30 06:52:04,587 - Epoch: [2][ 4500/31148]    Overall Loss 0.012166    Objective Loss 0.000000    Distill Loss 0.012166                     LR 0.001000    Time 0.258840    
+2023-11-30 06:52:30,355 - Epoch: [2][ 4600/31148]    Overall Loss 0.012163    Objective Loss 0.000000    Distill Loss 0.012163                     LR 0.001000    Time 0.258814    
+2023-11-30 06:52:56,056 - Epoch: [2][ 4700/31148]    Overall Loss 0.012162    Objective Loss 0.000000    Distill Loss 0.012162                     LR 0.001000    Time 0.258775    
+2023-11-30 06:53:21,783 - Epoch: [2][ 4800/31148]    Overall Loss 0.012161    Objective Loss 0.000000    Distill Loss 0.012161                     LR 0.001000    Time 0.258743    
+2023-11-30 06:53:47,537 - Epoch: [2][ 4900/31148]    Overall Loss 0.012159    Objective Loss 0.000000    Distill Loss 0.012159                     LR 0.001000    Time 0.258718    
+2023-11-30 06:54:13,233 - Epoch: [2][ 5000/31148]    Overall Loss 0.012158    Objective Loss 0.000000    Distill Loss 0.012158                     LR 0.001000    Time 0.258682    
+2023-11-30 06:54:38,954 - Epoch: [2][ 5100/31148]    Overall Loss 0.012155    Objective Loss 0.000000    Distill Loss 0.012155                     LR 0.001000    Time 0.258653    
+2023-11-30 06:55:04,686 - Epoch: [2][ 5200/31148]    Overall Loss 0.012157    Objective Loss 0.000000    Distill Loss 0.012157                     LR 0.001000    Time 0.258627    
+2023-11-30 06:55:30,340 - Epoch: [2][ 5300/31148]    Overall Loss 0.012154    Objective Loss 0.000000    Distill Loss 0.012154                     LR 0.001000    Time 0.258587    
+2023-11-30 06:55:56,081 - Epoch: [2][ 5400/31148]    Overall Loss 0.012154    Objective Loss 0.000000    Distill Loss 0.012154                     LR 0.001000    Time 0.258565    
+2023-11-30 06:56:21,796 - Epoch: [2][ 5500/31148]    Overall Loss 0.012153    Objective Loss 0.000000    Distill Loss 0.012153                     LR 0.001000    Time 0.258539    
+2023-11-30 06:56:47,528 - Epoch: [2][ 5600/31148]    Overall Loss 0.012151    Objective Loss 0.000000    Distill Loss 0.012151                     LR 0.001000    Time 0.258516    
+2023-11-30 06:57:13,256 - Epoch: [2][ 5700/31148]    Overall Loss 0.012150    Objective Loss 0.000000    Distill Loss 0.012150                     LR 0.001000    Time 0.258494    
+2023-11-30 06:57:39,029 - Epoch: [2][ 5800/31148]    Overall Loss 0.012147    Objective Loss 0.000000    Distill Loss 0.012147                     LR 0.001000    Time 0.258481    
+2023-11-30 06:58:04,705 - Epoch: [2][ 5900/31148]    Overall Loss 0.012143    Objective Loss 0.000000    Distill Loss 0.012143                     LR 0.001000    Time 0.258451    
+2023-11-30 06:58:30,445 - Epoch: [2][ 6000/31148]    Overall Loss 0.012141    Objective Loss 0.000000    Distill Loss 0.012141                     LR 0.001000    Time 0.258433    
+2023-11-30 06:58:56,178 - Epoch: [2][ 6100/31148]    Overall Loss 0.012140    Objective Loss 0.000000    Distill Loss 0.012140                     LR 0.001000    Time 0.258414    
+2023-11-30 06:59:21,948 - Epoch: [2][ 6200/31148]    Overall Loss 0.012134    Objective Loss 0.000000    Distill Loss 0.012134                     LR 0.001000    Time 0.258403    
+2023-11-30 06:59:47,685 - Epoch: [2][ 6300/31148]    Overall Loss 0.012131    Objective Loss 0.000000    Distill Loss 0.012131                     LR 0.001000    Time 0.258386    
+2023-11-30 07:00:13,448 - Epoch: [2][ 6400/31148]    Overall Loss 0.012130    Objective Loss 0.000000    Distill Loss 0.012130                     LR 0.001000    Time 0.258374    
+2023-11-30 07:00:39,183 - Epoch: [2][ 6500/31148]    Overall Loss 0.012127    Objective Loss 0.000000    Distill Loss 0.012127                     LR 0.001000    Time 0.258357    
+2023-11-30 07:01:04,948 - Epoch: [2][ 6600/31148]    Overall Loss 0.012124    Objective Loss 0.000000    Distill Loss 0.012124                     LR 0.001000    Time 0.258346    
+2023-11-30 07:01:30,636 - Epoch: [2][ 6700/31148]    Overall Loss 0.012122    Objective Loss 0.000000    Distill Loss 0.012122                     LR 0.001000    Time 0.258324    
+2023-11-30 07:01:56,372 - Epoch: [2][ 6800/31148]    Overall Loss 0.012121    Objective Loss 0.000000    Distill Loss 0.012121                     LR 0.001000    Time 0.258309    
+2023-11-30 07:02:22,063 - Epoch: [2][ 6900/31148]    Overall Loss 0.012121    Objective Loss 0.000000    Distill Loss 0.012121                     LR 0.001000    Time 0.258289    
+2023-11-30 07:02:47,810 - Epoch: [2][ 7000/31148]    Overall Loss 0.012118    Objective Loss 0.000000    Distill Loss 0.012118                     LR 0.001000    Time 0.258277    
+2023-11-30 07:03:13,612 - Epoch: [2][ 7100/31148]    Overall Loss 0.012117    Objective Loss 0.000000    Distill Loss 0.012117                     LR 0.001000    Time 0.258273    
+2023-11-30 07:03:39,376 - Epoch: [2][ 7200/31148]    Overall Loss 0.012116    Objective Loss 0.000000    Distill Loss 0.012116                     LR 0.001000    Time 0.258264    
+2023-11-30 07:04:05,116 - Epoch: [2][ 7300/31148]    Overall Loss 0.012115    Objective Loss 0.000000    Distill Loss 0.012115                     LR 0.001000    Time 0.258251    
+2023-11-30 07:04:30,813 - Epoch: [2][ 7400/31148]    Overall Loss 0.012112    Objective Loss 0.000000    Distill Loss 0.012112                     LR 0.001000    Time 0.258234    
+2023-11-30 07:04:56,566 - Epoch: [2][ 7500/31148]    Overall Loss 0.012112    Objective Loss 0.000000    Distill Loss 0.012112                     LR 0.001000    Time 0.258224    
+2023-11-30 07:05:22,286 - Epoch: [2][ 7600/31148]    Overall Loss 0.012110    Objective Loss 0.000000    Distill Loss 0.012110                     LR 0.001000    Time 0.258210    
+2023-11-30 07:05:48,031 - Epoch: [2][ 7700/31148]    Overall Loss 0.012107    Objective Loss 0.000000    Distill Loss 0.012107                     LR 0.001000    Time 0.258200    
+2023-11-30 07:06:13,737 - Epoch: [2][ 7800/31148]    Overall Loss 0.012104    Objective Loss 0.000000    Distill Loss 0.012104                     LR 0.001000    Time 0.258185    
+2023-11-30 07:06:39,468 - Epoch: [2][ 7900/31148]    Overall Loss 0.012103    Objective Loss 0.000000    Distill Loss 0.012103                     LR 0.001000    Time 0.258173    
+2023-11-30 07:07:05,161 - Epoch: [2][ 8000/31148]    Overall Loss 0.012100    Objective Loss 0.000000    Distill Loss 0.012100                     LR 0.001000    Time 0.258158    
+2023-11-30 07:07:30,875 - Epoch: [2][ 8100/31148]    Overall Loss 0.012099    Objective Loss 0.000000    Distill Loss 0.012099                     LR 0.001000    Time 0.258145    
+2023-11-30 07:07:56,605 - Epoch: [2][ 8200/31148]    Overall Loss 0.012097    Objective Loss 0.000000    Distill Loss 0.012097                     LR 0.001000    Time 0.258134    
+2023-11-30 07:08:22,323 - Epoch: [2][ 8300/31148]    Overall Loss 0.012096    Objective Loss 0.000000    Distill Loss 0.012096                     LR 0.001000    Time 0.258122    
+2023-11-30 07:08:48,090 - Epoch: [2][ 8400/31148]    Overall Loss 0.012094    Objective Loss 0.000000    Distill Loss 0.012094                     LR 0.001000    Time 0.258117    
+2023-11-30 07:09:13,812 - Epoch: [2][ 8500/31148]    Overall Loss 0.012092    Objective Loss 0.000000    Distill Loss 0.012092                     LR 0.001000    Time 0.258106    
+2023-11-30 07:09:39,601 - Epoch: [2][ 8600/31148]    Overall Loss 0.012090    Objective Loss 0.000000    Distill Loss 0.012090                     LR 0.001000    Time 0.258103    
+2023-11-30 07:10:05,320 - Epoch: [2][ 8700/31148]    Overall Loss 0.012090    Objective Loss 0.000000    Distill Loss 0.012090                     LR 0.001000    Time 0.258092    
+2023-11-30 07:10:31,065 - Epoch: [2][ 8800/31148]    Overall Loss 0.012089    Objective Loss 0.000000    Distill Loss 0.012089                     LR 0.001000    Time 0.258084    
+2023-11-30 07:10:56,773 - Epoch: [2][ 8900/31148]    Overall Loss 0.012087    Objective Loss 0.000000    Distill Loss 0.012087                     LR 0.001000    Time 0.258073    
+2023-11-30 07:11:22,514 - Epoch: [2][ 9000/31148]    Overall Loss 0.012086    Objective Loss 0.000000    Distill Loss 0.012086                     LR 0.001000    Time 0.258065    
+2023-11-30 07:11:48,227 - Epoch: [2][ 9100/31148]    Overall Loss 0.012084    Objective Loss 0.000000    Distill Loss 0.012084                     LR 0.001000    Time 0.258055    
+2023-11-30 07:12:13,955 - Epoch: [2][ 9200/31148]    Overall Loss 0.012084    Objective Loss 0.000000    Distill Loss 0.012084                     LR 0.001000    Time 0.258046    
+2023-11-30 07:12:39,720 - Epoch: [2][ 9300/31148]    Overall Loss 0.012082    Objective Loss 0.000000    Distill Loss 0.012082                     LR 0.001000    Time 0.258041    
+2023-11-30 07:13:05,476 - Epoch: [2][ 9400/31148]    Overall Loss 0.012081    Objective Loss 0.000000    Distill Loss 0.012081                     LR 0.001000    Time 0.258036    
+2023-11-30 07:13:31,235 - Epoch: [2][ 9500/31148]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                     LR 0.001000    Time 0.258031    
+2023-11-30 07:13:57,016 - Epoch: [2][ 9600/31148]    Overall Loss 0.012079    Objective Loss 0.000000    Distill Loss 0.012079                     LR 0.001000    Time 0.258028    
+2023-11-30 07:14:22,756 - Epoch: [2][ 9700/31148]    Overall Loss 0.012077    Objective Loss 0.000000    Distill Loss 0.012077                     LR 0.001000    Time 0.258022    
+2023-11-30 07:14:48,506 - Epoch: [2][ 9800/31148]    Overall Loss 0.012076    Objective Loss 0.000000    Distill Loss 0.012076                     LR 0.001000    Time 0.258016    
+2023-11-30 07:15:14,256 - Epoch: [2][ 9900/31148]    Overall Loss 0.012073    Objective Loss 0.000000    Distill Loss 0.012073                     LR 0.001000    Time 0.258011    
+2023-11-30 07:15:39,984 - Epoch: [2][10000/31148]    Overall Loss 0.012071    Objective Loss 0.000000    Distill Loss 0.012071                     LR 0.001000    Time 0.258003    
+2023-11-30 07:16:05,791 - Epoch: [2][10100/31148]    Overall Loss 0.012068    Objective Loss 0.000000    Distill Loss 0.012068                     LR 0.001000    Time 0.258003    
+2023-11-30 07:16:31,498 - Epoch: [2][10200/31148]    Overall Loss 0.012067    Objective Loss 0.000000    Distill Loss 0.012067                     LR 0.001000    Time 0.257994    
+2023-11-30 07:16:57,223 - Epoch: [2][10300/31148]    Overall Loss 0.012067    Objective Loss 0.000000    Distill Loss 0.012067                     LR 0.001000    Time 0.257986    
+2023-11-30 07:17:22,945 - Epoch: [2][10400/31148]    Overall Loss 0.012065    Objective Loss 0.000000    Distill Loss 0.012065                     LR 0.001000    Time 0.257979    
+2023-11-30 07:17:48,698 - Epoch: [2][10500/31148]    Overall Loss 0.012063    Objective Loss 0.000000    Distill Loss 0.012063                     LR 0.001000    Time 0.257974    
+2023-11-30 07:18:14,412 - Epoch: [2][10600/31148]    Overall Loss 0.012063    Objective Loss 0.000000    Distill Loss 0.012063                     LR 0.001000    Time 0.257966    
+2023-11-30 07:18:40,188 - Epoch: [2][10700/31148]    Overall Loss 0.012060    Objective Loss 0.000000    Distill Loss 0.012060                     LR 0.001000    Time 0.257964    
+2023-11-30 07:19:05,929 - Epoch: [2][10800/31148]    Overall Loss 0.012058    Objective Loss 0.000000    Distill Loss 0.012058                     LR 0.001000    Time 0.257959    
+2023-11-30 07:19:31,714 - Epoch: [2][10900/31148]    Overall Loss 0.012056    Objective Loss 0.000000    Distill Loss 0.012056                     LR 0.001000    Time 0.257957    
+2023-11-30 07:19:57,464 - Epoch: [2][11000/31148]    Overall Loss 0.012054    Objective Loss 0.000000    Distill Loss 0.012054                     LR 0.001000    Time 0.257953    
+2023-11-30 07:20:23,241 - Epoch: [2][11100/31148]    Overall Loss 0.012053    Objective Loss 0.000000    Distill Loss 0.012053                     LR 0.001000    Time 0.257951    
+2023-11-30 07:20:49,021 - Epoch: [2][11200/31148]    Overall Loss 0.012051    Objective Loss 0.000000    Distill Loss 0.012051                     LR 0.001000    Time 0.257949    
+2023-11-30 07:21:14,800 - Epoch: [2][11300/31148]    Overall Loss 0.012049    Objective Loss 0.000000    Distill Loss 0.012049                     LR 0.001000    Time 0.257948    
+2023-11-30 07:21:40,549 - Epoch: [2][11400/31148]    Overall Loss 0.012048    Objective Loss 0.000000    Distill Loss 0.012048                     LR 0.001000    Time 0.257944    
+2023-11-30 07:22:06,296 - Epoch: [2][11500/31148]    Overall Loss 0.012047    Objective Loss 0.000000    Distill Loss 0.012047                     LR 0.001000    Time 0.257939    
+2023-11-30 07:22:32,040 - Epoch: [2][11600/31148]    Overall Loss 0.012045    Objective Loss 0.000000    Distill Loss 0.012045                     LR 0.001000    Time 0.257935    
+2023-11-30 07:22:57,807 - Epoch: [2][11700/31148]    Overall Loss 0.012043    Objective Loss 0.000000    Distill Loss 0.012043                     LR 0.001000    Time 0.257932    
+2023-11-30 07:23:23,552 - Epoch: [2][11800/31148]    Overall Loss 0.012042    Objective Loss 0.000000    Distill Loss 0.012042                     LR 0.001000    Time 0.257928    
+2023-11-30 07:23:49,328 - Epoch: [2][11900/31148]    Overall Loss 0.012040    Objective Loss 0.000000    Distill Loss 0.012040                     LR 0.001000    Time 0.257926    
+2023-11-30 07:24:15,080 - Epoch: [2][12000/31148]    Overall Loss 0.012039    Objective Loss 0.000000    Distill Loss 0.012039                     LR 0.001000    Time 0.257923    
+2023-11-30 07:24:40,813 - Epoch: [2][12100/31148]    Overall Loss 0.012036    Objective Loss 0.000000    Distill Loss 0.012036                     LR 0.001000    Time 0.257917    
+2023-11-30 07:25:06,561 - Epoch: [2][12200/31148]    Overall Loss 0.012035    Objective Loss 0.000000    Distill Loss 0.012035                     LR 0.001000    Time 0.257914    
+2023-11-30 07:25:32,292 - Epoch: [2][12300/31148]    Overall Loss 0.012034    Objective Loss 0.000000    Distill Loss 0.012034                     LR 0.001000    Time 0.257909    
+2023-11-30 07:25:58,052 - Epoch: [2][12400/31148]    Overall Loss 0.012032    Objective Loss 0.000000    Distill Loss 0.012032                     LR 0.001000    Time 0.257906    
+2023-11-30 07:26:23,772 - Epoch: [2][12500/31148]    Overall Loss 0.012030    Objective Loss 0.000000    Distill Loss 0.012030                     LR 0.001000    Time 0.257900    
+2023-11-30 07:26:49,542 - Epoch: [2][12600/31148]    Overall Loss 0.012029    Objective Loss 0.000000    Distill Loss 0.012029                     LR 0.001000    Time 0.257898    
+2023-11-30 07:27:15,257 - Epoch: [2][12700/31148]    Overall Loss 0.012028    Objective Loss 0.000000    Distill Loss 0.012028                     LR 0.001000    Time 0.257892    
+2023-11-30 07:27:41,001 - Epoch: [2][12800/31148]    Overall Loss 0.012027    Objective Loss 0.000000    Distill Loss 0.012027                     LR 0.001000    Time 0.257888    
+2023-11-30 07:28:06,736 - Epoch: [2][12900/31148]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                     LR 0.001000    Time 0.257884    
+2023-11-30 07:28:32,488 - Epoch: [2][13000/31148]    Overall Loss 0.012026    Objective Loss 0.000000    Distill Loss 0.012026                     LR 0.001000    Time 0.257881    
+2023-11-30 07:28:58,259 - Epoch: [2][13100/31148]    Overall Loss 0.012025    Objective Loss 0.000000    Distill Loss 0.012025                     LR 0.001000    Time 0.257879    
+2023-11-30 07:29:24,017 - Epoch: [2][13200/31148]    Overall Loss 0.012023    Objective Loss 0.000000    Distill Loss 0.012023                     LR 0.001000    Time 0.257877    
+2023-11-30 07:29:49,749 - Epoch: [2][13300/31148]    Overall Loss 0.012022    Objective Loss 0.000000    Distill Loss 0.012022                     LR 0.001000    Time 0.257873    
+2023-11-30 07:30:15,467 - Epoch: [2][13400/31148]    Overall Loss 0.012020    Objective Loss 0.000000    Distill Loss 0.012020                     LR 0.001000    Time 0.257867    
+2023-11-30 07:30:41,195 - Epoch: [2][13500/31148]    Overall Loss 0.012019    Objective Loss 0.000000    Distill Loss 0.012019                     LR 0.001000    Time 0.257863    
+2023-11-30 07:31:06,961 - Epoch: [2][13600/31148]    Overall Loss 0.012018    Objective Loss 0.000000    Distill Loss 0.012018                     LR 0.001000    Time 0.257861    
+2023-11-30 07:31:32,693 - Epoch: [2][13700/31148]    Overall Loss 0.012017    Objective Loss 0.000000    Distill Loss 0.012017                     LR 0.001000    Time 0.257857    
+2023-11-30 07:31:58,432 - Epoch: [2][13800/31148]    Overall Loss 0.012016    Objective Loss 0.000000    Distill Loss 0.012016                     LR 0.001000    Time 0.257853    
+2023-11-30 07:32:24,178 - Epoch: [2][13900/31148]    Overall Loss 0.012014    Objective Loss 0.000000    Distill Loss 0.012014                     LR 0.001000    Time 0.257850    
+2023-11-30 07:32:49,918 - Epoch: [2][14000/31148]    Overall Loss 0.012013    Objective Loss 0.000000    Distill Loss 0.012013                     LR 0.001000    Time 0.257847    
+2023-11-30 07:33:15,669 - Epoch: [2][14100/31148]    Overall Loss 0.012011    Objective Loss 0.000000    Distill Loss 0.012011                     LR 0.001000    Time 0.257844    
+2023-11-30 07:33:41,354 - Epoch: [2][14200/31148]    Overall Loss 0.012010    Objective Loss 0.000000    Distill Loss 0.012010                     LR 0.001000    Time 0.257837    
+2023-11-30 07:34:07,096 - Epoch: [2][14300/31148]    Overall Loss 0.012009    Objective Loss 0.000000    Distill Loss 0.012009                     LR 0.001000    Time 0.257834    
+2023-11-30 07:34:32,824 - Epoch: [2][14400/31148]    Overall Loss 0.012007    Objective Loss 0.000000    Distill Loss 0.012007                     LR 0.001000    Time 0.257830    
+2023-11-30 07:34:58,609 - Epoch: [2][14500/31148]    Overall Loss 0.012006    Objective Loss 0.000000    Distill Loss 0.012006                     LR 0.001000    Time 0.257830    
+2023-11-30 07:35:24,369 - Epoch: [2][14600/31148]    Overall Loss 0.012005    Objective Loss 0.000000    Distill Loss 0.012005                     LR 0.001000    Time 0.257828    
+2023-11-30 07:35:50,123 - Epoch: [2][14700/31148]    Overall Loss 0.012002    Objective Loss 0.000000    Distill Loss 0.012002                     LR 0.001000    Time 0.257826    
+2023-11-30 07:36:15,836 - Epoch: [2][14800/31148]    Overall Loss 0.012000    Objective Loss 0.000000    Distill Loss 0.012000                     LR 0.001000    Time 0.257821    
+2023-11-30 07:36:41,582 - Epoch: [2][14900/31148]    Overall Loss 0.011998    Objective Loss 0.000000    Distill Loss 0.011998                     LR 0.001000    Time 0.257819    
+2023-11-30 07:37:07,317 - Epoch: [2][15000/31148]    Overall Loss 0.011997    Objective Loss 0.000000    Distill Loss 0.011997                     LR 0.001000    Time 0.257815    
+2023-11-30 07:37:33,103 - Epoch: [2][15100/31148]    Overall Loss 0.011997    Objective Loss 0.000000    Distill Loss 0.011997                     LR 0.001000    Time 0.257815    
+2023-11-30 07:37:58,871 - Epoch: [2][15200/31148]    Overall Loss 0.011995    Objective Loss 0.000000    Distill Loss 0.011995                     LR 0.001000    Time 0.257814    
+2023-11-30 07:38:24,556 - Epoch: [2][15300/31148]    Overall Loss 0.011995    Objective Loss 0.000000    Distill Loss 0.011995                     LR 0.001000    Time 0.257808    
+2023-11-30 07:38:50,287 - Epoch: [2][15400/31148]    Overall Loss 0.011993    Objective Loss 0.000000    Distill Loss 0.011993                     LR 0.001000    Time 0.257805    
+2023-11-30 07:39:15,995 - Epoch: [2][15500/31148]    Overall Loss 0.011992    Objective Loss 0.000000    Distill Loss 0.011992                     LR 0.001000    Time 0.257800    
+2023-11-30 07:39:41,760 - Epoch: [2][15600/31148]    Overall Loss 0.011990    Objective Loss 0.000000    Distill Loss 0.011990                     LR 0.001000    Time 0.257799    
+2023-11-30 07:40:07,481 - Epoch: [2][15700/31148]    Overall Loss 0.011989    Objective Loss 0.000000    Distill Loss 0.011989                     LR 0.001000    Time 0.257795    
+2023-11-30 07:40:33,271 - Epoch: [2][15800/31148]    Overall Loss 0.011988    Objective Loss 0.000000    Distill Loss 0.011988                     LR 0.001000    Time 0.257795    
+2023-11-30 07:40:58,970 - Epoch: [2][15900/31148]    Overall Loss 0.011987    Objective Loss 0.000000    Distill Loss 0.011987                     LR 0.001000    Time 0.257790    
+2023-11-30 07:41:24,697 - Epoch: [2][16000/31148]    Overall Loss 0.011986    Objective Loss 0.000000    Distill Loss 0.011986                     LR 0.001000    Time 0.257786    
+2023-11-30 07:41:50,440 - Epoch: [2][16100/31148]    Overall Loss 0.011985    Objective Loss 0.000000    Distill Loss 0.011985                     LR 0.001000    Time 0.257784    
+2023-11-30 07:42:16,241 - Epoch: [2][16200/31148]    Overall Loss 0.011983    Objective Loss 0.000000    Distill Loss 0.011983                     LR 0.001000    Time 0.257785    
+2023-11-30 07:42:42,029 - Epoch: [2][16300/31148]    Overall Loss 0.011982    Objective Loss 0.000000    Distill Loss 0.011982                     LR 0.001000    Time 0.257786    
+2023-11-30 07:43:07,774 - Epoch: [2][16400/31148]    Overall Loss 0.011981    Objective Loss 0.000000    Distill Loss 0.011981                     LR 0.001000    Time 0.257783    
+2023-11-30 07:43:33,543 - Epoch: [2][16500/31148]    Overall Loss 0.011980    Objective Loss 0.000000    Distill Loss 0.011980                     LR 0.001000    Time 0.257783    
+2023-11-30 07:43:59,341 - Epoch: [2][16600/31148]    Overall Loss 0.011979    Objective Loss 0.000000    Distill Loss 0.011979                     LR 0.001000    Time 0.257784    
+2023-11-30 07:44:25,113 - Epoch: [2][16700/31148]    Overall Loss 0.011977    Objective Loss 0.000000    Distill Loss 0.011977                     LR 0.001000    Time 0.257783    
+2023-11-30 07:44:50,853 - Epoch: [2][16800/31148]    Overall Loss 0.011976    Objective Loss 0.000000    Distill Loss 0.011976                     LR 0.001000    Time 0.257781    
+2023-11-30 07:45:16,598 - Epoch: [2][16900/31148]    Overall Loss 0.011974    Objective Loss 0.000000    Distill Loss 0.011974                     LR 0.001000    Time 0.257779    
+2023-11-30 07:45:42,306 - Epoch: [2][17000/31148]    Overall Loss 0.011972    Objective Loss 0.000000    Distill Loss 0.011972                     LR 0.001000    Time 0.257774    
+2023-11-30 07:46:08,041 - Epoch: [2][17100/31148]    Overall Loss 0.011972    Objective Loss 0.000000    Distill Loss 0.011972                     LR 0.001000    Time 0.257772    
+2023-11-30 07:46:33,771 - Epoch: [2][17200/31148]    Overall Loss 0.011971    Objective Loss 0.000000    Distill Loss 0.011971                     LR 0.001000    Time 0.257769    
+2023-11-30 07:46:59,522 - Epoch: [2][17300/31148]    Overall Loss 0.011969    Objective Loss 0.000000    Distill Loss 0.011969                     LR 0.001000    Time 0.257767    
+2023-11-30 07:47:25,252 - Epoch: [2][17400/31148]    Overall Loss 0.011968    Objective Loss 0.000000    Distill Loss 0.011968                     LR 0.001000    Time 0.257764    
+2023-11-30 07:47:51,021 - Epoch: [2][17500/31148]    Overall Loss 0.011966    Objective Loss 0.000000    Distill Loss 0.011966                     LR 0.001000    Time 0.257764    
+2023-11-30 07:48:16,767 - Epoch: [2][17600/31148]    Overall Loss 0.011965    Objective Loss 0.000000    Distill Loss 0.011965                     LR 0.001000    Time 0.257762    
+2023-11-30 07:48:42,541 - Epoch: [2][17700/31148]    Overall Loss 0.011962    Objective Loss 0.000000    Distill Loss 0.011962                     LR 0.001000    Time 0.257762    
+2023-11-30 07:49:08,281 - Epoch: [2][17800/31148]    Overall Loss 0.011961    Objective Loss 0.000000    Distill Loss 0.011961                     LR 0.001000    Time 0.257759    
+2023-11-30 07:49:34,041 - Epoch: [2][17900/31148]    Overall Loss 0.011960    Objective Loss 0.000000    Distill Loss 0.011960                     LR 0.001000    Time 0.257758    
+2023-11-30 07:49:59,831 - Epoch: [2][18000/31148]    Overall Loss 0.011958    Objective Loss 0.000000    Distill Loss 0.011958                     LR 0.001000    Time 0.257759    
+2023-11-30 07:50:25,561 - Epoch: [2][18100/31148]    Overall Loss 0.011956    Objective Loss 0.000000    Distill Loss 0.011956                     LR 0.001000    Time 0.257756    
+2023-11-30 07:50:51,263 - Epoch: [2][18200/31148]    Overall Loss 0.011956    Objective Loss 0.000000    Distill Loss 0.011956                     LR 0.001000    Time 0.257752    
+2023-11-30 07:51:17,003 - Epoch: [2][18300/31148]    Overall Loss 0.011955    Objective Loss 0.000000    Distill Loss 0.011955                     LR 0.001000    Time 0.257750    
+2023-11-30 07:51:42,744 - Epoch: [2][18400/31148]    Overall Loss 0.011954    Objective Loss 0.000000    Distill Loss 0.011954                     LR 0.001000    Time 0.257748    
+2023-11-30 07:52:08,467 - Epoch: [2][18500/31148]    Overall Loss 0.011952    Objective Loss 0.000000    Distill Loss 0.011952                     LR 0.001000    Time 0.257745    
+2023-11-30 07:52:34,231 - Epoch: [2][18600/31148]    Overall Loss 0.011950    Objective Loss 0.000000    Distill Loss 0.011950                     LR 0.001000    Time 0.257744    
+2023-11-30 07:52:59,936 - Epoch: [2][18700/31148]    Overall Loss 0.011949    Objective Loss 0.000000    Distill Loss 0.011949                     LR 0.001000    Time 0.257741    
+2023-11-30 07:53:25,665 - Epoch: [2][18800/31148]    Overall Loss 0.011948    Objective Loss 0.000000    Distill Loss 0.011948                     LR 0.001000    Time 0.257738    
+2023-11-30 07:53:51,441 - Epoch: [2][18900/31148]    Overall Loss 0.011947    Objective Loss 0.000000    Distill Loss 0.011947                     LR 0.001000    Time 0.257738    
+2023-11-30 07:54:17,142 - Epoch: [2][19000/31148]    Overall Loss 0.011945    Objective Loss 0.000000    Distill Loss 0.011945                     LR 0.001000    Time 0.257734    
+2023-11-30 07:54:42,870 - Epoch: [2][19100/31148]    Overall Loss 0.011943    Objective Loss 0.000000    Distill Loss 0.011943                     LR 0.001000    Time 0.257732    
+2023-11-30 07:55:08,596 - Epoch: [2][19200/31148]    Overall Loss 0.011942    Objective Loss 0.000000    Distill Loss 0.011942                     LR 0.001000    Time 0.257729    
+2023-11-30 07:55:34,334 - Epoch: [2][19300/31148]    Overall Loss 0.011941    Objective Loss 0.000000    Distill Loss 0.011941                     LR 0.001000    Time 0.257727    
+2023-11-30 07:56:00,104 - Epoch: [2][19400/31148]    Overall Loss 0.011940    Objective Loss 0.000000    Distill Loss 0.011940                     LR 0.001000    Time 0.257727    
+2023-11-30 07:56:25,880 - Epoch: [2][19500/31148]    Overall Loss 0.011939    Objective Loss 0.000000    Distill Loss 0.011939                     LR 0.001000    Time 0.257727    
+2023-11-30 07:56:51,593 - Epoch: [2][19600/31148]    Overall Loss 0.011939    Objective Loss 0.000000    Distill Loss 0.011939                     LR 0.001000    Time 0.257724    
+2023-11-30 07:57:17,406 - Epoch: [2][19700/31148]    Overall Loss 0.011938    Objective Loss 0.000000    Distill Loss 0.011938                     LR 0.001000    Time 0.257726    
+2023-11-30 07:57:43,118 - Epoch: [2][19800/31148]    Overall Loss 0.011936    Objective Loss 0.000000    Distill Loss 0.011936                     LR 0.001000    Time 0.257722    
+2023-11-30 07:58:08,839 - Epoch: [2][19900/31148]    Overall Loss 0.011935    Objective Loss 0.000000    Distill Loss 0.011935                     LR 0.001000    Time 0.257720    
+2023-11-30 07:58:34,598 - Epoch: [2][20000/31148]    Overall Loss 0.011934    Objective Loss 0.000000    Distill Loss 0.011934                     LR 0.001000    Time 0.257719    
+2023-11-30 07:59:00,310 - Epoch: [2][20100/31148]    Overall Loss 0.011933    Objective Loss 0.000000    Distill Loss 0.011933                     LR 0.001000    Time 0.257716    
+2023-11-30 07:59:26,064 - Epoch: [2][20200/31148]    Overall Loss 0.011932    Objective Loss 0.000000    Distill Loss 0.011932                     LR 0.001000    Time 0.257715    
+2023-11-30 07:59:51,764 - Epoch: [2][20300/31148]    Overall Loss 0.011931    Objective Loss 0.000000    Distill Loss 0.011931                     LR 0.001000    Time 0.257711    
+2023-11-30 08:00:17,535 - Epoch: [2][20400/31148]    Overall Loss 0.011930    Objective Loss 0.000000    Distill Loss 0.011930                     LR 0.001000    Time 0.257711    
+2023-11-30 08:00:43,282 - Epoch: [2][20500/31148]    Overall Loss 0.011928    Objective Loss 0.000000    Distill Loss 0.011928                     LR 0.001000    Time 0.257710    
+2023-11-30 08:01:09,006 - Epoch: [2][20600/31148]    Overall Loss 0.011926    Objective Loss 0.000000    Distill Loss 0.011926                     LR 0.001000    Time 0.257707    
+2023-11-30 08:01:34,753 - Epoch: [2][20700/31148]    Overall Loss 0.011924    Objective Loss 0.000000    Distill Loss 0.011924                     LR 0.001000    Time 0.257706    
+2023-11-30 08:02:00,522 - Epoch: [2][20800/31148]    Overall Loss 0.011923    Objective Loss 0.000000    Distill Loss 0.011923                     LR 0.001000    Time 0.257706    
+2023-11-30 08:02:26,248 - Epoch: [2][20900/31148]    Overall Loss 0.011922    Objective Loss 0.000000    Distill Loss 0.011922                     LR 0.001000    Time 0.257704    
+2023-11-30 08:02:51,976 - Epoch: [2][21000/31148]    Overall Loss 0.011921    Objective Loss 0.000000    Distill Loss 0.011921                     LR 0.001000    Time 0.257701    
+2023-11-30 08:03:17,765 - Epoch: [2][21100/31148]    Overall Loss 0.011920    Objective Loss 0.000000    Distill Loss 0.011920                     LR 0.001000    Time 0.257702    
+2023-11-30 08:03:43,518 - Epoch: [2][21200/31148]    Overall Loss 0.011919    Objective Loss 0.000000    Distill Loss 0.011919                     LR 0.001000    Time 0.257701    
+2023-11-30 08:04:09,293 - Epoch: [2][21300/31148]    Overall Loss 0.011918    Objective Loss 0.000000    Distill Loss 0.011918                     LR 0.001000    Time 0.257701    
+2023-11-30 08:04:34,992 - Epoch: [2][21400/31148]    Overall Loss 0.011917    Objective Loss 0.000000    Distill Loss 0.011917                     LR 0.001000    Time 0.257698    
+2023-11-30 08:05:00,725 - Epoch: [2][21500/31148]    Overall Loss 0.011916    Objective Loss 0.000000    Distill Loss 0.011916                     LR 0.001000    Time 0.257696    
+2023-11-30 08:05:26,543 - Epoch: [2][21600/31148]    Overall Loss 0.011914    Objective Loss 0.000000    Distill Loss 0.011914                     LR 0.001000    Time 0.257698    
+2023-11-30 08:05:52,271 - Epoch: [2][21700/31148]    Overall Loss 0.011913    Objective Loss 0.000000    Distill Loss 0.011913                     LR 0.001000    Time 0.257696    
+2023-11-30 08:06:18,004 - Epoch: [2][21800/31148]    Overall Loss 0.011912    Objective Loss 0.000000    Distill Loss 0.011912                     LR 0.001000    Time 0.257694    
+2023-11-30 08:06:43,738 - Epoch: [2][21900/31148]    Overall Loss 0.011911    Objective Loss 0.000000    Distill Loss 0.011911                     LR 0.001000    Time 0.257693    
+2023-11-30 08:07:09,462 - Epoch: [2][22000/31148]    Overall Loss 0.011909    Objective Loss 0.000000    Distill Loss 0.011909                     LR 0.001000    Time 0.257690    
+2023-11-30 08:07:35,207 - Epoch: [2][22100/31148]    Overall Loss 0.011908    Objective Loss 0.000000    Distill Loss 0.011908                     LR 0.001000    Time 0.257689    
+2023-11-30 08:08:00,936 - Epoch: [2][22200/31148]    Overall Loss 0.011907    Objective Loss 0.000000    Distill Loss 0.011907                     LR 0.001000    Time 0.257687    
+2023-11-30 08:08:26,670 - Epoch: [2][22300/31148]    Overall Loss 0.011906    Objective Loss 0.000000    Distill Loss 0.011906                     LR 0.001000    Time 0.257686    
+2023-11-30 08:08:52,431 - Epoch: [2][22400/31148]    Overall Loss 0.011904    Objective Loss 0.000000    Distill Loss 0.011904                     LR 0.001000    Time 0.257685    
+2023-11-30 08:09:18,180 - Epoch: [2][22500/31148]    Overall Loss 0.011903    Objective Loss 0.000000    Distill Loss 0.011903                     LR 0.001000    Time 0.257684    
+2023-11-30 08:09:43,915 - Epoch: [2][22600/31148]    Overall Loss 0.011901    Objective Loss 0.000000    Distill Loss 0.011901                     LR 0.001000    Time 0.257683    
+2023-11-30 08:10:09,688 - Epoch: [2][22700/31148]    Overall Loss 0.011900    Objective Loss 0.000000    Distill Loss 0.011900                     LR 0.001000    Time 0.257683    
+2023-11-30 08:10:35,438 - Epoch: [2][22800/31148]    Overall Loss 0.011899    Objective Loss 0.000000    Distill Loss 0.011899                     LR 0.001000    Time 0.257682    
+2023-11-30 08:11:01,173 - Epoch: [2][22900/31148]    Overall Loss 0.011897    Objective Loss 0.000000    Distill Loss 0.011897                     LR 0.001000    Time 0.257680    
+2023-11-30 08:11:26,889 - Epoch: [2][23000/31148]    Overall Loss 0.011896    Objective Loss 0.000000    Distill Loss 0.011896                     LR 0.001000    Time 0.257678    
+2023-11-30 08:11:52,651 - Epoch: [2][23100/31148]    Overall Loss 0.011895    Objective Loss 0.000000    Distill Loss 0.011895                     LR 0.001000    Time 0.257677    
+2023-11-30 08:12:18,396 - Epoch: [2][23200/31148]    Overall Loss 0.011894    Objective Loss 0.000000    Distill Loss 0.011894                     LR 0.001000    Time 0.257676    
+2023-11-30 08:12:44,114 - Epoch: [2][23300/31148]    Overall Loss 0.011893    Objective Loss 0.000000    Distill Loss 0.011893                     LR 0.001000    Time 0.257674    
+2023-11-30 08:13:09,866 - Epoch: [2][23400/31148]    Overall Loss 0.011892    Objective Loss 0.000000    Distill Loss 0.011892                     LR 0.001000    Time 0.257673    
+2023-11-30 08:13:35,575 - Epoch: [2][23500/31148]    Overall Loss 0.011891    Objective Loss 0.000000    Distill Loss 0.011891                     LR 0.001000    Time 0.257671    
+2023-11-30 08:14:01,266 - Epoch: [2][23600/31148]    Overall Loss 0.011890    Objective Loss 0.000000    Distill Loss 0.011890                     LR 0.001000    Time 0.257667    
+2023-11-30 08:14:27,042 - Epoch: [2][23700/31148]    Overall Loss 0.011889    Objective Loss 0.000000    Distill Loss 0.011889                     LR 0.001000    Time 0.257668    
+2023-11-30 08:14:52,773 - Epoch: [2][23800/31148]    Overall Loss 0.011888    Objective Loss 0.000000    Distill Loss 0.011888                     LR 0.001000    Time 0.257666    
+2023-11-30 08:15:18,505 - Epoch: [2][23900/31148]    Overall Loss 0.011886    Objective Loss 0.000000    Distill Loss 0.011886                     LR 0.001000    Time 0.257664    
+2023-11-30 08:15:44,322 - Epoch: [2][24000/31148]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                     LR 0.001000    Time 0.257666    
+2023-11-30 08:16:10,086 - Epoch: [2][24100/31148]    Overall Loss 0.011885    Objective Loss 0.000000    Distill Loss 0.011885                     LR 0.001000    Time 0.257666    
+2023-11-30 08:16:35,794 - Epoch: [2][24200/31148]    Overall Loss 0.011884    Objective Loss 0.000000    Distill Loss 0.011884                     LR 0.001000    Time 0.257664    
+2023-11-30 08:17:01,493 - Epoch: [2][24300/31148]    Overall Loss 0.011882    Objective Loss 0.000000    Distill Loss 0.011882                     LR 0.001000    Time 0.257661    
+2023-11-30 08:17:27,214 - Epoch: [2][24400/31148]    Overall Loss 0.011881    Objective Loss 0.000000    Distill Loss 0.011881                     LR 0.001000    Time 0.257659    
+2023-11-30 08:17:52,945 - Epoch: [2][24500/31148]    Overall Loss 0.011880    Objective Loss 0.000000    Distill Loss 0.011880                     LR 0.001000    Time 0.257657    
+2023-11-30 08:18:18,636 - Epoch: [2][24600/31148]    Overall Loss 0.011879    Objective Loss 0.000000    Distill Loss 0.011879                     LR 0.001000    Time 0.257654    
+2023-11-30 08:18:44,348 - Epoch: [2][24700/31148]    Overall Loss 0.011878    Objective Loss 0.000000    Distill Loss 0.011878                     LR 0.001000    Time 0.257652    
+2023-11-30 08:19:10,081 - Epoch: [2][24800/31148]    Overall Loss 0.011877    Objective Loss 0.000000    Distill Loss 0.011877                     LR 0.001000    Time 0.257651    
+2023-11-30 08:19:35,841 - Epoch: [2][24900/31148]    Overall Loss 0.011875    Objective Loss 0.000000    Distill Loss 0.011875                     LR 0.001000    Time 0.257650    
+2023-11-30 08:20:01,615 - Epoch: [2][25000/31148]    Overall Loss 0.011873    Objective Loss 0.000000    Distill Loss 0.011873                     LR 0.001000    Time 0.257650    
+2023-11-30 08:20:27,322 - Epoch: [2][25100/31148]    Overall Loss 0.011872    Objective Loss 0.000000    Distill Loss 0.011872                     LR 0.001000    Time 0.257648    
+2023-11-30 08:20:53,044 - Epoch: [2][25200/31148]    Overall Loss 0.011870    Objective Loss 0.000000    Distill Loss 0.011870                     LR 0.001000    Time 0.257646    
+2023-11-30 08:21:18,760 - Epoch: [2][25300/31148]    Overall Loss 0.011869    Objective Loss 0.000000    Distill Loss 0.011869                     LR 0.001000    Time 0.257644    
+2023-11-30 08:21:44,441 - Epoch: [2][25400/31148]    Overall Loss 0.011868    Objective Loss 0.000000    Distill Loss 0.011868                     LR 0.001000    Time 0.257641    
+2023-11-30 08:22:10,200 - Epoch: [2][25500/31148]    Overall Loss 0.011867    Objective Loss 0.000000    Distill Loss 0.011867                     LR 0.001000    Time 0.257641    
+2023-11-30 08:22:35,914 - Epoch: [2][25600/31148]    Overall Loss 0.011866    Objective Loss 0.000000    Distill Loss 0.011866                     LR 0.001000    Time 0.257638    
+2023-11-30 08:23:01,628 - Epoch: [2][25700/31148]    Overall Loss 0.011864    Objective Loss 0.000000    Distill Loss 0.011864                     LR 0.001000    Time 0.257636    
+2023-11-30 08:23:27,327 - Epoch: [2][25800/31148]    Overall Loss 0.011864    Objective Loss 0.000000    Distill Loss 0.011864                     LR 0.001000    Time 0.257634    
+2023-11-30 08:23:53,134 - Epoch: [2][25900/31148]    Overall Loss 0.011863    Objective Loss 0.000000    Distill Loss 0.011863                     LR 0.001000    Time 0.257635    
+2023-11-30 08:24:18,826 - Epoch: [2][26000/31148]    Overall Loss 0.011861    Objective Loss 0.000000    Distill Loss 0.011861                     LR 0.001000    Time 0.257633    
+2023-11-30 08:24:44,573 - Epoch: [2][26100/31148]    Overall Loss 0.011860    Objective Loss 0.000000    Distill Loss 0.011860                     LR 0.001000    Time 0.257632    
+2023-11-30 08:25:10,286 - Epoch: [2][26200/31148]    Overall Loss 0.011859    Objective Loss 0.000000    Distill Loss 0.011859                     LR 0.001000    Time 0.257630    
+2023-11-30 08:25:36,041 - Epoch: [2][26300/31148]    Overall Loss 0.011857    Objective Loss 0.000000    Distill Loss 0.011857                     LR 0.001000    Time 0.257629    
+2023-11-30 08:26:01,773 - Epoch: [2][26400/31148]    Overall Loss 0.011856    Objective Loss 0.000000    Distill Loss 0.011856                     LR 0.001000    Time 0.257628    
+2023-11-30 08:26:27,508 - Epoch: [2][26500/31148]    Overall Loss 0.011855    Objective Loss 0.000000    Distill Loss 0.011855                     LR 0.001000    Time 0.257627    
+2023-11-30 08:26:53,256 - Epoch: [2][26600/31148]    Overall Loss 0.011854    Objective Loss 0.000000    Distill Loss 0.011854                     LR 0.001000    Time 0.257626    
+2023-11-30 08:27:19,007 - Epoch: [2][26700/31148]    Overall Loss 0.011853    Objective Loss 0.000000    Distill Loss 0.011853                     LR 0.001000    Time 0.257626    
+2023-11-30 08:27:44,774 - Epoch: [2][26800/31148]    Overall Loss 0.011852    Objective Loss 0.000000    Distill Loss 0.011852                     LR 0.001000    Time 0.257626    
+2023-11-30 08:28:10,503 - Epoch: [2][26900/31148]    Overall Loss 0.011851    Objective Loss 0.000000    Distill Loss 0.011851                     LR 0.001000    Time 0.257625    
+2023-11-30 08:28:36,221 - Epoch: [2][27000/31148]    Overall Loss 0.011850    Objective Loss 0.000000    Distill Loss 0.011850                     LR 0.001000    Time 0.257623    
+2023-11-30 08:29:01,989 - Epoch: [2][27100/31148]    Overall Loss 0.011848    Objective Loss 0.000000    Distill Loss 0.011848                     LR 0.001000    Time 0.257623    
+2023-11-30 08:29:27,751 - Epoch: [2][27200/31148]    Overall Loss 0.011847    Objective Loss 0.000000    Distill Loss 0.011847                     LR 0.001000    Time 0.257623    
+2023-11-30 08:29:53,449 - Epoch: [2][27300/31148]    Overall Loss 0.011846    Objective Loss 0.000000    Distill Loss 0.011846                     LR 0.001000    Time 0.257620    
+2023-11-30 08:30:19,207 - Epoch: [2][27400/31148]    Overall Loss 0.011845    Objective Loss 0.000000    Distill Loss 0.011845                     LR 0.001000    Time 0.257620    
+2023-11-30 08:30:45,008 - Epoch: [2][27500/31148]    Overall Loss 0.011844    Objective Loss 0.000000    Distill Loss 0.011844                     LR 0.001000    Time 0.257621    
+2023-11-30 08:31:10,739 - Epoch: [2][27600/31148]    Overall Loss 0.011843    Objective Loss 0.000000    Distill Loss 0.011843                     LR 0.001000    Time 0.257620    
+2023-11-30 08:31:36,437 - Epoch: [2][27700/31148]    Overall Loss 0.011842    Objective Loss 0.000000    Distill Loss 0.011842                     LR 0.001000    Time 0.257618    
+2023-11-30 08:32:02,124 - Epoch: [2][27800/31148]    Overall Loss 0.011840    Objective Loss 0.000000    Distill Loss 0.011840                     LR 0.001000    Time 0.257615    
+2023-11-30 08:32:27,834 - Epoch: [2][27900/31148]    Overall Loss 0.011839    Objective Loss 0.000000    Distill Loss 0.011839                     LR 0.001000    Time 0.257613    
+2023-11-30 08:32:53,539 - Epoch: [2][28000/31148]    Overall Loss 0.011838    Objective Loss 0.000000    Distill Loss 0.011838                     LR 0.001000    Time 0.257611    
+2023-11-30 08:33:19,242 - Epoch: [2][28100/31148]    Overall Loss 0.011836    Objective Loss 0.000000    Distill Loss 0.011836                     LR 0.001000    Time 0.257609    
+2023-11-30 08:33:44,953 - Epoch: [2][28200/31148]    Overall Loss 0.011835    Objective Loss 0.000000    Distill Loss 0.011835                     LR 0.001000    Time 0.257607    
+2023-11-30 08:34:10,651 - Epoch: [2][28300/31148]    Overall Loss 0.011834    Objective Loss 0.000000    Distill Loss 0.011834                     LR 0.001000    Time 0.257605    
+2023-11-30 08:34:36,387 - Epoch: [2][28400/31148]    Overall Loss 0.011833    Objective Loss 0.000000    Distill Loss 0.011833                     LR 0.001000    Time 0.257604    
+2023-11-30 08:35:02,128 - Epoch: [2][28500/31148]    Overall Loss 0.011832    Objective Loss 0.000000    Distill Loss 0.011832                     LR 0.001000    Time 0.257603    
+2023-11-30 08:35:27,837 - Epoch: [2][28600/31148]    Overall Loss 0.011831    Objective Loss 0.000000    Distill Loss 0.011831                     LR 0.001000    Time 0.257601    
+2023-11-30 08:35:53,568 - Epoch: [2][28700/31148]    Overall Loss 0.011831    Objective Loss 0.000000    Distill Loss 0.011831                     LR 0.001000    Time 0.257600    
+2023-11-30 08:36:19,319 - Epoch: [2][28800/31148]    Overall Loss 0.011829    Objective Loss 0.000000    Distill Loss 0.011829                     LR 0.001000    Time 0.257600    
+2023-11-30 08:36:45,089 - Epoch: [2][28900/31148]    Overall Loss 0.011828    Objective Loss 0.000000    Distill Loss 0.011828                     LR 0.001000    Time 0.257600    
+2023-11-30 08:37:10,802 - Epoch: [2][29000/31148]    Overall Loss 0.011827    Objective Loss 0.000000    Distill Loss 0.011827                     LR 0.001000    Time 0.257598    
+2023-11-30 08:37:36,535 - Epoch: [2][29100/31148]    Overall Loss 0.011825    Objective Loss 0.000000    Distill Loss 0.011825                     LR 0.001000    Time 0.257597    
+2023-11-30 08:38:02,281 - Epoch: [2][29200/31148]    Overall Loss 0.011824    Objective Loss 0.000000    Distill Loss 0.011824                     LR 0.001000    Time 0.257597    
+2023-11-30 08:38:28,036 - Epoch: [2][29300/31148]    Overall Loss 0.011823    Objective Loss 0.000000    Distill Loss 0.011823                     LR 0.001000    Time 0.257596    
+2023-11-30 08:38:53,741 - Epoch: [2][29400/31148]    Overall Loss 0.011822    Objective Loss 0.000000    Distill Loss 0.011822                     LR 0.001000    Time 0.257594    
+2023-11-30 08:39:19,477 - Epoch: [2][29500/31148]    Overall Loss 0.011821    Objective Loss 0.000000    Distill Loss 0.011821                     LR 0.001000    Time 0.257593    
+2023-11-30 08:39:45,230 - Epoch: [2][29600/31148]    Overall Loss 0.011820    Objective Loss 0.000000    Distill Loss 0.011820                     LR 0.001000    Time 0.257593    
+2023-11-30 08:40:10,925 - Epoch: [2][29700/31148]    Overall Loss 0.011819    Objective Loss 0.000000    Distill Loss 0.011819                     LR 0.001000    Time 0.257591    
+2023-11-30 08:40:36,663 - Epoch: [2][29800/31148]    Overall Loss 0.011818    Objective Loss 0.000000    Distill Loss 0.011818                     LR 0.001000    Time 0.257590    
+2023-11-30 08:41:02,395 - Epoch: [2][29900/31148]    Overall Loss 0.011817    Objective Loss 0.000000    Distill Loss 0.011817                     LR 0.001000    Time 0.257589    
+2023-11-30 08:41:28,125 - Epoch: [2][30000/31148]    Overall Loss 0.011816    Objective Loss 0.000000    Distill Loss 0.011816                     LR 0.001000    Time 0.257588    
+2023-11-30 08:41:53,859 - Epoch: [2][30100/31148]    Overall Loss 0.011815    Objective Loss 0.000000    Distill Loss 0.011815                     LR 0.001000    Time 0.257587    
+2023-11-30 08:42:19,565 - Epoch: [2][30200/31148]    Overall Loss 0.011814    Objective Loss 0.000000    Distill Loss 0.011814                     LR 0.001000    Time 0.257585    
+2023-11-30 08:42:45,312 - Epoch: [2][30300/31148]    Overall Loss 0.011813    Objective Loss 0.000000    Distill Loss 0.011813                     LR 0.001000    Time 0.257585    
+2023-11-30 08:43:11,093 - Epoch: [2][30400/31148]    Overall Loss 0.011812    Objective Loss 0.000000    Distill Loss 0.011812                     LR 0.001000    Time 0.257585    
+2023-11-30 08:43:36,831 - Epoch: [2][30500/31148]    Overall Loss 0.011811    Objective Loss 0.000000    Distill Loss 0.011811                     LR 0.001000    Time 0.257585    
+2023-11-30 08:44:02,582 - Epoch: [2][30600/31148]    Overall Loss 0.011810    Objective Loss 0.000000    Distill Loss 0.011810                     LR 0.001000    Time 0.257584    
+2023-11-30 08:44:28,338 - Epoch: [2][30700/31148]    Overall Loss 0.011809    Objective Loss 0.000000    Distill Loss 0.011809                     LR 0.001000    Time 0.257584    
+2023-11-30 08:44:54,085 - Epoch: [2][30800/31148]    Overall Loss 0.011808    Objective Loss 0.000000    Distill Loss 0.011808                     LR 0.001000    Time 0.257584    
+2023-11-30 08:45:19,773 - Epoch: [2][30900/31148]    Overall Loss 0.011807    Objective Loss 0.000000    Distill Loss 0.011807                     LR 0.001000    Time 0.257581    
+2023-11-30 08:45:45,483 - Epoch: [2][31000/31148]    Overall Loss 0.011806    Objective Loss 0.000000    Distill Loss 0.011806                     LR 0.001000    Time 0.257580    
+2023-11-30 08:46:11,239 - Epoch: [2][31100/31148]    Overall Loss 0.011804    Objective Loss 0.000000    Distill Loss 0.011804                     LR 0.001000    Time 0.257580    
+2023-11-30 08:46:24,011 - Epoch: [2][31148/31148]    Overall Loss 0.011804    Objective Loss 0.000000    Distill Loss 0.011804                     LR 0.001000    Time 0.257593    
+2023-11-30 08:46:24,361 - --- validate (epoch=2)-----------
+2023-11-30 08:46:24,361 - 167951 samples (100 per mini-batch)
+2023-11-30 08:46:45,194 - Epoch: [2][  100/ 1680]    Loss 0.000000    Overall Loss 0.012216    
+2023-11-30 08:47:04,929 - Epoch: [2][  200/ 1680]    Loss 0.000000    Overall Loss 0.012226    
+2023-11-30 08:47:24,648 - Epoch: [2][  300/ 1680]    Loss 0.000000    Overall Loss 0.012250    
+2023-11-30 08:47:44,343 - Epoch: [2][  400/ 1680]    Loss 0.000000    Overall Loss 0.012242    
+2023-11-30 08:48:04,039 - Epoch: [2][  500/ 1680]    Loss 0.000000    Overall Loss 0.012235    
+2023-11-30 08:48:23,753 - Epoch: [2][  600/ 1680]    Loss 0.000000    Overall Loss 0.012223    
+2023-11-30 08:48:43,452 - Epoch: [2][  700/ 1680]    Loss 0.000000    Overall Loss 0.012218    
+2023-11-30 08:49:03,155 - Epoch: [2][  800/ 1680]    Loss 0.000000    Overall Loss 0.012219    
+2023-11-30 08:49:22,873 - Epoch: [2][  900/ 1680]    Loss 0.000000    Overall Loss 0.012208    
+2023-11-30 08:49:42,582 - Epoch: [2][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.012208    
+2023-11-30 08:50:02,310 - Epoch: [2][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.012203    
+2023-11-30 08:50:22,020 - Epoch: [2][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.012201    
+2023-11-30 08:50:41,755 - Epoch: [2][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.012201    
+2023-11-30 08:51:01,468 - Epoch: [2][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.012206    
+2023-11-30 08:51:21,188 - Epoch: [2][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.012208    
+2023-11-30 08:51:40,903 - Epoch: [2][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.012204    
+2023-11-30 08:51:56,599 - Epoch: [2][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.012206    
+2023-11-30 08:51:56,791 - ==> Overall Loss: 0.012
+
+2023-11-30 08:51:56,795 - ==> Best [Overall Loss: 0.012206 on epoch: 2]
+2023-11-30 08:51:56,795 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 08:51:56,834 - 
+
+2023-11-30 08:51:56,834 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 08:52:28,235 - Epoch: [3][  100/31148]    Overall Loss 0.011420    Objective Loss 0.000000    Distill Loss 0.011420                     LR 0.001000    Time 0.313973    
+2023-11-30 08:52:53,983 - Epoch: [3][  200/31148]    Overall Loss 0.011388    Objective Loss 0.000000    Distill Loss 0.011388                     LR 0.001000    Time 0.285713    
+2023-11-30 08:53:19,771 - Epoch: [3][  300/31148]    Overall Loss 0.011411    Objective Loss 0.000000    Distill Loss 0.011411                     LR 0.001000    Time 0.276426    
+2023-11-30 08:53:45,548 - Epoch: [3][  400/31148]    Overall Loss 0.011414    Objective Loss 0.000000    Distill Loss 0.011414                     LR 0.001000    Time 0.271755    
+2023-11-30 08:54:11,298 - Epoch: [3][  500/31148]    Overall Loss 0.011393    Objective Loss 0.000000    Distill Loss 0.011393                     LR 0.001000    Time 0.268898    
+2023-11-30 08:54:37,042 - Epoch: [3][  600/31148]    Overall Loss 0.011377    Objective Loss 0.000000    Distill Loss 0.011377                     LR 0.001000    Time 0.266984    
+2023-11-30 08:55:02,762 - Epoch: [3][  700/31148]    Overall Loss 0.011392    Objective Loss 0.000000    Distill Loss 0.011392                     LR 0.001000    Time 0.265583    
+2023-11-30 08:55:28,460 - Epoch: [3][  800/31148]    Overall Loss 0.011404    Objective Loss 0.000000    Distill Loss 0.011404                     LR 0.001000    Time 0.264504    
+2023-11-30 08:55:54,141 - Epoch: [3][  900/31148]    Overall Loss 0.011387    Objective Loss 0.000000    Distill Loss 0.011387                     LR 0.001000    Time 0.263647    
+2023-11-30 08:56:19,895 - Epoch: [3][ 1000/31148]    Overall Loss 0.011379    Objective Loss 0.000000    Distill Loss 0.011379                     LR 0.001000    Time 0.263033    
+2023-11-30 08:56:45,594 - Epoch: [3][ 1100/31148]    Overall Loss 0.011386    Objective Loss 0.000000    Distill Loss 0.011386                     LR 0.001000    Time 0.262481    
+2023-11-30 08:57:11,396 - Epoch: [3][ 1200/31148]    Overall Loss 0.011380    Objective Loss 0.000000    Distill Loss 0.011380                     LR 0.001000    Time 0.262108    
+2023-11-30 08:57:37,167 - Epoch: [3][ 1300/31148]    Overall Loss 0.011378    Objective Loss 0.000000    Distill Loss 0.011378                     LR 0.001000    Time 0.261767    
+2023-11-30 08:58:02,858 - Epoch: [3][ 1400/31148]    Overall Loss 0.011378    Objective Loss 0.000000    Distill Loss 0.011378                     LR 0.001000    Time 0.261418    
+2023-11-30 08:58:28,566 - Epoch: [3][ 1500/31148]    Overall Loss 0.011381    Objective Loss 0.000000    Distill Loss 0.011381                     LR 0.001000    Time 0.261127    
+2023-11-30 08:58:54,305 - Epoch: [3][ 1600/31148]    Overall Loss 0.011382    Objective Loss 0.000000    Distill Loss 0.011382                     LR 0.001000    Time 0.260892    
+2023-11-30 08:59:20,069 - Epoch: [3][ 1700/31148]    Overall Loss 0.011381    Objective Loss 0.000000    Distill Loss 0.011381                     LR 0.001000    Time 0.260699    
+2023-11-30 08:59:45,843 - Epoch: [3][ 1800/31148]    Overall Loss 0.011380    Objective Loss 0.000000    Distill Loss 0.011380                     LR 0.001000    Time 0.260533    
+2023-11-30 09:00:11,575 - Epoch: [3][ 1900/31148]    Overall Loss 0.011382    Objective Loss 0.000000    Distill Loss 0.011382                     LR 0.001000    Time 0.260363    
+2023-11-30 09:00:37,276 - Epoch: [3][ 2000/31148]    Overall Loss 0.011379    Objective Loss 0.000000    Distill Loss 0.011379                     LR 0.001000    Time 0.260194    
+2023-11-30 09:01:02,987 - Epoch: [3][ 2100/31148]    Overall Loss 0.011382    Objective Loss 0.000000    Distill Loss 0.011382                     LR 0.001000    Time 0.260045    
+2023-11-30 09:01:28,749 - Epoch: [3][ 2200/31148]    Overall Loss 0.011380    Objective Loss 0.000000    Distill Loss 0.011380                     LR 0.001000    Time 0.259934    
+2023-11-30 09:01:54,495 - Epoch: [3][ 2300/31148]    Overall Loss 0.011386    Objective Loss 0.000000    Distill Loss 0.011386                     LR 0.001000    Time 0.259826    
+2023-11-30 09:02:20,284 - Epoch: [3][ 2400/31148]    Overall Loss 0.011387    Objective Loss 0.000000    Distill Loss 0.011387                     LR 0.001000    Time 0.259744    
+2023-11-30 09:02:45,970 - Epoch: [3][ 2500/31148]    Overall Loss 0.011386    Objective Loss 0.000000    Distill Loss 0.011386                     LR 0.001000    Time 0.259627    
+2023-11-30 09:03:11,748 - Epoch: [3][ 2600/31148]    Overall Loss 0.011389    Objective Loss 0.000000    Distill Loss 0.011389                     LR 0.001000    Time 0.259555    
+2023-11-30 09:03:37,542 - Epoch: [3][ 2700/31148]    Overall Loss 0.011391    Objective Loss 0.000000    Distill Loss 0.011391                     LR 0.001000    Time 0.259494    
+2023-11-30 09:04:03,312 - Epoch: [3][ 2800/31148]    Overall Loss 0.011388    Objective Loss 0.000000    Distill Loss 0.011388                     LR 0.001000    Time 0.259429    
+2023-11-30 09:04:29,065 - Epoch: [3][ 2900/31148]    Overall Loss 0.011384    Objective Loss 0.000000    Distill Loss 0.011384                     LR 0.001000    Time 0.259363    
+2023-11-30 09:04:54,765 - Epoch: [3][ 3000/31148]    Overall Loss 0.011382    Objective Loss 0.000000    Distill Loss 0.011382                     LR 0.001000    Time 0.259283    
+2023-11-30 09:05:20,505 - Epoch: [3][ 3100/31148]    Overall Loss 0.011379    Objective Loss 0.000000    Distill Loss 0.011379                     LR 0.001000    Time 0.259221    
+2023-11-30 09:05:46,276 - Epoch: [3][ 3200/31148]    Overall Loss 0.011380    Objective Loss 0.000000    Distill Loss 0.011380                     LR 0.001000    Time 0.259173    
+2023-11-30 09:06:12,062 - Epoch: [3][ 3300/31148]    Overall Loss 0.011381    Objective Loss 0.000000    Distill Loss 0.011381                     LR 0.001000    Time 0.259133    
+2023-11-30 09:06:37,765 - Epoch: [3][ 3400/31148]    Overall Loss 0.011379    Objective Loss 0.000000    Distill Loss 0.011379                     LR 0.001000    Time 0.259070    
+2023-11-30 09:07:03,500 - Epoch: [3][ 3500/31148]    Overall Loss 0.011375    Objective Loss 0.000000    Distill Loss 0.011375                     LR 0.001000    Time 0.259020    
+2023-11-30 09:07:29,242 - Epoch: [3][ 3600/31148]    Overall Loss 0.011378    Objective Loss 0.000000    Distill Loss 0.011378                     LR 0.001000    Time 0.258975    
+2023-11-30 09:07:54,948 - Epoch: [3][ 3700/31148]    Overall Loss 0.011378    Objective Loss 0.000000    Distill Loss 0.011378                     LR 0.001000    Time 0.258923    
+2023-11-30 09:08:20,680 - Epoch: [3][ 3800/31148]    Overall Loss 0.011377    Objective Loss 0.000000    Distill Loss 0.011377                     LR 0.001000    Time 0.258880    
+2023-11-30 09:08:46,384 - Epoch: [3][ 3900/31148]    Overall Loss 0.011379    Objective Loss 0.000000    Distill Loss 0.011379                     LR 0.001000    Time 0.258832    
+2023-11-30 09:09:12,084 - Epoch: [3][ 4000/31148]    Overall Loss 0.011380    Objective Loss 0.000000    Distill Loss 0.011380                     LR 0.001000    Time 0.258786    
+2023-11-30 09:09:37,793 - Epoch: [3][ 4100/31148]    Overall Loss 0.011378    Objective Loss 0.000000    Distill Loss 0.011378                     LR 0.001000    Time 0.258743    
+2023-11-30 09:10:03,577 - Epoch: [3][ 4200/31148]    Overall Loss 0.011378    Objective Loss 0.000000    Distill Loss 0.011378                     LR 0.001000    Time 0.258721    
+2023-11-30 09:10:29,420 - Epoch: [3][ 4300/31148]    Overall Loss 0.011380    Objective Loss 0.000000    Distill Loss 0.011380                     LR 0.001000    Time 0.258714    
+2023-11-30 09:10:55,197 - Epoch: [3][ 4400/31148]    Overall Loss 0.011376    Objective Loss 0.000000    Distill Loss 0.011376                     LR 0.001000    Time 0.258692    
+2023-11-30 09:11:20,944 - Epoch: [3][ 4500/31148]    Overall Loss 0.011376    Objective Loss 0.000000    Distill Loss 0.011376                     LR 0.001000    Time 0.258664    
+2023-11-30 09:11:46,695 - Epoch: [3][ 4600/31148]    Overall Loss 0.011376    Objective Loss 0.000000    Distill Loss 0.011376                     LR 0.001000    Time 0.258639    
+2023-11-30 09:12:12,403 - Epoch: [3][ 4700/31148]    Overall Loss 0.011377    Objective Loss 0.000000    Distill Loss 0.011377                     LR 0.001000    Time 0.258605    
+2023-11-30 09:12:38,115 - Epoch: [3][ 4800/31148]    Overall Loss 0.011375    Objective Loss 0.000000    Distill Loss 0.011375                     LR 0.001000    Time 0.258573    
+2023-11-30 09:13:03,816 - Epoch: [3][ 4900/31148]    Overall Loss 0.011373    Objective Loss 0.000000    Distill Loss 0.011373                     LR 0.001000    Time 0.258541    
+2023-11-30 09:13:29,547 - Epoch: [3][ 5000/31148]    Overall Loss 0.011375    Objective Loss 0.000000    Distill Loss 0.011375                     LR 0.001000    Time 0.258516    
+2023-11-30 09:13:55,269 - Epoch: [3][ 5100/31148]    Overall Loss 0.011374    Objective Loss 0.000000    Distill Loss 0.011374                     LR 0.001000    Time 0.258490    
+2023-11-30 09:14:21,046 - Epoch: [3][ 5200/31148]    Overall Loss 0.011377    Objective Loss 0.000000    Distill Loss 0.011377                     LR 0.001000    Time 0.258476    
+2023-11-30 09:14:46,757 - Epoch: [3][ 5300/31148]    Overall Loss 0.011374    Objective Loss 0.000000    Distill Loss 0.011374                     LR 0.001000    Time 0.258449    
+2023-11-30 09:15:12,509 - Epoch: [3][ 5400/31148]    Overall Loss 0.011376    Objective Loss 0.000000    Distill Loss 0.011376                     LR 0.001000    Time 0.258432    
+2023-11-30 09:15:38,306 - Epoch: [3][ 5500/31148]    Overall Loss 0.011375    Objective Loss 0.000000    Distill Loss 0.011375                     LR 0.001000    Time 0.258423    
+2023-11-30 09:16:04,038 - Epoch: [3][ 5600/31148]    Overall Loss 0.011375    Objective Loss 0.000000    Distill Loss 0.011375                     LR 0.001000    Time 0.258403    
+2023-11-30 09:16:29,768 - Epoch: [3][ 5700/31148]    Overall Loss 0.011373    Objective Loss 0.000000    Distill Loss 0.011373                     LR 0.001000    Time 0.258383    
+2023-11-30 09:16:55,455 - Epoch: [3][ 5800/31148]    Overall Loss 0.011369    Objective Loss 0.000000    Distill Loss 0.011369                     LR 0.001000    Time 0.258356    
+2023-11-30 09:17:21,251 - Epoch: [3][ 5900/31148]    Overall Loss 0.011367    Objective Loss 0.000000    Distill Loss 0.011367                     LR 0.001000    Time 0.258349    
+2023-11-30 09:17:47,025 - Epoch: [3][ 6000/31148]    Overall Loss 0.011365    Objective Loss 0.000000    Distill Loss 0.011365                     LR 0.001000    Time 0.258338    
+2023-11-30 09:18:12,804 - Epoch: [3][ 6100/31148]    Overall Loss 0.011366    Objective Loss 0.000000    Distill Loss 0.011366                     LR 0.001000    Time 0.258329    
+2023-11-30 09:18:38,505 - Epoch: [3][ 6200/31148]    Overall Loss 0.011363    Objective Loss 0.000000    Distill Loss 0.011363                     LR 0.001000    Time 0.258307    
+2023-11-30 09:19:04,221 - Epoch: [3][ 6300/31148]    Overall Loss 0.011362    Objective Loss 0.000000    Distill Loss 0.011362                     LR 0.001000    Time 0.258289    
+2023-11-30 09:19:29,984 - Epoch: [3][ 6400/31148]    Overall Loss 0.011361    Objective Loss 0.000000    Distill Loss 0.011361                     LR 0.001000    Time 0.258278    
+2023-11-30 09:19:55,748 - Epoch: [3][ 6500/31148]    Overall Loss 0.011359    Objective Loss 0.000000    Distill Loss 0.011359                     LR 0.001000    Time 0.258268    
+2023-11-30 09:20:21,505 - Epoch: [3][ 6600/31148]    Overall Loss 0.011357    Objective Loss 0.000000    Distill Loss 0.011357                     LR 0.001000    Time 0.258257    
+2023-11-30 09:20:47,258 - Epoch: [3][ 6700/31148]    Overall Loss 0.011356    Objective Loss 0.000000    Distill Loss 0.011356                     LR 0.001000    Time 0.258246    
+2023-11-30 09:21:12,998 - Epoch: [3][ 6800/31148]    Overall Loss 0.011354    Objective Loss 0.000000    Distill Loss 0.011354                     LR 0.001000    Time 0.258233    
+2023-11-30 09:21:38,771 - Epoch: [3][ 6900/31148]    Overall Loss 0.011353    Objective Loss 0.000000    Distill Loss 0.011353                     LR 0.001000    Time 0.258225    
+2023-11-30 09:22:04,506 - Epoch: [3][ 7000/31148]    Overall Loss 0.011354    Objective Loss 0.000000    Distill Loss 0.011354                     LR 0.001000    Time 0.258212    
+2023-11-30 09:22:30,202 - Epoch: [3][ 7100/31148]    Overall Loss 0.011353    Objective Loss 0.000000    Distill Loss 0.011353                     LR 0.001000    Time 0.258194    
+2023-11-30 09:22:55,957 - Epoch: [3][ 7200/31148]    Overall Loss 0.011352    Objective Loss 0.000000    Distill Loss 0.011352                     LR 0.001000    Time 0.258185    
+2023-11-30 09:23:21,684 - Epoch: [3][ 7300/31148]    Overall Loss 0.011353    Objective Loss 0.000000    Distill Loss 0.011353                     LR 0.001000    Time 0.258172    
+2023-11-30 09:23:47,414 - Epoch: [3][ 7400/31148]    Overall Loss 0.011353    Objective Loss 0.000000    Distill Loss 0.011353                     LR 0.001000    Time 0.258160    
+2023-11-30 09:24:13,139 - Epoch: [3][ 7500/31148]    Overall Loss 0.011353    Objective Loss 0.000000    Distill Loss 0.011353                     LR 0.001000    Time 0.258147    
+2023-11-30 09:24:38,897 - Epoch: [3][ 7600/31148]    Overall Loss 0.011351    Objective Loss 0.000000    Distill Loss 0.011351                     LR 0.001000    Time 0.258139    
+2023-11-30 09:25:04,633 - Epoch: [3][ 7700/31148]    Overall Loss 0.011349    Objective Loss 0.000000    Distill Loss 0.011349                     LR 0.001000    Time 0.258129    
+2023-11-30 09:25:30,304 - Epoch: [3][ 7800/31148]    Overall Loss 0.011346    Objective Loss 0.000000    Distill Loss 0.011346                     LR 0.001000    Time 0.258111    
+2023-11-30 09:25:56,047 - Epoch: [3][ 7900/31148]    Overall Loss 0.011345    Objective Loss 0.000000    Distill Loss 0.011345                     LR 0.001000    Time 0.258102    
+2023-11-30 09:26:21,817 - Epoch: [3][ 8000/31148]    Overall Loss 0.011343    Objective Loss 0.000000    Distill Loss 0.011343                     LR 0.001000    Time 0.258096    
+2023-11-30 09:26:47,543 - Epoch: [3][ 8100/31148]    Overall Loss 0.011343    Objective Loss 0.000000    Distill Loss 0.011343                     LR 0.001000    Time 0.258086    
+2023-11-30 09:27:13,324 - Epoch: [3][ 8200/31148]    Overall Loss 0.011342    Objective Loss 0.000000    Distill Loss 0.011342                     LR 0.001000    Time 0.258082    
+2023-11-30 09:27:39,052 - Epoch: [3][ 8300/31148]    Overall Loss 0.011342    Objective Loss 0.000000    Distill Loss 0.011342                     LR 0.001000    Time 0.258072    
+2023-11-30 09:28:04,778 - Epoch: [3][ 8400/31148]    Overall Loss 0.011340    Objective Loss 0.000000    Distill Loss 0.011340                     LR 0.001000    Time 0.258062    
+2023-11-30 09:28:30,550 - Epoch: [3][ 8500/31148]    Overall Loss 0.011340    Objective Loss 0.000000    Distill Loss 0.011340                     LR 0.001000    Time 0.258058    
+2023-11-30 09:28:56,286 - Epoch: [3][ 8600/31148]    Overall Loss 0.011338    Objective Loss 0.000000    Distill Loss 0.011338                     LR 0.001000    Time 0.258049    
+2023-11-30 09:29:22,020 - Epoch: [3][ 8700/31148]    Overall Loss 0.011338    Objective Loss 0.000000    Distill Loss 0.011338                     LR 0.001000    Time 0.258041    
+2023-11-30 09:29:47,749 - Epoch: [3][ 8800/31148]    Overall Loss 0.011338    Objective Loss 0.000000    Distill Loss 0.011338                     LR 0.001000    Time 0.258032    
+2023-11-30 09:30:13,519 - Epoch: [3][ 8900/31148]    Overall Loss 0.011336    Objective Loss 0.000000    Distill Loss 0.011336                     LR 0.001000    Time 0.258028    
+2023-11-30 09:30:39,267 - Epoch: [3][ 9000/31148]    Overall Loss 0.011334    Objective Loss 0.000000    Distill Loss 0.011334                     LR 0.001000    Time 0.258021    
+2023-11-30 09:31:04,991 - Epoch: [3][ 9100/31148]    Overall Loss 0.011333    Objective Loss 0.000000    Distill Loss 0.011333                     LR 0.001000    Time 0.258013    
+2023-11-30 09:31:30,759 - Epoch: [3][ 9200/31148]    Overall Loss 0.011332    Objective Loss 0.000000    Distill Loss 0.011332                     LR 0.001000    Time 0.258009    
+2023-11-30 09:31:56,558 - Epoch: [3][ 9300/31148]    Overall Loss 0.011331    Objective Loss 0.000000    Distill Loss 0.011331                     LR 0.001000    Time 0.258008    
+2023-11-30 09:32:22,328 - Epoch: [3][ 9400/31148]    Overall Loss 0.011330    Objective Loss 0.000000    Distill Loss 0.011330                     LR 0.001000    Time 0.258005    
+2023-11-30 09:32:48,064 - Epoch: [3][ 9500/31148]    Overall Loss 0.011329    Objective Loss 0.000000    Distill Loss 0.011329                     LR 0.001000    Time 0.257998    
+2023-11-30 09:33:13,829 - Epoch: [3][ 9600/31148]    Overall Loss 0.011329    Objective Loss 0.000000    Distill Loss 0.011329                     LR 0.001000    Time 0.257994    
+2023-11-30 09:33:39,606 - Epoch: [3][ 9700/31148]    Overall Loss 0.011329    Objective Loss 0.000000    Distill Loss 0.011329                     LR 0.001000    Time 0.257991    
+2023-11-30 09:34:05,359 - Epoch: [3][ 9800/31148]    Overall Loss 0.011329    Objective Loss 0.000000    Distill Loss 0.011329                     LR 0.001000    Time 0.257986    
+2023-11-30 09:34:31,159 - Epoch: [3][ 9900/31148]    Overall Loss 0.011327    Objective Loss 0.000000    Distill Loss 0.011327                     LR 0.001000    Time 0.257986    
+2023-11-30 09:34:56,945 - Epoch: [3][10000/31148]    Overall Loss 0.011325    Objective Loss 0.000000    Distill Loss 0.011325                     LR 0.001000    Time 0.257984    
+2023-11-30 09:35:22,692 - Epoch: [3][10100/31148]    Overall Loss 0.011323    Objective Loss 0.000000    Distill Loss 0.011323                     LR 0.001000    Time 0.257979    
+2023-11-30 09:35:48,454 - Epoch: [3][10200/31148]    Overall Loss 0.011322    Objective Loss 0.000000    Distill Loss 0.011322                     LR 0.001000    Time 0.257975    
+2023-11-30 09:36:14,189 - Epoch: [3][10300/31148]    Overall Loss 0.011322    Objective Loss 0.000000    Distill Loss 0.011322                     LR 0.001000    Time 0.257969    
+2023-11-30 09:36:39,922 - Epoch: [3][10400/31148]    Overall Loss 0.011321    Objective Loss 0.000000    Distill Loss 0.011321                     LR 0.001000    Time 0.257962    
+2023-11-30 09:37:05,673 - Epoch: [3][10500/31148]    Overall Loss 0.011321    Objective Loss 0.000000    Distill Loss 0.011321                     LR 0.001000    Time 0.257958    
+2023-11-30 09:37:31,427 - Epoch: [3][10600/31148]    Overall Loss 0.011321    Objective Loss 0.000000    Distill Loss 0.011321                     LR 0.001000    Time 0.257954    
+2023-11-30 09:37:57,187 - Epoch: [3][10700/31148]    Overall Loss 0.011320    Objective Loss 0.000000    Distill Loss 0.011320                     LR 0.001000    Time 0.257950    
+2023-11-30 09:38:22,942 - Epoch: [3][10800/31148]    Overall Loss 0.011319    Objective Loss 0.000000    Distill Loss 0.011319                     LR 0.001000    Time 0.257946    
+2023-11-30 09:38:48,708 - Epoch: [3][10900/31148]    Overall Loss 0.011319    Objective Loss 0.000000    Distill Loss 0.011319                     LR 0.001000    Time 0.257943    
+2023-11-30 09:39:14,458 - Epoch: [3][11000/31148]    Overall Loss 0.011317    Objective Loss 0.000000    Distill Loss 0.011317                     LR 0.001000    Time 0.257939    
+2023-11-30 09:39:40,185 - Epoch: [3][11100/31148]    Overall Loss 0.011316    Objective Loss 0.000000    Distill Loss 0.011316                     LR 0.001000    Time 0.257933    
+2023-11-30 09:40:05,925 - Epoch: [3][11200/31148]    Overall Loss 0.011314    Objective Loss 0.000000    Distill Loss 0.011314                     LR 0.001000    Time 0.257928    
+2023-11-30 09:40:31,689 - Epoch: [3][11300/31148]    Overall Loss 0.011313    Objective Loss 0.000000    Distill Loss 0.011313                     LR 0.001000    Time 0.257925    
+2023-11-30 09:40:57,450 - Epoch: [3][11400/31148]    Overall Loss 0.011314    Objective Loss 0.000000    Distill Loss 0.011314                     LR 0.001000    Time 0.257922    
+2023-11-30 09:41:23,183 - Epoch: [3][11500/31148]    Overall Loss 0.011313    Objective Loss 0.000000    Distill Loss 0.011313                     LR 0.001000    Time 0.257917    
+2023-11-30 09:41:48,953 - Epoch: [3][11600/31148]    Overall Loss 0.011312    Objective Loss 0.000000    Distill Loss 0.011312                     LR 0.001000    Time 0.257915    
+2023-11-30 09:42:14,733 - Epoch: [3][11700/31148]    Overall Loss 0.011310    Objective Loss 0.000000    Distill Loss 0.011310                     LR 0.001000    Time 0.257913    
+2023-11-30 09:42:40,514 - Epoch: [3][11800/31148]    Overall Loss 0.011310    Objective Loss 0.000000    Distill Loss 0.011310                     LR 0.001000    Time 0.257912    
+2023-11-30 09:43:06,235 - Epoch: [3][11900/31148]    Overall Loss 0.011309    Objective Loss 0.000000    Distill Loss 0.011309                     LR 0.001000    Time 0.257906    
+2023-11-30 09:43:31,990 - Epoch: [3][12000/31148]    Overall Loss 0.011308    Objective Loss 0.000000    Distill Loss 0.011308                     LR 0.001000    Time 0.257903    
+2023-11-30 09:43:57,807 - Epoch: [3][12100/31148]    Overall Loss 0.011308    Objective Loss 0.000000    Distill Loss 0.011308                     LR 0.001000    Time 0.257905    
+2023-11-30 09:44:23,614 - Epoch: [3][12200/31148]    Overall Loss 0.011307    Objective Loss 0.000000    Distill Loss 0.011307                     LR 0.001000    Time 0.257906    
+2023-11-30 09:44:49,354 - Epoch: [3][12300/31148]    Overall Loss 0.011306    Objective Loss 0.000000    Distill Loss 0.011306                     LR 0.001000    Time 0.257902    
+2023-11-30 09:45:15,116 - Epoch: [3][12400/31148]    Overall Loss 0.011305    Objective Loss 0.000000    Distill Loss 0.011305                     LR 0.001000    Time 0.257899    
+2023-11-30 09:45:40,815 - Epoch: [3][12500/31148]    Overall Loss 0.011304    Objective Loss 0.000000    Distill Loss 0.011304                     LR 0.001000    Time 0.257892    
+2023-11-30 09:46:06,572 - Epoch: [3][12600/31148]    Overall Loss 0.011304    Objective Loss 0.000000    Distill Loss 0.011304                     LR 0.001000    Time 0.257889    
+2023-11-30 09:46:32,396 - Epoch: [3][12700/31148]    Overall Loss 0.011303    Objective Loss 0.000000    Distill Loss 0.011303                     LR 0.001000    Time 0.257892    
+2023-11-30 09:46:58,119 - Epoch: [3][12800/31148]    Overall Loss 0.011302    Objective Loss 0.000000    Distill Loss 0.011302                     LR 0.001000    Time 0.257886    
+2023-11-30 09:47:23,921 - Epoch: [3][12900/31148]    Overall Loss 0.011302    Objective Loss 0.000000    Distill Loss 0.011302                     LR 0.001000    Time 0.257887    
+2023-11-30 09:47:49,696 - Epoch: [3][13000/31148]    Overall Loss 0.011302    Objective Loss 0.000000    Distill Loss 0.011302                     LR 0.001000    Time 0.257886    
+2023-11-30 09:48:15,444 - Epoch: [3][13100/31148]    Overall Loss 0.011302    Objective Loss 0.000000    Distill Loss 0.011302                     LR 0.001000    Time 0.257882    
+2023-11-30 09:48:41,215 - Epoch: [3][13200/31148]    Overall Loss 0.011301    Objective Loss 0.000000    Distill Loss 0.011301                     LR 0.001000    Time 0.257881    
+2023-11-30 09:49:07,020 - Epoch: [3][13300/31148]    Overall Loss 0.011300    Objective Loss 0.000000    Distill Loss 0.011300                     LR 0.001000    Time 0.257882    
+2023-11-30 09:49:32,755 - Epoch: [3][13400/31148]    Overall Loss 0.011300    Objective Loss 0.000000    Distill Loss 0.011300                     LR 0.001000    Time 0.257878    
+2023-11-30 09:49:58,604 - Epoch: [3][13500/31148]    Overall Loss 0.011299    Objective Loss 0.000000    Distill Loss 0.011299                     LR 0.001000    Time 0.257882    
+2023-11-30 09:50:24,319 - Epoch: [3][13600/31148]    Overall Loss 0.011298    Objective Loss 0.000000    Distill Loss 0.011298                     LR 0.001000    Time 0.257877    
+2023-11-30 09:50:50,041 - Epoch: [3][13700/31148]    Overall Loss 0.011298    Objective Loss 0.000000    Distill Loss 0.011298                     LR 0.001000    Time 0.257872    
+2023-11-30 09:51:15,834 - Epoch: [3][13800/31148]    Overall Loss 0.011298    Objective Loss 0.000000    Distill Loss 0.011298                     LR 0.001000    Time 0.257872    
+2023-11-30 09:51:41,584 - Epoch: [3][13900/31148]    Overall Loss 0.011296    Objective Loss 0.000000    Distill Loss 0.011296                     LR 0.001000    Time 0.257869    
+2023-11-30 09:52:07,361 - Epoch: [3][14000/31148]    Overall Loss 0.011296    Objective Loss 0.000000    Distill Loss 0.011296                     LR 0.001000    Time 0.257868    
+2023-11-30 09:52:33,128 - Epoch: [3][14100/31148]    Overall Loss 0.011295    Objective Loss 0.000000    Distill Loss 0.011295                     LR 0.001000    Time 0.257867    
+2023-11-30 09:52:58,882 - Epoch: [3][14200/31148]    Overall Loss 0.011295    Objective Loss 0.000000    Distill Loss 0.011295                     LR 0.001000    Time 0.257864    
+2023-11-30 09:53:24,636 - Epoch: [3][14300/31148]    Overall Loss 0.011293    Objective Loss 0.000000    Distill Loss 0.011293                     LR 0.001000    Time 0.257862    
+2023-11-30 09:53:50,373 - Epoch: [3][14400/31148]    Overall Loss 0.011292    Objective Loss 0.000000    Distill Loss 0.011292                     LR 0.001000    Time 0.257858    
+2023-11-30 09:54:16,150 - Epoch: [3][14500/31148]    Overall Loss 0.011292    Objective Loss 0.000000    Distill Loss 0.011292                     LR 0.001000    Time 0.257857    
+2023-11-30 09:54:41,929 - Epoch: [3][14600/31148]    Overall Loss 0.011291    Objective Loss 0.000000    Distill Loss 0.011291                     LR 0.001000    Time 0.257857    
+2023-11-30 09:55:07,649 - Epoch: [3][14700/31148]    Overall Loss 0.011291    Objective Loss 0.000000    Distill Loss 0.011291                     LR 0.001000    Time 0.257852    
+2023-11-30 09:55:33,419 - Epoch: [3][14800/31148]    Overall Loss 0.011290    Objective Loss 0.000000    Distill Loss 0.011290                     LR 0.001000    Time 0.257851    
+2023-11-30 09:55:59,158 - Epoch: [3][14900/31148]    Overall Loss 0.011289    Objective Loss 0.000000    Distill Loss 0.011289                     LR 0.001000    Time 0.257847    
+2023-11-30 09:56:24,877 - Epoch: [3][15000/31148]    Overall Loss 0.011288    Objective Loss 0.000000    Distill Loss 0.011288                     LR 0.001000    Time 0.257843    
+2023-11-30 09:56:50,618 - Epoch: [3][15100/31148]    Overall Loss 0.011288    Objective Loss 0.000000    Distill Loss 0.011288                     LR 0.001000    Time 0.257840    
+2023-11-30 09:57:16,387 - Epoch: [3][15200/31148]    Overall Loss 0.011287    Objective Loss 0.000000    Distill Loss 0.011287                     LR 0.001000    Time 0.257839    
+2023-11-30 09:57:42,149 - Epoch: [3][15300/31148]    Overall Loss 0.011287    Objective Loss 0.000000    Distill Loss 0.011287                     LR 0.001000    Time 0.257837    
+2023-11-30 09:58:07,875 - Epoch: [3][15400/31148]    Overall Loss 0.011287    Objective Loss 0.000000    Distill Loss 0.011287                     LR 0.001000    Time 0.257833    
+2023-11-30 09:58:33,651 - Epoch: [3][15500/31148]    Overall Loss 0.011285    Objective Loss 0.000000    Distill Loss 0.011285                     LR 0.001000    Time 0.257833    
+2023-11-30 09:58:59,412 - Epoch: [3][15600/31148]    Overall Loss 0.011284    Objective Loss 0.000000    Distill Loss 0.011284                     LR 0.001000    Time 0.257831    
+2023-11-30 09:59:25,184 - Epoch: [3][15700/31148]    Overall Loss 0.011283    Objective Loss 0.000000    Distill Loss 0.011283                     LR 0.001000    Time 0.257830    
+2023-11-30 09:59:50,967 - Epoch: [3][15800/31148]    Overall Loss 0.011282    Objective Loss 0.000000    Distill Loss 0.011282                     LR 0.001000    Time 0.257830    
+2023-11-30 10:00:16,742 - Epoch: [3][15900/31148]    Overall Loss 0.011281    Objective Loss 0.000000    Distill Loss 0.011281                     LR 0.001000    Time 0.257829    
+2023-11-30 10:00:42,568 - Epoch: [3][16000/31148]    Overall Loss 0.011280    Objective Loss 0.000000    Distill Loss 0.011280                     LR 0.001000    Time 0.257832    
+2023-11-30 10:01:08,344 - Epoch: [3][16100/31148]    Overall Loss 0.011280    Objective Loss 0.000000    Distill Loss 0.011280                     LR 0.001000    Time 0.257831    
+2023-11-30 10:01:34,139 - Epoch: [3][16200/31148]    Overall Loss 0.011279    Objective Loss 0.000000    Distill Loss 0.011279                     LR 0.001000    Time 0.257832    
+2023-11-30 10:01:59,901 - Epoch: [3][16300/31148]    Overall Loss 0.011278    Objective Loss 0.000000    Distill Loss 0.011278                     LR 0.001000    Time 0.257830    
+2023-11-30 10:02:25,618 - Epoch: [3][16400/31148]    Overall Loss 0.011277    Objective Loss 0.000000    Distill Loss 0.011277                     LR 0.001000    Time 0.257826    
+2023-11-30 10:02:51,376 - Epoch: [3][16500/31148]    Overall Loss 0.011276    Objective Loss 0.000000    Distill Loss 0.011276                     LR 0.001000    Time 0.257824    
+2023-11-30 10:03:17,188 - Epoch: [3][16600/31148]    Overall Loss 0.011276    Objective Loss 0.000000    Distill Loss 0.011276                     LR 0.001000    Time 0.257826    
+2023-11-30 10:03:43,001 - Epoch: [3][16700/31148]    Overall Loss 0.011274    Objective Loss 0.000000    Distill Loss 0.011274                     LR 0.001000    Time 0.257828    
+2023-11-30 10:04:08,751 - Epoch: [3][16800/31148]    Overall Loss 0.011273    Objective Loss 0.000000    Distill Loss 0.011273                     LR 0.001000    Time 0.257826    
+2023-11-30 10:04:34,501 - Epoch: [3][16900/31148]    Overall Loss 0.011272    Objective Loss 0.000000    Distill Loss 0.011272                     LR 0.001000    Time 0.257823    
+2023-11-30 10:05:00,191 - Epoch: [3][17000/31148]    Overall Loss 0.011271    Objective Loss 0.000000    Distill Loss 0.011271                     LR 0.001000    Time 0.257818    
+2023-11-30 10:05:25,947 - Epoch: [3][17100/31148]    Overall Loss 0.011271    Objective Loss 0.000000    Distill Loss 0.011271                     LR 0.001000    Time 0.257816    
+2023-11-30 10:05:51,679 - Epoch: [3][17200/31148]    Overall Loss 0.011270    Objective Loss 0.000000    Distill Loss 0.011270                     LR 0.001000    Time 0.257813    
+2023-11-30 10:06:17,409 - Epoch: [3][17300/31148]    Overall Loss 0.011270    Objective Loss 0.000000    Distill Loss 0.011270                     LR 0.001000    Time 0.257810    
+2023-11-30 10:06:43,225 - Epoch: [3][17400/31148]    Overall Loss 0.011269    Objective Loss 0.000000    Distill Loss 0.011269                     LR 0.001000    Time 0.257812    
+2023-11-30 10:07:08,974 - Epoch: [3][17500/31148]    Overall Loss 0.011268    Objective Loss 0.000000    Distill Loss 0.011268                     LR 0.001000    Time 0.257810    
+2023-11-30 10:07:34,721 - Epoch: [3][17600/31148]    Overall Loss 0.011267    Objective Loss 0.000000    Distill Loss 0.011267                     LR 0.001000    Time 0.257808    
+2023-11-30 10:08:00,454 - Epoch: [3][17700/31148]    Overall Loss 0.011265    Objective Loss 0.000000    Distill Loss 0.011265                     LR 0.001000    Time 0.257805    
+2023-11-30 10:08:26,294 - Epoch: [3][17800/31148]    Overall Loss 0.011265    Objective Loss 0.000000    Distill Loss 0.011265                     LR 0.001000    Time 0.257808    
+2023-11-30 10:08:52,075 - Epoch: [3][17900/31148]    Overall Loss 0.011265    Objective Loss 0.000000    Distill Loss 0.011265                     LR 0.001000    Time 0.257808    
+2023-11-30 10:09:17,807 - Epoch: [3][18000/31148]    Overall Loss 0.011264    Objective Loss 0.000000    Distill Loss 0.011264                     LR 0.001000    Time 0.257805    
+2023-11-30 10:09:43,563 - Epoch: [3][18100/31148]    Overall Loss 0.011263    Objective Loss 0.000000    Distill Loss 0.011263                     LR 0.001000    Time 0.257804    
+2023-11-30 10:10:09,286 - Epoch: [3][18200/31148]    Overall Loss 0.011262    Objective Loss 0.000000    Distill Loss 0.011262                     LR 0.001000    Time 0.257800    
+2023-11-30 10:10:35,061 - Epoch: [3][18300/31148]    Overall Loss 0.011261    Objective Loss 0.000000    Distill Loss 0.011261                     LR 0.001000    Time 0.257800    
+2023-11-30 10:11:00,820 - Epoch: [3][18400/31148]    Overall Loss 0.011261    Objective Loss 0.000000    Distill Loss 0.011261                     LR 0.001000    Time 0.257799    
+2023-11-30 10:11:26,501 - Epoch: [3][18500/31148]    Overall Loss 0.011260    Objective Loss 0.000000    Distill Loss 0.011260                     LR 0.001000    Time 0.257793    
+2023-11-30 10:11:52,263 - Epoch: [3][18600/31148]    Overall Loss 0.011259    Objective Loss 0.000000    Distill Loss 0.011259                     LR 0.001000    Time 0.257792    
+2023-11-30 10:12:18,027 - Epoch: [3][18700/31148]    Overall Loss 0.011259    Objective Loss 0.000000    Distill Loss 0.011259                     LR 0.001000    Time 0.257791    
+2023-11-30 10:12:43,771 - Epoch: [3][18800/31148]    Overall Loss 0.011258    Objective Loss 0.000000    Distill Loss 0.011258                     LR 0.001000    Time 0.257789    
+2023-11-30 10:13:09,493 - Epoch: [3][18900/31148]    Overall Loss 0.011258    Objective Loss 0.000000    Distill Loss 0.011258                     LR 0.001000    Time 0.257786    
+2023-11-30 10:13:35,242 - Epoch: [3][19000/31148]    Overall Loss 0.011256    Objective Loss 0.000000    Distill Loss 0.011256                     LR 0.001000    Time 0.257784    
+2023-11-30 10:14:00,973 - Epoch: [3][19100/31148]    Overall Loss 0.011255    Objective Loss 0.000000    Distill Loss 0.011255                     LR 0.001000    Time 0.257782    
+2023-11-30 10:14:26,700 - Epoch: [3][19200/31148]    Overall Loss 0.011255    Objective Loss 0.000000    Distill Loss 0.011255                     LR 0.001000    Time 0.257779    
+2023-11-30 10:14:52,448 - Epoch: [3][19300/31148]    Overall Loss 0.011254    Objective Loss 0.000000    Distill Loss 0.011254                     LR 0.001000    Time 0.257777    
+2023-11-30 10:15:18,204 - Epoch: [3][19400/31148]    Overall Loss 0.011253    Objective Loss 0.000000    Distill Loss 0.011253                     LR 0.001000    Time 0.257776    
+2023-11-30 10:15:43,888 - Epoch: [3][19500/31148]    Overall Loss 0.011253    Objective Loss 0.000000    Distill Loss 0.011253                     LR 0.001000    Time 0.257771    
+2023-11-30 10:16:09,635 - Epoch: [3][19600/31148]    Overall Loss 0.011252    Objective Loss 0.000000    Distill Loss 0.011252                     LR 0.001000    Time 0.257769    
+2023-11-30 10:16:35,386 - Epoch: [3][19700/31148]    Overall Loss 0.011252    Objective Loss 0.000000    Distill Loss 0.011252                     LR 0.001000    Time 0.257768    
+2023-11-30 10:17:01,127 - Epoch: [3][19800/31148]    Overall Loss 0.011251    Objective Loss 0.000000    Distill Loss 0.011251                     LR 0.001000    Time 0.257766    
+2023-11-30 10:17:26,920 - Epoch: [3][19900/31148]    Overall Loss 0.011250    Objective Loss 0.000000    Distill Loss 0.011250                     LR 0.001000    Time 0.257767    
+2023-11-30 10:17:52,645 - Epoch: [3][20000/31148]    Overall Loss 0.011250    Objective Loss 0.000000    Distill Loss 0.011250                     LR 0.001000    Time 0.257764    
+2023-11-30 10:18:18,366 - Epoch: [3][20100/31148]    Overall Loss 0.011250    Objective Loss 0.000000    Distill Loss 0.011250                     LR 0.001000    Time 0.257761    
+2023-11-30 10:18:44,151 - Epoch: [3][20200/31148]    Overall Loss 0.011249    Objective Loss 0.000000    Distill Loss 0.011249                     LR 0.001000    Time 0.257761    
+2023-11-30 10:19:09,872 - Epoch: [3][20300/31148]    Overall Loss 0.011249    Objective Loss 0.000000    Distill Loss 0.011249                     LR 0.001000    Time 0.257759    
+2023-11-30 10:19:35,636 - Epoch: [3][20400/31148]    Overall Loss 0.011248    Objective Loss 0.000000    Distill Loss 0.011248                     LR 0.001000    Time 0.257758    
+2023-11-30 10:20:01,362 - Epoch: [3][20500/31148]    Overall Loss 0.011246    Objective Loss 0.000000    Distill Loss 0.011246                     LR 0.001000    Time 0.257755    
+2023-11-30 10:20:27,138 - Epoch: [3][20600/31148]    Overall Loss 0.011245    Objective Loss 0.000000    Distill Loss 0.011245                     LR 0.001000    Time 0.257755    
+2023-11-30 10:20:52,890 - Epoch: [3][20700/31148]    Overall Loss 0.011245    Objective Loss 0.000000    Distill Loss 0.011245                     LR 0.001000    Time 0.257754    
+2023-11-30 10:21:18,669 - Epoch: [3][20800/31148]    Overall Loss 0.011244    Objective Loss 0.000000    Distill Loss 0.011244                     LR 0.001000    Time 0.257754    
+2023-11-30 10:21:44,372 - Epoch: [3][20900/31148]    Overall Loss 0.011244    Objective Loss 0.000000    Distill Loss 0.011244                     LR 0.001000    Time 0.257750    
+2023-11-30 10:22:10,076 - Epoch: [3][21000/31148]    Overall Loss 0.011243    Objective Loss 0.000000    Distill Loss 0.011243                     LR 0.001000    Time 0.257747    
+2023-11-30 10:22:35,808 - Epoch: [3][21100/31148]    Overall Loss 0.011242    Objective Loss 0.000000    Distill Loss 0.011242                     LR 0.001000    Time 0.257745    
+2023-11-30 10:23:01,554 - Epoch: [3][21200/31148]    Overall Loss 0.011242    Objective Loss 0.000000    Distill Loss 0.011242                     LR 0.001000    Time 0.257743    
+2023-11-30 10:23:27,245 - Epoch: [3][21300/31148]    Overall Loss 0.011241    Objective Loss 0.000000    Distill Loss 0.011241                     LR 0.001000    Time 0.257739    
+2023-11-30 10:23:53,016 - Epoch: [3][21400/31148]    Overall Loss 0.011240    Objective Loss 0.000000    Distill Loss 0.011240                     LR 0.001000    Time 0.257739    
+2023-11-30 10:24:18,752 - Epoch: [3][21500/31148]    Overall Loss 0.011240    Objective Loss 0.000000    Distill Loss 0.011240                     LR 0.001000    Time 0.257737    
+2023-11-30 10:24:44,472 - Epoch: [3][21600/31148]    Overall Loss 0.011238    Objective Loss 0.000000    Distill Loss 0.011238                     LR 0.001000    Time 0.257734    
+2023-11-30 10:25:10,166 - Epoch: [3][21700/31148]    Overall Loss 0.011238    Objective Loss 0.000000    Distill Loss 0.011238                     LR 0.001000    Time 0.257731    
+2023-11-30 10:25:35,890 - Epoch: [3][21800/31148]    Overall Loss 0.011237    Objective Loss 0.000000    Distill Loss 0.011237                     LR 0.001000    Time 0.257728    
+2023-11-30 10:26:01,668 - Epoch: [3][21900/31148]    Overall Loss 0.011236    Objective Loss 0.000000    Distill Loss 0.011236                     LR 0.001000    Time 0.257728    
+2023-11-30 10:26:27,367 - Epoch: [3][22000/31148]    Overall Loss 0.011236    Objective Loss 0.000000    Distill Loss 0.011236                     LR 0.001000    Time 0.257725    
+2023-11-30 10:26:53,141 - Epoch: [3][22100/31148]    Overall Loss 0.011235    Objective Loss 0.000000    Distill Loss 0.011235                     LR 0.001000    Time 0.257725    
+2023-11-30 10:27:18,926 - Epoch: [3][22200/31148]    Overall Loss 0.011235    Objective Loss 0.000000    Distill Loss 0.011235                     LR 0.001000    Time 0.257725    
+2023-11-30 10:27:44,632 - Epoch: [3][22300/31148]    Overall Loss 0.011234    Objective Loss 0.000000    Distill Loss 0.011234                     LR 0.001000    Time 0.257722    
+2023-11-30 10:28:10,384 - Epoch: [3][22400/31148]    Overall Loss 0.011233    Objective Loss 0.000000    Distill Loss 0.011233                     LR 0.001000    Time 0.257721    
+2023-11-30 10:28:36,160 - Epoch: [3][22500/31148]    Overall Loss 0.011233    Objective Loss 0.000000    Distill Loss 0.011233                     LR 0.001000    Time 0.257721    
+2023-11-30 10:29:01,889 - Epoch: [3][22600/31148]    Overall Loss 0.011232    Objective Loss 0.000000    Distill Loss 0.011232                     LR 0.001000    Time 0.257719    
+2023-11-30 10:29:27,583 - Epoch: [3][22700/31148]    Overall Loss 0.011231    Objective Loss 0.000000    Distill Loss 0.011231                     LR 0.001000    Time 0.257716    
+2023-11-30 10:29:53,343 - Epoch: [3][22800/31148]    Overall Loss 0.011230    Objective Loss 0.000000    Distill Loss 0.011230                     LR 0.001000    Time 0.257715    
+2023-11-30 10:30:19,114 - Epoch: [3][22900/31148]    Overall Loss 0.011229    Objective Loss 0.000000    Distill Loss 0.011229                     LR 0.001000    Time 0.257715    
+2023-11-30 10:30:44,874 - Epoch: [3][23000/31148]    Overall Loss 0.011228    Objective Loss 0.000000    Distill Loss 0.011228                     LR 0.001000    Time 0.257714    
+2023-11-30 10:31:10,645 - Epoch: [3][23100/31148]    Overall Loss 0.011227    Objective Loss 0.000000    Distill Loss 0.011227                     LR 0.001000    Time 0.257714    
+2023-11-30 10:31:36,425 - Epoch: [3][23200/31148]    Overall Loss 0.011227    Objective Loss 0.000000    Distill Loss 0.011227                     LR 0.001000    Time 0.257714    
+2023-11-30 10:32:02,176 - Epoch: [3][23300/31148]    Overall Loss 0.011227    Objective Loss 0.000000    Distill Loss 0.011227                     LR 0.001000    Time 0.257713    
+2023-11-30 10:32:27,918 - Epoch: [3][23400/31148]    Overall Loss 0.011226    Objective Loss 0.000000    Distill Loss 0.011226                     LR 0.001000    Time 0.257712    
+2023-11-30 10:32:53,657 - Epoch: [3][23500/31148]    Overall Loss 0.011226    Objective Loss 0.000000    Distill Loss 0.011226                     LR 0.001000    Time 0.257711    
+2023-11-30 10:33:19,444 - Epoch: [3][23600/31148]    Overall Loss 0.011225    Objective Loss 0.000000    Distill Loss 0.011225                     LR 0.001000    Time 0.257711    
+2023-11-30 10:33:45,196 - Epoch: [3][23700/31148]    Overall Loss 0.011225    Objective Loss 0.000000    Distill Loss 0.011225                     LR 0.001000    Time 0.257710    
+2023-11-30 10:34:11,003 - Epoch: [3][23800/31148]    Overall Loss 0.011224    Objective Loss 0.000000    Distill Loss 0.011224                     LR 0.001000    Time 0.257712    
+2023-11-30 10:34:36,740 - Epoch: [3][23900/31148]    Overall Loss 0.011223    Objective Loss 0.000000    Distill Loss 0.011223                     LR 0.001000    Time 0.257710    
+2023-11-30 10:35:02,509 - Epoch: [3][24000/31148]    Overall Loss 0.011222    Objective Loss 0.000000    Distill Loss 0.011222                     LR 0.001000    Time 0.257710    
+2023-11-30 10:35:28,305 - Epoch: [3][24100/31148]    Overall Loss 0.011222    Objective Loss 0.000000    Distill Loss 0.011222                     LR 0.001000    Time 0.257711    
+2023-11-30 10:35:54,027 - Epoch: [3][24200/31148]    Overall Loss 0.011220    Objective Loss 0.000000    Distill Loss 0.011220                     LR 0.001000    Time 0.257709    
+2023-11-30 10:36:19,818 - Epoch: [3][24300/31148]    Overall Loss 0.011220    Objective Loss 0.000000    Distill Loss 0.011220                     LR 0.001000    Time 0.257709    
+2023-11-30 10:36:45,573 - Epoch: [3][24400/31148]    Overall Loss 0.011219    Objective Loss 0.000000    Distill Loss 0.011219                     LR 0.001000    Time 0.257709    
+2023-11-30 10:37:11,298 - Epoch: [3][24500/31148]    Overall Loss 0.011218    Objective Loss 0.000000    Distill Loss 0.011218                     LR 0.001000    Time 0.257707    
+2023-11-30 10:37:37,034 - Epoch: [3][24600/31148]    Overall Loss 0.011218    Objective Loss 0.000000    Distill Loss 0.011218                     LR 0.001000    Time 0.257705    
+2023-11-30 10:38:02,777 - Epoch: [3][24700/31148]    Overall Loss 0.011217    Objective Loss 0.000000    Distill Loss 0.011217                     LR 0.001000    Time 0.257704    
+2023-11-30 10:38:28,483 - Epoch: [3][24800/31148]    Overall Loss 0.011217    Objective Loss 0.000000    Distill Loss 0.011217                     LR 0.001000    Time 0.257701    
+2023-11-30 10:38:54,196 - Epoch: [3][24900/31148]    Overall Loss 0.011216    Objective Loss 0.000000    Distill Loss 0.011216                     LR 0.001000    Time 0.257699    
+2023-11-30 10:39:19,914 - Epoch: [3][25000/31148]    Overall Loss 0.011215    Objective Loss 0.000000    Distill Loss 0.011215                     LR 0.001000    Time 0.257697    
+2023-11-30 10:39:45,718 - Epoch: [3][25100/31148]    Overall Loss 0.011214    Objective Loss 0.000000    Distill Loss 0.011214                     LR 0.001000    Time 0.257698    
+2023-11-30 10:40:11,480 - Epoch: [3][25200/31148]    Overall Loss 0.011213    Objective Loss 0.000000    Distill Loss 0.011213                     LR 0.001000    Time 0.257697    
+2023-11-30 10:40:37,265 - Epoch: [3][25300/31148]    Overall Loss 0.011213    Objective Loss 0.000000    Distill Loss 0.011213                     LR 0.001000    Time 0.257698    
+2023-11-30 10:41:03,045 - Epoch: [3][25400/31148]    Overall Loss 0.011212    Objective Loss 0.000000    Distill Loss 0.011212                     LR 0.001000    Time 0.257698    
+2023-11-30 10:41:28,757 - Epoch: [3][25500/31148]    Overall Loss 0.011212    Objective Loss 0.000000    Distill Loss 0.011212                     LR 0.001000    Time 0.257696    
+2023-11-30 10:41:54,502 - Epoch: [3][25600/31148]    Overall Loss 0.011211    Objective Loss 0.000000    Distill Loss 0.011211                     LR 0.001000    Time 0.257695    
+2023-11-30 10:42:20,225 - Epoch: [3][25700/31148]    Overall Loss 0.011210    Objective Loss 0.000000    Distill Loss 0.011210                     LR 0.001000    Time 0.257693    
+2023-11-30 10:42:46,027 - Epoch: [3][25800/31148]    Overall Loss 0.011210    Objective Loss 0.000000    Distill Loss 0.011210                     LR 0.001000    Time 0.257694    
+2023-11-30 10:43:11,729 - Epoch: [3][25900/31148]    Overall Loss 0.011209    Objective Loss 0.000000    Distill Loss 0.011209                     LR 0.001000    Time 0.257691    
+2023-11-30 10:43:37,471 - Epoch: [3][26000/31148]    Overall Loss 0.011209    Objective Loss 0.000000    Distill Loss 0.011209                     LR 0.001000    Time 0.257690    
+2023-11-30 10:44:03,169 - Epoch: [3][26100/31148]    Overall Loss 0.011208    Objective Loss 0.000000    Distill Loss 0.011208                     LR 0.001000    Time 0.257687    
+2023-11-30 10:44:28,930 - Epoch: [3][26200/31148]    Overall Loss 0.011207    Objective Loss 0.000000    Distill Loss 0.011207                     LR 0.001000    Time 0.257687    
+2023-11-30 10:44:54,696 - Epoch: [3][26300/31148]    Overall Loss 0.011206    Objective Loss 0.000000    Distill Loss 0.011206                     LR 0.001000    Time 0.257687    
+2023-11-30 10:45:20,504 - Epoch: [3][26400/31148]    Overall Loss 0.011206    Objective Loss 0.000000    Distill Loss 0.011206                     LR 0.001000    Time 0.257688    
+2023-11-30 10:45:46,271 - Epoch: [3][26500/31148]    Overall Loss 0.011205    Objective Loss 0.000000    Distill Loss 0.011205                     LR 0.001000    Time 0.257688    
+2023-11-30 10:46:12,017 - Epoch: [3][26600/31148]    Overall Loss 0.011204    Objective Loss 0.000000    Distill Loss 0.011204                     LR 0.001000    Time 0.257687    
+2023-11-30 10:46:37,759 - Epoch: [3][26700/31148]    Overall Loss 0.011204    Objective Loss 0.000000    Distill Loss 0.011204                     LR 0.001000    Time 0.257686    
+2023-11-30 10:47:03,537 - Epoch: [3][26800/31148]    Overall Loss 0.011204    Objective Loss 0.000000    Distill Loss 0.011204                     LR 0.001000    Time 0.257686    
+2023-11-30 10:47:29,282 - Epoch: [3][26900/31148]    Overall Loss 0.011203    Objective Loss 0.000000    Distill Loss 0.011203                     LR 0.001000    Time 0.257685    
+2023-11-30 10:47:55,018 - Epoch: [3][27000/31148]    Overall Loss 0.011202    Objective Loss 0.000000    Distill Loss 0.011202                     LR 0.001000    Time 0.257684    
+2023-11-30 10:48:20,786 - Epoch: [3][27100/31148]    Overall Loss 0.011201    Objective Loss 0.000000    Distill Loss 0.011201                     LR 0.001000    Time 0.257684    
+2023-11-30 10:48:46,488 - Epoch: [3][27200/31148]    Overall Loss 0.011201    Objective Loss 0.000000    Distill Loss 0.011201                     LR 0.001000    Time 0.257681    
+2023-11-30 10:49:12,199 - Epoch: [3][27300/31148]    Overall Loss 0.011200    Objective Loss 0.000000    Distill Loss 0.011200                     LR 0.001000    Time 0.257679    
+2023-11-30 10:49:37,953 - Epoch: [3][27400/31148]    Overall Loss 0.011199    Objective Loss 0.000000    Distill Loss 0.011199                     LR 0.001000    Time 0.257678    
+2023-11-30 10:50:03,702 - Epoch: [3][27500/31148]    Overall Loss 0.011199    Objective Loss 0.000000    Distill Loss 0.011199                     LR 0.001000    Time 0.257678    
+2023-11-30 10:50:29,424 - Epoch: [3][27600/31148]    Overall Loss 0.011198    Objective Loss 0.000000    Distill Loss 0.011198                     LR 0.001000    Time 0.257676    
+2023-11-30 10:50:55,213 - Epoch: [3][27700/31148]    Overall Loss 0.011198    Objective Loss 0.000000    Distill Loss 0.011198                     LR 0.001000    Time 0.257677    
+2023-11-30 10:51:20,984 - Epoch: [3][27800/31148]    Overall Loss 0.011197    Objective Loss 0.000000    Distill Loss 0.011197                     LR 0.001000    Time 0.257677    
+2023-11-30 10:51:46,676 - Epoch: [3][27900/31148]    Overall Loss 0.011196    Objective Loss 0.000000    Distill Loss 0.011196                     LR 0.001000    Time 0.257674    
+2023-11-30 10:52:12,359 - Epoch: [3][28000/31148]    Overall Loss 0.011195    Objective Loss 0.000000    Distill Loss 0.011195                     LR 0.001000    Time 0.257671    
+2023-11-30 10:52:38,121 - Epoch: [3][28100/31148]    Overall Loss 0.011194    Objective Loss 0.000000    Distill Loss 0.011194                     LR 0.001000    Time 0.257670    
+2023-11-30 10:53:03,854 - Epoch: [3][28200/31148]    Overall Loss 0.011193    Objective Loss 0.000000    Distill Loss 0.011193                     LR 0.001000    Time 0.257669    
+2023-11-30 10:53:29,682 - Epoch: [3][28300/31148]    Overall Loss 0.011193    Objective Loss 0.000000    Distill Loss 0.011193                     LR 0.001000    Time 0.257671    
+2023-11-30 10:53:55,483 - Epoch: [3][28400/31148]    Overall Loss 0.011192    Objective Loss 0.000000    Distill Loss 0.011192                     LR 0.001000    Time 0.257672    
+2023-11-30 10:54:21,211 - Epoch: [3][28500/31148]    Overall Loss 0.011192    Objective Loss 0.000000    Distill Loss 0.011192                     LR 0.001000    Time 0.257671    
+2023-11-30 10:54:46,910 - Epoch: [3][28600/31148]    Overall Loss 0.011192    Objective Loss 0.000000    Distill Loss 0.011192                     LR 0.001000    Time 0.257668    
+2023-11-30 10:55:12,640 - Epoch: [3][28700/31148]    Overall Loss 0.011191    Objective Loss 0.000000    Distill Loss 0.011191                     LR 0.001000    Time 0.257667    
+2023-11-30 10:55:38,342 - Epoch: [3][28800/31148]    Overall Loss 0.011190    Objective Loss 0.000000    Distill Loss 0.011190                     LR 0.001000    Time 0.257665    
+2023-11-30 10:56:04,085 - Epoch: [3][28900/31148]    Overall Loss 0.011190    Objective Loss 0.000000    Distill Loss 0.011190                     LR 0.001000    Time 0.257664    
+2023-11-30 10:56:29,828 - Epoch: [3][29000/31148]    Overall Loss 0.011189    Objective Loss 0.000000    Distill Loss 0.011189                     LR 0.001000    Time 0.257663    
+2023-11-30 10:56:55,518 - Epoch: [3][29100/31148]    Overall Loss 0.011189    Objective Loss 0.000000    Distill Loss 0.011189                     LR 0.001000    Time 0.257660    
+2023-11-30 10:57:21,252 - Epoch: [3][29200/31148]    Overall Loss 0.011188    Objective Loss 0.000000    Distill Loss 0.011188                     LR 0.001000    Time 0.257659    
+2023-11-30 10:57:46,992 - Epoch: [3][29300/31148]    Overall Loss 0.011187    Objective Loss 0.000000    Distill Loss 0.011187                     LR 0.001000    Time 0.257658    
+2023-11-30 10:58:12,728 - Epoch: [3][29400/31148]    Overall Loss 0.011186    Objective Loss 0.000000    Distill Loss 0.011186                     LR 0.001000    Time 0.257657    
+2023-11-30 10:58:38,444 - Epoch: [3][29500/31148]    Overall Loss 0.011186    Objective Loss 0.000000    Distill Loss 0.011186                     LR 0.001000    Time 0.257655    
+2023-11-30 10:59:04,228 - Epoch: [3][29600/31148]    Overall Loss 0.011184    Objective Loss 0.000000    Distill Loss 0.011184                     LR 0.001000    Time 0.257656    
+2023-11-30 10:59:29,989 - Epoch: [3][29700/31148]    Overall Loss 0.011184    Objective Loss 0.000000    Distill Loss 0.011184                     LR 0.001000    Time 0.257655    
+2023-11-30 10:59:55,691 - Epoch: [3][29800/31148]    Overall Loss 0.011183    Objective Loss 0.000000    Distill Loss 0.011183                     LR 0.001000    Time 0.257653    
+2023-11-30 11:00:21,434 - Epoch: [3][29900/31148]    Overall Loss 0.011183    Objective Loss 0.000000    Distill Loss 0.011183                     LR 0.001000    Time 0.257652    
+2023-11-30 11:00:47,215 - Epoch: [3][30000/31148]    Overall Loss 0.011182    Objective Loss 0.000000    Distill Loss 0.011182                     LR 0.001000    Time 0.257653    
+2023-11-30 11:01:12,927 - Epoch: [3][30100/31148]    Overall Loss 0.011182    Objective Loss 0.000000    Distill Loss 0.011182                     LR 0.001000    Time 0.257651    
+2023-11-30 11:01:38,662 - Epoch: [3][30200/31148]    Overall Loss 0.011181    Objective Loss 0.000000    Distill Loss 0.011181                     LR 0.001000    Time 0.257650    
+2023-11-30 11:02:04,385 - Epoch: [3][30300/31148]    Overall Loss 0.011180    Objective Loss 0.000000    Distill Loss 0.011180                     LR 0.001000    Time 0.257648    
+2023-11-30 11:02:30,149 - Epoch: [3][30400/31148]    Overall Loss 0.011179    Objective Loss 0.000000    Distill Loss 0.011179                     LR 0.001000    Time 0.257648    
+2023-11-30 11:02:55,856 - Epoch: [3][30500/31148]    Overall Loss 0.011179    Objective Loss 0.000000    Distill Loss 0.011179                     LR 0.001000    Time 0.257646    
+2023-11-30 11:03:21,656 - Epoch: [3][30600/31148]    Overall Loss 0.011178    Objective Loss 0.000000    Distill Loss 0.011178                     LR 0.001000    Time 0.257647    
+2023-11-30 11:03:47,428 - Epoch: [3][30700/31148]    Overall Loss 0.011177    Objective Loss 0.000000    Distill Loss 0.011177                     LR 0.001000    Time 0.257647    
+2023-11-30 11:04:13,115 - Epoch: [3][30800/31148]    Overall Loss 0.011177    Objective Loss 0.000000    Distill Loss 0.011177                     LR 0.001000    Time 0.257645    
+2023-11-30 11:04:38,863 - Epoch: [3][30900/31148]    Overall Loss 0.011176    Objective Loss 0.000000    Distill Loss 0.011176                     LR 0.001000    Time 0.257644    
+2023-11-30 11:05:04,580 - Epoch: [3][31000/31148]    Overall Loss 0.011176    Objective Loss 0.000000    Distill Loss 0.011176                     LR 0.001000    Time 0.257643    
+2023-11-30 11:05:30,324 - Epoch: [3][31100/31148]    Overall Loss 0.011175    Objective Loss 0.000000    Distill Loss 0.011175                     LR 0.001000    Time 0.257642    
+2023-11-30 11:05:43,087 - Epoch: [3][31148/31148]    Overall Loss 0.011175    Objective Loss 0.000000    Distill Loss 0.011175                     LR 0.001000    Time 0.257655    
+2023-11-30 11:05:43,451 - --- validate (epoch=3)-----------
+2023-11-30 11:05:43,451 - 167951 samples (100 per mini-batch)
+2023-11-30 11:06:04,381 - Epoch: [3][  100/ 1680]    Loss 0.000000    Overall Loss 0.011617    
+2023-11-30 11:06:24,086 - Epoch: [3][  200/ 1680]    Loss 0.000000    Overall Loss 0.011639    
+2023-11-30 11:06:43,797 - Epoch: [3][  300/ 1680]    Loss 0.000000    Overall Loss 0.011662    
+2023-11-30 11:07:03,513 - Epoch: [3][  400/ 1680]    Loss 0.000000    Overall Loss 0.011669    
+2023-11-30 11:07:23,213 - Epoch: [3][  500/ 1680]    Loss 0.000000    Overall Loss 0.011660    
+2023-11-30 11:07:42,891 - Epoch: [3][  600/ 1680]    Loss 0.000000    Overall Loss 0.011664    
+2023-11-30 11:08:02,618 - Epoch: [3][  700/ 1680]    Loss 0.000000    Overall Loss 0.011672    
+2023-11-30 11:08:22,303 - Epoch: [3][  800/ 1680]    Loss 0.000000    Overall Loss 0.011680    
+2023-11-30 11:08:42,026 - Epoch: [3][  900/ 1680]    Loss 0.000000    Overall Loss 0.011680    
+2023-11-30 11:09:01,714 - Epoch: [3][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.011686    
+2023-11-30 11:09:21,446 - Epoch: [3][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.011678    
+2023-11-30 11:09:41,141 - Epoch: [3][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.011674    
+2023-11-30 11:10:00,887 - Epoch: [3][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.011677    
+2023-11-30 11:10:20,598 - Epoch: [3][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.011679    
+2023-11-30 11:10:40,298 - Epoch: [3][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.011681    
+2023-11-30 11:11:00,029 - Epoch: [3][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.011681    
+2023-11-30 11:11:15,727 - Epoch: [3][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.011679    
+2023-11-30 11:11:15,932 - ==> Overall Loss: 0.012
+
+2023-11-30 11:11:15,936 - ==> Best [Overall Loss: 0.011679 on epoch: 3]
+2023-11-30 11:11:15,936 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 11:11:15,975 - 
+
+2023-11-30 11:11:15,975 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 11:11:47,789 - Epoch: [4][  100/31148]    Overall Loss 0.010907    Objective Loss 0.000000    Distill Loss 0.010907                     LR 0.001000    Time 0.318105    
+2023-11-30 11:12:13,522 - Epoch: [4][  200/31148]    Overall Loss 0.010843    Objective Loss 0.000000    Distill Loss 0.010843                     LR 0.001000    Time 0.287705    
+2023-11-30 11:12:39,266 - Epoch: [4][  300/31148]    Overall Loss 0.010866    Objective Loss 0.000000    Distill Loss 0.010866                     LR 0.001000    Time 0.277608    
+2023-11-30 11:13:05,059 - Epoch: [4][  400/31148]    Overall Loss 0.010871    Objective Loss 0.000000    Distill Loss 0.010871                     LR 0.001000    Time 0.272682    
+2023-11-30 11:13:30,818 - Epoch: [4][  500/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.269659    
+2023-11-30 11:13:56,594 - Epoch: [4][  600/31148]    Overall Loss 0.010891    Objective Loss 0.000000    Distill Loss 0.010891                     LR 0.001000    Time 0.267671    
+2023-11-30 11:14:22,372 - Epoch: [4][  700/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.266254    
+2023-11-30 11:14:48,052 - Epoch: [4][  800/31148]    Overall Loss 0.010909    Objective Loss 0.000000    Distill Loss 0.010909                     LR 0.001000    Time 0.265068    
+2023-11-30 11:15:13,781 - Epoch: [4][  900/31148]    Overall Loss 0.010906    Objective Loss 0.000000    Distill Loss 0.010906                     LR 0.001000    Time 0.264201    
+2023-11-30 11:15:39,522 - Epoch: [4][ 1000/31148]    Overall Loss 0.010902    Objective Loss 0.000000    Distill Loss 0.010902                     LR 0.001000    Time 0.263520    
+2023-11-30 11:16:05,271 - Epoch: [4][ 1100/31148]    Overall Loss 0.010906    Objective Loss 0.000000    Distill Loss 0.010906                     LR 0.001000    Time 0.262969    
+2023-11-30 11:16:30,976 - Epoch: [4][ 1200/31148]    Overall Loss 0.010902    Objective Loss 0.000000    Distill Loss 0.010902                     LR 0.001000    Time 0.262474    
+2023-11-30 11:16:56,711 - Epoch: [4][ 1300/31148]    Overall Loss 0.010901    Objective Loss 0.000000    Distill Loss 0.010901                     LR 0.001000    Time 0.262078    
+2023-11-30 11:17:22,439 - Epoch: [4][ 1400/31148]    Overall Loss 0.010901    Objective Loss 0.000000    Distill Loss 0.010901                     LR 0.001000    Time 0.261733    
+2023-11-30 11:17:48,162 - Epoch: [4][ 1500/31148]    Overall Loss 0.010901    Objective Loss 0.000000    Distill Loss 0.010901                     LR 0.001000    Time 0.261431    
+2023-11-30 11:18:13,938 - Epoch: [4][ 1600/31148]    Overall Loss 0.010899    Objective Loss 0.000000    Distill Loss 0.010899                     LR 0.001000    Time 0.261200    
+2023-11-30 11:18:39,660 - Epoch: [4][ 1700/31148]    Overall Loss 0.010899    Objective Loss 0.000000    Distill Loss 0.010899                     LR 0.001000    Time 0.260965    
+2023-11-30 11:19:05,379 - Epoch: [4][ 1800/31148]    Overall Loss 0.010900    Objective Loss 0.000000    Distill Loss 0.010900                     LR 0.001000    Time 0.260753    
+2023-11-30 11:19:31,084 - Epoch: [4][ 1900/31148]    Overall Loss 0.010899    Objective Loss 0.000000    Distill Loss 0.010899                     LR 0.001000    Time 0.260557    
+2023-11-30 11:19:56,819 - Epoch: [4][ 2000/31148]    Overall Loss 0.010902    Objective Loss 0.000000    Distill Loss 0.010902                     LR 0.001000    Time 0.260395    
+2023-11-30 11:20:22,522 - Epoch: [4][ 2100/31148]    Overall Loss 0.010910    Objective Loss 0.000000    Distill Loss 0.010910                     LR 0.001000    Time 0.260234    
+2023-11-30 11:20:48,286 - Epoch: [4][ 2200/31148]    Overall Loss 0.010912    Objective Loss 0.000000    Distill Loss 0.010912                     LR 0.001000    Time 0.260115    
+2023-11-30 11:21:14,060 - Epoch: [4][ 2300/31148]    Overall Loss 0.010915    Objective Loss 0.000000    Distill Loss 0.010915                     LR 0.001000    Time 0.260010    
+2023-11-30 11:21:39,799 - Epoch: [4][ 2400/31148]    Overall Loss 0.010917    Objective Loss 0.000000    Distill Loss 0.010917                     LR 0.001000    Time 0.259900    
+2023-11-30 11:22:05,579 - Epoch: [4][ 2500/31148]    Overall Loss 0.010913    Objective Loss 0.000000    Distill Loss 0.010913                     LR 0.001000    Time 0.259815    
+2023-11-30 11:22:31,313 - Epoch: [4][ 2600/31148]    Overall Loss 0.010918    Objective Loss 0.000000    Distill Loss 0.010918                     LR 0.001000    Time 0.259719    
+2023-11-30 11:22:57,029 - Epoch: [4][ 2700/31148]    Overall Loss 0.010918    Objective Loss 0.000000    Distill Loss 0.010918                     LR 0.001000    Time 0.259623    
+2023-11-30 11:23:22,745 - Epoch: [4][ 2800/31148]    Overall Loss 0.010916    Objective Loss 0.000000    Distill Loss 0.010916                     LR 0.001000    Time 0.259534    
+2023-11-30 11:23:48,473 - Epoch: [4][ 2900/31148]    Overall Loss 0.010913    Objective Loss 0.000000    Distill Loss 0.010913                     LR 0.001000    Time 0.259455    
+2023-11-30 11:24:14,213 - Epoch: [4][ 3000/31148]    Overall Loss 0.010911    Objective Loss 0.000000    Distill Loss 0.010911                     LR 0.001000    Time 0.259386    
+2023-11-30 11:24:39,935 - Epoch: [4][ 3100/31148]    Overall Loss 0.010908    Objective Loss 0.000000    Distill Loss 0.010908                     LR 0.001000    Time 0.259315    
+2023-11-30 11:25:05,707 - Epoch: [4][ 3200/31148]    Overall Loss 0.010911    Objective Loss 0.000000    Distill Loss 0.010911                     LR 0.001000    Time 0.259265    
+2023-11-30 11:25:31,434 - Epoch: [4][ 3300/31148]    Overall Loss 0.010912    Objective Loss 0.000000    Distill Loss 0.010912                     LR 0.001000    Time 0.259203    
+2023-11-30 11:25:57,135 - Epoch: [4][ 3400/31148]    Overall Loss 0.010915    Objective Loss 0.000000    Distill Loss 0.010915                     LR 0.001000    Time 0.259138    
+2023-11-30 11:26:22,823 - Epoch: [4][ 3500/31148]    Overall Loss 0.010912    Objective Loss 0.000000    Distill Loss 0.010912                     LR 0.001000    Time 0.259073    
+2023-11-30 11:26:48,553 - Epoch: [4][ 3600/31148]    Overall Loss 0.010916    Objective Loss 0.000000    Distill Loss 0.010916                     LR 0.001000    Time 0.259023    
+2023-11-30 11:27:14,264 - Epoch: [4][ 3700/31148]    Overall Loss 0.010919    Objective Loss 0.000000    Distill Loss 0.010919                     LR 0.001000    Time 0.258970    
+2023-11-30 11:27:39,933 - Epoch: [4][ 3800/31148]    Overall Loss 0.010919    Objective Loss 0.000000    Distill Loss 0.010919                     LR 0.001000    Time 0.258910    
+2023-11-30 11:28:05,651 - Epoch: [4][ 3900/31148]    Overall Loss 0.010921    Objective Loss 0.000000    Distill Loss 0.010921                     LR 0.001000    Time 0.258865    
+2023-11-30 11:28:31,376 - Epoch: [4][ 4000/31148]    Overall Loss 0.010920    Objective Loss 0.000000    Distill Loss 0.010920                     LR 0.001000    Time 0.258824    
+2023-11-30 11:28:57,102 - Epoch: [4][ 4100/31148]    Overall Loss 0.010921    Objective Loss 0.000000    Distill Loss 0.010921                     LR 0.001000    Time 0.258785    
+2023-11-30 11:29:22,831 - Epoch: [4][ 4200/31148]    Overall Loss 0.010921    Objective Loss 0.000000    Distill Loss 0.010921                     LR 0.001000    Time 0.258749    
+2023-11-30 11:29:48,542 - Epoch: [4][ 4300/31148]    Overall Loss 0.010926    Objective Loss 0.000000    Distill Loss 0.010926                     LR 0.001000    Time 0.258710    
+2023-11-30 11:30:14,339 - Epoch: [4][ 4400/31148]    Overall Loss 0.010921    Objective Loss 0.000000    Distill Loss 0.010921                     LR 0.001000    Time 0.258693    
+2023-11-30 11:30:40,086 - Epoch: [4][ 4500/31148]    Overall Loss 0.010921    Objective Loss 0.000000    Distill Loss 0.010921                     LR 0.001000    Time 0.258665    
+2023-11-30 11:31:05,819 - Epoch: [4][ 4600/31148]    Overall Loss 0.010920    Objective Loss 0.000000    Distill Loss 0.010920                     LR 0.001000    Time 0.258636    
+2023-11-30 11:31:31,529 - Epoch: [4][ 4700/31148]    Overall Loss 0.010920    Objective Loss 0.000000    Distill Loss 0.010920                     LR 0.001000    Time 0.258602    
+2023-11-30 11:31:57,237 - Epoch: [4][ 4800/31148]    Overall Loss 0.010919    Objective Loss 0.000000    Distill Loss 0.010919                     LR 0.001000    Time 0.258570    
+2023-11-30 11:32:22,912 - Epoch: [4][ 4900/31148]    Overall Loss 0.010918    Objective Loss 0.000000    Distill Loss 0.010918                     LR 0.001000    Time 0.258532    
+2023-11-30 11:32:48,689 - Epoch: [4][ 5000/31148]    Overall Loss 0.010918    Objective Loss 0.000000    Distill Loss 0.010918                     LR 0.001000    Time 0.258517    
+2023-11-30 11:33:14,468 - Epoch: [4][ 5100/31148]    Overall Loss 0.010917    Objective Loss 0.000000    Distill Loss 0.010917                     LR 0.001000    Time 0.258502    
+2023-11-30 11:33:40,198 - Epoch: [4][ 5200/31148]    Overall Loss 0.010917    Objective Loss 0.000000    Distill Loss 0.010917                     LR 0.001000    Time 0.258478    
+2023-11-30 11:34:05,952 - Epoch: [4][ 5300/31148]    Overall Loss 0.010916    Objective Loss 0.000000    Distill Loss 0.010916                     LR 0.001000    Time 0.258460    
+2023-11-30 11:34:31,743 - Epoch: [4][ 5400/31148]    Overall Loss 0.010917    Objective Loss 0.000000    Distill Loss 0.010917                     LR 0.001000    Time 0.258449    
+2023-11-30 11:34:57,512 - Epoch: [4][ 5500/31148]    Overall Loss 0.010916    Objective Loss 0.000000    Distill Loss 0.010916                     LR 0.001000    Time 0.258435    
+2023-11-30 11:35:23,210 - Epoch: [4][ 5600/31148]    Overall Loss 0.010916    Objective Loss 0.000000    Distill Loss 0.010916                     LR 0.001000    Time 0.258408    
+2023-11-30 11:35:48,965 - Epoch: [4][ 5700/31148]    Overall Loss 0.010914    Objective Loss 0.000000    Distill Loss 0.010914                     LR 0.001000    Time 0.258393    
+2023-11-30 11:36:14,722 - Epoch: [4][ 5800/31148]    Overall Loss 0.010911    Objective Loss 0.000000    Distill Loss 0.010911                     LR 0.001000    Time 0.258378    
+2023-11-30 11:36:40,519 - Epoch: [4][ 5900/31148]    Overall Loss 0.010908    Objective Loss 0.000000    Distill Loss 0.010908                     LR 0.001000    Time 0.258371    
+2023-11-30 11:37:06,259 - Epoch: [4][ 6000/31148]    Overall Loss 0.010907    Objective Loss 0.000000    Distill Loss 0.010907                     LR 0.001000    Time 0.258354    
+2023-11-30 11:37:32,009 - Epoch: [4][ 6100/31148]    Overall Loss 0.010906    Objective Loss 0.000000    Distill Loss 0.010906                     LR 0.001000    Time 0.258340    
+2023-11-30 11:37:57,786 - Epoch: [4][ 6200/31148]    Overall Loss 0.010904    Objective Loss 0.000000    Distill Loss 0.010904                     LR 0.001000    Time 0.258330    
+2023-11-30 11:38:23,542 - Epoch: [4][ 6300/31148]    Overall Loss 0.010901    Objective Loss 0.000000    Distill Loss 0.010901                     LR 0.001000    Time 0.258318    
+2023-11-30 11:38:49,284 - Epoch: [4][ 6400/31148]    Overall Loss 0.010900    Objective Loss 0.000000    Distill Loss 0.010900                     LR 0.001000    Time 0.258303    
+2023-11-30 11:39:15,043 - Epoch: [4][ 6500/31148]    Overall Loss 0.010898    Objective Loss 0.000000    Distill Loss 0.010898                     LR 0.001000    Time 0.258292    
+2023-11-30 11:39:40,796 - Epoch: [4][ 6600/31148]    Overall Loss 0.010896    Objective Loss 0.000000    Distill Loss 0.010896                     LR 0.001000    Time 0.258280    
+2023-11-30 11:40:06,545 - Epoch: [4][ 6700/31148]    Overall Loss 0.010895    Objective Loss 0.000000    Distill Loss 0.010895                     LR 0.001000    Time 0.258268    
+2023-11-30 11:40:32,279 - Epoch: [4][ 6800/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.258254    
+2023-11-30 11:40:58,011 - Epoch: [4][ 6900/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.258240    
+2023-11-30 11:41:23,695 - Epoch: [4][ 7000/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.258219    
+2023-11-30 11:41:49,421 - Epoch: [4][ 7100/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.258206    
+2023-11-30 11:42:15,143 - Epoch: [4][ 7200/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.258192    
+2023-11-30 11:42:40,872 - Epoch: [4][ 7300/31148]    Overall Loss 0.010895    Objective Loss 0.000000    Distill Loss 0.010895                     LR 0.001000    Time 0.258179    
+2023-11-30 11:43:06,587 - Epoch: [4][ 7400/31148]    Overall Loss 0.010895    Objective Loss 0.000000    Distill Loss 0.010895                     LR 0.001000    Time 0.258165    
+2023-11-30 11:43:32,363 - Epoch: [4][ 7500/31148]    Overall Loss 0.010895    Objective Loss 0.000000    Distill Loss 0.010895                     LR 0.001000    Time 0.258159    
+2023-11-30 11:43:58,126 - Epoch: [4][ 7600/31148]    Overall Loss 0.010894    Objective Loss 0.000000    Distill Loss 0.010894                     LR 0.001000    Time 0.258151    
+2023-11-30 11:44:23,888 - Epoch: [4][ 7700/31148]    Overall Loss 0.010892    Objective Loss 0.000000    Distill Loss 0.010892                     LR 0.001000    Time 0.258144    
+2023-11-30 11:44:49,616 - Epoch: [4][ 7800/31148]    Overall Loss 0.010889    Objective Loss 0.000000    Distill Loss 0.010889                     LR 0.001000    Time 0.258133    
+2023-11-30 11:45:15,412 - Epoch: [4][ 7900/31148]    Overall Loss 0.010888    Objective Loss 0.000000    Distill Loss 0.010888                     LR 0.001000    Time 0.258130    
+2023-11-30 11:45:41,123 - Epoch: [4][ 8000/31148]    Overall Loss 0.010886    Objective Loss 0.000000    Distill Loss 0.010886                     LR 0.001000    Time 0.258117    
+2023-11-30 11:46:06,822 - Epoch: [4][ 8100/31148]    Overall Loss 0.010887    Objective Loss 0.000000    Distill Loss 0.010887                     LR 0.001000    Time 0.258103    
+2023-11-30 11:46:32,552 - Epoch: [4][ 8200/31148]    Overall Loss 0.010885    Objective Loss 0.000000    Distill Loss 0.010885                     LR 0.001000    Time 0.258093    
+2023-11-30 11:46:58,305 - Epoch: [4][ 8300/31148]    Overall Loss 0.010885    Objective Loss 0.000000    Distill Loss 0.010885                     LR 0.001000    Time 0.258086    
+2023-11-30 11:47:24,061 - Epoch: [4][ 8400/31148]    Overall Loss 0.010885    Objective Loss 0.000000    Distill Loss 0.010885                     LR 0.001000    Time 0.258079    
+2023-11-30 11:47:49,769 - Epoch: [4][ 8500/31148]    Overall Loss 0.010885    Objective Loss 0.000000    Distill Loss 0.010885                     LR 0.001000    Time 0.258067    
+2023-11-30 11:48:15,518 - Epoch: [4][ 8600/31148]    Overall Loss 0.010884    Objective Loss 0.000000    Distill Loss 0.010884                     LR 0.001000    Time 0.258060    
+2023-11-30 11:48:41,315 - Epoch: [4][ 8700/31148]    Overall Loss 0.010885    Objective Loss 0.000000    Distill Loss 0.010885                     LR 0.001000    Time 0.258059    
+2023-11-30 11:49:07,004 - Epoch: [4][ 8800/31148]    Overall Loss 0.010884    Objective Loss 0.000000    Distill Loss 0.010884                     LR 0.001000    Time 0.258045    
+2023-11-30 11:49:32,771 - Epoch: [4][ 8900/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.258041    
+2023-11-30 11:49:58,514 - Epoch: [4][ 9000/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.258034    
+2023-11-30 11:50:24,228 - Epoch: [4][ 9100/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.258024    
+2023-11-30 11:50:49,948 - Epoch: [4][ 9200/31148]    Overall Loss 0.010883    Objective Loss 0.000000    Distill Loss 0.010883                     LR 0.001000    Time 0.258014    
+2023-11-30 11:51:15,697 - Epoch: [4][ 9300/31148]    Overall Loss 0.010883    Objective Loss 0.000000    Distill Loss 0.010883                     LR 0.001000    Time 0.258008    
+2023-11-30 11:51:41,454 - Epoch: [4][ 9400/31148]    Overall Loss 0.010883    Objective Loss 0.000000    Distill Loss 0.010883                     LR 0.001000    Time 0.258003    
+2023-11-30 11:52:07,176 - Epoch: [4][ 9500/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.257995    
+2023-11-30 11:52:32,987 - Epoch: [4][ 9600/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.257996    
+2023-11-30 11:52:58,762 - Epoch: [4][ 9700/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.257993    
+2023-11-30 11:53:24,494 - Epoch: [4][ 9800/31148]    Overall Loss 0.010882    Objective Loss 0.000000    Distill Loss 0.010882                     LR 0.001000    Time 0.257986    
+2023-11-30 11:53:50,210 - Epoch: [4][ 9900/31148]    Overall Loss 0.010880    Objective Loss 0.000000    Distill Loss 0.010880                     LR 0.001000    Time 0.257977    
+2023-11-30 11:54:15,987 - Epoch: [4][10000/31148]    Overall Loss 0.010879    Objective Loss 0.000000    Distill Loss 0.010879                     LR 0.001000    Time 0.257975    
+2023-11-30 11:54:41,722 - Epoch: [4][10100/31148]    Overall Loss 0.010877    Objective Loss 0.000000    Distill Loss 0.010877                     LR 0.001000    Time 0.257969    
+2023-11-30 11:55:07,492 - Epoch: [4][10200/31148]    Overall Loss 0.010876    Objective Loss 0.000000    Distill Loss 0.010876                     LR 0.001000    Time 0.257966    
+2023-11-30 11:55:33,250 - Epoch: [4][10300/31148]    Overall Loss 0.010876    Objective Loss 0.000000    Distill Loss 0.010876                     LR 0.001000    Time 0.257962    
+2023-11-30 11:55:58,973 - Epoch: [4][10400/31148]    Overall Loss 0.010875    Objective Loss 0.000000    Distill Loss 0.010875                     LR 0.001000    Time 0.257954    
+2023-11-30 11:56:24,743 - Epoch: [4][10500/31148]    Overall Loss 0.010873    Objective Loss 0.000000    Distill Loss 0.010873                     LR 0.001000    Time 0.257952    
+2023-11-30 11:56:50,486 - Epoch: [4][10600/31148]    Overall Loss 0.010873    Objective Loss 0.000000    Distill Loss 0.010873                     LR 0.001000    Time 0.257946    
+2023-11-30 11:57:16,239 - Epoch: [4][10700/31148]    Overall Loss 0.010871    Objective Loss 0.000000    Distill Loss 0.010871                     LR 0.001000    Time 0.257942    
+2023-11-30 11:57:41,970 - Epoch: [4][10800/31148]    Overall Loss 0.010871    Objective Loss 0.000000    Distill Loss 0.010871                     LR 0.001000    Time 0.257936    
+2023-11-30 11:58:07,646 - Epoch: [4][10900/31148]    Overall Loss 0.010871    Objective Loss 0.000000    Distill Loss 0.010871                     LR 0.001000    Time 0.257925    
+2023-11-30 11:58:33,462 - Epoch: [4][11000/31148]    Overall Loss 0.010870    Objective Loss 0.000000    Distill Loss 0.010870                     LR 0.001000    Time 0.257927    
+2023-11-30 11:58:59,193 - Epoch: [4][11100/31148]    Overall Loss 0.010869    Objective Loss 0.000000    Distill Loss 0.010869                     LR 0.001000    Time 0.257921    
+2023-11-30 11:59:24,942 - Epoch: [4][11200/31148]    Overall Loss 0.010867    Objective Loss 0.000000    Distill Loss 0.010867                     LR 0.001000    Time 0.257917    
+2023-11-30 11:59:50,693 - Epoch: [4][11300/31148]    Overall Loss 0.010867    Objective Loss 0.000000    Distill Loss 0.010867                     LR 0.001000    Time 0.257913    
+2023-11-30 12:00:16,484 - Epoch: [4][11400/31148]    Overall Loss 0.010868    Objective Loss 0.000000    Distill Loss 0.010868                     LR 0.001000    Time 0.257913    
+2023-11-30 12:00:42,252 - Epoch: [4][11500/31148]    Overall Loss 0.010867    Objective Loss 0.000000    Distill Loss 0.010867                     LR 0.001000    Time 0.257911    
+2023-11-30 12:01:07,968 - Epoch: [4][11600/31148]    Overall Loss 0.010867    Objective Loss 0.000000    Distill Loss 0.010867                     LR 0.001000    Time 0.257904    
+2023-11-30 12:01:33,710 - Epoch: [4][11700/31148]    Overall Loss 0.010865    Objective Loss 0.000000    Distill Loss 0.010865                     LR 0.001000    Time 0.257900    
+2023-11-30 12:01:59,482 - Epoch: [4][11800/31148]    Overall Loss 0.010865    Objective Loss 0.000000    Distill Loss 0.010865                     LR 0.001000    Time 0.257898    
+2023-11-30 12:02:25,205 - Epoch: [4][11900/31148]    Overall Loss 0.010864    Objective Loss 0.000000    Distill Loss 0.010864                     LR 0.001000    Time 0.257892    
+2023-11-30 12:02:50,941 - Epoch: [4][12000/31148]    Overall Loss 0.010865    Objective Loss 0.000000    Distill Loss 0.010865                     LR 0.001000    Time 0.257888    
+2023-11-30 12:03:16,677 - Epoch: [4][12100/31148]    Overall Loss 0.010865    Objective Loss 0.000000    Distill Loss 0.010865                     LR 0.001000    Time 0.257883    
+2023-11-30 12:03:42,382 - Epoch: [4][12200/31148]    Overall Loss 0.010864    Objective Loss 0.000000    Distill Loss 0.010864                     LR 0.001000    Time 0.257876    
+2023-11-30 12:04:08,153 - Epoch: [4][12300/31148]    Overall Loss 0.010863    Objective Loss 0.000000    Distill Loss 0.010863                     LR 0.001000    Time 0.257874    
+2023-11-30 12:04:33,877 - Epoch: [4][12400/31148]    Overall Loss 0.010863    Objective Loss 0.000000    Distill Loss 0.010863                     LR 0.001000    Time 0.257869    
+2023-11-30 12:04:59,611 - Epoch: [4][12500/31148]    Overall Loss 0.010862    Objective Loss 0.000000    Distill Loss 0.010862                     LR 0.001000    Time 0.257865    
+2023-11-30 12:05:25,394 - Epoch: [4][12600/31148]    Overall Loss 0.010861    Objective Loss 0.000000    Distill Loss 0.010861                     LR 0.001000    Time 0.257864    
+2023-11-30 12:05:51,142 - Epoch: [4][12700/31148]    Overall Loss 0.010860    Objective Loss 0.000000    Distill Loss 0.010860                     LR 0.001000    Time 0.257861    
+2023-11-30 12:06:16,826 - Epoch: [4][12800/31148]    Overall Loss 0.010860    Objective Loss 0.000000    Distill Loss 0.010860                     LR 0.001000    Time 0.257853    
+2023-11-30 12:06:42,593 - Epoch: [4][12900/31148]    Overall Loss 0.010860    Objective Loss 0.000000    Distill Loss 0.010860                     LR 0.001000    Time 0.257851    
+2023-11-30 12:07:08,343 - Epoch: [4][13000/31148]    Overall Loss 0.010860    Objective Loss 0.000000    Distill Loss 0.010860                     LR 0.001000    Time 0.257848    
+2023-11-30 12:07:34,107 - Epoch: [4][13100/31148]    Overall Loss 0.010861    Objective Loss 0.000000    Distill Loss 0.010861                     LR 0.001000    Time 0.257846    
+2023-11-30 12:07:59,879 - Epoch: [4][13200/31148]    Overall Loss 0.010860    Objective Loss 0.000000    Distill Loss 0.010860                     LR 0.001000    Time 0.257845    
+2023-11-30 12:08:25,650 - Epoch: [4][13300/31148]    Overall Loss 0.010859    Objective Loss 0.000000    Distill Loss 0.010859                     LR 0.001000    Time 0.257844    
+2023-11-30 12:08:51,424 - Epoch: [4][13400/31148]    Overall Loss 0.010859    Objective Loss 0.000000    Distill Loss 0.010859                     LR 0.001000    Time 0.257843    
+2023-11-30 12:09:17,191 - Epoch: [4][13500/31148]    Overall Loss 0.010859    Objective Loss 0.000000    Distill Loss 0.010859                     LR 0.001000    Time 0.257842    
+2023-11-30 12:09:42,946 - Epoch: [4][13600/31148]    Overall Loss 0.010858    Objective Loss 0.000000    Distill Loss 0.010858                     LR 0.001000    Time 0.257839    
+2023-11-30 12:10:08,733 - Epoch: [4][13700/31148]    Overall Loss 0.010857    Objective Loss 0.000000    Distill Loss 0.010857                     LR 0.001000    Time 0.257839    
+2023-11-30 12:10:34,475 - Epoch: [4][13800/31148]    Overall Loss 0.010858    Objective Loss 0.000000    Distill Loss 0.010858                     LR 0.001000    Time 0.257836    
+2023-11-30 12:11:00,226 - Epoch: [4][13900/31148]    Overall Loss 0.010857    Objective Loss 0.000000    Distill Loss 0.010857                     LR 0.001000    Time 0.257833    
+2023-11-30 12:11:25,943 - Epoch: [4][14000/31148]    Overall Loss 0.010857    Objective Loss 0.000000    Distill Loss 0.010857                     LR 0.001000    Time 0.257829    
+2023-11-30 12:11:51,768 - Epoch: [4][14100/31148]    Overall Loss 0.010857    Objective Loss 0.000000    Distill Loss 0.010857                     LR 0.001000    Time 0.257831    
+2023-11-30 12:12:17,522 - Epoch: [4][14200/31148]    Overall Loss 0.010856    Objective Loss 0.000000    Distill Loss 0.010856                     LR 0.001000    Time 0.257829    
+2023-11-30 12:12:43,294 - Epoch: [4][14300/31148]    Overall Loss 0.010855    Objective Loss 0.000000    Distill Loss 0.010855                     LR 0.001000    Time 0.257828    
+2023-11-30 12:13:09,022 - Epoch: [4][14400/31148]    Overall Loss 0.010854    Objective Loss 0.000000    Distill Loss 0.010854                     LR 0.001000    Time 0.257824    
+2023-11-30 12:13:34,728 - Epoch: [4][14500/31148]    Overall Loss 0.010853    Objective Loss 0.000000    Distill Loss 0.010853                     LR 0.001000    Time 0.257819    
+2023-11-30 12:14:00,452 - Epoch: [4][14600/31148]    Overall Loss 0.010853    Objective Loss 0.000000    Distill Loss 0.010853                     LR 0.001000    Time 0.257815    
+2023-11-30 12:14:26,195 - Epoch: [4][14700/31148]    Overall Loss 0.010852    Objective Loss 0.000000    Distill Loss 0.010852                     LR 0.001000    Time 0.257812    
+2023-11-30 12:14:51,957 - Epoch: [4][14800/31148]    Overall Loss 0.010851    Objective Loss 0.000000    Distill Loss 0.010851                     LR 0.001000    Time 0.257810    
+2023-11-30 12:15:17,707 - Epoch: [4][14900/31148]    Overall Loss 0.010850    Objective Loss 0.000000    Distill Loss 0.010850                     LR 0.001000    Time 0.257808    
+2023-11-30 12:15:43,422 - Epoch: [4][15000/31148]    Overall Loss 0.010851    Objective Loss 0.000000    Distill Loss 0.010851                     LR 0.001000    Time 0.257803    
+2023-11-30 12:16:09,197 - Epoch: [4][15100/31148]    Overall Loss 0.010851    Objective Loss 0.000000    Distill Loss 0.010851                     LR 0.001000    Time 0.257803    
+2023-11-30 12:16:34,950 - Epoch: [4][15200/31148]    Overall Loss 0.010851    Objective Loss 0.000000    Distill Loss 0.010851                     LR 0.001000    Time 0.257801    
+2023-11-30 12:17:00,717 - Epoch: [4][15300/31148]    Overall Loss 0.010850    Objective Loss 0.000000    Distill Loss 0.010850                     LR 0.001000    Time 0.257800    
+2023-11-30 12:17:26,484 - Epoch: [4][15400/31148]    Overall Loss 0.010850    Objective Loss 0.000000    Distill Loss 0.010850                     LR 0.001000    Time 0.257799    
+2023-11-30 12:17:52,301 - Epoch: [4][15500/31148]    Overall Loss 0.010850    Objective Loss 0.000000    Distill Loss 0.010850                     LR 0.001000    Time 0.257801    
+2023-11-30 12:18:18,052 - Epoch: [4][15600/31148]    Overall Loss 0.010849    Objective Loss 0.000000    Distill Loss 0.010849                     LR 0.001000    Time 0.257799    
+2023-11-30 12:18:43,859 - Epoch: [4][15700/31148]    Overall Loss 0.010849    Objective Loss 0.000000    Distill Loss 0.010849                     LR 0.001000    Time 0.257801    
+2023-11-30 12:19:09,562 - Epoch: [4][15800/31148]    Overall Loss 0.010849    Objective Loss 0.000000    Distill Loss 0.010849                     LR 0.001000    Time 0.257796    
+2023-11-30 12:19:35,317 - Epoch: [4][15900/31148]    Overall Loss 0.010848    Objective Loss 0.000000    Distill Loss 0.010848                     LR 0.001000    Time 0.257794    
+2023-11-30 12:20:01,053 - Epoch: [4][16000/31148]    Overall Loss 0.010848    Objective Loss 0.000000    Distill Loss 0.010848                     LR 0.001000    Time 0.257791    
+2023-11-30 12:20:26,778 - Epoch: [4][16100/31148]    Overall Loss 0.010847    Objective Loss 0.000000    Distill Loss 0.010847                     LR 0.001000    Time 0.257788    
+2023-11-30 12:20:52,516 - Epoch: [4][16200/31148]    Overall Loss 0.010847    Objective Loss 0.000000    Distill Loss 0.010847                     LR 0.001000    Time 0.257785    
+2023-11-30 12:21:18,257 - Epoch: [4][16300/31148]    Overall Loss 0.010847    Objective Loss 0.000000    Distill Loss 0.010847                     LR 0.001000    Time 0.257782    
+2023-11-30 12:21:43,979 - Epoch: [4][16400/31148]    Overall Loss 0.010847    Objective Loss 0.000000    Distill Loss 0.010847                     LR 0.001000    Time 0.257779    
+2023-11-30 12:22:09,752 - Epoch: [4][16500/31148]    Overall Loss 0.010847    Objective Loss 0.000000    Distill Loss 0.010847                     LR 0.001000    Time 0.257778    
+2023-11-30 12:22:35,460 - Epoch: [4][16600/31148]    Overall Loss 0.010846    Objective Loss 0.000000    Distill Loss 0.010846                     LR 0.001000    Time 0.257774    
+2023-11-30 12:23:01,241 - Epoch: [4][16700/31148]    Overall Loss 0.010845    Objective Loss 0.000000    Distill Loss 0.010845                     LR 0.001000    Time 0.257774    
+2023-11-30 12:23:27,025 - Epoch: [4][16800/31148]    Overall Loss 0.010844    Objective Loss 0.000000    Distill Loss 0.010844                     LR 0.001000    Time 0.257774    
+2023-11-30 12:23:52,739 - Epoch: [4][16900/31148]    Overall Loss 0.010843    Objective Loss 0.000000    Distill Loss 0.010843                     LR 0.001000    Time 0.257770    
+2023-11-30 12:24:18,468 - Epoch: [4][17000/31148]    Overall Loss 0.010842    Objective Loss 0.000000    Distill Loss 0.010842                     LR 0.001000    Time 0.257767    
+2023-11-30 12:24:44,223 - Epoch: [4][17100/31148]    Overall Loss 0.010843    Objective Loss 0.000000    Distill Loss 0.010843                     LR 0.001000    Time 0.257766    
+2023-11-30 12:25:09,953 - Epoch: [4][17200/31148]    Overall Loss 0.010842    Objective Loss 0.000000    Distill Loss 0.010842                     LR 0.001000    Time 0.257763    
+2023-11-30 12:25:35,697 - Epoch: [4][17300/31148]    Overall Loss 0.010842    Objective Loss 0.000000    Distill Loss 0.010842                     LR 0.001000    Time 0.257761    
+2023-11-30 12:26:01,485 - Epoch: [4][17400/31148]    Overall Loss 0.010842    Objective Loss 0.000000    Distill Loss 0.010842                     LR 0.001000    Time 0.257762    
+2023-11-30 12:26:27,230 - Epoch: [4][17500/31148]    Overall Loss 0.010841    Objective Loss 0.000000    Distill Loss 0.010841                     LR 0.001000    Time 0.257760    
+2023-11-30 12:26:52,963 - Epoch: [4][17600/31148]    Overall Loss 0.010840    Objective Loss 0.000000    Distill Loss 0.010840                     LR 0.001000    Time 0.257757    
+2023-11-30 12:27:18,760 - Epoch: [4][17700/31148]    Overall Loss 0.010838    Objective Loss 0.000000    Distill Loss 0.010838                     LR 0.001000    Time 0.257758    
+2023-11-30 12:27:44,448 - Epoch: [4][17800/31148]    Overall Loss 0.010838    Objective Loss 0.000000    Distill Loss 0.010838                     LR 0.001000    Time 0.257753    
+2023-11-30 12:28:10,199 - Epoch: [4][17900/31148]    Overall Loss 0.010837    Objective Loss 0.000000    Distill Loss 0.010837                     LR 0.001000    Time 0.257752    
+2023-11-30 12:28:35,912 - Epoch: [4][18000/31148]    Overall Loss 0.010836    Objective Loss 0.000000    Distill Loss 0.010836                     LR 0.001000    Time 0.257748    
+2023-11-30 12:29:01,631 - Epoch: [4][18100/31148]    Overall Loss 0.010835    Objective Loss 0.000000    Distill Loss 0.010835                     LR 0.001000    Time 0.257745    
+2023-11-30 12:29:27,364 - Epoch: [4][18200/31148]    Overall Loss 0.010835    Objective Loss 0.000000    Distill Loss 0.010835                     LR 0.001000    Time 0.257742    
+2023-11-30 12:29:53,154 - Epoch: [4][18300/31148]    Overall Loss 0.010834    Objective Loss 0.000000    Distill Loss 0.010834                     LR 0.001000    Time 0.257743    
+2023-11-30 12:30:18,865 - Epoch: [4][18400/31148]    Overall Loss 0.010834    Objective Loss 0.000000    Distill Loss 0.010834                     LR 0.001000    Time 0.257739    
+2023-11-30 12:30:44,598 - Epoch: [4][18500/31148]    Overall Loss 0.010833    Objective Loss 0.000000    Distill Loss 0.010833                     LR 0.001000    Time 0.257737    
+2023-11-30 12:31:10,421 - Epoch: [4][18600/31148]    Overall Loss 0.010832    Objective Loss 0.000000    Distill Loss 0.010832                     LR 0.001000    Time 0.257740    
+2023-11-30 12:31:36,221 - Epoch: [4][18700/31148]    Overall Loss 0.010832    Objective Loss 0.000000    Distill Loss 0.010832                     LR 0.001000    Time 0.257741    
+2023-11-30 12:32:01,940 - Epoch: [4][18800/31148]    Overall Loss 0.010831    Objective Loss 0.000000    Distill Loss 0.010831                     LR 0.001000    Time 0.257738    
+2023-11-30 12:32:27,698 - Epoch: [4][18900/31148]    Overall Loss 0.010831    Objective Loss 0.000000    Distill Loss 0.010831                     LR 0.001000    Time 0.257737    
+2023-11-30 12:32:53,402 - Epoch: [4][19000/31148]    Overall Loss 0.010831    Objective Loss 0.000000    Distill Loss 0.010831                     LR 0.001000    Time 0.257733    
+2023-11-30 12:33:19,184 - Epoch: [4][19100/31148]    Overall Loss 0.010830    Objective Loss 0.000000    Distill Loss 0.010830                     LR 0.001000    Time 0.257733    
+2023-11-30 12:33:44,929 - Epoch: [4][19200/31148]    Overall Loss 0.010830    Objective Loss 0.000000    Distill Loss 0.010830                     LR 0.001000    Time 0.257732    
+2023-11-30 12:34:10,680 - Epoch: [4][19300/31148]    Overall Loss 0.010829    Objective Loss 0.000000    Distill Loss 0.010829                     LR 0.001000    Time 0.257730    
+2023-11-30 12:34:36,473 - Epoch: [4][19400/31148]    Overall Loss 0.010830    Objective Loss 0.000000    Distill Loss 0.010830                     LR 0.001000    Time 0.257731    
+2023-11-30 12:35:02,245 - Epoch: [4][19500/31148]    Overall Loss 0.010830    Objective Loss 0.000000    Distill Loss 0.010830                     LR 0.001000    Time 0.257731    
+2023-11-30 12:35:28,011 - Epoch: [4][19600/31148]    Overall Loss 0.010829    Objective Loss 0.000000    Distill Loss 0.010829                     LR 0.001000    Time 0.257731    
+2023-11-30 12:35:53,783 - Epoch: [4][19700/31148]    Overall Loss 0.010829    Objective Loss 0.000000    Distill Loss 0.010829                     LR 0.001000    Time 0.257730    
+2023-11-30 12:36:19,467 - Epoch: [4][19800/31148]    Overall Loss 0.010829    Objective Loss 0.000000    Distill Loss 0.010829                     LR 0.001000    Time 0.257726    
+2023-11-30 12:36:45,222 - Epoch: [4][19900/31148]    Overall Loss 0.010828    Objective Loss 0.000000    Distill Loss 0.010828                     LR 0.001000    Time 0.257725    
+2023-11-30 12:37:10,968 - Epoch: [4][20000/31148]    Overall Loss 0.010828    Objective Loss 0.000000    Distill Loss 0.010828                     LR 0.001000    Time 0.257723    
+2023-11-30 12:37:36,681 - Epoch: [4][20100/31148]    Overall Loss 0.010828    Objective Loss 0.000000    Distill Loss 0.010828                     LR 0.001000    Time 0.257720    
+2023-11-30 12:38:02,415 - Epoch: [4][20200/31148]    Overall Loss 0.010828    Objective Loss 0.000000    Distill Loss 0.010828                     LR 0.001000    Time 0.257718    
+2023-11-30 12:38:28,166 - Epoch: [4][20300/31148]    Overall Loss 0.010827    Objective Loss 0.000000    Distill Loss 0.010827                     LR 0.001000    Time 0.257717    
+2023-11-30 12:38:53,996 - Epoch: [4][20400/31148]    Overall Loss 0.010826    Objective Loss 0.000000    Distill Loss 0.010826                     LR 0.001000    Time 0.257720    
+2023-11-30 12:39:19,739 - Epoch: [4][20500/31148]    Overall Loss 0.010826    Objective Loss 0.000000    Distill Loss 0.010826                     LR 0.001000    Time 0.257718    
+2023-11-30 12:39:45,485 - Epoch: [4][20600/31148]    Overall Loss 0.010825    Objective Loss 0.000000    Distill Loss 0.010825                     LR 0.001000    Time 0.257717    
+2023-11-30 12:40:11,223 - Epoch: [4][20700/31148]    Overall Loss 0.010825    Objective Loss 0.000000    Distill Loss 0.010825                     LR 0.001000    Time 0.257715    
+2023-11-30 12:40:36,976 - Epoch: [4][20800/31148]    Overall Loss 0.010824    Objective Loss 0.000000    Distill Loss 0.010824                     LR 0.001000    Time 0.257714    
+2023-11-30 12:41:02,746 - Epoch: [4][20900/31148]    Overall Loss 0.010824    Objective Loss 0.000000    Distill Loss 0.010824                     LR 0.001000    Time 0.257714    
+2023-11-30 12:41:28,492 - Epoch: [4][21000/31148]    Overall Loss 0.010823    Objective Loss 0.000000    Distill Loss 0.010823                     LR 0.001000    Time 0.257713    
+2023-11-30 12:41:54,296 - Epoch: [4][21100/31148]    Overall Loss 0.010822    Objective Loss 0.000000    Distill Loss 0.010822                     LR 0.001000    Time 0.257714    
+2023-11-30 12:42:20,049 - Epoch: [4][21200/31148]    Overall Loss 0.010823    Objective Loss 0.000000    Distill Loss 0.010823                     LR 0.001000    Time 0.257713    
+2023-11-30 12:42:45,784 - Epoch: [4][21300/31148]    Overall Loss 0.010823    Objective Loss 0.000000    Distill Loss 0.010823                     LR 0.001000    Time 0.257711    
+2023-11-30 12:43:11,536 - Epoch: [4][21400/31148]    Overall Loss 0.010822    Objective Loss 0.000000    Distill Loss 0.010822                     LR 0.001000    Time 0.257710    
+2023-11-30 12:43:37,301 - Epoch: [4][21500/31148]    Overall Loss 0.010821    Objective Loss 0.000000    Distill Loss 0.010821                     LR 0.001000    Time 0.257710    
+2023-11-30 12:44:03,074 - Epoch: [4][21600/31148]    Overall Loss 0.010820    Objective Loss 0.000000    Distill Loss 0.010820                     LR 0.001000    Time 0.257710    
+2023-11-30 12:44:28,857 - Epoch: [4][21700/31148]    Overall Loss 0.010820    Objective Loss 0.000000    Distill Loss 0.010820                     LR 0.001000    Time 0.257710    
+2023-11-30 12:44:54,613 - Epoch: [4][21800/31148]    Overall Loss 0.010819    Objective Loss 0.000000    Distill Loss 0.010819                     LR 0.001000    Time 0.257709    
+2023-11-30 12:45:20,368 - Epoch: [4][21900/31148]    Overall Loss 0.010819    Objective Loss 0.000000    Distill Loss 0.010819                     LR 0.001000    Time 0.257709    
+2023-11-30 12:45:46,145 - Epoch: [4][22000/31148]    Overall Loss 0.010819    Objective Loss 0.000000    Distill Loss 0.010819                     LR 0.001000    Time 0.257709    
+2023-11-30 12:46:11,932 - Epoch: [4][22100/31148]    Overall Loss 0.010819    Objective Loss 0.000000    Distill Loss 0.010819                     LR 0.001000    Time 0.257709    
+2023-11-30 12:46:37,691 - Epoch: [4][22200/31148]    Overall Loss 0.010818    Objective Loss 0.000000    Distill Loss 0.010818                     LR 0.001000    Time 0.257709    
+2023-11-30 12:47:03,445 - Epoch: [4][22300/31148]    Overall Loss 0.010817    Objective Loss 0.000000    Distill Loss 0.010817                     LR 0.001000    Time 0.257708    
+2023-11-30 12:47:29,198 - Epoch: [4][22400/31148]    Overall Loss 0.010817    Objective Loss 0.000000    Distill Loss 0.010817                     LR 0.001000    Time 0.257707    
+2023-11-30 12:47:54,964 - Epoch: [4][22500/31148]    Overall Loss 0.010816    Objective Loss 0.000000    Distill Loss 0.010816                     LR 0.001000    Time 0.257706    
+2023-11-30 12:48:20,727 - Epoch: [4][22600/31148]    Overall Loss 0.010815    Objective Loss 0.000000    Distill Loss 0.010815                     LR 0.001000    Time 0.257706    
+2023-11-30 12:48:46,548 - Epoch: [4][22700/31148]    Overall Loss 0.010815    Objective Loss 0.000000    Distill Loss 0.010815                     LR 0.001000    Time 0.257708    
+2023-11-30 12:49:12,272 - Epoch: [4][22800/31148]    Overall Loss 0.010815    Objective Loss 0.000000    Distill Loss 0.010815                     LR 0.001000    Time 0.257706    
+2023-11-30 12:49:37,978 - Epoch: [4][22900/31148]    Overall Loss 0.010814    Objective Loss 0.000000    Distill Loss 0.010814                     LR 0.001000    Time 0.257703    
+2023-11-30 12:50:03,753 - Epoch: [4][23000/31148]    Overall Loss 0.010814    Objective Loss 0.000000    Distill Loss 0.010814                     LR 0.001000    Time 0.257703    
+2023-11-30 12:50:29,550 - Epoch: [4][23100/31148]    Overall Loss 0.010814    Objective Loss 0.000000    Distill Loss 0.010814                     LR 0.001000    Time 0.257704    
+2023-11-30 12:50:55,315 - Epoch: [4][23200/31148]    Overall Loss 0.010814    Objective Loss 0.000000    Distill Loss 0.010814                     LR 0.001000    Time 0.257704    
+2023-11-30 12:51:21,175 - Epoch: [4][23300/31148]    Overall Loss 0.010814    Objective Loss 0.000000    Distill Loss 0.010814                     LR 0.001000    Time 0.257708    
+2023-11-30 12:51:46,934 - Epoch: [4][23400/31148]    Overall Loss 0.010813    Objective Loss 0.000000    Distill Loss 0.010813                     LR 0.001000    Time 0.257707    
+2023-11-30 12:52:12,705 - Epoch: [4][23500/31148]    Overall Loss 0.010813    Objective Loss 0.000000    Distill Loss 0.010813                     LR 0.001000    Time 0.257707    
+2023-11-30 12:52:38,432 - Epoch: [4][23600/31148]    Overall Loss 0.010813    Objective Loss 0.000000    Distill Loss 0.010813                     LR 0.001000    Time 0.257705    
+2023-11-30 12:53:04,191 - Epoch: [4][23700/31148]    Overall Loss 0.010812    Objective Loss 0.000000    Distill Loss 0.010812                     LR 0.001000    Time 0.257704    
+2023-11-30 12:53:29,900 - Epoch: [4][23800/31148]    Overall Loss 0.010812    Objective Loss 0.000000    Distill Loss 0.010812                     LR 0.001000    Time 0.257701    
+2023-11-30 12:53:55,606 - Epoch: [4][23900/31148]    Overall Loss 0.010811    Objective Loss 0.000000    Distill Loss 0.010811                     LR 0.001000    Time 0.257699    
+2023-11-30 12:54:21,302 - Epoch: [4][24000/31148]    Overall Loss 0.010810    Objective Loss 0.000000    Distill Loss 0.010810                     LR 0.001000    Time 0.257696    
+2023-11-30 12:54:47,034 - Epoch: [4][24100/31148]    Overall Loss 0.010810    Objective Loss 0.000000    Distill Loss 0.010810                     LR 0.001000    Time 0.257694    
+2023-11-30 12:55:12,786 - Epoch: [4][24200/31148]    Overall Loss 0.010810    Objective Loss 0.000000    Distill Loss 0.010810                     LR 0.001000    Time 0.257693    
+2023-11-30 12:55:38,514 - Epoch: [4][24300/31148]    Overall Loss 0.010809    Objective Loss 0.000000    Distill Loss 0.010809                     LR 0.001000    Time 0.257691    
+2023-11-30 12:56:04,224 - Epoch: [4][24400/31148]    Overall Loss 0.010808    Objective Loss 0.000000    Distill Loss 0.010808                     LR 0.001000    Time 0.257689    
+2023-11-30 12:56:29,943 - Epoch: [4][24500/31148]    Overall Loss 0.010808    Objective Loss 0.000000    Distill Loss 0.010808                     LR 0.001000    Time 0.257687    
+2023-11-30 12:56:55,708 - Epoch: [4][24600/31148]    Overall Loss 0.010807    Objective Loss 0.000000    Distill Loss 0.010807                     LR 0.001000    Time 0.257686    
+2023-11-30 12:57:21,450 - Epoch: [4][24700/31148]    Overall Loss 0.010807    Objective Loss 0.000000    Distill Loss 0.010807                     LR 0.001000    Time 0.257685    
+2023-11-30 12:57:47,235 - Epoch: [4][24800/31148]    Overall Loss 0.010807    Objective Loss 0.000000    Distill Loss 0.010807                     LR 0.001000    Time 0.257686    
+2023-11-30 12:58:12,955 - Epoch: [4][24900/31148]    Overall Loss 0.010806    Objective Loss 0.000000    Distill Loss 0.010806                     LR 0.001000    Time 0.257684    
+2023-11-30 12:58:38,686 - Epoch: [4][25000/31148]    Overall Loss 0.010805    Objective Loss 0.000000    Distill Loss 0.010805                     LR 0.001000    Time 0.257682    
+2023-11-30 12:59:04,442 - Epoch: [4][25100/31148]    Overall Loss 0.010804    Objective Loss 0.000000    Distill Loss 0.010804                     LR 0.001000    Time 0.257681    
+2023-11-30 12:59:30,191 - Epoch: [4][25200/31148]    Overall Loss 0.010804    Objective Loss 0.000000    Distill Loss 0.010804                     LR 0.001000    Time 0.257681    
+2023-11-30 12:59:55,906 - Epoch: [4][25300/31148]    Overall Loss 0.010803    Objective Loss 0.000000    Distill Loss 0.010803                     LR 0.001000    Time 0.257678    
+2023-11-30 13:00:21,652 - Epoch: [4][25400/31148]    Overall Loss 0.010803    Objective Loss 0.000000    Distill Loss 0.010803                     LR 0.001000    Time 0.257677    
+2023-11-30 13:00:47,424 - Epoch: [4][25500/31148]    Overall Loss 0.010802    Objective Loss 0.000000    Distill Loss 0.010802                     LR 0.001000    Time 0.257677    
+2023-11-30 13:01:13,167 - Epoch: [4][25600/31148]    Overall Loss 0.010802    Objective Loss 0.000000    Distill Loss 0.010802                     LR 0.001000    Time 0.257676    
+2023-11-30 13:01:38,910 - Epoch: [4][25700/31148]    Overall Loss 0.010801    Objective Loss 0.000000    Distill Loss 0.010801                     LR 0.001000    Time 0.257675    
+2023-11-30 13:02:04,699 - Epoch: [4][25800/31148]    Overall Loss 0.010801    Objective Loss 0.000000    Distill Loss 0.010801                     LR 0.001000    Time 0.257676    
+2023-11-30 13:02:30,414 - Epoch: [4][25900/31148]    Overall Loss 0.010801    Objective Loss 0.000000    Distill Loss 0.010801                     LR 0.001000    Time 0.257674    
+2023-11-30 13:02:56,180 - Epoch: [4][26000/31148]    Overall Loss 0.010801    Objective Loss 0.000000    Distill Loss 0.010801                     LR 0.001000    Time 0.257674    
+2023-11-30 13:03:21,938 - Epoch: [4][26100/31148]    Overall Loss 0.010800    Objective Loss 0.000000    Distill Loss 0.010800                     LR 0.001000    Time 0.257673    
+2023-11-30 13:03:47,724 - Epoch: [4][26200/31148]    Overall Loss 0.010800    Objective Loss 0.000000    Distill Loss 0.010800                     LR 0.001000    Time 0.257674    
+2023-11-30 13:04:13,470 - Epoch: [4][26300/31148]    Overall Loss 0.010799    Objective Loss 0.000000    Distill Loss 0.010799                     LR 0.001000    Time 0.257673    
+2023-11-30 13:04:39,220 - Epoch: [4][26400/31148]    Overall Loss 0.010799    Objective Loss 0.000000    Distill Loss 0.010799                     LR 0.001000    Time 0.257672    
+2023-11-30 13:05:04,943 - Epoch: [4][26500/31148]    Overall Loss 0.010799    Objective Loss 0.000000    Distill Loss 0.010799                     LR 0.001000    Time 0.257670    
+2023-11-30 13:05:30,649 - Epoch: [4][26600/31148]    Overall Loss 0.010798    Objective Loss 0.000000    Distill Loss 0.010798                     LR 0.001000    Time 0.257668    
+2023-11-30 13:05:56,413 - Epoch: [4][26700/31148]    Overall Loss 0.010798    Objective Loss 0.000000    Distill Loss 0.010798                     LR 0.001000    Time 0.257668    
+2023-11-30 13:06:22,241 - Epoch: [4][26800/31148]    Overall Loss 0.010797    Objective Loss 0.000000    Distill Loss 0.010797                     LR 0.001000    Time 0.257670    
+2023-11-30 13:06:47,977 - Epoch: [4][26900/31148]    Overall Loss 0.010797    Objective Loss 0.000000    Distill Loss 0.010797                     LR 0.001000    Time 0.257669    
+2023-11-30 13:07:13,758 - Epoch: [4][27000/31148]    Overall Loss 0.010796    Objective Loss 0.000000    Distill Loss 0.010796                     LR 0.001000    Time 0.257669    
+2023-11-30 13:07:39,501 - Epoch: [4][27100/31148]    Overall Loss 0.010796    Objective Loss 0.000000    Distill Loss 0.010796                     LR 0.001000    Time 0.257668    
+2023-11-30 13:08:05,246 - Epoch: [4][27200/31148]    Overall Loss 0.010795    Objective Loss 0.000000    Distill Loss 0.010795                     LR 0.001000    Time 0.257667    
+2023-11-30 13:08:30,939 - Epoch: [4][27300/31148]    Overall Loss 0.010795    Objective Loss 0.000000    Distill Loss 0.010795                     LR 0.001000    Time 0.257665    
+2023-11-30 13:08:56,692 - Epoch: [4][27400/31148]    Overall Loss 0.010794    Objective Loss 0.000000    Distill Loss 0.010794                     LR 0.001000    Time 0.257664    
+2023-11-30 13:09:22,443 - Epoch: [4][27500/31148]    Overall Loss 0.010794    Objective Loss 0.000000    Distill Loss 0.010794                     LR 0.001000    Time 0.257663    
+2023-11-30 13:09:48,210 - Epoch: [4][27600/31148]    Overall Loss 0.010794    Objective Loss 0.000000    Distill Loss 0.010794                     LR 0.001000    Time 0.257663    
+2023-11-30 13:10:13,939 - Epoch: [4][27700/31148]    Overall Loss 0.010794    Objective Loss 0.000000    Distill Loss 0.010794                     LR 0.001000    Time 0.257662    
+2023-11-30 13:10:39,680 - Epoch: [4][27800/31148]    Overall Loss 0.010793    Objective Loss 0.000000    Distill Loss 0.010793                     LR 0.001000    Time 0.257661    
+2023-11-30 13:11:05,468 - Epoch: [4][27900/31148]    Overall Loss 0.010792    Objective Loss 0.000000    Distill Loss 0.010792                     LR 0.001000    Time 0.257661    
+2023-11-30 13:11:31,214 - Epoch: [4][28000/31148]    Overall Loss 0.010792    Objective Loss 0.000000    Distill Loss 0.010792                     LR 0.001000    Time 0.257661    
+2023-11-30 13:11:56,989 - Epoch: [4][28100/31148]    Overall Loss 0.010791    Objective Loss 0.000000    Distill Loss 0.010791                     LR 0.001000    Time 0.257661    
+2023-11-30 13:12:22,797 - Epoch: [4][28200/31148]    Overall Loss 0.010791    Objective Loss 0.000000    Distill Loss 0.010791                     LR 0.001000    Time 0.257662    
+2023-11-30 13:12:48,520 - Epoch: [4][28300/31148]    Overall Loss 0.010790    Objective Loss 0.000000    Distill Loss 0.010790                     LR 0.001000    Time 0.257661    
+2023-11-30 13:13:14,290 - Epoch: [4][28400/31148]    Overall Loss 0.010790    Objective Loss 0.000000    Distill Loss 0.010790                     LR 0.001000    Time 0.257661    
+2023-11-30 13:13:40,081 - Epoch: [4][28500/31148]    Overall Loss 0.010790    Objective Loss 0.000000    Distill Loss 0.010790                     LR 0.001000    Time 0.257661    
+2023-11-30 13:14:05,888 - Epoch: [4][28600/31148]    Overall Loss 0.010789    Objective Loss 0.000000    Distill Loss 0.010789                     LR 0.001000    Time 0.257663    
+2023-11-30 13:14:31,603 - Epoch: [4][28700/31148]    Overall Loss 0.010789    Objective Loss 0.000000    Distill Loss 0.010789                     LR 0.001000    Time 0.257661    
+2023-11-30 13:14:57,330 - Epoch: [4][28800/31148]    Overall Loss 0.010788    Objective Loss 0.000000    Distill Loss 0.010788                     LR 0.001000    Time 0.257659    
+2023-11-30 13:15:23,058 - Epoch: [4][28900/31148]    Overall Loss 0.010788    Objective Loss 0.000000    Distill Loss 0.010788                     LR 0.001000    Time 0.257658    
+2023-11-30 13:15:48,817 - Epoch: [4][29000/31148]    Overall Loss 0.010788    Objective Loss 0.000000    Distill Loss 0.010788                     LR 0.001000    Time 0.257658    
+2023-11-30 13:16:14,559 - Epoch: [4][29100/31148]    Overall Loss 0.010787    Objective Loss 0.000000    Distill Loss 0.010787                     LR 0.001000    Time 0.257657    
+2023-11-30 13:16:40,313 - Epoch: [4][29200/31148]    Overall Loss 0.010787    Objective Loss 0.000000    Distill Loss 0.010787                     LR 0.001000    Time 0.257656    
+2023-11-30 13:17:06,055 - Epoch: [4][29300/31148]    Overall Loss 0.010787    Objective Loss 0.000000    Distill Loss 0.010787                     LR 0.001000    Time 0.257655    
+2023-11-30 13:17:31,795 - Epoch: [4][29400/31148]    Overall Loss 0.010786    Objective Loss 0.000000    Distill Loss 0.010786                     LR 0.001000    Time 0.257654    
+2023-11-30 13:17:57,500 - Epoch: [4][29500/31148]    Overall Loss 0.010785    Objective Loss 0.000000    Distill Loss 0.010785                     LR 0.001000    Time 0.257652    
+2023-11-30 13:18:23,206 - Epoch: [4][29600/31148]    Overall Loss 0.010785    Objective Loss 0.000000    Distill Loss 0.010785                     LR 0.001000    Time 0.257650    
+2023-11-30 13:18:48,967 - Epoch: [4][29700/31148]    Overall Loss 0.010784    Objective Loss 0.000000    Distill Loss 0.010784                     LR 0.001000    Time 0.257650    
+2023-11-30 13:19:14,724 - Epoch: [4][29800/31148]    Overall Loss 0.010784    Objective Loss 0.000000    Distill Loss 0.010784                     LR 0.001000    Time 0.257650    
+2023-11-30 13:19:40,420 - Epoch: [4][29900/31148]    Overall Loss 0.010784    Objective Loss 0.000000    Distill Loss 0.010784                     LR 0.001000    Time 0.257647    
+2023-11-30 13:20:06,221 - Epoch: [4][30000/31148]    Overall Loss 0.010784    Objective Loss 0.000000    Distill Loss 0.010784                     LR 0.001000    Time 0.257648    
+2023-11-30 13:20:32,013 - Epoch: [4][30100/31148]    Overall Loss 0.010783    Objective Loss 0.000000    Distill Loss 0.010783                     LR 0.001000    Time 0.257649    
+2023-11-30 13:20:57,769 - Epoch: [4][30200/31148]    Overall Loss 0.010783    Objective Loss 0.000000    Distill Loss 0.010783                     LR 0.001000    Time 0.257649    
+2023-11-30 13:21:23,540 - Epoch: [4][30300/31148]    Overall Loss 0.010783    Objective Loss 0.000000    Distill Loss 0.010783                     LR 0.001000    Time 0.257649    
+2023-11-30 13:21:49,340 - Epoch: [4][30400/31148]    Overall Loss 0.010782    Objective Loss 0.000000    Distill Loss 0.010782                     LR 0.001000    Time 0.257650    
+2023-11-30 13:22:15,168 - Epoch: [4][30500/31148]    Overall Loss 0.010782    Objective Loss 0.000000    Distill Loss 0.010782                     LR 0.001000    Time 0.257652    
+2023-11-30 13:22:40,859 - Epoch: [4][30600/31148]    Overall Loss 0.010781    Objective Loss 0.000000    Distill Loss 0.010781                     LR 0.001000    Time 0.257649    
+2023-11-30 13:23:06,654 - Epoch: [4][30700/31148]    Overall Loss 0.010781    Objective Loss 0.000000    Distill Loss 0.010781                     LR 0.001000    Time 0.257650    
+2023-11-30 13:23:32,384 - Epoch: [4][30800/31148]    Overall Loss 0.010780    Objective Loss 0.000000    Distill Loss 0.010780                     LR 0.001000    Time 0.257649    
+2023-11-30 13:23:58,117 - Epoch: [4][30900/31148]    Overall Loss 0.010780    Objective Loss 0.000000    Distill Loss 0.010780                     LR 0.001000    Time 0.257648    
+2023-11-30 13:24:23,892 - Epoch: [4][31000/31148]    Overall Loss 0.010779    Objective Loss 0.000000    Distill Loss 0.010779                     LR 0.001000    Time 0.257648    
+2023-11-30 13:24:49,601 - Epoch: [4][31100/31148]    Overall Loss 0.010779    Objective Loss 0.000000    Distill Loss 0.010779                     LR 0.001000    Time 0.257646    
+2023-11-30 13:25:02,462 - Epoch: [4][31148/31148]    Overall Loss 0.010778    Objective Loss 0.000000    Distill Loss 0.010778                     LR 0.001000    Time 0.257662    
+2023-11-30 13:25:02,830 - --- validate (epoch=4)-----------
+2023-11-30 13:25:02,831 - 167951 samples (100 per mini-batch)
+2023-11-30 13:25:23,826 - Epoch: [4][  100/ 1680]    Loss 0.000000    Overall Loss 0.011475    
+2023-11-30 13:25:43,529 - Epoch: [4][  200/ 1680]    Loss 0.000000    Overall Loss 0.011471    
+2023-11-30 13:26:03,236 - Epoch: [4][  300/ 1680]    Loss 0.000000    Overall Loss 0.011455    
+2023-11-30 13:26:22,972 - Epoch: [4][  400/ 1680]    Loss 0.000000    Overall Loss 0.011443    
+2023-11-30 13:26:42,674 - Epoch: [4][  500/ 1680]    Loss 0.000000    Overall Loss 0.011437    
+2023-11-30 13:27:02,392 - Epoch: [4][  600/ 1680]    Loss 0.000000    Overall Loss 0.011457    
+2023-11-30 13:27:22,088 - Epoch: [4][  700/ 1680]    Loss 0.000000    Overall Loss 0.011468    
+2023-11-30 13:27:41,797 - Epoch: [4][  800/ 1680]    Loss 0.000000    Overall Loss 0.011459    
+2023-11-30 13:28:01,507 - Epoch: [4][  900/ 1680]    Loss 0.000000    Overall Loss 0.011460    
+2023-11-30 13:28:21,258 - Epoch: [4][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.011455    
+2023-11-30 13:28:41,015 - Epoch: [4][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.011449    
+2023-11-30 13:29:00,732 - Epoch: [4][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.011448    
+2023-11-30 13:29:20,446 - Epoch: [4][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.011447    
+2023-11-30 13:29:40,192 - Epoch: [4][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.011448    
+2023-11-30 13:29:59,932 - Epoch: [4][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.011454    
+2023-11-30 13:30:19,645 - Epoch: [4][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.011451    
+2023-11-30 13:30:35,336 - Epoch: [4][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.011451    
+2023-11-30 13:30:35,530 - ==> Overall Loss: 0.011
+
+2023-11-30 13:30:35,533 - ==> Best [Overall Loss: 0.011451 on epoch: 4]
+2023-11-30 13:30:35,533 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 13:30:35,572 - 
+
+2023-11-30 13:30:35,572 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 13:31:07,749 - Epoch: [5][  100/31148]    Overall Loss 0.010618    Objective Loss 0.000000    Distill Loss 0.010618                     LR 0.001000    Time 0.321736    
+2023-11-30 13:31:33,514 - Epoch: [5][  200/31148]    Overall Loss 0.010562    Objective Loss 0.000000    Distill Loss 0.010562                     LR 0.001000    Time 0.289679    
+2023-11-30 13:31:59,262 - Epoch: [5][  300/31148]    Overall Loss 0.010563    Objective Loss 0.000000    Distill Loss 0.010563                     LR 0.001000    Time 0.278937    
+2023-11-30 13:32:25,022 - Epoch: [5][  400/31148]    Overall Loss 0.010550    Objective Loss 0.000000    Distill Loss 0.010550                     LR 0.001000    Time 0.273595    
+2023-11-30 13:32:50,783 - Epoch: [5][  500/31148]    Overall Loss 0.010540    Objective Loss 0.000000    Distill Loss 0.010540                     LR 0.001000    Time 0.270392    
+2023-11-30 13:33:16,521 - Epoch: [5][  600/31148]    Overall Loss 0.010537    Objective Loss 0.000000    Distill Loss 0.010537                     LR 0.001000    Time 0.268219    
+2023-11-30 13:33:42,247 - Epoch: [5][  700/31148]    Overall Loss 0.010559    Objective Loss 0.000000    Distill Loss 0.010559                     LR 0.001000    Time 0.266650    
+2023-11-30 13:34:07,979 - Epoch: [5][  800/31148]    Overall Loss 0.010571    Objective Loss 0.000000    Distill Loss 0.010571                     LR 0.001000    Time 0.265480    
+2023-11-30 13:34:33,703 - Epoch: [5][  900/31148]    Overall Loss 0.010558    Objective Loss 0.000000    Distill Loss 0.010558                     LR 0.001000    Time 0.264561    
+2023-11-30 13:34:59,461 - Epoch: [5][ 1000/31148]    Overall Loss 0.010558    Objective Loss 0.000000    Distill Loss 0.010558                     LR 0.001000    Time 0.263861    
+2023-11-30 13:35:25,169 - Epoch: [5][ 1100/31148]    Overall Loss 0.010557    Objective Loss 0.000000    Distill Loss 0.010557                     LR 0.001000    Time 0.263242    
+2023-11-30 13:35:50,920 - Epoch: [5][ 1200/31148]    Overall Loss 0.010555    Objective Loss 0.000000    Distill Loss 0.010555                     LR 0.001000    Time 0.262763    
+2023-11-30 13:36:16,671 - Epoch: [5][ 1300/31148]    Overall Loss 0.010556    Objective Loss 0.000000    Distill Loss 0.010556                     LR 0.001000    Time 0.262356    
+2023-11-30 13:36:42,401 - Epoch: [5][ 1400/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.261993    
+2023-11-30 13:37:08,168 - Epoch: [5][ 1500/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.261704    
+2023-11-30 13:37:33,915 - Epoch: [5][ 1600/31148]    Overall Loss 0.010570    Objective Loss 0.000000    Distill Loss 0.010570                     LR 0.001000    Time 0.261437    
+2023-11-30 13:37:59,675 - Epoch: [5][ 1700/31148]    Overall Loss 0.010572    Objective Loss 0.000000    Distill Loss 0.010572                     LR 0.001000    Time 0.261210    
+2023-11-30 13:38:25,389 - Epoch: [5][ 1800/31148]    Overall Loss 0.010571    Objective Loss 0.000000    Distill Loss 0.010571                     LR 0.001000    Time 0.260982    
+2023-11-30 13:38:51,115 - Epoch: [5][ 1900/31148]    Overall Loss 0.010569    Objective Loss 0.000000    Distill Loss 0.010569                     LR 0.001000    Time 0.260785    
+2023-11-30 13:39:16,868 - Epoch: [5][ 2000/31148]    Overall Loss 0.010569    Objective Loss 0.000000    Distill Loss 0.010569                     LR 0.001000    Time 0.260621    
+2023-11-30 13:39:42,553 - Epoch: [5][ 2100/31148]    Overall Loss 0.010572    Objective Loss 0.000000    Distill Loss 0.010572                     LR 0.001000    Time 0.260440    
+2023-11-30 13:40:08,295 - Epoch: [5][ 2200/31148]    Overall Loss 0.010572    Objective Loss 0.000000    Distill Loss 0.010572                     LR 0.001000    Time 0.260302    
+2023-11-30 13:40:33,988 - Epoch: [5][ 2300/31148]    Overall Loss 0.010582    Objective Loss 0.000000    Distill Loss 0.010582                     LR 0.001000    Time 0.260154    
+2023-11-30 13:40:59,722 - Epoch: [5][ 2400/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.260036    
+2023-11-30 13:41:25,485 - Epoch: [5][ 2500/31148]    Overall Loss 0.010585    Objective Loss 0.000000    Distill Loss 0.010585                     LR 0.001000    Time 0.259939    
+2023-11-30 13:41:51,203 - Epoch: [5][ 2600/31148]    Overall Loss 0.010590    Objective Loss 0.000000    Distill Loss 0.010590                     LR 0.001000    Time 0.259831    
+2023-11-30 13:42:16,951 - Epoch: [5][ 2700/31148]    Overall Loss 0.010591    Objective Loss 0.000000    Distill Loss 0.010591                     LR 0.001000    Time 0.259743    
+2023-11-30 13:42:42,686 - Epoch: [5][ 2800/31148]    Overall Loss 0.010587    Objective Loss 0.000000    Distill Loss 0.010587                     LR 0.001000    Time 0.259657    
+2023-11-30 13:43:08,406 - Epoch: [5][ 2900/31148]    Overall Loss 0.010585    Objective Loss 0.000000    Distill Loss 0.010585                     LR 0.001000    Time 0.259571    
+2023-11-30 13:43:34,109 - Epoch: [5][ 3000/31148]    Overall Loss 0.010585    Objective Loss 0.000000    Distill Loss 0.010585                     LR 0.001000    Time 0.259486    
+2023-11-30 13:43:59,772 - Epoch: [5][ 3100/31148]    Overall Loss 0.010584    Objective Loss 0.000000    Distill Loss 0.010584                     LR 0.001000    Time 0.259393    
+2023-11-30 13:44:25,546 - Epoch: [5][ 3200/31148]    Overall Loss 0.010585    Objective Loss 0.000000    Distill Loss 0.010585                     LR 0.001000    Time 0.259340    
+2023-11-30 13:44:51,291 - Epoch: [5][ 3300/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.259282    
+2023-11-30 13:45:17,052 - Epoch: [5][ 3400/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.259232    
+2023-11-30 13:45:42,745 - Epoch: [5][ 3500/31148]    Overall Loss 0.010580    Objective Loss 0.000000    Distill Loss 0.010580                     LR 0.001000    Time 0.259166    
+2023-11-30 13:46:08,569 - Epoch: [5][ 3600/31148]    Overall Loss 0.010584    Objective Loss 0.000000    Distill Loss 0.010584                     LR 0.001000    Time 0.259139    
+2023-11-30 13:46:34,307 - Epoch: [5][ 3700/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.259091    
+2023-11-30 13:47:00,032 - Epoch: [5][ 3800/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.259042    
+2023-11-30 13:47:25,774 - Epoch: [5][ 3900/31148]    Overall Loss 0.010584    Objective Loss 0.000000    Distill Loss 0.010584                     LR 0.001000    Time 0.259000    
+2023-11-30 13:47:51,554 - Epoch: [5][ 4000/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.258969    
+2023-11-30 13:48:17,296 - Epoch: [5][ 4100/31148]    Overall Loss 0.010582    Objective Loss 0.000000    Distill Loss 0.010582                     LR 0.001000    Time 0.258931    
+2023-11-30 13:48:43,038 - Epoch: [5][ 4200/31148]    Overall Loss 0.010583    Objective Loss 0.000000    Distill Loss 0.010583                     LR 0.001000    Time 0.258894    
+2023-11-30 13:49:08,710 - Epoch: [5][ 4300/31148]    Overall Loss 0.010586    Objective Loss 0.000000    Distill Loss 0.010586                     LR 0.001000    Time 0.258843    
+2023-11-30 13:49:34,475 - Epoch: [5][ 4400/31148]    Overall Loss 0.010586    Objective Loss 0.000000    Distill Loss 0.010586                     LR 0.001000    Time 0.258815    
+2023-11-30 13:50:00,258 - Epoch: [5][ 4500/31148]    Overall Loss 0.010586    Objective Loss 0.000000    Distill Loss 0.010586                     LR 0.001000    Time 0.258792    
+2023-11-30 13:50:26,003 - Epoch: [5][ 4600/31148]    Overall Loss 0.010585    Objective Loss 0.000000    Distill Loss 0.010585                     LR 0.001000    Time 0.258763    
+2023-11-30 13:50:51,781 - Epoch: [5][ 4700/31148]    Overall Loss 0.010586    Objective Loss 0.000000    Distill Loss 0.010586                     LR 0.001000    Time 0.258741    
+2023-11-30 13:51:17,502 - Epoch: [5][ 4800/31148]    Overall Loss 0.010587    Objective Loss 0.000000    Distill Loss 0.010587                     LR 0.001000    Time 0.258709    
+2023-11-30 13:51:43,236 - Epoch: [5][ 4900/31148]    Overall Loss 0.010586    Objective Loss 0.000000    Distill Loss 0.010586                     LR 0.001000    Time 0.258680    
+2023-11-30 13:52:08,980 - Epoch: [5][ 5000/31148]    Overall Loss 0.010584    Objective Loss 0.000000    Distill Loss 0.010584                     LR 0.001000    Time 0.258655    
+2023-11-30 13:52:34,714 - Epoch: [5][ 5100/31148]    Overall Loss 0.010584    Objective Loss 0.000000    Distill Loss 0.010584                     LR 0.001000    Time 0.258629    
+2023-11-30 13:53:00,431 - Epoch: [5][ 5200/31148]    Overall Loss 0.010587    Objective Loss 0.000000    Distill Loss 0.010587                     LR 0.001000    Time 0.258600    
+2023-11-30 13:53:26,117 - Epoch: [5][ 5300/31148]    Overall Loss 0.010585    Objective Loss 0.000000    Distill Loss 0.010585                     LR 0.001000    Time 0.258567    
+2023-11-30 13:53:51,915 - Epoch: [5][ 5400/31148]    Overall Loss 0.010587    Objective Loss 0.000000    Distill Loss 0.010587                     LR 0.001000    Time 0.258555    
+2023-11-30 13:54:17,667 - Epoch: [5][ 5500/31148]    Overall Loss 0.010587    Objective Loss 0.000000    Distill Loss 0.010587                     LR 0.001000    Time 0.258536    
+2023-11-30 13:54:43,414 - Epoch: [5][ 5600/31148]    Overall Loss 0.010586    Objective Loss 0.000000    Distill Loss 0.010586                     LR 0.001000    Time 0.258517    
+2023-11-30 13:55:09,207 - Epoch: [5][ 5700/31148]    Overall Loss 0.010584    Objective Loss 0.000000    Distill Loss 0.010584                     LR 0.001000    Time 0.258506    
+2023-11-30 13:55:34,900 - Epoch: [5][ 5800/31148]    Overall Loss 0.010582    Objective Loss 0.000000    Distill Loss 0.010582                     LR 0.001000    Time 0.258478    
+2023-11-30 13:56:00,631 - Epoch: [5][ 5900/31148]    Overall Loss 0.010579    Objective Loss 0.000000    Distill Loss 0.010579                     LR 0.001000    Time 0.258458    
+2023-11-30 13:56:26,362 - Epoch: [5][ 6000/31148]    Overall Loss 0.010577    Objective Loss 0.000000    Distill Loss 0.010577                     LR 0.001000    Time 0.258438    
+2023-11-30 13:56:52,157 - Epoch: [5][ 6100/31148]    Overall Loss 0.010578    Objective Loss 0.000000    Distill Loss 0.010578                     LR 0.001000    Time 0.258430    
+2023-11-30 13:57:17,847 - Epoch: [5][ 6200/31148]    Overall Loss 0.010576    Objective Loss 0.000000    Distill Loss 0.010576                     LR 0.001000    Time 0.258405    
+2023-11-30 13:57:43,636 - Epoch: [5][ 6300/31148]    Overall Loss 0.010575    Objective Loss 0.000000    Distill Loss 0.010575                     LR 0.001000    Time 0.258396    
+2023-11-30 13:58:09,400 - Epoch: [5][ 6400/31148]    Overall Loss 0.010575    Objective Loss 0.000000    Distill Loss 0.010575                     LR 0.001000    Time 0.258384    
+2023-11-30 13:58:35,148 - Epoch: [5][ 6500/31148]    Overall Loss 0.010573    Objective Loss 0.000000    Distill Loss 0.010573                     LR 0.001000    Time 0.258370    
+2023-11-30 13:59:00,930 - Epoch: [5][ 6600/31148]    Overall Loss 0.010572    Objective Loss 0.000000    Distill Loss 0.010572                     LR 0.001000    Time 0.258361    
+2023-11-30 13:59:26,642 - Epoch: [5][ 6700/31148]    Overall Loss 0.010572    Objective Loss 0.000000    Distill Loss 0.010572                     LR 0.001000    Time 0.258342    
+2023-11-30 13:59:52,360 - Epoch: [5][ 6800/31148]    Overall Loss 0.010572    Objective Loss 0.000000    Distill Loss 0.010572                     LR 0.001000    Time 0.258325    
+2023-11-30 14:00:18,085 - Epoch: [5][ 6900/31148]    Overall Loss 0.010573    Objective Loss 0.000000    Distill Loss 0.010573                     LR 0.001000    Time 0.258309    
+2023-11-30 14:00:43,815 - Epoch: [5][ 7000/31148]    Overall Loss 0.010573    Objective Loss 0.000000    Distill Loss 0.010573                     LR 0.001000    Time 0.258294    
+2023-11-30 14:01:09,545 - Epoch: [5][ 7100/31148]    Overall Loss 0.010574    Objective Loss 0.000000    Distill Loss 0.010574                     LR 0.001000    Time 0.258279    
+2023-11-30 14:01:35,295 - Epoch: [5][ 7200/31148]    Overall Loss 0.010574    Objective Loss 0.000000    Distill Loss 0.010574                     LR 0.001000    Time 0.258268    
+2023-11-30 14:02:01,025 - Epoch: [5][ 7300/31148]    Overall Loss 0.010575    Objective Loss 0.000000    Distill Loss 0.010575                     LR 0.001000    Time 0.258255    
+2023-11-30 14:02:26,792 - Epoch: [5][ 7400/31148]    Overall Loss 0.010575    Objective Loss 0.000000    Distill Loss 0.010575                     LR 0.001000    Time 0.258246    
+2023-11-30 14:02:52,598 - Epoch: [5][ 7500/31148]    Overall Loss 0.010574    Objective Loss 0.000000    Distill Loss 0.010574                     LR 0.001000    Time 0.258244    
+2023-11-30 14:03:18,364 - Epoch: [5][ 7600/31148]    Overall Loss 0.010573    Objective Loss 0.000000    Distill Loss 0.010573                     LR 0.001000    Time 0.258236    
+2023-11-30 14:03:44,104 - Epoch: [5][ 7700/31148]    Overall Loss 0.010573    Objective Loss 0.000000    Distill Loss 0.010573                     LR 0.001000    Time 0.258224    
+2023-11-30 14:04:09,861 - Epoch: [5][ 7800/31148]    Overall Loss 0.010571    Objective Loss 0.000000    Distill Loss 0.010571                     LR 0.001000    Time 0.258216    
+2023-11-30 14:04:35,605 - Epoch: [5][ 7900/31148]    Overall Loss 0.010569    Objective Loss 0.000000    Distill Loss 0.010569                     LR 0.001000    Time 0.258205    
+2023-11-30 14:05:01,360 - Epoch: [5][ 8000/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258197    
+2023-11-30 14:05:27,066 - Epoch: [5][ 8100/31148]    Overall Loss 0.010568    Objective Loss 0.000000    Distill Loss 0.010568                     LR 0.001000    Time 0.258183    
+2023-11-30 14:05:52,802 - Epoch: [5][ 8200/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258172    
+2023-11-30 14:06:18,592 - Epoch: [5][ 8300/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258169    
+2023-11-30 14:06:44,328 - Epoch: [5][ 8400/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258159    
+2023-11-30 14:07:10,082 - Epoch: [5][ 8500/31148]    Overall Loss 0.010568    Objective Loss 0.000000    Distill Loss 0.010568                     LR 0.001000    Time 0.258151    
+2023-11-30 14:07:35,876 - Epoch: [5][ 8600/31148]    Overall Loss 0.010568    Objective Loss 0.000000    Distill Loss 0.010568                     LR 0.001000    Time 0.258148    
+2023-11-30 14:08:01,646 - Epoch: [5][ 8700/31148]    Overall Loss 0.010569    Objective Loss 0.000000    Distill Loss 0.010569                     LR 0.001000    Time 0.258143    
+2023-11-30 14:08:27,414 - Epoch: [5][ 8800/31148]    Overall Loss 0.010569    Objective Loss 0.000000    Distill Loss 0.010569                     LR 0.001000    Time 0.258137    
+2023-11-30 14:08:53,162 - Epoch: [5][ 8900/31148]    Overall Loss 0.010568    Objective Loss 0.000000    Distill Loss 0.010568                     LR 0.001000    Time 0.258130    
+2023-11-30 14:09:18,907 - Epoch: [5][ 9000/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258122    
+2023-11-30 14:09:44,664 - Epoch: [5][ 9100/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258115    
+2023-11-30 14:10:10,421 - Epoch: [5][ 9200/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258109    
+2023-11-30 14:10:36,179 - Epoch: [5][ 9300/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258103    
+2023-11-30 14:11:01,990 - Epoch: [5][ 9400/31148]    Overall Loss 0.010568    Objective Loss 0.000000    Distill Loss 0.010568                     LR 0.001000    Time 0.258103    
+2023-11-30 14:11:27,718 - Epoch: [5][ 9500/31148]    Overall Loss 0.010566    Objective Loss 0.000000    Distill Loss 0.010566                     LR 0.001000    Time 0.258094    
+2023-11-30 14:11:53,476 - Epoch: [5][ 9600/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258088    
+2023-11-30 14:12:19,202 - Epoch: [5][ 9700/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258080    
+2023-11-30 14:12:44,973 - Epoch: [5][ 9800/31148]    Overall Loss 0.010569    Objective Loss 0.000000    Distill Loss 0.010569                     LR 0.001000    Time 0.258076    
+2023-11-30 14:13:10,732 - Epoch: [5][ 9900/31148]    Overall Loss 0.010568    Objective Loss 0.000000    Distill Loss 0.010568                     LR 0.001000    Time 0.258070    
+2023-11-30 14:13:36,460 - Epoch: [5][10000/31148]    Overall Loss 0.010567    Objective Loss 0.000000    Distill Loss 0.010567                     LR 0.001000    Time 0.258062    
+2023-11-30 14:14:02,160 - Epoch: [5][10100/31148]    Overall Loss 0.010565    Objective Loss 0.000000    Distill Loss 0.010565                     LR 0.001000    Time 0.258052    
+2023-11-30 14:14:27,904 - Epoch: [5][10200/31148]    Overall Loss 0.010564    Objective Loss 0.000000    Distill Loss 0.010564                     LR 0.001000    Time 0.258045    
+2023-11-30 14:14:53,647 - Epoch: [5][10300/31148]    Overall Loss 0.010565    Objective Loss 0.000000    Distill Loss 0.010565                     LR 0.001000    Time 0.258039    
+2023-11-30 14:15:19,375 - Epoch: [5][10400/31148]    Overall Loss 0.010563    Objective Loss 0.000000    Distill Loss 0.010563                     LR 0.001000    Time 0.258031    
+2023-11-30 14:15:45,053 - Epoch: [5][10500/31148]    Overall Loss 0.010563    Objective Loss 0.000000    Distill Loss 0.010563                     LR 0.001000    Time 0.258019    
+2023-11-30 14:16:10,800 - Epoch: [5][10600/31148]    Overall Loss 0.010563    Objective Loss 0.000000    Distill Loss 0.010563                     LR 0.001000    Time 0.258014    
+2023-11-30 14:16:36,537 - Epoch: [5][10700/31148]    Overall Loss 0.010562    Objective Loss 0.000000    Distill Loss 0.010562                     LR 0.001000    Time 0.258008    
+2023-11-30 14:17:02,291 - Epoch: [5][10800/31148]    Overall Loss 0.010562    Objective Loss 0.000000    Distill Loss 0.010562                     LR 0.001000    Time 0.258003    
+2023-11-30 14:17:28,027 - Epoch: [5][10900/31148]    Overall Loss 0.010562    Objective Loss 0.000000    Distill Loss 0.010562                     LR 0.001000    Time 0.257997    
+2023-11-30 14:17:53,734 - Epoch: [5][11000/31148]    Overall Loss 0.010561    Objective Loss 0.000000    Distill Loss 0.010561                     LR 0.001000    Time 0.257988    
+2023-11-30 14:18:19,490 - Epoch: [5][11100/31148]    Overall Loss 0.010560    Objective Loss 0.000000    Distill Loss 0.010560                     LR 0.001000    Time 0.257984    
+2023-11-30 14:18:45,297 - Epoch: [5][11200/31148]    Overall Loss 0.010559    Objective Loss 0.000000    Distill Loss 0.010559                     LR 0.001000    Time 0.257985    
+2023-11-30 14:19:11,057 - Epoch: [5][11300/31148]    Overall Loss 0.010559    Objective Loss 0.000000    Distill Loss 0.010559                     LR 0.001000    Time 0.257981    
+2023-11-30 14:19:36,805 - Epoch: [5][11400/31148]    Overall Loss 0.010559    Objective Loss 0.000000    Distill Loss 0.010559                     LR 0.001000    Time 0.257976    
+2023-11-30 14:20:02,538 - Epoch: [5][11500/31148]    Overall Loss 0.010558    Objective Loss 0.000000    Distill Loss 0.010558                     LR 0.001000    Time 0.257970    
+2023-11-30 14:20:28,270 - Epoch: [5][11600/31148]    Overall Loss 0.010559    Objective Loss 0.000000    Distill Loss 0.010559                     LR 0.001000    Time 0.257965    
+2023-11-30 14:20:53,982 - Epoch: [5][11700/31148]    Overall Loss 0.010558    Objective Loss 0.000000    Distill Loss 0.010558                     LR 0.001000    Time 0.257957    
+2023-11-30 14:21:19,742 - Epoch: [5][11800/31148]    Overall Loss 0.010557    Objective Loss 0.000000    Distill Loss 0.010557                     LR 0.001000    Time 0.257954    
+2023-11-30 14:21:45,453 - Epoch: [5][11900/31148]    Overall Loss 0.010556    Objective Loss 0.000000    Distill Loss 0.010556                     LR 0.001000    Time 0.257947    
+2023-11-30 14:22:11,188 - Epoch: [5][12000/31148]    Overall Loss 0.010556    Objective Loss 0.000000    Distill Loss 0.010556                     LR 0.001000    Time 0.257941    
+2023-11-30 14:22:36,962 - Epoch: [5][12100/31148]    Overall Loss 0.010556    Objective Loss 0.000000    Distill Loss 0.010556                     LR 0.001000    Time 0.257940    
+2023-11-30 14:23:02,684 - Epoch: [5][12200/31148]    Overall Loss 0.010555    Objective Loss 0.000000    Distill Loss 0.010555                     LR 0.001000    Time 0.257933    
+2023-11-30 14:23:28,377 - Epoch: [5][12300/31148]    Overall Loss 0.010555    Objective Loss 0.000000    Distill Loss 0.010555                     LR 0.001000    Time 0.257925    
+2023-11-30 14:23:54,120 - Epoch: [5][12400/31148]    Overall Loss 0.010556    Objective Loss 0.000000    Distill Loss 0.010556                     LR 0.001000    Time 0.257921    
+2023-11-30 14:24:19,831 - Epoch: [5][12500/31148]    Overall Loss 0.010555    Objective Loss 0.000000    Distill Loss 0.010555                     LR 0.001000    Time 0.257914    
+2023-11-30 14:24:45,508 - Epoch: [5][12600/31148]    Overall Loss 0.010555    Objective Loss 0.000000    Distill Loss 0.010555                     LR 0.001000    Time 0.257905    
+2023-11-30 14:25:11,260 - Epoch: [5][12700/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257902    
+2023-11-30 14:25:37,027 - Epoch: [5][12800/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257900    
+2023-11-30 14:26:02,744 - Epoch: [5][12900/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257894    
+2023-11-30 14:26:28,459 - Epoch: [5][13000/31148]    Overall Loss 0.010555    Objective Loss 0.000000    Distill Loss 0.010555                     LR 0.001000    Time 0.257888    
+2023-11-30 14:26:54,250 - Epoch: [5][13100/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257888    
+2023-11-30 14:27:19,985 - Epoch: [5][13200/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257884    
+2023-11-30 14:27:45,712 - Epoch: [5][13300/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257879    
+2023-11-30 14:28:11,431 - Epoch: [5][13400/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257873    
+2023-11-30 14:28:37,138 - Epoch: [5][13500/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257867    
+2023-11-30 14:29:02,917 - Epoch: [5][13600/31148]    Overall Loss 0.010554    Objective Loss 0.000000    Distill Loss 0.010554                     LR 0.001000    Time 0.257867    
+2023-11-30 14:29:28,666 - Epoch: [5][13700/31148]    Overall Loss 0.010553    Objective Loss 0.000000    Distill Loss 0.010553                     LR 0.001000    Time 0.257864    
+2023-11-30 14:29:54,399 - Epoch: [5][13800/31148]    Overall Loss 0.010553    Objective Loss 0.000000    Distill Loss 0.010553                     LR 0.001000    Time 0.257860    
+2023-11-30 14:30:20,170 - Epoch: [5][13900/31148]    Overall Loss 0.010552    Objective Loss 0.000000    Distill Loss 0.010552                     LR 0.001000    Time 0.257858    
+2023-11-30 14:30:45,886 - Epoch: [5][14000/31148]    Overall Loss 0.010552    Objective Loss 0.000000    Distill Loss 0.010552                     LR 0.001000    Time 0.257853    
+2023-11-30 14:31:11,621 - Epoch: [5][14100/31148]    Overall Loss 0.010552    Objective Loss 0.000000    Distill Loss 0.010552                     LR 0.001000    Time 0.257849    
+2023-11-30 14:31:37,400 - Epoch: [5][14200/31148]    Overall Loss 0.010552    Objective Loss 0.000000    Distill Loss 0.010552                     LR 0.001000    Time 0.257849    
+2023-11-30 14:32:03,116 - Epoch: [5][14300/31148]    Overall Loss 0.010551    Objective Loss 0.000000    Distill Loss 0.010551                     LR 0.001000    Time 0.257844    
+2023-11-30 14:32:28,885 - Epoch: [5][14400/31148]    Overall Loss 0.010550    Objective Loss 0.000000    Distill Loss 0.010550                     LR 0.001000    Time 0.257842    
+2023-11-30 14:32:54,621 - Epoch: [5][14500/31148]    Overall Loss 0.010549    Objective Loss 0.000000    Distill Loss 0.010549                     LR 0.001000    Time 0.257839    
+2023-11-30 14:33:20,417 - Epoch: [5][14600/31148]    Overall Loss 0.010549    Objective Loss 0.000000    Distill Loss 0.010549                     LR 0.001000    Time 0.257840    
+2023-11-30 14:33:46,074 - Epoch: [5][14700/31148]    Overall Loss 0.010548    Objective Loss 0.000000    Distill Loss 0.010548                     LR 0.001000    Time 0.257831    
+2023-11-30 14:34:11,834 - Epoch: [5][14800/31148]    Overall Loss 0.010547    Objective Loss 0.000000    Distill Loss 0.010547                     LR 0.001000    Time 0.257829    
+2023-11-30 14:34:37,526 - Epoch: [5][14900/31148]    Overall Loss 0.010547    Objective Loss 0.000000    Distill Loss 0.010547                     LR 0.001000    Time 0.257823    
+2023-11-30 14:35:03,306 - Epoch: [5][15000/31148]    Overall Loss 0.010547    Objective Loss 0.000000    Distill Loss 0.010547                     LR 0.001000    Time 0.257822    
+2023-11-30 14:35:29,060 - Epoch: [5][15100/31148]    Overall Loss 0.010547    Objective Loss 0.000000    Distill Loss 0.010547                     LR 0.001000    Time 0.257820    
+2023-11-30 14:35:54,783 - Epoch: [5][15200/31148]    Overall Loss 0.010546    Objective Loss 0.000000    Distill Loss 0.010546                     LR 0.001000    Time 0.257816    
+2023-11-30 14:36:20,482 - Epoch: [5][15300/31148]    Overall Loss 0.010546    Objective Loss 0.000000    Distill Loss 0.010546                     LR 0.001000    Time 0.257811    
+2023-11-30 14:36:46,237 - Epoch: [5][15400/31148]    Overall Loss 0.010546    Objective Loss 0.000000    Distill Loss 0.010546                     LR 0.001000    Time 0.257809    
+2023-11-30 14:37:11,977 - Epoch: [5][15500/31148]    Overall Loss 0.010546    Objective Loss 0.000000    Distill Loss 0.010546                     LR 0.001000    Time 0.257806    
+2023-11-30 14:37:37,726 - Epoch: [5][15600/31148]    Overall Loss 0.010545    Objective Loss 0.000000    Distill Loss 0.010545                     LR 0.001000    Time 0.257804    
+2023-11-30 14:38:03,447 - Epoch: [5][15700/31148]    Overall Loss 0.010544    Objective Loss 0.000000    Distill Loss 0.010544                     LR 0.001000    Time 0.257800    
+2023-11-30 14:38:29,162 - Epoch: [5][15800/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257796    
+2023-11-30 14:38:54,896 - Epoch: [5][15900/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257793    
+2023-11-30 14:39:20,636 - Epoch: [5][16000/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257790    
+2023-11-30 14:39:46,426 - Epoch: [5][16100/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257790    
+2023-11-30 14:40:12,131 - Epoch: [5][16200/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257786    
+2023-11-30 14:40:37,867 - Epoch: [5][16300/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257783    
+2023-11-30 14:41:03,583 - Epoch: [5][16400/31148]    Overall Loss 0.010543    Objective Loss 0.000000    Distill Loss 0.010543                     LR 0.001000    Time 0.257779    
+2023-11-30 14:41:29,315 - Epoch: [5][16500/31148]    Overall Loss 0.010542    Objective Loss 0.000000    Distill Loss 0.010542                     LR 0.001000    Time 0.257776    
+2023-11-30 14:41:55,039 - Epoch: [5][16600/31148]    Overall Loss 0.010542    Objective Loss 0.000000    Distill Loss 0.010542                     LR 0.001000    Time 0.257773    
+2023-11-30 14:42:20,776 - Epoch: [5][16700/31148]    Overall Loss 0.010541    Objective Loss 0.000000    Distill Loss 0.010541                     LR 0.001000    Time 0.257770    
+2023-11-30 14:42:46,478 - Epoch: [5][16800/31148]    Overall Loss 0.010541    Objective Loss 0.000000    Distill Loss 0.010541                     LR 0.001000    Time 0.257765    
+2023-11-30 14:43:12,258 - Epoch: [5][16900/31148]    Overall Loss 0.010540    Objective Loss 0.000000    Distill Loss 0.010540                     LR 0.001000    Time 0.257765    
+2023-11-30 14:43:37,953 - Epoch: [5][17000/31148]    Overall Loss 0.010540    Objective Loss 0.000000    Distill Loss 0.010540                     LR 0.001000    Time 0.257761    
+2023-11-30 14:44:03,710 - Epoch: [5][17100/31148]    Overall Loss 0.010539    Objective Loss 0.000000    Distill Loss 0.010539                     LR 0.001000    Time 0.257759    
+2023-11-30 14:44:29,449 - Epoch: [5][17200/31148]    Overall Loss 0.010539    Objective Loss 0.000000    Distill Loss 0.010539                     LR 0.001000    Time 0.257757    
+2023-11-30 14:44:55,169 - Epoch: [5][17300/31148]    Overall Loss 0.010539    Objective Loss 0.000000    Distill Loss 0.010539                     LR 0.001000    Time 0.257754    
+2023-11-30 14:45:20,924 - Epoch: [5][17400/31148]    Overall Loss 0.010539    Objective Loss 0.000000    Distill Loss 0.010539                     LR 0.001000    Time 0.257752    
+2023-11-30 14:45:46,702 - Epoch: [5][17500/31148]    Overall Loss 0.010538    Objective Loss 0.000000    Distill Loss 0.010538                     LR 0.001000    Time 0.257752    
+2023-11-30 14:46:12,479 - Epoch: [5][17600/31148]    Overall Loss 0.010538    Objective Loss 0.000000    Distill Loss 0.010538                     LR 0.001000    Time 0.257752    
+2023-11-30 14:46:38,217 - Epoch: [5][17700/31148]    Overall Loss 0.010536    Objective Loss 0.000000    Distill Loss 0.010536                     LR 0.001000    Time 0.257750    
+2023-11-30 14:47:03,933 - Epoch: [5][17800/31148]    Overall Loss 0.010537    Objective Loss 0.000000    Distill Loss 0.010537                     LR 0.001000    Time 0.257747    
+2023-11-30 14:47:29,622 - Epoch: [5][17900/31148]    Overall Loss 0.010536    Objective Loss 0.000000    Distill Loss 0.010536                     LR 0.001000    Time 0.257742    
+2023-11-30 14:47:55,310 - Epoch: [5][18000/31148]    Overall Loss 0.010535    Objective Loss 0.000000    Distill Loss 0.010535                     LR 0.001000    Time 0.257737    
+2023-11-30 14:48:21,126 - Epoch: [5][18100/31148]    Overall Loss 0.010535    Objective Loss 0.000000    Distill Loss 0.010535                     LR 0.001000    Time 0.257739    
+2023-11-30 14:48:46,880 - Epoch: [5][18200/31148]    Overall Loss 0.010536    Objective Loss 0.000000    Distill Loss 0.010536                     LR 0.001000    Time 0.257738    
+2023-11-30 14:49:12,623 - Epoch: [5][18300/31148]    Overall Loss 0.010535    Objective Loss 0.000000    Distill Loss 0.010535                     LR 0.001000    Time 0.257736    
+2023-11-30 14:49:38,355 - Epoch: [5][18400/31148]    Overall Loss 0.010535    Objective Loss 0.000000    Distill Loss 0.010535                     LR 0.001000    Time 0.257733    
+2023-11-30 14:50:04,110 - Epoch: [5][18500/31148]    Overall Loss 0.010534    Objective Loss 0.000000    Distill Loss 0.010534                     LR 0.001000    Time 0.257732    
+2023-11-30 14:50:29,883 - Epoch: [5][18600/31148]    Overall Loss 0.010533    Objective Loss 0.000000    Distill Loss 0.010533                     LR 0.001000    Time 0.257732    
+2023-11-30 14:50:55,651 - Epoch: [5][18700/31148]    Overall Loss 0.010533    Objective Loss 0.000000    Distill Loss 0.010533                     LR 0.001000    Time 0.257732    
+2023-11-30 14:51:21,398 - Epoch: [5][18800/31148]    Overall Loss 0.010533    Objective Loss 0.000000    Distill Loss 0.010533                     LR 0.001000    Time 0.257730    
+2023-11-30 14:51:47,150 - Epoch: [5][18900/31148]    Overall Loss 0.010533    Objective Loss 0.000000    Distill Loss 0.010533                     LR 0.001000    Time 0.257729    
+2023-11-30 14:52:12,918 - Epoch: [5][19000/31148]    Overall Loss 0.010532    Objective Loss 0.000000    Distill Loss 0.010532                     LR 0.001000    Time 0.257728    
+2023-11-30 14:52:38,649 - Epoch: [5][19100/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257726    
+2023-11-30 14:53:04,395 - Epoch: [5][19200/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257725    
+2023-11-30 14:53:30,156 - Epoch: [5][19300/31148]    Overall Loss 0.010530    Objective Loss 0.000000    Distill Loss 0.010530                     LR 0.001000    Time 0.257724    
+2023-11-30 14:53:55,901 - Epoch: [5][19400/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257722    
+2023-11-30 14:54:21,615 - Epoch: [5][19500/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257719    
+2023-11-30 14:54:47,284 - Epoch: [5][19600/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257714    
+2023-11-30 14:55:13,058 - Epoch: [5][19700/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257714    
+2023-11-30 14:55:38,780 - Epoch: [5][19800/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257711    
+2023-11-30 14:56:04,489 - Epoch: [5][19900/31148]    Overall Loss 0.010530    Objective Loss 0.000000    Distill Loss 0.010530                     LR 0.001000    Time 0.257708    
+2023-11-30 14:56:30,193 - Epoch: [5][20000/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257704    
+2023-11-30 14:56:55,952 - Epoch: [5][20100/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257704    
+2023-11-30 14:57:21,689 - Epoch: [5][20200/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257702    
+2023-11-30 14:57:47,399 - Epoch: [5][20300/31148]    Overall Loss 0.010531    Objective Loss 0.000000    Distill Loss 0.010531                     LR 0.001000    Time 0.257699    
+2023-11-30 14:58:13,146 - Epoch: [5][20400/31148]    Overall Loss 0.010530    Objective Loss 0.000000    Distill Loss 0.010530                     LR 0.001000    Time 0.257698    
+2023-11-30 14:58:38,897 - Epoch: [5][20500/31148]    Overall Loss 0.010529    Objective Loss 0.000000    Distill Loss 0.010529                     LR 0.001000    Time 0.257697    
+2023-11-30 14:59:04,683 - Epoch: [5][20600/31148]    Overall Loss 0.010528    Objective Loss 0.000000    Distill Loss 0.010528                     LR 0.001000    Time 0.257697    
+2023-11-30 14:59:30,432 - Epoch: [5][20700/31148]    Overall Loss 0.010528    Objective Loss 0.000000    Distill Loss 0.010528                     LR 0.001000    Time 0.257696    
+2023-11-30 14:59:56,196 - Epoch: [5][20800/31148]    Overall Loss 0.010528    Objective Loss 0.000000    Distill Loss 0.010528                     LR 0.001000    Time 0.257696    
+2023-11-30 15:00:21,946 - Epoch: [5][20900/31148]    Overall Loss 0.010528    Objective Loss 0.000000    Distill Loss 0.010528                     LR 0.001000    Time 0.257695    
+2023-11-30 15:00:47,667 - Epoch: [5][21000/31148]    Overall Loss 0.010528    Objective Loss 0.000000    Distill Loss 0.010528                     LR 0.001000    Time 0.257692    
+2023-11-30 15:01:13,393 - Epoch: [5][21100/31148]    Overall Loss 0.010527    Objective Loss 0.000000    Distill Loss 0.010527                     LR 0.001000    Time 0.257690    
+2023-11-30 15:01:39,101 - Epoch: [5][21200/31148]    Overall Loss 0.010527    Objective Loss 0.000000    Distill Loss 0.010527                     LR 0.001000    Time 0.257687    
+2023-11-30 15:02:04,825 - Epoch: [5][21300/31148]    Overall Loss 0.010527    Objective Loss 0.000000    Distill Loss 0.010527                     LR 0.001000    Time 0.257685    
+2023-11-30 15:02:30,590 - Epoch: [5][21400/31148]    Overall Loss 0.010527    Objective Loss 0.000000    Distill Loss 0.010527                     LR 0.001000    Time 0.257685    
+2023-11-30 15:02:56,315 - Epoch: [5][21500/31148]    Overall Loss 0.010526    Objective Loss 0.000000    Distill Loss 0.010526                     LR 0.001000    Time 0.257682    
+2023-11-30 15:03:22,064 - Epoch: [5][21600/31148]    Overall Loss 0.010526    Objective Loss 0.000000    Distill Loss 0.010526                     LR 0.001000    Time 0.257681    
+2023-11-30 15:03:47,767 - Epoch: [5][21700/31148]    Overall Loss 0.010526    Objective Loss 0.000000    Distill Loss 0.010526                     LR 0.001000    Time 0.257678    
+2023-11-30 15:04:13,522 - Epoch: [5][21800/31148]    Overall Loss 0.010526    Objective Loss 0.000000    Distill Loss 0.010526                     LR 0.001000    Time 0.257678    
+2023-11-30 15:04:39,228 - Epoch: [5][21900/31148]    Overall Loss 0.010525    Objective Loss 0.000000    Distill Loss 0.010525                     LR 0.001000    Time 0.257675    
+2023-11-30 15:05:04,904 - Epoch: [5][22000/31148]    Overall Loss 0.010525    Objective Loss 0.000000    Distill Loss 0.010525                     LR 0.001000    Time 0.257670    
+2023-11-30 15:05:30,619 - Epoch: [5][22100/31148]    Overall Loss 0.010524    Objective Loss 0.000000    Distill Loss 0.010524                     LR 0.001000    Time 0.257668    
+2023-11-30 15:05:56,336 - Epoch: [5][22200/31148]    Overall Loss 0.010524    Objective Loss 0.000000    Distill Loss 0.010524                     LR 0.001000    Time 0.257666    
+2023-11-30 15:06:22,066 - Epoch: [5][22300/31148]    Overall Loss 0.010523    Objective Loss 0.000000    Distill Loss 0.010523                     LR 0.001000    Time 0.257664    
+2023-11-30 15:06:47,802 - Epoch: [5][22400/31148]    Overall Loss 0.010523    Objective Loss 0.000000    Distill Loss 0.010523                     LR 0.001000    Time 0.257662    
+2023-11-30 15:07:13,501 - Epoch: [5][22500/31148]    Overall Loss 0.010523    Objective Loss 0.000000    Distill Loss 0.010523                     LR 0.001000    Time 0.257659    
+2023-11-30 15:07:39,266 - Epoch: [5][22600/31148]    Overall Loss 0.010522    Objective Loss 0.000000    Distill Loss 0.010522                     LR 0.001000    Time 0.257659    
+2023-11-30 15:08:04,995 - Epoch: [5][22700/31148]    Overall Loss 0.010522    Objective Loss 0.000000    Distill Loss 0.010522                     LR 0.001000    Time 0.257657    
+2023-11-30 15:08:30,723 - Epoch: [5][22800/31148]    Overall Loss 0.010521    Objective Loss 0.000000    Distill Loss 0.010521                     LR 0.001000    Time 0.257656    
+2023-11-30 15:08:56,448 - Epoch: [5][22900/31148]    Overall Loss 0.010521    Objective Loss 0.000000    Distill Loss 0.010521                     LR 0.001000    Time 0.257654    
+2023-11-30 15:09:22,225 - Epoch: [5][23000/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257654    
+2023-11-30 15:09:48,001 - Epoch: [5][23100/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257654    
+2023-11-30 15:10:13,756 - Epoch: [5][23200/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257654    
+2023-11-30 15:10:39,547 - Epoch: [5][23300/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257655    
+2023-11-30 15:11:05,319 - Epoch: [5][23400/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257655    
+2023-11-30 15:11:31,096 - Epoch: [5][23500/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257655    
+2023-11-30 15:11:56,869 - Epoch: [5][23600/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257656    
+2023-11-30 15:12:22,610 - Epoch: [5][23700/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257654    
+2023-11-30 15:12:48,405 - Epoch: [5][23800/31148]    Overall Loss 0.010520    Objective Loss 0.000000    Distill Loss 0.010520                     LR 0.001000    Time 0.257656    
+2023-11-30 15:13:14,123 - Epoch: [5][23900/31148]    Overall Loss 0.010519    Objective Loss 0.000000    Distill Loss 0.010519                     LR 0.001000    Time 0.257653    
+2023-11-30 15:13:39,884 - Epoch: [5][24000/31148]    Overall Loss 0.010519    Objective Loss 0.000000    Distill Loss 0.010519                     LR 0.001000    Time 0.257653    
+2023-11-30 15:14:05,621 - Epoch: [5][24100/31148]    Overall Loss 0.010519    Objective Loss 0.000000    Distill Loss 0.010519                     LR 0.001000    Time 0.257652    
+2023-11-30 15:14:31,397 - Epoch: [5][24200/31148]    Overall Loss 0.010519    Objective Loss 0.000000    Distill Loss 0.010519                     LR 0.001000    Time 0.257652    
+2023-11-30 15:14:57,090 - Epoch: [5][24300/31148]    Overall Loss 0.010518    Objective Loss 0.000000    Distill Loss 0.010518                     LR 0.001000    Time 0.257649    
+2023-11-30 15:15:22,802 - Epoch: [5][24400/31148]    Overall Loss 0.010518    Objective Loss 0.000000    Distill Loss 0.010518                     LR 0.001000    Time 0.257647    
+2023-11-30 15:15:48,533 - Epoch: [5][24500/31148]    Overall Loss 0.010518    Objective Loss 0.000000    Distill Loss 0.010518                     LR 0.001000    Time 0.257645    
+2023-11-30 15:16:14,269 - Epoch: [5][24600/31148]    Overall Loss 0.010518    Objective Loss 0.000000    Distill Loss 0.010518                     LR 0.001000    Time 0.257644    
+2023-11-30 15:16:40,010 - Epoch: [5][24700/31148]    Overall Loss 0.010517    Objective Loss 0.000000    Distill Loss 0.010517                     LR 0.001000    Time 0.257643    
+2023-11-30 15:17:05,757 - Epoch: [5][24800/31148]    Overall Loss 0.010517    Objective Loss 0.000000    Distill Loss 0.010517                     LR 0.001000    Time 0.257642    
+2023-11-30 15:17:31,477 - Epoch: [5][24900/31148]    Overall Loss 0.010517    Objective Loss 0.000000    Distill Loss 0.010517                     LR 0.001000    Time 0.257640    
+2023-11-30 15:17:57,196 - Epoch: [5][25000/31148]    Overall Loss 0.010516    Objective Loss 0.000000    Distill Loss 0.010516                     LR 0.001000    Time 0.257638    
+2023-11-30 15:18:22,982 - Epoch: [5][25100/31148]    Overall Loss 0.010516    Objective Loss 0.000000    Distill Loss 0.010516                     LR 0.001000    Time 0.257639    
+2023-11-30 15:18:48,781 - Epoch: [5][25200/31148]    Overall Loss 0.010515    Objective Loss 0.000000    Distill Loss 0.010515                     LR 0.001000    Time 0.257640    
+2023-11-30 15:19:14,508 - Epoch: [5][25300/31148]    Overall Loss 0.010515    Objective Loss 0.000000    Distill Loss 0.010515                     LR 0.001000    Time 0.257639    
+2023-11-30 15:19:40,237 - Epoch: [5][25400/31148]    Overall Loss 0.010515    Objective Loss 0.000000    Distill Loss 0.010515                     LR 0.001000    Time 0.257637    
+2023-11-30 15:20:05,910 - Epoch: [5][25500/31148]    Overall Loss 0.010515    Objective Loss 0.000000    Distill Loss 0.010515                     LR 0.001000    Time 0.257634    
+2023-11-30 15:20:31,648 - Epoch: [5][25600/31148]    Overall Loss 0.010514    Objective Loss 0.000000    Distill Loss 0.010514                     LR 0.001000    Time 0.257633    
+2023-11-30 15:20:57,370 - Epoch: [5][25700/31148]    Overall Loss 0.010514    Objective Loss 0.000000    Distill Loss 0.010514                     LR 0.001000    Time 0.257631    
+2023-11-30 15:21:23,090 - Epoch: [5][25800/31148]    Overall Loss 0.010514    Objective Loss 0.000000    Distill Loss 0.010514                     LR 0.001000    Time 0.257629    
+2023-11-30 15:21:48,844 - Epoch: [5][25900/31148]    Overall Loss 0.010514    Objective Loss 0.000000    Distill Loss 0.010514                     LR 0.001000    Time 0.257629    
+2023-11-30 15:22:14,562 - Epoch: [5][26000/31148]    Overall Loss 0.010513    Objective Loss 0.000000    Distill Loss 0.010513                     LR 0.001000    Time 0.257627    
+2023-11-30 15:22:40,313 - Epoch: [5][26100/31148]    Overall Loss 0.010513    Objective Loss 0.000000    Distill Loss 0.010513                     LR 0.001000    Time 0.257626    
+2023-11-30 15:23:06,087 - Epoch: [5][26200/31148]    Overall Loss 0.010513    Objective Loss 0.000000    Distill Loss 0.010513                     LR 0.001000    Time 0.257627    
+2023-11-30 15:23:31,820 - Epoch: [5][26300/31148]    Overall Loss 0.010513    Objective Loss 0.000000    Distill Loss 0.010513                     LR 0.001000    Time 0.257625    
+2023-11-30 15:23:57,555 - Epoch: [5][26400/31148]    Overall Loss 0.010512    Objective Loss 0.000000    Distill Loss 0.010512                     LR 0.001000    Time 0.257624    
+2023-11-30 15:24:23,266 - Epoch: [5][26500/31148]    Overall Loss 0.010512    Objective Loss 0.000000    Distill Loss 0.010512                     LR 0.001000    Time 0.257622    
+2023-11-30 15:24:49,040 - Epoch: [5][26600/31148]    Overall Loss 0.010512    Objective Loss 0.000000    Distill Loss 0.010512                     LR 0.001000    Time 0.257623    
+2023-11-30 15:25:14,838 - Epoch: [5][26700/31148]    Overall Loss 0.010512    Objective Loss 0.000000    Distill Loss 0.010512                     LR 0.001000    Time 0.257624    
+2023-11-30 15:25:40,586 - Epoch: [5][26800/31148]    Overall Loss 0.010511    Objective Loss 0.000000    Distill Loss 0.010511                     LR 0.001000    Time 0.257623    
+2023-11-30 15:26:06,332 - Epoch: [5][26900/31148]    Overall Loss 0.010511    Objective Loss 0.000000    Distill Loss 0.010511                     LR 0.001000    Time 0.257623    
+2023-11-30 15:26:32,044 - Epoch: [5][27000/31148]    Overall Loss 0.010510    Objective Loss 0.000000    Distill Loss 0.010510                     LR 0.001000    Time 0.257621    
+2023-11-30 15:26:57,814 - Epoch: [5][27100/31148]    Overall Loss 0.010510    Objective Loss 0.000000    Distill Loss 0.010510                     LR 0.001000    Time 0.257621    
+2023-11-30 15:27:23,573 - Epoch: [5][27200/31148]    Overall Loss 0.010510    Objective Loss 0.000000    Distill Loss 0.010510                     LR 0.001000    Time 0.257621    
+2023-11-30 15:27:49,323 - Epoch: [5][27300/31148]    Overall Loss 0.010509    Objective Loss 0.000000    Distill Loss 0.010509                     LR 0.001000    Time 0.257620    
+2023-11-30 15:28:15,029 - Epoch: [5][27400/31148]    Overall Loss 0.010509    Objective Loss 0.000000    Distill Loss 0.010509                     LR 0.001000    Time 0.257618    
+2023-11-30 15:28:40,727 - Epoch: [5][27500/31148]    Overall Loss 0.010509    Objective Loss 0.000000    Distill Loss 0.010509                     LR 0.001000    Time 0.257615    
+2023-11-30 15:29:06,462 - Epoch: [5][27600/31148]    Overall Loss 0.010509    Objective Loss 0.000000    Distill Loss 0.010509                     LR 0.001000    Time 0.257614    
+2023-11-30 15:29:32,197 - Epoch: [5][27700/31148]    Overall Loss 0.010509    Objective Loss 0.000000    Distill Loss 0.010509                     LR 0.001000    Time 0.257613    
+2023-11-30 15:29:57,923 - Epoch: [5][27800/31148]    Overall Loss 0.010509    Objective Loss 0.000000    Distill Loss 0.010509                     LR 0.001000    Time 0.257612    
+2023-11-30 15:30:23,610 - Epoch: [5][27900/31148]    Overall Loss 0.010508    Objective Loss 0.000000    Distill Loss 0.010508                     LR 0.001000    Time 0.257609    
+2023-11-30 15:30:49,371 - Epoch: [5][28000/31148]    Overall Loss 0.010508    Objective Loss 0.000000    Distill Loss 0.010508                     LR 0.001000    Time 0.257609    
+2023-11-30 15:31:15,143 - Epoch: [5][28100/31148]    Overall Loss 0.010507    Objective Loss 0.000000    Distill Loss 0.010507                     LR 0.001000    Time 0.257609    
+2023-11-30 15:31:40,864 - Epoch: [5][28200/31148]    Overall Loss 0.010507    Objective Loss 0.000000    Distill Loss 0.010507                     LR 0.001000    Time 0.257608    
+2023-11-30 15:32:06,597 - Epoch: [5][28300/31148]    Overall Loss 0.010506    Objective Loss 0.000000    Distill Loss 0.010506                     LR 0.001000    Time 0.257607    
+2023-11-30 15:32:32,300 - Epoch: [5][28400/31148]    Overall Loss 0.010506    Objective Loss 0.000000    Distill Loss 0.010506                     LR 0.001000    Time 0.257605    
+2023-11-30 15:32:58,070 - Epoch: [5][28500/31148]    Overall Loss 0.010506    Objective Loss 0.000000    Distill Loss 0.010506                     LR 0.001000    Time 0.257605    
+2023-11-30 15:33:23,863 - Epoch: [5][28600/31148]    Overall Loss 0.010506    Objective Loss 0.000000    Distill Loss 0.010506                     LR 0.001000    Time 0.257606    
+2023-11-30 15:33:49,626 - Epoch: [5][28700/31148]    Overall Loss 0.010505    Objective Loss 0.000000    Distill Loss 0.010505                     LR 0.001000    Time 0.257606    
+2023-11-30 15:34:15,377 - Epoch: [5][28800/31148]    Overall Loss 0.010505    Objective Loss 0.000000    Distill Loss 0.010505                     LR 0.001000    Time 0.257606    
+2023-11-30 15:34:41,126 - Epoch: [5][28900/31148]    Overall Loss 0.010505    Objective Loss 0.000000    Distill Loss 0.010505                     LR 0.001000    Time 0.257605    
+2023-11-30 15:35:06,898 - Epoch: [5][29000/31148]    Overall Loss 0.010505    Objective Loss 0.000000    Distill Loss 0.010505                     LR 0.001000    Time 0.257605    
+2023-11-30 15:35:32,667 - Epoch: [5][29100/31148]    Overall Loss 0.010504    Objective Loss 0.000000    Distill Loss 0.010504                     LR 0.001000    Time 0.257606    
+2023-11-30 15:35:58,398 - Epoch: [5][29200/31148]    Overall Loss 0.010504    Objective Loss 0.000000    Distill Loss 0.010504                     LR 0.001000    Time 0.257604    
+2023-11-30 15:36:24,120 - Epoch: [5][29300/31148]    Overall Loss 0.010503    Objective Loss 0.000000    Distill Loss 0.010503                     LR 0.001000    Time 0.257603    
+2023-11-30 15:36:49,864 - Epoch: [5][29400/31148]    Overall Loss 0.010503    Objective Loss 0.000000    Distill Loss 0.010503                     LR 0.001000    Time 0.257602    
+2023-11-30 15:37:15,628 - Epoch: [5][29500/31148]    Overall Loss 0.010503    Objective Loss 0.000000    Distill Loss 0.010503                     LR 0.001000    Time 0.257602    
+2023-11-30 15:37:41,404 - Epoch: [5][29600/31148]    Overall Loss 0.010502    Objective Loss 0.000000    Distill Loss 0.010502                     LR 0.001000    Time 0.257603    
+2023-11-30 15:38:07,141 - Epoch: [5][29700/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257602    
+2023-11-30 15:38:32,879 - Epoch: [5][29800/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257601    
+2023-11-30 15:38:58,659 - Epoch: [5][29900/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257602    
+2023-11-30 15:39:24,381 - Epoch: [5][30000/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257600    
+2023-11-30 15:39:50,115 - Epoch: [5][30100/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257599    
+2023-11-30 15:40:15,847 - Epoch: [5][30200/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257598    
+2023-11-30 15:40:41,591 - Epoch: [5][30300/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257598    
+2023-11-30 15:41:07,324 - Epoch: [5][30400/31148]    Overall Loss 0.010501    Objective Loss 0.000000    Distill Loss 0.010501                     LR 0.001000    Time 0.257597    
+2023-11-30 15:41:33,076 - Epoch: [5][30500/31148]    Overall Loss 0.010500    Objective Loss 0.000000    Distill Loss 0.010500                     LR 0.001000    Time 0.257596    
+2023-11-30 15:41:58,787 - Epoch: [5][30600/31148]    Overall Loss 0.010500    Objective Loss 0.000000    Distill Loss 0.010500                     LR 0.001000    Time 0.257595    
+2023-11-30 15:42:24,529 - Epoch: [5][30700/31148]    Overall Loss 0.010499    Objective Loss 0.000000    Distill Loss 0.010499                     LR 0.001000    Time 0.257594    
+2023-11-30 15:42:50,302 - Epoch: [5][30800/31148]    Overall Loss 0.010499    Objective Loss 0.000000    Distill Loss 0.010499                     LR 0.001000    Time 0.257594    
+2023-11-30 15:43:16,009 - Epoch: [5][30900/31148]    Overall Loss 0.010499    Objective Loss 0.000000    Distill Loss 0.010499                     LR 0.001000    Time 0.257593    
+2023-11-30 15:43:41,784 - Epoch: [5][31000/31148]    Overall Loss 0.010499    Objective Loss 0.000000    Distill Loss 0.010499                     LR 0.001000    Time 0.257593    
+2023-11-30 15:44:07,545 - Epoch: [5][31100/31148]    Overall Loss 0.010498    Objective Loss 0.000000    Distill Loss 0.010498                     LR 0.001000    Time 0.257593    
+2023-11-30 15:44:20,410 - Epoch: [5][31148/31148]    Overall Loss 0.010498    Objective Loss 0.000000    Distill Loss 0.010498                     LR 0.001000    Time 0.257609    
+2023-11-30 15:44:20,775 - --- validate (epoch=5)-----------
+2023-11-30 15:44:20,775 - 167951 samples (100 per mini-batch)
+2023-11-30 15:44:41,835 - Epoch: [5][  100/ 1680]    Loss 0.000000    Overall Loss 0.011065    
+2023-11-30 15:45:01,550 - Epoch: [5][  200/ 1680]    Loss 0.000000    Overall Loss 0.011110    
+2023-11-30 15:45:21,250 - Epoch: [5][  300/ 1680]    Loss 0.000000    Overall Loss 0.011118    
+2023-11-30 15:45:40,976 - Epoch: [5][  400/ 1680]    Loss 0.000000    Overall Loss 0.011110    
+2023-11-30 15:46:00,651 - Epoch: [5][  500/ 1680]    Loss 0.000000    Overall Loss 0.011109    
+2023-11-30 15:46:20,361 - Epoch: [5][  600/ 1680]    Loss 0.000000    Overall Loss 0.011111    
+2023-11-30 15:46:40,059 - Epoch: [5][  700/ 1680]    Loss 0.000000    Overall Loss 0.011110    
+2023-11-30 15:46:59,784 - Epoch: [5][  800/ 1680]    Loss 0.000000    Overall Loss 0.011116    
+2023-11-30 15:47:19,493 - Epoch: [5][  900/ 1680]    Loss 0.000000    Overall Loss 0.011113    
+2023-11-30 15:47:39,201 - Epoch: [5][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.011110    
+2023-11-30 15:47:58,940 - Epoch: [5][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.011118    
+2023-11-30 15:48:18,647 - Epoch: [5][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.011119    
+2023-11-30 15:48:38,359 - Epoch: [5][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.011118    
+2023-11-30 15:48:58,081 - Epoch: [5][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.011118    
+2023-11-30 15:49:17,780 - Epoch: [5][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.011120    
+2023-11-30 15:49:37,497 - Epoch: [5][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.011120    
+2023-11-30 15:49:53,166 - Epoch: [5][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.011123    
+2023-11-30 15:49:53,360 - ==> Overall Loss: 0.011
+
+2023-11-30 15:49:53,365 - ==> Best [Overall Loss: 0.011123 on epoch: 5]
+2023-11-30 15:49:53,365 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 15:49:53,403 - 
+
+2023-11-30 15:49:53,403 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 15:50:26,099 - Epoch: [6][  100/31148]    Overall Loss 0.010258    Objective Loss 0.000000    Distill Loss 0.010258                     LR 0.001000    Time 0.326923    
+2023-11-30 15:50:51,878 - Epoch: [6][  200/31148]    Overall Loss 0.010228    Objective Loss 0.000000    Distill Loss 0.010228                     LR 0.001000    Time 0.292343    
+2023-11-30 15:51:17,618 - Epoch: [6][  300/31148]    Overall Loss 0.010274    Objective Loss 0.000000    Distill Loss 0.010274                     LR 0.001000    Time 0.280687    
+2023-11-30 15:51:43,316 - Epoch: [6][  400/31148]    Overall Loss 0.010297    Objective Loss 0.000000    Distill Loss 0.010297                     LR 0.001000    Time 0.274753    
+2023-11-30 15:52:09,048 - Epoch: [6][  500/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.271262    
+2023-11-30 15:52:34,792 - Epoch: [6][  600/31148]    Overall Loss 0.010311    Objective Loss 0.000000    Distill Loss 0.010311                     LR 0.001000    Time 0.268953    
+2023-11-30 15:53:00,526 - Epoch: [6][  700/31148]    Overall Loss 0.010332    Objective Loss 0.000000    Distill Loss 0.010332                     LR 0.001000    Time 0.267291    
+2023-11-30 15:53:26,241 - Epoch: [6][  800/31148]    Overall Loss 0.010339    Objective Loss 0.000000    Distill Loss 0.010339                     LR 0.001000    Time 0.266019    
+2023-11-30 15:53:52,041 - Epoch: [6][  900/31148]    Overall Loss 0.010334    Objective Loss 0.000000    Distill Loss 0.010334                     LR 0.001000    Time 0.265125    
+2023-11-30 15:54:17,775 - Epoch: [6][ 1000/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.264345    
+2023-11-30 15:54:43,511 - Epoch: [6][ 1100/31148]    Overall Loss 0.010328    Objective Loss 0.000000    Distill Loss 0.010328                     LR 0.001000    Time 0.263708    
+2023-11-30 15:55:09,272 - Epoch: [6][ 1200/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.263197    
+2023-11-30 15:55:35,062 - Epoch: [6][ 1300/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.262787    
+2023-11-30 15:56:00,817 - Epoch: [6][ 1400/31148]    Overall Loss 0.010330    Objective Loss 0.000000    Distill Loss 0.010330                     LR 0.001000    Time 0.262412    
+2023-11-30 15:56:26,579 - Epoch: [6][ 1500/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.262090    
+2023-11-30 15:56:52,285 - Epoch: [6][ 1600/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.261774    
+2023-11-30 15:57:18,015 - Epoch: [6][ 1700/31148]    Overall Loss 0.010328    Objective Loss 0.000000    Distill Loss 0.010328                     LR 0.001000    Time 0.261510    
+2023-11-30 15:57:43,792 - Epoch: [6][ 1800/31148]    Overall Loss 0.010329    Objective Loss 0.000000    Distill Loss 0.010329                     LR 0.001000    Time 0.261300    
+2023-11-30 15:58:09,574 - Epoch: [6][ 1900/31148]    Overall Loss 0.010331    Objective Loss 0.000000    Distill Loss 0.010331                     LR 0.001000    Time 0.261116    
+2023-11-30 15:58:35,381 - Epoch: [6][ 2000/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.260962    
+2023-11-30 15:59:01,107 - Epoch: [6][ 2100/31148]    Overall Loss 0.010329    Objective Loss 0.000000    Distill Loss 0.010329                     LR 0.001000    Time 0.260784    
+2023-11-30 15:59:26,848 - Epoch: [6][ 2200/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.260630    
+2023-11-30 15:59:52,584 - Epoch: [6][ 2300/31148]    Overall Loss 0.010331    Objective Loss 0.000000    Distill Loss 0.010331                     LR 0.001000    Time 0.260487    
+2023-11-30 16:00:18,304 - Epoch: [6][ 2400/31148]    Overall Loss 0.010336    Objective Loss 0.000000    Distill Loss 0.010336                     LR 0.001000    Time 0.260349    
+2023-11-30 16:00:44,026 - Epoch: [6][ 2500/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.260223    
+2023-11-30 16:01:09,780 - Epoch: [6][ 2600/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.001000    Time 0.260118    
+2023-11-30 16:01:35,467 - Epoch: [6][ 2700/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.259997    
+2023-11-30 16:02:01,230 - Epoch: [6][ 2800/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.259911    
+2023-11-30 16:02:26,968 - Epoch: [6][ 2900/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.259823    
+2023-11-30 16:02:52,721 - Epoch: [6][ 3000/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.001000    Time 0.259746    
+2023-11-30 16:03:18,522 - Epoch: [6][ 3100/31148]    Overall Loss 0.010338    Objective Loss 0.000000    Distill Loss 0.010338                     LR 0.001000    Time 0.259689    
+2023-11-30 16:03:44,222 - Epoch: [6][ 3200/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.259604    
+2023-11-30 16:04:09,933 - Epoch: [6][ 3300/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.259528    
+2023-11-30 16:04:35,688 - Epoch: [6][ 3400/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.259469    
+2023-11-30 16:05:01,428 - Epoch: [6][ 3500/31148]    Overall Loss 0.010333    Objective Loss 0.000000    Distill Loss 0.010333                     LR 0.001000    Time 0.259409    
+2023-11-30 16:05:27,190 - Epoch: [6][ 3600/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.259359    
+2023-11-30 16:05:52,943 - Epoch: [6][ 3700/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.259309    
+2023-11-30 16:06:18,672 - Epoch: [6][ 3800/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.259255    
+2023-11-30 16:06:44,450 - Epoch: [6][ 3900/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.259216    
+2023-11-30 16:07:10,164 - Epoch: [6][ 4000/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.259164    
+2023-11-30 16:07:35,835 - Epoch: [6][ 4100/31148]    Overall Loss 0.010336    Objective Loss 0.000000    Distill Loss 0.010336                     LR 0.001000    Time 0.259103    
+2023-11-30 16:08:01,597 - Epoch: [6][ 4200/31148]    Overall Loss 0.010338    Objective Loss 0.000000    Distill Loss 0.010338                     LR 0.001000    Time 0.259067    
+2023-11-30 16:08:27,320 - Epoch: [6][ 4300/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.001000    Time 0.259024    
+2023-11-30 16:08:53,069 - Epoch: [6][ 4400/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.001000    Time 0.258988    
+2023-11-30 16:09:18,820 - Epoch: [6][ 4500/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.258955    
+2023-11-30 16:09:44,582 - Epoch: [6][ 4600/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.001000    Time 0.258926    
+2023-11-30 16:10:10,302 - Epoch: [6][ 4700/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.258888    
+2023-11-30 16:10:36,042 - Epoch: [6][ 4800/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.258857    
+2023-11-30 16:11:01,821 - Epoch: [6][ 4900/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.001000    Time 0.258834    
+2023-11-30 16:11:27,556 - Epoch: [6][ 5000/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.001000    Time 0.258804    
+2023-11-30 16:11:53,311 - Epoch: [6][ 5100/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.001000    Time 0.258779    
+2023-11-30 16:12:19,038 - Epoch: [6][ 5200/31148]    Overall Loss 0.010347    Objective Loss 0.000000    Distill Loss 0.010347                     LR 0.001000    Time 0.258750    
+2023-11-30 16:12:44,831 - Epoch: [6][ 5300/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.001000    Time 0.258734    
+2023-11-30 16:13:10,565 - Epoch: [6][ 5400/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.001000    Time 0.258707    
+2023-11-30 16:13:36,347 - Epoch: [6][ 5500/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.001000    Time 0.258691    
+2023-11-30 16:14:02,092 - Epoch: [6][ 5600/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.001000    Time 0.258668    
+2023-11-30 16:14:27,849 - Epoch: [6][ 5700/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.001000    Time 0.258648    
+2023-11-30 16:14:53,556 - Epoch: [6][ 5800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.001000    Time 0.258621    
+2023-11-30 16:15:19,321 - Epoch: [6][ 5900/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.001000    Time 0.258603    
+2023-11-30 16:15:45,081 - Epoch: [6][ 6000/31148]    Overall Loss 0.010340    Objective Loss 0.000000    Distill Loss 0.010340                     LR 0.001000    Time 0.258586    
+2023-11-30 16:16:10,864 - Epoch: [6][ 6100/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.001000    Time 0.258573    
+2023-11-30 16:16:36,593 - Epoch: [6][ 6200/31148]    Overall Loss 0.010339    Objective Loss 0.000000    Distill Loss 0.010339                     LR 0.001000    Time 0.258552    
+2023-11-30 16:17:02,348 - Epoch: [6][ 6300/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.258536    
+2023-11-30 16:17:28,110 - Epoch: [6][ 6400/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.258521    
+2023-11-30 16:17:53,894 - Epoch: [6][ 6500/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.258510    
+2023-11-30 16:18:19,620 - Epoch: [6][ 6600/31148]    Overall Loss 0.010334    Objective Loss 0.000000    Distill Loss 0.010334                     LR 0.001000    Time 0.258491    
+2023-11-30 16:18:45,350 - Epoch: [6][ 6700/31148]    Overall Loss 0.010334    Objective Loss 0.000000    Distill Loss 0.010334                     LR 0.001000    Time 0.258473    
+2023-11-30 16:19:11,133 - Epoch: [6][ 6800/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.258463    
+2023-11-30 16:19:36,876 - Epoch: [6][ 6900/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.258448    
+2023-11-30 16:20:02,635 - Epoch: [6][ 7000/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.258435    
+2023-11-30 16:20:28,358 - Epoch: [6][ 7100/31148]    Overall Loss 0.010335    Objective Loss 0.000000    Distill Loss 0.010335                     LR 0.001000    Time 0.258418    
+2023-11-30 16:20:54,122 - Epoch: [6][ 7200/31148]    Overall Loss 0.010336    Objective Loss 0.000000    Distill Loss 0.010336                     LR 0.001000    Time 0.258406    
+2023-11-30 16:21:19,851 - Epoch: [6][ 7300/31148]    Overall Loss 0.010336    Objective Loss 0.000000    Distill Loss 0.010336                     LR 0.001000    Time 0.258391    
+2023-11-30 16:21:45,565 - Epoch: [6][ 7400/31148]    Overall Loss 0.010336    Objective Loss 0.000000    Distill Loss 0.010336                     LR 0.001000    Time 0.258374    
+2023-11-30 16:22:11,292 - Epoch: [6][ 7500/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.258358    
+2023-11-30 16:22:37,075 - Epoch: [6][ 7600/31148]    Overall Loss 0.010337    Objective Loss 0.000000    Distill Loss 0.010337                     LR 0.001000    Time 0.258351    
+2023-11-30 16:23:02,810 - Epoch: [6][ 7700/31148]    Overall Loss 0.010336    Objective Loss 0.000000    Distill Loss 0.010336                     LR 0.001000    Time 0.258338    
+2023-11-30 16:23:28,540 - Epoch: [6][ 7800/31148]    Overall Loss 0.010334    Objective Loss 0.000000    Distill Loss 0.010334                     LR 0.001000    Time 0.258324    
+2023-11-30 16:23:54,286 - Epoch: [6][ 7900/31148]    Overall Loss 0.010332    Objective Loss 0.000000    Distill Loss 0.010332                     LR 0.001000    Time 0.258313    
+2023-11-30 16:24:20,030 - Epoch: [6][ 8000/31148]    Overall Loss 0.010330    Objective Loss 0.000000    Distill Loss 0.010330                     LR 0.001000    Time 0.258302    
+2023-11-30 16:24:45,762 - Epoch: [6][ 8100/31148]    Overall Loss 0.010331    Objective Loss 0.000000    Distill Loss 0.010331                     LR 0.001000    Time 0.258289    
+2023-11-30 16:25:11,503 - Epoch: [6][ 8200/31148]    Overall Loss 0.010328    Objective Loss 0.000000    Distill Loss 0.010328                     LR 0.001000    Time 0.258278    
+2023-11-30 16:25:37,275 - Epoch: [6][ 8300/31148]    Overall Loss 0.010330    Objective Loss 0.000000    Distill Loss 0.010330                     LR 0.001000    Time 0.258271    
+2023-11-30 16:26:02,998 - Epoch: [6][ 8400/31148]    Overall Loss 0.010329    Objective Loss 0.000000    Distill Loss 0.010329                     LR 0.001000    Time 0.258259    
+2023-11-30 16:26:28,767 - Epoch: [6][ 8500/31148]    Overall Loss 0.010328    Objective Loss 0.000000    Distill Loss 0.010328                     LR 0.001000    Time 0.258251    
+2023-11-30 16:26:54,598 - Epoch: [6][ 8600/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.258252    
+2023-11-30 16:27:20,342 - Epoch: [6][ 8700/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.258242    
+2023-11-30 16:27:46,109 - Epoch: [6][ 8800/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.258235    
+2023-11-30 16:28:11,858 - Epoch: [6][ 8900/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258227    
+2023-11-30 16:28:37,632 - Epoch: [6][ 9000/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258221    
+2023-11-30 16:29:03,350 - Epoch: [6][ 9100/31148]    Overall Loss 0.010324    Objective Loss 0.000000    Distill Loss 0.010324                     LR 0.001000    Time 0.258209    
+2023-11-30 16:29:29,049 - Epoch: [6][ 9200/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258196    
+2023-11-30 16:29:54,793 - Epoch: [6][ 9300/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258187    
+2023-11-30 16:30:20,531 - Epoch: [6][ 9400/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258178    
+2023-11-30 16:30:46,235 - Epoch: [6][ 9500/31148]    Overall Loss 0.010324    Objective Loss 0.000000    Distill Loss 0.010324                     LR 0.001000    Time 0.258166    
+2023-11-30 16:31:11,967 - Epoch: [6][ 9600/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258157    
+2023-11-30 16:31:37,737 - Epoch: [6][ 9700/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258152    
+2023-11-30 16:32:03,521 - Epoch: [6][ 9800/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.258149    
+2023-11-30 16:32:29,242 - Epoch: [6][ 9900/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258139    
+2023-11-30 16:32:55,008 - Epoch: [6][10000/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258134    
+2023-11-30 16:33:20,722 - Epoch: [6][10100/31148]    Overall Loss 0.010324    Objective Loss 0.000000    Distill Loss 0.010324                     LR 0.001000    Time 0.258124    
+2023-11-30 16:33:46,461 - Epoch: [6][10200/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258116    
+2023-11-30 16:34:12,196 - Epoch: [6][10300/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258109    
+2023-11-30 16:34:37,911 - Epoch: [6][10400/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258099    
+2023-11-30 16:35:03,692 - Epoch: [6][10500/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258096    
+2023-11-30 16:35:29,392 - Epoch: [6][10600/31148]    Overall Loss 0.010327    Objective Loss 0.000000    Distill Loss 0.010327                     LR 0.001000    Time 0.258086    
+2023-11-30 16:35:55,122 - Epoch: [6][10700/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258078    
+2023-11-30 16:36:20,906 - Epoch: [6][10800/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258076    
+2023-11-30 16:36:46,675 - Epoch: [6][10900/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258072    
+2023-11-30 16:37:12,378 - Epoch: [6][11000/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258062    
+2023-11-30 16:37:38,194 - Epoch: [6][11100/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258063    
+2023-11-30 16:38:03,938 - Epoch: [6][11200/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258057    
+2023-11-30 16:38:29,708 - Epoch: [6][11300/31148]    Overall Loss 0.010324    Objective Loss 0.000000    Distill Loss 0.010324                     LR 0.001000    Time 0.258054    
+2023-11-30 16:38:55,431 - Epoch: [6][11400/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258046    
+2023-11-30 16:39:21,186 - Epoch: [6][11500/31148]    Overall Loss 0.010326    Objective Loss 0.000000    Distill Loss 0.010326                     LR 0.001000    Time 0.258042    
+2023-11-30 16:39:46,937 - Epoch: [6][11600/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258037    
+2023-11-30 16:40:12,717 - Epoch: [6][11700/31148]    Overall Loss 0.010324    Objective Loss 0.000000    Distill Loss 0.010324                     LR 0.001000    Time 0.258034    
+2023-11-30 16:40:38,488 - Epoch: [6][11800/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258031    
+2023-11-30 16:41:04,294 - Epoch: [6][11900/31148]    Overall Loss 0.010325    Objective Loss 0.000000    Distill Loss 0.010325                     LR 0.001000    Time 0.258031    
+2023-11-30 16:41:30,064 - Epoch: [6][12000/31148]    Overall Loss 0.010324    Objective Loss 0.000000    Distill Loss 0.010324                     LR 0.001000    Time 0.258028    
+2023-11-30 16:41:55,773 - Epoch: [6][12100/31148]    Overall Loss 0.010323    Objective Loss 0.000000    Distill Loss 0.010323                     LR 0.001000    Time 0.258021    
+2023-11-30 16:42:21,554 - Epoch: [6][12200/31148]    Overall Loss 0.010322    Objective Loss 0.000000    Distill Loss 0.010322                     LR 0.001000    Time 0.258019    
+2023-11-30 16:42:47,319 - Epoch: [6][12300/31148]    Overall Loss 0.010322    Objective Loss 0.000000    Distill Loss 0.010322                     LR 0.001000    Time 0.258015    
+2023-11-30 16:43:13,077 - Epoch: [6][12400/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.258012    
+2023-11-30 16:43:38,809 - Epoch: [6][12500/31148]    Overall Loss 0.010320    Objective Loss 0.000000    Distill Loss 0.010320                     LR 0.001000    Time 0.258006    
+2023-11-30 16:44:04,629 - Epoch: [6][12600/31148]    Overall Loss 0.010320    Objective Loss 0.000000    Distill Loss 0.010320                     LR 0.001000    Time 0.258007    
+2023-11-30 16:44:30,390 - Epoch: [6][12700/31148]    Overall Loss 0.010320    Objective Loss 0.000000    Distill Loss 0.010320                     LR 0.001000    Time 0.258004    
+2023-11-30 16:44:56,189 - Epoch: [6][12800/31148]    Overall Loss 0.010320    Objective Loss 0.000000    Distill Loss 0.010320                     LR 0.001000    Time 0.258004    
+2023-11-30 16:45:21,954 - Epoch: [6][12900/31148]    Overall Loss 0.010320    Objective Loss 0.000000    Distill Loss 0.010320                     LR 0.001000    Time 0.258001    
+2023-11-30 16:45:47,717 - Epoch: [6][13000/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257998    
+2023-11-30 16:46:13,440 - Epoch: [6][13100/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257992    
+2023-11-30 16:46:39,262 - Epoch: [6][13200/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257993    
+2023-11-30 16:47:04,973 - Epoch: [6][13300/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257986    
+2023-11-30 16:47:30,758 - Epoch: [6][13400/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257985    
+2023-11-30 16:47:56,514 - Epoch: [6][13500/31148]    Overall Loss 0.010322    Objective Loss 0.000000    Distill Loss 0.010322                     LR 0.001000    Time 0.257982    
+2023-11-30 16:48:22,227 - Epoch: [6][13600/31148]    Overall Loss 0.010322    Objective Loss 0.000000    Distill Loss 0.010322                     LR 0.001000    Time 0.257975    
+2023-11-30 16:48:47,992 - Epoch: [6][13700/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257973    
+2023-11-30 16:49:13,728 - Epoch: [6][13800/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257968    
+2023-11-30 16:49:39,501 - Epoch: [6][13900/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257966    
+2023-11-30 16:50:05,307 - Epoch: [6][14000/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257967    
+2023-11-30 16:50:31,127 - Epoch: [6][14100/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257968    
+2023-11-30 16:50:56,900 - Epoch: [6][14200/31148]    Overall Loss 0.010321    Objective Loss 0.000000    Distill Loss 0.010321                     LR 0.001000    Time 0.257966    
+2023-11-30 16:51:22,647 - Epoch: [6][14300/31148]    Overall Loss 0.010320    Objective Loss 0.000000    Distill Loss 0.010320                     LR 0.001000    Time 0.257963    
+2023-11-30 16:51:48,424 - Epoch: [6][14400/31148]    Overall Loss 0.010319    Objective Loss 0.000000    Distill Loss 0.010319                     LR 0.001000    Time 0.257961    
+2023-11-30 16:52:14,236 - Epoch: [6][14500/31148]    Overall Loss 0.010319    Objective Loss 0.000000    Distill Loss 0.010319                     LR 0.001000    Time 0.257962    
+2023-11-30 16:52:39,988 - Epoch: [6][14600/31148]    Overall Loss 0.010319    Objective Loss 0.000000    Distill Loss 0.010319                     LR 0.001000    Time 0.257959    
+2023-11-30 16:53:05,707 - Epoch: [6][14700/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257953    
+2023-11-30 16:53:31,532 - Epoch: [6][14800/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257955    
+2023-11-30 16:53:57,285 - Epoch: [6][14900/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257952    
+2023-11-30 16:54:22,970 - Epoch: [6][15000/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257944    
+2023-11-30 16:54:48,676 - Epoch: [6][15100/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257938    
+2023-11-30 16:55:14,387 - Epoch: [6][15200/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257933    
+2023-11-30 16:55:40,117 - Epoch: [6][15300/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257928    
+2023-11-30 16:56:05,909 - Epoch: [6][15400/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257928    
+2023-11-30 16:56:31,663 - Epoch: [6][15500/31148]    Overall Loss 0.010317    Objective Loss 0.000000    Distill Loss 0.010317                     LR 0.001000    Time 0.257926    
+2023-11-30 16:56:57,409 - Epoch: [6][15600/31148]    Overall Loss 0.010316    Objective Loss 0.000000    Distill Loss 0.010316                     LR 0.001000    Time 0.257922    
+2023-11-30 16:57:23,098 - Epoch: [6][15700/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257916    
+2023-11-30 16:57:48,874 - Epoch: [6][15800/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257914    
+2023-11-30 16:58:14,624 - Epoch: [6][15900/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257912    
+2023-11-30 16:58:40,358 - Epoch: [6][16000/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257908    
+2023-11-30 16:59:06,113 - Epoch: [6][16100/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257905    
+2023-11-30 16:59:31,923 - Epoch: [6][16200/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257906    
+2023-11-30 16:59:57,652 - Epoch: [6][16300/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257902    
+2023-11-30 17:00:23,408 - Epoch: [6][16400/31148]    Overall Loss 0.010315    Objective Loss 0.000000    Distill Loss 0.010315                     LR 0.001000    Time 0.257900    
+2023-11-30 17:00:49,205 - Epoch: [6][16500/31148]    Overall Loss 0.010314    Objective Loss 0.000000    Distill Loss 0.010314                     LR 0.001000    Time 0.257900    
+2023-11-30 17:01:14,956 - Epoch: [6][16600/31148]    Overall Loss 0.010314    Objective Loss 0.000000    Distill Loss 0.010314                     LR 0.001000    Time 0.257898    
+2023-11-30 17:01:40,701 - Epoch: [6][16700/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.257895    
+2023-11-30 17:02:06,504 - Epoch: [6][16800/31148]    Overall Loss 0.010314    Objective Loss 0.000000    Distill Loss 0.010314                     LR 0.001000    Time 0.257896    
+2023-11-30 17:02:32,283 - Epoch: [6][16900/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.257895    
+2023-11-30 17:02:58,027 - Epoch: [6][17000/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.257892    
+2023-11-30 17:03:23,792 - Epoch: [6][17100/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.257891    
+2023-11-30 17:03:49,573 - Epoch: [6][17200/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.257890    
+2023-11-30 17:04:15,276 - Epoch: [6][17300/31148]    Overall Loss 0.010313    Objective Loss 0.000000    Distill Loss 0.010313                     LR 0.001000    Time 0.257885    
+2023-11-30 17:04:41,007 - Epoch: [6][17400/31148]    Overall Loss 0.010312    Objective Loss 0.000000    Distill Loss 0.010312                     LR 0.001000    Time 0.257881    
+2023-11-30 17:05:06,783 - Epoch: [6][17500/31148]    Overall Loss 0.010311    Objective Loss 0.000000    Distill Loss 0.010311                     LR 0.001000    Time 0.257880    
+2023-11-30 17:05:32,523 - Epoch: [6][17600/31148]    Overall Loss 0.010310    Objective Loss 0.000000    Distill Loss 0.010310                     LR 0.001000    Time 0.257878    
+2023-11-30 17:05:58,259 - Epoch: [6][17700/31148]    Overall Loss 0.010310    Objective Loss 0.000000    Distill Loss 0.010310                     LR 0.001000    Time 0.257875    
+2023-11-30 17:06:24,040 - Epoch: [6][17800/31148]    Overall Loss 0.010310    Objective Loss 0.000000    Distill Loss 0.010310                     LR 0.001000    Time 0.257874    
+2023-11-30 17:06:49,786 - Epoch: [6][17900/31148]    Overall Loss 0.010310    Objective Loss 0.000000    Distill Loss 0.010310                     LR 0.001000    Time 0.257872    
+2023-11-30 17:07:15,541 - Epoch: [6][18000/31148]    Overall Loss 0.010309    Objective Loss 0.000000    Distill Loss 0.010309                     LR 0.001000    Time 0.257870    
+2023-11-30 17:07:41,346 - Epoch: [6][18100/31148]    Overall Loss 0.010309    Objective Loss 0.000000    Distill Loss 0.010309                     LR 0.001000    Time 0.257870    
+2023-11-30 17:08:07,118 - Epoch: [6][18200/31148]    Overall Loss 0.010309    Objective Loss 0.000000    Distill Loss 0.010309                     LR 0.001000    Time 0.257869    
+2023-11-30 17:08:32,873 - Epoch: [6][18300/31148]    Overall Loss 0.010309    Objective Loss 0.000000    Distill Loss 0.010309                     LR 0.001000    Time 0.257868    
+2023-11-30 17:08:58,624 - Epoch: [6][18400/31148]    Overall Loss 0.010309    Objective Loss 0.000000    Distill Loss 0.010309                     LR 0.001000    Time 0.257865    
+2023-11-30 17:09:24,384 - Epoch: [6][18500/31148]    Overall Loss 0.010309    Objective Loss 0.000000    Distill Loss 0.010309                     LR 0.001000    Time 0.257864    
+2023-11-30 17:09:50,120 - Epoch: [6][18600/31148]    Overall Loss 0.010308    Objective Loss 0.000000    Distill Loss 0.010308                     LR 0.001000    Time 0.257861    
+2023-11-30 17:10:15,822 - Epoch: [6][18700/31148]    Overall Loss 0.010308    Objective Loss 0.000000    Distill Loss 0.010308                     LR 0.001000    Time 0.257856    
+2023-11-30 17:10:41,539 - Epoch: [6][18800/31148]    Overall Loss 0.010308    Objective Loss 0.000000    Distill Loss 0.010308                     LR 0.001000    Time 0.257853    
+2023-11-30 17:11:07,261 - Epoch: [6][18900/31148]    Overall Loss 0.010308    Objective Loss 0.000000    Distill Loss 0.010308                     LR 0.001000    Time 0.257849    
+2023-11-30 17:11:33,042 - Epoch: [6][19000/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257849    
+2023-11-30 17:11:58,772 - Epoch: [6][19100/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257846    
+2023-11-30 17:12:24,519 - Epoch: [6][19200/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257844    
+2023-11-30 17:12:50,243 - Epoch: [6][19300/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257840    
+2023-11-30 17:13:16,049 - Epoch: [6][19400/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257841    
+2023-11-30 17:13:41,764 - Epoch: [6][19500/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257838    
+2023-11-30 17:14:07,517 - Epoch: [6][19600/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257836    
+2023-11-30 17:14:33,289 - Epoch: [6][19700/31148]    Overall Loss 0.010307    Objective Loss 0.000000    Distill Loss 0.010307                     LR 0.001000    Time 0.257835    
+2023-11-30 17:14:59,021 - Epoch: [6][19800/31148]    Overall Loss 0.010306    Objective Loss 0.000000    Distill Loss 0.010306                     LR 0.001000    Time 0.257833    
+2023-11-30 17:15:24,767 - Epoch: [6][19900/31148]    Overall Loss 0.010306    Objective Loss 0.000000    Distill Loss 0.010306                     LR 0.001000    Time 0.257831    
+2023-11-30 17:15:50,597 - Epoch: [6][20000/31148]    Overall Loss 0.010306    Objective Loss 0.000000    Distill Loss 0.010306                     LR 0.001000    Time 0.257833    
+2023-11-30 17:16:16,351 - Epoch: [6][20100/31148]    Overall Loss 0.010306    Objective Loss 0.000000    Distill Loss 0.010306                     LR 0.001000    Time 0.257831    
+2023-11-30 17:16:42,126 - Epoch: [6][20200/31148]    Overall Loss 0.010305    Objective Loss 0.000000    Distill Loss 0.010305                     LR 0.001000    Time 0.257831    
+2023-11-30 17:17:07,844 - Epoch: [6][20300/31148]    Overall Loss 0.010306    Objective Loss 0.000000    Distill Loss 0.010306                     LR 0.001000    Time 0.257827    
+2023-11-30 17:17:33,577 - Epoch: [6][20400/31148]    Overall Loss 0.010305    Objective Loss 0.000000    Distill Loss 0.010305                     LR 0.001000    Time 0.257825    
+2023-11-30 17:17:59,305 - Epoch: [6][20500/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257822    
+2023-11-30 17:18:25,006 - Epoch: [6][20600/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257818    
+2023-11-30 17:18:50,764 - Epoch: [6][20700/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257817    
+2023-11-30 17:19:16,515 - Epoch: [6][20800/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257815    
+2023-11-30 17:19:42,248 - Epoch: [6][20900/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257813    
+2023-11-30 17:20:07,933 - Epoch: [6][21000/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257808    
+2023-11-30 17:20:33,656 - Epoch: [6][21100/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257805    
+2023-11-30 17:20:59,370 - Epoch: [6][21200/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257802    
+2023-11-30 17:21:25,066 - Epoch: [6][21300/31148]    Overall Loss 0.010304    Objective Loss 0.000000    Distill Loss 0.010304                     LR 0.001000    Time 0.257798    
+2023-11-30 17:21:50,792 - Epoch: [6][21400/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257795    
+2023-11-30 17:22:16,595 - Epoch: [6][21500/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257796    
+2023-11-30 17:22:42,352 - Epoch: [6][21600/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257795    
+2023-11-30 17:23:08,077 - Epoch: [6][21700/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257792    
+2023-11-30 17:23:33,807 - Epoch: [6][21800/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257790    
+2023-11-30 17:23:59,566 - Epoch: [6][21900/31148]    Overall Loss 0.010302    Objective Loss 0.000000    Distill Loss 0.010302                     LR 0.001000    Time 0.257789    
+2023-11-30 17:24:25,283 - Epoch: [6][22000/31148]    Overall Loss 0.010303    Objective Loss 0.000000    Distill Loss 0.010303                     LR 0.001000    Time 0.257786    
+2023-11-30 17:24:51,073 - Epoch: [6][22100/31148]    Overall Loss 0.010302    Objective Loss 0.000000    Distill Loss 0.010302                     LR 0.001000    Time 0.257786    
+2023-11-30 17:25:16,790 - Epoch: [6][22200/31148]    Overall Loss 0.010302    Objective Loss 0.000000    Distill Loss 0.010302                     LR 0.001000    Time 0.257783    
+2023-11-30 17:25:42,648 - Epoch: [6][22300/31148]    Overall Loss 0.010302    Objective Loss 0.000000    Distill Loss 0.010302                     LR 0.001000    Time 0.257787    
+2023-11-30 17:26:08,436 - Epoch: [6][22400/31148]    Overall Loss 0.010301    Objective Loss 0.000000    Distill Loss 0.010301                     LR 0.001000    Time 0.257787    
+2023-11-30 17:26:34,175 - Epoch: [6][22500/31148]    Overall Loss 0.010301    Objective Loss 0.000000    Distill Loss 0.010301                     LR 0.001000    Time 0.257785    
+2023-11-30 17:26:59,893 - Epoch: [6][22600/31148]    Overall Loss 0.010301    Objective Loss 0.000000    Distill Loss 0.010301                     LR 0.001000    Time 0.257782    
+2023-11-30 17:27:25,646 - Epoch: [6][22700/31148]    Overall Loss 0.010300    Objective Loss 0.000000    Distill Loss 0.010300                     LR 0.001000    Time 0.257781    
+2023-11-30 17:27:51,428 - Epoch: [6][22800/31148]    Overall Loss 0.010300    Objective Loss 0.000000    Distill Loss 0.010300                     LR 0.001000    Time 0.257781    
+2023-11-30 17:28:17,145 - Epoch: [6][22900/31148]    Overall Loss 0.010299    Objective Loss 0.000000    Distill Loss 0.010299                     LR 0.001000    Time 0.257778    
+2023-11-30 17:28:42,883 - Epoch: [6][23000/31148]    Overall Loss 0.010299    Objective Loss 0.000000    Distill Loss 0.010299                     LR 0.001000    Time 0.257777    
+2023-11-30 17:29:08,652 - Epoch: [6][23100/31148]    Overall Loss 0.010299    Objective Loss 0.000000    Distill Loss 0.010299                     LR 0.001000    Time 0.257776    
+2023-11-30 17:29:34,377 - Epoch: [6][23200/31148]    Overall Loss 0.010299    Objective Loss 0.000000    Distill Loss 0.010299                     LR 0.001000    Time 0.257774    
+2023-11-30 17:30:00,150 - Epoch: [6][23300/31148]    Overall Loss 0.010299    Objective Loss 0.000000    Distill Loss 0.010299                     LR 0.001000    Time 0.257773    
+2023-11-30 17:30:25,886 - Epoch: [6][23400/31148]    Overall Loss 0.010299    Objective Loss 0.000000    Distill Loss 0.010299                     LR 0.001000    Time 0.257772    
+2023-11-30 17:30:51,636 - Epoch: [6][23500/31148]    Overall Loss 0.010298    Objective Loss 0.000000    Distill Loss 0.010298                     LR 0.001000    Time 0.257770    
+2023-11-30 17:31:17,414 - Epoch: [6][23600/31148]    Overall Loss 0.010298    Objective Loss 0.000000    Distill Loss 0.010298                     LR 0.001000    Time 0.257770    
+2023-11-30 17:31:43,221 - Epoch: [6][23700/31148]    Overall Loss 0.010298    Objective Loss 0.000000    Distill Loss 0.010298                     LR 0.001000    Time 0.257771    
+2023-11-30 17:32:08,956 - Epoch: [6][23800/31148]    Overall Loss 0.010298    Objective Loss 0.000000    Distill Loss 0.010298                     LR 0.001000    Time 0.257769    
+2023-11-30 17:32:34,675 - Epoch: [6][23900/31148]    Overall Loss 0.010297    Objective Loss 0.000000    Distill Loss 0.010297                     LR 0.001000    Time 0.257767    
+2023-11-30 17:33:00,444 - Epoch: [6][24000/31148]    Overall Loss 0.010297    Objective Loss 0.000000    Distill Loss 0.010297                     LR 0.001000    Time 0.257767    
+2023-11-30 17:33:26,195 - Epoch: [6][24100/31148]    Overall Loss 0.010297    Objective Loss 0.000000    Distill Loss 0.010297                     LR 0.001000    Time 0.257765    
+2023-11-30 17:33:51,974 - Epoch: [6][24200/31148]    Overall Loss 0.010297    Objective Loss 0.000000    Distill Loss 0.010297                     LR 0.001000    Time 0.257765    
+2023-11-30 17:34:17,690 - Epoch: [6][24300/31148]    Overall Loss 0.010296    Objective Loss 0.000000    Distill Loss 0.010296                     LR 0.001000    Time 0.257763    
+2023-11-30 17:34:43,421 - Epoch: [6][24400/31148]    Overall Loss 0.010296    Objective Loss 0.000000    Distill Loss 0.010296                     LR 0.001000    Time 0.257761    
+2023-11-30 17:35:09,139 - Epoch: [6][24500/31148]    Overall Loss 0.010295    Objective Loss 0.000000    Distill Loss 0.010295                     LR 0.001000    Time 0.257758    
+2023-11-30 17:35:34,874 - Epoch: [6][24600/31148]    Overall Loss 0.010295    Objective Loss 0.000000    Distill Loss 0.010295                     LR 0.001000    Time 0.257757    
+2023-11-30 17:36:00,626 - Epoch: [6][24700/31148]    Overall Loss 0.010295    Objective Loss 0.000000    Distill Loss 0.010295                     LR 0.001000    Time 0.257755    
+2023-11-30 17:36:26,391 - Epoch: [6][24800/31148]    Overall Loss 0.010295    Objective Loss 0.000000    Distill Loss 0.010295                     LR 0.001000    Time 0.257755    
+2023-11-30 17:36:52,185 - Epoch: [6][24900/31148]    Overall Loss 0.010295    Objective Loss 0.000000    Distill Loss 0.010295                     LR 0.001000    Time 0.257756    
+2023-11-30 17:37:17,957 - Epoch: [6][25000/31148]    Overall Loss 0.010294    Objective Loss 0.000000    Distill Loss 0.010294                     LR 0.001000    Time 0.257755    
+2023-11-30 17:37:43,634 - Epoch: [6][25100/31148]    Overall Loss 0.010294    Objective Loss 0.000000    Distill Loss 0.010294                     LR 0.001000    Time 0.257751    
+2023-11-30 17:38:09,370 - Epoch: [6][25200/31148]    Overall Loss 0.010294    Objective Loss 0.000000    Distill Loss 0.010294                     LR 0.001000    Time 0.257750    
+2023-11-30 17:38:35,120 - Epoch: [6][25300/31148]    Overall Loss 0.010293    Objective Loss 0.000000    Distill Loss 0.010293                     LR 0.001000    Time 0.257749    
+2023-11-30 17:39:00,851 - Epoch: [6][25400/31148]    Overall Loss 0.010293    Objective Loss 0.000000    Distill Loss 0.010293                     LR 0.001000    Time 0.257747    
+2023-11-30 17:39:26,593 - Epoch: [6][25500/31148]    Overall Loss 0.010293    Objective Loss 0.000000    Distill Loss 0.010293                     LR 0.001000    Time 0.257745    
+2023-11-30 17:39:52,328 - Epoch: [6][25600/31148]    Overall Loss 0.010293    Objective Loss 0.000000    Distill Loss 0.010293                     LR 0.001000    Time 0.257744    
+2023-11-30 17:40:18,046 - Epoch: [6][25700/31148]    Overall Loss 0.010293    Objective Loss 0.000000    Distill Loss 0.010293                     LR 0.001000    Time 0.257741    
+2023-11-30 17:40:43,792 - Epoch: [6][25800/31148]    Overall Loss 0.010293    Objective Loss 0.000000    Distill Loss 0.010293                     LR 0.001000    Time 0.257740    
+2023-11-30 17:41:09,579 - Epoch: [6][25900/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257741    
+2023-11-30 17:41:35,410 - Epoch: [6][26000/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257743    
+2023-11-30 17:42:01,141 - Epoch: [6][26100/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257741    
+2023-11-30 17:42:26,897 - Epoch: [6][26200/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257740    
+2023-11-30 17:42:52,665 - Epoch: [6][26300/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257740    
+2023-11-30 17:43:18,422 - Epoch: [6][26400/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257739    
+2023-11-30 17:43:44,214 - Epoch: [6][26500/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257740    
+2023-11-30 17:44:10,030 - Epoch: [6][26600/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257741    
+2023-11-30 17:44:35,749 - Epoch: [6][26700/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257739    
+2023-11-30 17:45:01,483 - Epoch: [6][26800/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257737    
+2023-11-30 17:45:27,221 - Epoch: [6][26900/31148]    Overall Loss 0.010292    Objective Loss 0.000000    Distill Loss 0.010292                     LR 0.001000    Time 0.257736    
+2023-11-30 17:45:52,944 - Epoch: [6][27000/31148]    Overall Loss 0.010291    Objective Loss 0.000000    Distill Loss 0.010291                     LR 0.001000    Time 0.257734    
+2023-11-30 17:46:18,664 - Epoch: [6][27100/31148]    Overall Loss 0.010291    Objective Loss 0.000000    Distill Loss 0.010291                     LR 0.001000    Time 0.257732    
+2023-11-30 17:46:44,459 - Epoch: [6][27200/31148]    Overall Loss 0.010291    Objective Loss 0.000000    Distill Loss 0.010291                     LR 0.001000    Time 0.257733    
+2023-11-30 17:47:10,233 - Epoch: [6][27300/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257733    
+2023-11-30 17:47:35,948 - Epoch: [6][27400/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257730    
+2023-11-30 17:48:01,710 - Epoch: [6][27500/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257730    
+2023-11-30 17:48:27,424 - Epoch: [6][27600/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257728    
+2023-11-30 17:48:53,134 - Epoch: [6][27700/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257725    
+2023-11-30 17:49:18,877 - Epoch: [6][27800/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257724    
+2023-11-30 17:49:44,628 - Epoch: [6][27900/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257723    
+2023-11-30 17:50:10,371 - Epoch: [6][28000/31148]    Overall Loss 0.010290    Objective Loss 0.000000    Distill Loss 0.010290                     LR 0.001000    Time 0.257722    
+2023-11-30 17:50:36,158 - Epoch: [6][28100/31148]    Overall Loss 0.010289    Objective Loss 0.000000    Distill Loss 0.010289                     LR 0.001000    Time 0.257722    
+2023-11-30 17:51:01,880 - Epoch: [6][28200/31148]    Overall Loss 0.010289    Objective Loss 0.000000    Distill Loss 0.010289                     LR 0.001000    Time 0.257721    
+2023-11-30 17:51:27,576 - Epoch: [6][28300/31148]    Overall Loss 0.010288    Objective Loss 0.000000    Distill Loss 0.010288                     LR 0.001000    Time 0.257718    
+2023-11-30 17:51:53,342 - Epoch: [6][28400/31148]    Overall Loss 0.010289    Objective Loss 0.000000    Distill Loss 0.010289                     LR 0.001000    Time 0.257718    
+2023-11-30 17:52:19,055 - Epoch: [6][28500/31148]    Overall Loss 0.010289    Objective Loss 0.000000    Distill Loss 0.010289                     LR 0.001000    Time 0.257715    
+2023-11-30 17:52:44,833 - Epoch: [6][28600/31148]    Overall Loss 0.010289    Objective Loss 0.000000    Distill Loss 0.010289                     LR 0.001000    Time 0.257716    
+2023-11-30 17:53:10,609 - Epoch: [6][28700/31148]    Overall Loss 0.010289    Objective Loss 0.000000    Distill Loss 0.010289                     LR 0.001000    Time 0.257716    
+2023-11-30 17:53:36,373 - Epoch: [6][28800/31148]    Overall Loss 0.010288    Objective Loss 0.000000    Distill Loss 0.010288                     LR 0.001000    Time 0.257715    
+2023-11-30 17:54:02,209 - Epoch: [6][28900/31148]    Overall Loss 0.010288    Objective Loss 0.000000    Distill Loss 0.010288                     LR 0.001000    Time 0.257717    
+2023-11-30 17:54:28,026 - Epoch: [6][29000/31148]    Overall Loss 0.010288    Objective Loss 0.000000    Distill Loss 0.010288                     LR 0.001000    Time 0.257719    
+2023-11-30 17:54:53,789 - Epoch: [6][29100/31148]    Overall Loss 0.010288    Objective Loss 0.000000    Distill Loss 0.010288                     LR 0.001000    Time 0.257718    
+2023-11-30 17:55:19,534 - Epoch: [6][29200/31148]    Overall Loss 0.010288    Objective Loss 0.000000    Distill Loss 0.010288                     LR 0.001000    Time 0.257717    
+2023-11-30 17:55:45,292 - Epoch: [6][29300/31148]    Overall Loss 0.010287    Objective Loss 0.000000    Distill Loss 0.010287                     LR 0.001000    Time 0.257717    
+2023-11-30 17:56:11,041 - Epoch: [6][29400/31148]    Overall Loss 0.010287    Objective Loss 0.000000    Distill Loss 0.010287                     LR 0.001000    Time 0.257716    
+2023-11-30 17:56:36,846 - Epoch: [6][29500/31148]    Overall Loss 0.010287    Objective Loss 0.000000    Distill Loss 0.010287                     LR 0.001000    Time 0.257717    
+2023-11-30 17:57:02,623 - Epoch: [6][29600/31148]    Overall Loss 0.010286    Objective Loss 0.000000    Distill Loss 0.010286                     LR 0.001000    Time 0.257717    
+2023-11-30 17:57:28,415 - Epoch: [6][29700/31148]    Overall Loss 0.010286    Objective Loss 0.000000    Distill Loss 0.010286                     LR 0.001000    Time 0.257718    
+2023-11-30 17:57:54,195 - Epoch: [6][29800/31148]    Overall Loss 0.010286    Objective Loss 0.000000    Distill Loss 0.010286                     LR 0.001000    Time 0.257718    
+2023-11-30 17:58:19,935 - Epoch: [6][29900/31148]    Overall Loss 0.010286    Objective Loss 0.000000    Distill Loss 0.010286                     LR 0.001000    Time 0.257717    
+2023-11-30 17:58:45,641 - Epoch: [6][30000/31148]    Overall Loss 0.010286    Objective Loss 0.000000    Distill Loss 0.010286                     LR 0.001000    Time 0.257714    
+2023-11-30 17:59:11,422 - Epoch: [6][30100/31148]    Overall Loss 0.010285    Objective Loss 0.000000    Distill Loss 0.010285                     LR 0.001000    Time 0.257715    
+2023-11-30 17:59:37,168 - Epoch: [6][30200/31148]    Overall Loss 0.010285    Objective Loss 0.000000    Distill Loss 0.010285                     LR 0.001000    Time 0.257714    
+2023-11-30 18:00:02,938 - Epoch: [6][30300/31148]    Overall Loss 0.010285    Objective Loss 0.000000    Distill Loss 0.010285                     LR 0.001000    Time 0.257714    
+2023-11-30 18:00:28,656 - Epoch: [6][30400/31148]    Overall Loss 0.010284    Objective Loss 0.000000    Distill Loss 0.010284                     LR 0.001000    Time 0.257712    
+2023-11-30 18:00:54,408 - Epoch: [6][30500/31148]    Overall Loss 0.010284    Objective Loss 0.000000    Distill Loss 0.010284                     LR 0.001000    Time 0.257711    
+2023-11-30 18:01:20,143 - Epoch: [6][30600/31148]    Overall Loss 0.010284    Objective Loss 0.000000    Distill Loss 0.010284                     LR 0.001000    Time 0.257710    
+2023-11-30 18:01:45,920 - Epoch: [6][30700/31148]    Overall Loss 0.010284    Objective Loss 0.000000    Distill Loss 0.010284                     LR 0.001000    Time 0.257710    
+2023-11-30 18:02:11,681 - Epoch: [6][30800/31148]    Overall Loss 0.010283    Objective Loss 0.000000    Distill Loss 0.010283                     LR 0.001000    Time 0.257710    
+2023-11-30 18:02:37,479 - Epoch: [6][30900/31148]    Overall Loss 0.010283    Objective Loss 0.000000    Distill Loss 0.010283                     LR 0.001000    Time 0.257710    
+2023-11-30 18:03:03,237 - Epoch: [6][31000/31148]    Overall Loss 0.010283    Objective Loss 0.000000    Distill Loss 0.010283                     LR 0.001000    Time 0.257710    
+2023-11-30 18:03:28,974 - Epoch: [6][31100/31148]    Overall Loss 0.010283    Objective Loss 0.000000    Distill Loss 0.010283                     LR 0.001000    Time 0.257709    
+2023-11-30 18:03:41,807 - Epoch: [6][31148/31148]    Overall Loss 0.010282    Objective Loss 0.000000    Distill Loss 0.010282                     LR 0.001000    Time 0.257723    
+2023-11-30 18:03:42,167 - --- validate (epoch=6)-----------
+2023-11-30 18:03:42,167 - 167951 samples (100 per mini-batch)
+2023-11-30 18:04:03,132 - Epoch: [6][  100/ 1680]    Loss 0.000000    Overall Loss 0.010974    
+2023-11-30 18:04:22,847 - Epoch: [6][  200/ 1680]    Loss 0.000000    Overall Loss 0.011001    
+2023-11-30 18:04:42,552 - Epoch: [6][  300/ 1680]    Loss 0.000000    Overall Loss 0.011017    
+2023-11-30 18:05:02,292 - Epoch: [6][  400/ 1680]    Loss 0.000000    Overall Loss 0.011009    
+2023-11-30 18:05:22,008 - Epoch: [6][  500/ 1680]    Loss 0.000000    Overall Loss 0.010998    
+2023-11-30 18:05:41,745 - Epoch: [6][  600/ 1680]    Loss 0.000000    Overall Loss 0.010979    
+2023-11-30 18:06:01,511 - Epoch: [6][  700/ 1680]    Loss 0.000000    Overall Loss 0.010985    
+2023-11-30 18:06:22,437 - Epoch: [6][  800/ 1680]    Loss 0.000000    Overall Loss 0.010981    
+2023-11-30 18:06:42,157 - Epoch: [6][  900/ 1680]    Loss 0.000000    Overall Loss 0.010984    
+2023-11-30 18:07:01,898 - Epoch: [6][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010982    
+2023-11-30 18:07:21,648 - Epoch: [6][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010984    
+2023-11-30 18:07:41,354 - Epoch: [6][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010987    
+2023-11-30 18:08:01,041 - Epoch: [6][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010992    
+2023-11-30 18:08:20,771 - Epoch: [6][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010984    
+2023-11-30 18:08:40,490 - Epoch: [6][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010985    
+2023-11-30 18:09:00,265 - Epoch: [6][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010985    
+2023-11-30 18:09:17,331 - Epoch: [6][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010987    
+2023-11-30 18:09:17,637 - ==> Overall Loss: 0.011
+
+2023-11-30 18:09:17,643 - ==> Best [Overall Loss: 0.010987 on epoch: 6]
+2023-11-30 18:09:17,643 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 18:09:17,705 - 
+
+2023-11-30 18:09:17,705 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 18:09:57,416 - Epoch: [7][  100/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.397052    
+2023-11-30 18:10:26,798 - Epoch: [7][  200/31148]    Overall Loss 0.010103    Objective Loss 0.000000    Distill Loss 0.010103                     LR 0.001000    Time 0.345412    
+2023-11-30 18:10:56,319 - Epoch: [7][  300/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.328659    
+2023-11-30 18:11:24,971 - Epoch: [7][  400/31148]    Overall Loss 0.010157    Objective Loss 0.000000    Distill Loss 0.010157                     LR 0.001000    Time 0.318112    
+2023-11-30 18:11:53,861 - Epoch: [7][  500/31148]    Overall Loss 0.010131    Objective Loss 0.000000    Distill Loss 0.010131                     LR 0.001000    Time 0.312260    
+2023-11-30 18:12:23,098 - Epoch: [7][  600/31148]    Overall Loss 0.010131    Objective Loss 0.000000    Distill Loss 0.010131                     LR 0.001000    Time 0.308937    
+2023-11-30 18:12:51,190 - Epoch: [7][  700/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.304929    
+2023-11-30 18:13:16,982 - Epoch: [7][  800/31148]    Overall Loss 0.010165    Objective Loss 0.000000    Distill Loss 0.010165                     LR 0.001000    Time 0.299049    
+2023-11-30 18:13:42,766 - Epoch: [7][  900/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.294467    
+2023-11-30 18:14:08,565 - Epoch: [7][ 1000/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.290816    
+2023-11-30 18:14:34,313 - Epoch: [7][ 1100/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.287784    
+2023-11-30 18:15:00,041 - Epoch: [7][ 1200/31148]    Overall Loss 0.010139    Objective Loss 0.000000    Distill Loss 0.010139                     LR 0.001000    Time 0.285240    
+2023-11-30 18:15:25,773 - Epoch: [7][ 1300/31148]    Overall Loss 0.010139    Objective Loss 0.000000    Distill Loss 0.010139                     LR 0.001000    Time 0.283090    
+2023-11-30 18:15:52,486 - Epoch: [7][ 1400/31148]    Overall Loss 0.010143    Objective Loss 0.000000    Distill Loss 0.010143                     LR 0.001000    Time 0.281948    
+2023-11-30 18:16:18,244 - Epoch: [7][ 1500/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.280322    
+2023-11-30 18:16:43,982 - Epoch: [7][ 1600/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.278886    
+2023-11-30 18:17:09,842 - Epoch: [7][ 1700/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.277691    
+2023-11-30 18:17:36,569 - Epoch: [7][ 1800/31148]    Overall Loss 0.010143    Objective Loss 0.000000    Distill Loss 0.010143                     LR 0.001000    Time 0.277111    
+2023-11-30 18:18:02,317 - Epoch: [7][ 1900/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.276076    
+2023-11-30 18:18:28,116 - Epoch: [7][ 2000/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.275170    
+2023-11-30 18:18:54,044 - Epoch: [7][ 2100/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.274413    
+2023-11-30 18:19:20,718 - Epoch: [7][ 2200/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.274062    
+2023-11-30 18:19:46,490 - Epoch: [7][ 2300/31148]    Overall Loss 0.010151    Objective Loss 0.000000    Distill Loss 0.010151                     LR 0.001000    Time 0.273351    
+2023-11-30 18:20:12,292 - Epoch: [7][ 2400/31148]    Overall Loss 0.010156    Objective Loss 0.000000    Distill Loss 0.010156                     LR 0.001000    Time 0.272711    
+2023-11-30 18:20:38,068 - Epoch: [7][ 2500/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.272112    
+2023-11-30 18:21:03,823 - Epoch: [7][ 2600/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.271551    
+2023-11-30 18:21:29,526 - Epoch: [7][ 2700/31148]    Overall Loss 0.010166    Objective Loss 0.000000    Distill Loss 0.010166                     LR 0.001000    Time 0.271012    
+2023-11-30 18:21:55,361 - Epoch: [7][ 2800/31148]    Overall Loss 0.010163    Objective Loss 0.000000    Distill Loss 0.010163                     LR 0.001000    Time 0.270559    
+2023-11-30 18:22:21,147 - Epoch: [7][ 2900/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.270120    
+2023-11-30 18:22:47,850 - Epoch: [7][ 3000/31148]    Overall Loss 0.010163    Objective Loss 0.000000    Distill Loss 0.010163                     LR 0.001000    Time 0.270016    
+2023-11-30 18:23:13,640 - Epoch: [7][ 3100/31148]    Overall Loss 0.010163    Objective Loss 0.000000    Distill Loss 0.010163                     LR 0.001000    Time 0.269624    
+2023-11-30 18:23:39,477 - Epoch: [7][ 3200/31148]    Overall Loss 0.010166    Objective Loss 0.000000    Distill Loss 0.010166                     LR 0.001000    Time 0.269272    
+2023-11-30 18:24:07,098 - Epoch: [7][ 3300/31148]    Overall Loss 0.010162    Objective Loss 0.000000    Distill Loss 0.010162                     LR 0.001000    Time 0.269481    
+2023-11-30 18:25:00,216 - Epoch: [7][ 3400/31148]    Overall Loss 0.010162    Objective Loss 0.000000    Distill Loss 0.010162                     LR 0.001000    Time 0.277177    
+2023-11-30 18:25:54,086 - Epoch: [7][ 3500/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.284649    
+2023-11-30 18:26:47,991 - Epoch: [7][ 3600/31148]    Overall Loss 0.010167    Objective Loss 0.000000    Distill Loss 0.010167                     LR 0.001000    Time 0.291715    
+2023-11-30 18:27:41,852 - Epoch: [7][ 3700/31148]    Overall Loss 0.010169    Objective Loss 0.000000    Distill Loss 0.010169                     LR 0.001000    Time 0.298387    
+2023-11-30 18:28:35,744 - Epoch: [7][ 3800/31148]    Overall Loss 0.010167    Objective Loss 0.000000    Distill Loss 0.010167                     LR 0.001000    Time 0.304717    
+2023-11-30 18:29:29,671 - Epoch: [7][ 3900/31148]    Overall Loss 0.010169    Objective Loss 0.000000    Distill Loss 0.010169                     LR 0.001000    Time 0.310730    
+2023-11-30 18:30:23,589 - Epoch: [7][ 4000/31148]    Overall Loss 0.010170    Objective Loss 0.000000    Distill Loss 0.010170                     LR 0.001000    Time 0.316441    
+2023-11-30 18:31:17,498 - Epoch: [7][ 4100/31148]    Overall Loss 0.010171    Objective Loss 0.000000    Distill Loss 0.010171                     LR 0.001000    Time 0.321871    
+2023-11-30 18:32:11,428 - Epoch: [7][ 4200/31148]    Overall Loss 0.010171    Objective Loss 0.000000    Distill Loss 0.010171                     LR 0.001000    Time 0.327047    
+2023-11-30 18:33:05,338 - Epoch: [7][ 4300/31148]    Overall Loss 0.010174    Objective Loss 0.000000    Distill Loss 0.010174                     LR 0.001000    Time 0.331978    
+2023-11-30 18:33:59,274 - Epoch: [7][ 4400/31148]    Overall Loss 0.010172    Objective Loss 0.000000    Distill Loss 0.010172                     LR 0.001000    Time 0.336691    
+2023-11-30 18:34:53,240 - Epoch: [7][ 4500/31148]    Overall Loss 0.010171    Objective Loss 0.000000    Distill Loss 0.010171                     LR 0.001000    Time 0.341201    
+2023-11-30 18:35:38,218 - Epoch: [7][ 4600/31148]    Overall Loss 0.010171    Objective Loss 0.000000    Distill Loss 0.010171                     LR 0.001000    Time 0.343561    
+2023-11-30 18:36:04,064 - Epoch: [7][ 4700/31148]    Overall Loss 0.010172    Objective Loss 0.000000    Distill Loss 0.010172                     LR 0.001000    Time 0.341750    
+2023-11-30 18:36:29,844 - Epoch: [7][ 4800/31148]    Overall Loss 0.010174    Objective Loss 0.000000    Distill Loss 0.010174                     LR 0.001000    Time 0.340000    
+2023-11-30 18:36:55,655 - Epoch: [7][ 4900/31148]    Overall Loss 0.010172    Objective Loss 0.000000    Distill Loss 0.010172                     LR 0.001000    Time 0.338328    
+2023-11-30 18:37:21,390 - Epoch: [7][ 5000/31148]    Overall Loss 0.010172    Objective Loss 0.000000    Distill Loss 0.010172                     LR 0.001000    Time 0.336708    
+2023-11-30 18:37:47,144 - Epoch: [7][ 5100/31148]    Overall Loss 0.010172    Objective Loss 0.000000    Distill Loss 0.010172                     LR 0.001000    Time 0.335155    
+2023-11-30 18:38:12,916 - Epoch: [7][ 5200/31148]    Overall Loss 0.010175    Objective Loss 0.000000    Distill Loss 0.010175                     LR 0.001000    Time 0.333666    
+2023-11-30 18:38:38,688 - Epoch: [7][ 5300/31148]    Overall Loss 0.010174    Objective Loss 0.000000    Distill Loss 0.010174                     LR 0.001000    Time 0.332232    
+2023-11-30 18:39:04,422 - Epoch: [7][ 5400/31148]    Overall Loss 0.010176    Objective Loss 0.000000    Distill Loss 0.010176                     LR 0.001000    Time 0.330845    
+2023-11-30 18:39:30,166 - Epoch: [7][ 5500/31148]    Overall Loss 0.010176    Objective Loss 0.000000    Distill Loss 0.010176                     LR 0.001000    Time 0.329510    
+2023-11-30 18:39:55,924 - Epoch: [7][ 5600/31148]    Overall Loss 0.010175    Objective Loss 0.000000    Distill Loss 0.010175                     LR 0.001000    Time 0.328225    
+2023-11-30 18:40:23,652 - Epoch: [7][ 5700/31148]    Overall Loss 0.010173    Objective Loss 0.000000    Distill Loss 0.010173                     LR 0.001000    Time 0.327330    
+2023-11-30 18:41:01,194 - Epoch: [7][ 5800/31148]    Overall Loss 0.010172    Objective Loss 0.000000    Distill Loss 0.010172                     LR 0.001000    Time 0.328158    
+2023-11-30 18:41:48,544 - Epoch: [7][ 5900/31148]    Overall Loss 0.010170    Objective Loss 0.000000    Distill Loss 0.010170                     LR 0.001000    Time 0.330620    
+2023-11-30 18:42:36,469 - Epoch: [7][ 6000/31148]    Overall Loss 0.010168    Objective Loss 0.000000    Distill Loss 0.010168                     LR 0.001000    Time 0.333096    
+2023-11-30 18:43:19,511 - Epoch: [7][ 6100/31148]    Overall Loss 0.010169    Objective Loss 0.000000    Distill Loss 0.010169                     LR 0.001000    Time 0.334690    
+2023-11-30 18:44:07,034 - Epoch: [7][ 6200/31148]    Overall Loss 0.010165    Objective Loss 0.000000    Distill Loss 0.010165                     LR 0.001000    Time 0.336956    
+2023-11-30 18:44:32,816 - Epoch: [7][ 6300/31148]    Overall Loss 0.010163    Objective Loss 0.000000    Distill Loss 0.010163                     LR 0.001000    Time 0.335699    
+2023-11-30 18:44:58,561 - Epoch: [7][ 6400/31148]    Overall Loss 0.010163    Objective Loss 0.000000    Distill Loss 0.010163                     LR 0.001000    Time 0.334476    
+2023-11-30 18:45:24,353 - Epoch: [7][ 6500/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.333298    
+2023-11-30 18:45:50,154 - Epoch: [7][ 6600/31148]    Overall Loss 0.010160    Objective Loss 0.000000    Distill Loss 0.010160                     LR 0.001000    Time 0.332157    
+2023-11-30 18:46:26,342 - Epoch: [7][ 6700/31148]    Overall Loss 0.010159    Objective Loss 0.000000    Distill Loss 0.010159                     LR 0.001000    Time 0.332599    
+2023-11-30 18:47:07,887 - Epoch: [7][ 6800/31148]    Overall Loss 0.010158    Objective Loss 0.000000    Distill Loss 0.010158                     LR 0.001000    Time 0.333816    
+2023-11-30 18:47:47,227 - Epoch: [7][ 6900/31148]    Overall Loss 0.010159    Objective Loss 0.000000    Distill Loss 0.010159                     LR 0.001000    Time 0.334679    
+2023-11-30 18:48:22,915 - Epoch: [7][ 7000/31148]    Overall Loss 0.010159    Objective Loss 0.000000    Distill Loss 0.010159                     LR 0.001000    Time 0.334995    
+2023-11-30 18:49:00,487 - Epoch: [7][ 7100/31148]    Overall Loss 0.010160    Objective Loss 0.000000    Distill Loss 0.010160                     LR 0.001000    Time 0.335567    
+2023-11-30 18:49:46,175 - Epoch: [7][ 7200/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.337251    
+2023-11-30 18:50:19,922 - Epoch: [7][ 7300/31148]    Overall Loss 0.010162    Objective Loss 0.000000    Distill Loss 0.010162                     LR 0.001000    Time 0.337253    
+2023-11-30 18:51:05,022 - Epoch: [7][ 7400/31148]    Overall Loss 0.010161    Objective Loss 0.000000    Distill Loss 0.010161                     LR 0.001000    Time 0.338789    
+2023-11-30 18:51:49,418 - Epoch: [7][ 7500/31148]    Overall Loss 0.010160    Objective Loss 0.000000    Distill Loss 0.010160                     LR 0.001000    Time 0.340191    
+2023-11-30 18:52:43,186 - Epoch: [7][ 7600/31148]    Overall Loss 0.010160    Objective Loss 0.000000    Distill Loss 0.010160                     LR 0.001000    Time 0.342788    
+2023-11-30 18:53:47,155 - Epoch: [7][ 7700/31148]    Overall Loss 0.010160    Objective Loss 0.000000    Distill Loss 0.010160                     LR 0.001000    Time 0.346643    
+2023-11-30 18:54:29,213 - Epoch: [7][ 7800/31148]    Overall Loss 0.010156    Objective Loss 0.000000    Distill Loss 0.010156                     LR 0.001000    Time 0.347590    
+2023-11-30 18:55:07,499 - Epoch: [7][ 7900/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.348035    
+2023-11-30 18:55:46,186 - Epoch: [7][ 8000/31148]    Overall Loss 0.010153    Objective Loss 0.000000    Distill Loss 0.010153                     LR 0.001000    Time 0.348520    
+2023-11-30 18:56:29,756 - Epoch: [7][ 8100/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.349595    
+2023-11-30 18:57:07,918 - Epoch: [7][ 8200/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.349985    
+2023-11-30 18:57:54,249 - Epoch: [7][ 8300/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.351349    
+2023-11-30 18:58:37,246 - Epoch: [7][ 8400/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.352284    
+2023-11-30 18:59:36,199 - Epoch: [7][ 8500/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.355074    
+2023-11-30 19:00:23,489 - Epoch: [7][ 8600/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.356443    
+2023-11-30 19:01:04,338 - Epoch: [7][ 8700/31148]    Overall Loss 0.010156    Objective Loss 0.000000    Distill Loss 0.010156                     LR 0.001000    Time 0.357041    
+2023-11-30 19:01:44,648 - Epoch: [7][ 8800/31148]    Overall Loss 0.010156    Objective Loss 0.000000    Distill Loss 0.010156                     LR 0.001000    Time 0.357563    
+2023-11-30 19:02:20,161 - Epoch: [7][ 8900/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.357535    
+2023-11-30 19:03:07,900 - Epoch: [7][ 9000/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.358866    
+2023-11-30 19:03:45,573 - Epoch: [7][ 9100/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.359062    
+2023-11-30 19:04:25,712 - Epoch: [7][ 9200/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.359521    
+2023-11-30 19:05:08,713 - Epoch: [7][ 9300/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.360278    
+2023-11-30 19:05:44,151 - Epoch: [7][ 9400/31148]    Overall Loss 0.010156    Objective Loss 0.000000    Distill Loss 0.010156                     LR 0.001000    Time 0.360214    
+2023-11-30 19:06:30,261 - Epoch: [7][ 9500/31148]    Overall Loss 0.010153    Objective Loss 0.000000    Distill Loss 0.010153                     LR 0.001000    Time 0.361276    
+2023-11-30 19:07:07,635 - Epoch: [7][ 9600/31148]    Overall Loss 0.010154    Objective Loss 0.000000    Distill Loss 0.010154                     LR 0.001000    Time 0.361405    
+2023-11-30 19:07:57,061 - Epoch: [7][ 9700/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.362774    
+2023-11-30 19:08:28,288 - Epoch: [7][ 9800/31148]    Overall Loss 0.010155    Objective Loss 0.000000    Distill Loss 0.010155                     LR 0.001000    Time 0.362258    
+2023-11-30 19:09:13,393 - Epoch: [7][ 9900/31148]    Overall Loss 0.010153    Objective Loss 0.000000    Distill Loss 0.010153                     LR 0.001000    Time 0.363154    
+2023-11-30 19:09:54,761 - Epoch: [7][10000/31148]    Overall Loss 0.010153    Objective Loss 0.000000    Distill Loss 0.010153                     LR 0.001000    Time 0.363658    
+2023-11-30 19:10:37,763 - Epoch: [7][10100/31148]    Overall Loss 0.010151    Objective Loss 0.000000    Distill Loss 0.010151                     LR 0.001000    Time 0.364314    
+2023-11-30 19:11:25,572 - Epoch: [7][10200/31148]    Overall Loss 0.010150    Objective Loss 0.000000    Distill Loss 0.010150                     LR 0.001000    Time 0.365429    
+2023-11-30 19:12:10,202 - Epoch: [7][10300/31148]    Overall Loss 0.010152    Objective Loss 0.000000    Distill Loss 0.010152                     LR 0.001000    Time 0.366214    
+2023-11-30 19:12:52,206 - Epoch: [7][10400/31148]    Overall Loss 0.010151    Objective Loss 0.000000    Distill Loss 0.010151                     LR 0.001000    Time 0.366731    
+2023-11-30 19:13:37,083 - Epoch: [7][10500/31148]    Overall Loss 0.010151    Objective Loss 0.000000    Distill Loss 0.010151                     LR 0.001000    Time 0.367511    
+2023-11-30 19:14:19,665 - Epoch: [7][10600/31148]    Overall Loss 0.010152    Objective Loss 0.000000    Distill Loss 0.010152                     LR 0.001000    Time 0.368060    
+2023-11-30 19:15:06,473 - Epoch: [7][10700/31148]    Overall Loss 0.010150    Objective Loss 0.000000    Distill Loss 0.010150                     LR 0.001000    Time 0.368994    
+2023-11-30 19:15:53,167 - Epoch: [7][10800/31148]    Overall Loss 0.010150    Objective Loss 0.000000    Distill Loss 0.010150                     LR 0.001000    Time 0.369901    
+2023-11-30 19:16:38,460 - Epoch: [7][10900/31148]    Overall Loss 0.010148    Objective Loss 0.000000    Distill Loss 0.010148                     LR 0.001000    Time 0.370662    
+2023-11-30 19:17:26,125 - Epoch: [7][11000/31148]    Overall Loss 0.010148    Objective Loss 0.000000    Distill Loss 0.010148                     LR 0.001000    Time 0.371625    
+2023-11-30 19:18:08,013 - Epoch: [7][11100/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.372050    
+2023-11-30 19:18:44,340 - Epoch: [7][11200/31148]    Overall Loss 0.010146    Objective Loss 0.000000    Distill Loss 0.010146                     LR 0.001000    Time 0.371971    
+2023-11-30 19:19:28,167 - Epoch: [7][11300/31148]    Overall Loss 0.010146    Objective Loss 0.000000    Distill Loss 0.010146                     LR 0.001000    Time 0.372557    
+2023-11-30 19:20:12,407 - Epoch: [7][11400/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.373169    
+2023-11-30 19:21:06,494 - Epoch: [7][11500/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.374626    
+2023-11-30 19:21:51,628 - Epoch: [7][11600/31148]    Overall Loss 0.010148    Objective Loss 0.000000    Distill Loss 0.010148                     LR 0.001000    Time 0.375287    
+2023-11-30 19:22:27,822 - Epoch: [7][11700/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.375172    
+2023-11-30 19:23:19,215 - Epoch: [7][11800/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.376348    
+2023-11-30 19:23:57,362 - Epoch: [7][11900/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.376390    
+2023-11-30 19:24:37,147 - Epoch: [7][12000/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.376568    
+2023-11-30 19:25:25,576 - Epoch: [7][12100/31148]    Overall Loss 0.010147    Objective Loss 0.000000    Distill Loss 0.010147                     LR 0.001000    Time 0.377458    
+2023-11-30 19:26:13,997 - Epoch: [7][12200/31148]    Overall Loss 0.010146    Objective Loss 0.000000    Distill Loss 0.010146                     LR 0.001000    Time 0.378333    
+2023-11-30 19:27:07,343 - Epoch: [7][12300/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.379593    
+2023-11-30 19:27:52,613 - Epoch: [7][12400/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.380182    
+2023-11-30 19:28:29,949 - Epoch: [7][12500/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.380127    
+2023-11-30 19:29:12,939 - Epoch: [7][12600/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.380521    
+2023-11-30 19:29:57,718 - Epoch: [7][12700/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.381050    
+2023-11-30 19:30:46,876 - Epoch: [7][12800/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.381913    
+2023-11-30 19:31:26,248 - Epoch: [7][12900/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.382004    
+2023-11-30 19:32:11,282 - Epoch: [7][13000/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.382529    
+2023-11-30 19:32:54,027 - Epoch: [7][13100/31148]    Overall Loss 0.010146    Objective Loss 0.000000    Distill Loss 0.010146                     LR 0.001000    Time 0.382872    
+2023-11-30 19:33:35,465 - Epoch: [7][13200/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.383110    
+2023-11-30 19:34:24,023 - Epoch: [7][13300/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.383880    
+2023-11-30 19:35:07,139 - Epoch: [7][13400/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.384232    
+2023-11-30 19:35:56,600 - Epoch: [7][13500/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.385049    
+2023-11-30 19:36:42,792 - Epoch: [7][13600/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.385614    
+2023-11-30 19:37:33,339 - Epoch: [7][13700/31148]    Overall Loss 0.010145    Objective Loss 0.000000    Distill Loss 0.010145                     LR 0.001000    Time 0.386488    
+2023-11-30 19:38:43,611 - Epoch: [7][13800/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.388779    
+2023-11-30 19:39:35,267 - Epoch: [7][13900/31148]    Overall Loss 0.010144    Objective Loss 0.000000    Distill Loss 0.010144                     LR 0.001000    Time 0.389698    
+2023-11-30 19:40:21,072 - Epoch: [7][14000/31148]    Overall Loss 0.010143    Objective Loss 0.000000    Distill Loss 0.010143                     LR 0.001000    Time 0.390186    
+2023-11-30 19:41:32,671 - Epoch: [7][14100/31148]    Overall Loss 0.010143    Objective Loss 0.000000    Distill Loss 0.010143                     LR 0.001000    Time 0.392496    
+2023-11-30 19:42:37,219 - Epoch: [7][14200/31148]    Overall Loss 0.010143    Objective Loss 0.000000    Distill Loss 0.010143                     LR 0.001000    Time 0.394277    
+2023-11-30 19:43:23,887 - Epoch: [7][14300/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.394782    
+2023-11-30 19:44:11,586 - Epoch: [7][14400/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.395353    
+2023-11-30 19:45:07,002 - Epoch: [7][14500/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.396447    
+2023-11-30 19:45:52,120 - Epoch: [7][14600/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.396822    
+2023-11-30 19:46:37,851 - Epoch: [7][14700/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.397233    
+2023-11-30 19:47:29,752 - Epoch: [7][14800/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.398055    
+2023-11-30 19:48:26,316 - Epoch: [7][14900/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.399179    
+2023-11-30 19:49:50,215 - Epoch: [7][15000/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.402111    
+2023-11-30 19:51:08,921 - Epoch: [7][15100/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.404659    
+2023-11-30 19:52:25,507 - Epoch: [7][15200/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.407035    
+2023-11-30 19:53:58,335 - Epoch: [7][15300/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.410441    
+2023-11-30 19:55:11,075 - Epoch: [7][15400/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.412499    
+2023-11-30 19:56:35,068 - Epoch: [7][15500/31148]    Overall Loss 0.010142    Objective Loss 0.000000    Distill Loss 0.010142                     LR 0.001000    Time 0.415256    
+2023-11-30 19:58:03,656 - Epoch: [7][15600/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.418272    
+2023-11-30 19:58:47,571 - Epoch: [7][15700/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.418405    
+2023-11-30 19:59:40,493 - Epoch: [7][15800/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.419105    
+2023-11-30 20:00:27,286 - Epoch: [7][15900/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.419412    
+2023-11-30 20:01:16,980 - Epoch: [7][16000/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.419896    
+2023-11-30 20:01:57,741 - Epoch: [7][16100/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.419819    
+2023-11-30 20:02:36,961 - Epoch: [7][16200/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.419649    
+2023-11-30 20:03:30,980 - Epoch: [7][16300/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.420388    
+2023-11-30 20:04:20,001 - Epoch: [7][16400/31148]    Overall Loss 0.010141    Objective Loss 0.000000    Distill Loss 0.010141                     LR 0.001000    Time 0.420813    
+2023-11-30 20:05:27,957 - Epoch: [7][16500/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.422381    
+2023-11-30 20:06:26,151 - Epoch: [7][16600/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.423341    
+2023-11-30 20:07:30,595 - Epoch: [7][16700/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.424665    
+2023-11-30 20:08:34,125 - Epoch: [7][16800/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.425918    
+2023-11-30 20:09:57,755 - Epoch: [7][16900/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.428346    
+2023-11-30 20:10:49,401 - Epoch: [7][17000/31148]    Overall Loss 0.010139    Objective Loss 0.000000    Distill Loss 0.010139                     LR 0.001000    Time 0.428864    
+2023-11-30 20:11:35,386 - Epoch: [7][17100/31148]    Overall Loss 0.010140    Objective Loss 0.000000    Distill Loss 0.010140                     LR 0.001000    Time 0.429044    
+2023-11-30 20:12:24,923 - Epoch: [7][17200/31148]    Overall Loss 0.010139    Objective Loss 0.000000    Distill Loss 0.010139                     LR 0.001000    Time 0.429429    
+2023-11-30 20:13:13,672 - Epoch: [7][17300/31148]    Overall Loss 0.010138    Objective Loss 0.000000    Distill Loss 0.010138                     LR 0.001000    Time 0.429765    
+2023-11-30 20:14:13,961 - Epoch: [7][17400/31148]    Overall Loss 0.010138    Objective Loss 0.000000    Distill Loss 0.010138                     LR 0.001000    Time 0.430759    
+2023-11-30 20:15:11,005 - Epoch: [7][17500/31148]    Overall Loss 0.010138    Objective Loss 0.000000    Distill Loss 0.010138                     LR 0.001000    Time 0.431557    
+2023-11-30 20:16:05,638 - Epoch: [7][17600/31148]    Overall Loss 0.010137    Objective Loss 0.000000    Distill Loss 0.010137                     LR 0.001000    Time 0.432209    
+2023-11-30 20:16:50,838 - Epoch: [7][17700/31148]    Overall Loss 0.010136    Objective Loss 0.000000    Distill Loss 0.010136                     LR 0.001000    Time 0.432320    
+2023-11-30 20:17:39,762 - Epoch: [7][17800/31148]    Overall Loss 0.010136    Objective Loss 0.000000    Distill Loss 0.010136                     LR 0.001000    Time 0.432640    
+2023-11-30 20:18:31,952 - Epoch: [7][17900/31148]    Overall Loss 0.010136    Objective Loss 0.000000    Distill Loss 0.010136                     LR 0.001000    Time 0.433138    
+2023-11-30 20:19:16,568 - Epoch: [7][18000/31148]    Overall Loss 0.010135    Objective Loss 0.000000    Distill Loss 0.010135                     LR 0.001000    Time 0.433210    
+2023-11-30 20:20:31,314 - Epoch: [7][18100/31148]    Overall Loss 0.010135    Objective Loss 0.000000    Distill Loss 0.010135                     LR 0.001000    Time 0.434945    
+2023-11-30 20:21:47,926 - Epoch: [7][18200/31148]    Overall Loss 0.010135    Objective Loss 0.000000    Distill Loss 0.010135                     LR 0.001000    Time 0.436765    
+2023-11-30 20:23:11,070 - Epoch: [7][18300/31148]    Overall Loss 0.010134    Objective Loss 0.000000    Distill Loss 0.010134                     LR 0.001000    Time 0.438921    
+2023-11-30 20:24:06,894 - Epoch: [7][18400/31148]    Overall Loss 0.010135    Objective Loss 0.000000    Distill Loss 0.010135                     LR 0.001000    Time 0.439569    
+2023-11-30 20:24:50,363 - Epoch: [7][18500/31148]    Overall Loss 0.010134    Objective Loss 0.000000    Distill Loss 0.010134                     LR 0.001000    Time 0.439542    
+2023-11-30 20:25:56,554 - Epoch: [7][18600/31148]    Overall Loss 0.010134    Objective Loss 0.000000    Distill Loss 0.010134                     LR 0.001000    Time 0.440737    
+2023-11-30 20:26:36,597 - Epoch: [7][18700/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.440521    
+2023-11-30 20:27:26,410 - Epoch: [7][18800/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.440827    
+2023-11-30 20:28:09,767 - Epoch: [7][18900/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.440789    
+2023-11-30 20:29:02,671 - Epoch: [7][19000/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.441253    
+2023-11-30 20:29:31,150 - Epoch: [7][19100/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.440433    
+2023-11-30 20:30:04,485 - Epoch: [7][19200/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.439875    
+2023-11-30 20:31:02,577 - Epoch: [7][19300/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.440606    
+2023-11-30 20:32:01,688 - Epoch: [7][19400/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.441381    
+2023-11-30 20:32:53,826 - Epoch: [7][19500/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.441791    
+2023-11-30 20:33:49,805 - Epoch: [7][19600/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.442393    
+2023-11-30 20:34:48,165 - Epoch: [7][19700/31148]    Overall Loss 0.010133    Objective Loss 0.000000    Distill Loss 0.010133                     LR 0.001000    Time 0.443109    
+2023-11-30 20:35:33,747 - Epoch: [7][19800/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.443173    
+2023-11-30 20:36:21,251 - Epoch: [7][19900/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.443333    
+2023-11-30 20:37:05,664 - Epoch: [7][20000/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.443336    
+2023-11-30 20:37:49,934 - Epoch: [7][20100/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.443333    
+2023-11-30 20:38:25,593 - Epoch: [7][20200/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.442903    
+2023-11-30 20:39:07,255 - Epoch: [7][20300/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.442773    
+2023-11-30 20:39:47,045 - Epoch: [7][20400/31148]    Overall Loss 0.010132    Objective Loss 0.000000    Distill Loss 0.010132                     LR 0.001000    Time 0.442553    
+2023-11-30 20:40:34,589 - Epoch: [7][20500/31148]    Overall Loss 0.010131    Objective Loss 0.000000    Distill Loss 0.010131                     LR 0.001000    Time 0.442713    
+2023-11-30 20:41:15,305 - Epoch: [7][20600/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442540    
+2023-11-30 20:42:02,726 - Epoch: [7][20700/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442693    
+2023-11-30 20:42:47,320 - Epoch: [7][20800/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442708    
+2023-11-30 20:43:33,783 - Epoch: [7][20900/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442812    
+2023-11-30 20:44:14,725 - Epoch: [7][21000/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442653    
+2023-11-30 20:45:00,952 - Epoch: [7][21100/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442746    
+2023-11-30 20:45:43,257 - Epoch: [7][21200/31148]    Overall Loss 0.010130    Objective Loss 0.000000    Distill Loss 0.010130                     LR 0.001000    Time 0.442653    
+2023-11-30 20:46:24,271 - Epoch: [7][21300/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.442500    
+2023-11-30 20:47:02,797 - Epoch: [7][21400/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.442232    
+2023-11-30 20:47:48,265 - Epoch: [7][21500/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.442289    
+2023-11-30 20:48:28,282 - Epoch: [7][21600/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.442094    
+2023-11-30 20:49:22,356 - Epoch: [7][21700/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.442548    
+2023-11-30 20:50:09,405 - Epoch: [7][21800/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.442676    
+2023-11-30 20:51:05,215 - Epoch: [7][21900/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.443203    
+2023-11-30 20:51:55,038 - Epoch: [7][22000/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.443453    
+2023-11-30 20:52:35,660 - Epoch: [7][22100/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.443284    
+2023-11-30 20:53:16,844 - Epoch: [7][22200/31148]    Overall Loss 0.010129    Objective Loss 0.000000    Distill Loss 0.010129                     LR 0.001000    Time 0.443142    
+2023-11-30 20:53:59,125 - Epoch: [7][22300/31148]    Overall Loss 0.010128    Objective Loss 0.000000    Distill Loss 0.010128                     LR 0.001000    Time 0.443050    
+2023-11-30 20:54:48,467 - Epoch: [7][22400/31148]    Overall Loss 0.010128    Objective Loss 0.000000    Distill Loss 0.010128                     LR 0.001000    Time 0.443275    
+2023-11-30 20:55:39,360 - Epoch: [7][22500/31148]    Overall Loss 0.010128    Objective Loss 0.000000    Distill Loss 0.010128                     LR 0.001000    Time 0.443566    
+2023-11-30 20:56:34,236 - Epoch: [7][22600/31148]    Overall Loss 0.010127    Objective Loss 0.000000    Distill Loss 0.010127                     LR 0.001000    Time 0.444032    
+2023-11-30 20:57:17,182 - Epoch: [7][22700/31148]    Overall Loss 0.010127    Objective Loss 0.000000    Distill Loss 0.010127                     LR 0.001000    Time 0.443967    
+2023-11-30 20:58:06,932 - Epoch: [7][22800/31148]    Overall Loss 0.010127    Objective Loss 0.000000    Distill Loss 0.010127                     LR 0.001000    Time 0.444202    
+2023-11-30 20:58:41,365 - Epoch: [7][22900/31148]    Overall Loss 0.010127    Objective Loss 0.000000    Distill Loss 0.010127                     LR 0.001000    Time 0.443765    
+2023-11-30 20:59:27,319 - Epoch: [7][23000/31148]    Overall Loss 0.010126    Objective Loss 0.000000    Distill Loss 0.010126                     LR 0.001000    Time 0.443833    
+2023-11-30 21:00:01,702 - Epoch: [7][23100/31148]    Overall Loss 0.010126    Objective Loss 0.000000    Distill Loss 0.010126                     LR 0.001000    Time 0.443400    
+2023-11-30 21:00:45,649 - Epoch: [7][23200/31148]    Overall Loss 0.010126    Objective Loss 0.000000    Distill Loss 0.010126                     LR 0.001000    Time 0.443383    
+2023-11-30 21:01:40,031 - Epoch: [7][23300/31148]    Overall Loss 0.010126    Objective Loss 0.000000    Distill Loss 0.010126                     LR 0.001000    Time 0.443814    
+2023-11-30 21:02:37,718 - Epoch: [7][23400/31148]    Overall Loss 0.010126    Objective Loss 0.000000    Distill Loss 0.010126                     LR 0.001000    Time 0.444382    
+2023-11-30 21:03:22,110 - Epoch: [7][23500/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.444380    
+2023-11-30 21:04:00,819 - Epoch: [7][23600/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.444137    
+2023-11-30 21:04:56,861 - Epoch: [7][23700/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.444627    
+2023-11-30 21:05:54,330 - Epoch: [7][23800/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.445173    
+2023-11-30 21:06:51,128 - Epoch: [7][23900/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.445687    
+2023-11-30 21:07:42,103 - Epoch: [7][24000/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.445953    
+2023-11-30 21:08:37,139 - Epoch: [7][24100/31148]    Overall Loss 0.010125    Objective Loss 0.000000    Distill Loss 0.010125                     LR 0.001000    Time 0.446386    
+2023-11-30 21:09:27,319 - Epoch: [7][24200/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.446615    
+2023-11-30 21:10:34,176 - Epoch: [7][24300/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.447528    
+2023-11-30 21:11:32,536 - Epoch: [7][24400/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.448085    
+2023-11-30 21:12:28,481 - Epoch: [7][24500/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.448540    
+2023-11-30 21:13:20,776 - Epoch: [7][24600/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.448842    
+2023-11-30 21:14:05,736 - Epoch: [7][24700/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.448845    
+2023-11-30 21:15:04,166 - Epoch: [7][24800/31148]    Overall Loss 0.010124    Objective Loss 0.000000    Distill Loss 0.010124                     LR 0.001000    Time 0.449390    
+2023-11-30 21:16:00,856 - Epoch: [7][24900/31148]    Overall Loss 0.010123    Objective Loss 0.000000    Distill Loss 0.010123                     LR 0.001000    Time 0.449862    
+2023-11-30 21:16:49,205 - Epoch: [7][25000/31148]    Overall Loss 0.010123    Objective Loss 0.000000    Distill Loss 0.010123                     LR 0.001000    Time 0.449996    
+2023-11-30 21:17:39,690 - Epoch: [7][25100/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.450214    
+2023-11-30 21:18:36,689 - Epoch: [7][25200/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.450689    
+2023-11-30 21:19:43,591 - Epoch: [7][25300/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.451552    
+2023-11-30 21:20:35,697 - Epoch: [7][25400/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.451825    
+2023-11-30 21:21:28,277 - Epoch: [7][25500/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.452115    
+2023-11-30 21:22:33,059 - Epoch: [7][25600/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.452879    
+2023-11-30 21:23:21,936 - Epoch: [7][25700/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.453019    
+2023-11-30 21:24:07,858 - Epoch: [7][25800/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.453042    
+2023-11-30 21:24:51,895 - Epoch: [7][25900/31148]    Overall Loss 0.010122    Objective Loss 0.000000    Distill Loss 0.010122                     LR 0.001000    Time 0.452993    
+2023-11-30 21:25:55,093 - Epoch: [7][26000/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.453681    
+2023-11-30 21:26:44,995 - Epoch: [7][26100/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.453855    
+2023-11-30 21:27:45,797 - Epoch: [7][26200/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.454443    
+2023-11-30 21:28:38,934 - Epoch: [7][26300/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.454735    
+2023-11-30 21:29:28,617 - Epoch: [7][26400/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.454894    
+2023-11-30 21:30:23,483 - Epoch: [7][26500/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.455248    
+2023-11-30 21:31:28,833 - Epoch: [7][26600/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.455993    
+2023-11-30 21:32:24,427 - Epoch: [7][26700/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.456367    
+2023-11-30 21:33:18,458 - Epoch: [7][26800/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.456680    
+2023-11-30 21:34:12,647 - Epoch: [7][26900/31148]    Overall Loss 0.010121    Objective Loss 0.000000    Distill Loss 0.010121                     LR 0.001000    Time 0.456996    
+2023-11-30 21:35:18,834 - Epoch: [7][27000/31148]    Overall Loss 0.010120    Objective Loss 0.000000    Distill Loss 0.010120                     LR 0.001000    Time 0.457755    
+2023-11-30 21:36:09,172 - Epoch: [7][27100/31148]    Overall Loss 0.010120    Objective Loss 0.000000    Distill Loss 0.010120                     LR 0.001000    Time 0.457923    
+2023-11-30 21:36:56,207 - Epoch: [7][27200/31148]    Overall Loss 0.010120    Objective Loss 0.000000    Distill Loss 0.010120                     LR 0.001000    Time 0.457968    
+2023-11-30 21:37:45,095 - Epoch: [7][27300/31148]    Overall Loss 0.010120    Objective Loss 0.000000    Distill Loss 0.010120                     LR 0.001000    Time 0.458081    
+2023-11-30 21:38:42,225 - Epoch: [7][27400/31148]    Overall Loss 0.010119    Objective Loss 0.000000    Distill Loss 0.010119                     LR 0.001000    Time 0.458494    
+2023-11-30 21:39:38,452 - Epoch: [7][27500/31148]    Overall Loss 0.010119    Objective Loss 0.000000    Distill Loss 0.010119                     LR 0.001000    Time 0.458871    
+2023-11-30 21:40:34,038 - Epoch: [7][27600/31148]    Overall Loss 0.010119    Objective Loss 0.000000    Distill Loss 0.010119                     LR 0.001000    Time 0.459222    
+2023-11-30 21:41:26,952 - Epoch: [7][27700/31148]    Overall Loss 0.010119    Objective Loss 0.000000    Distill Loss 0.010119                     LR 0.001000    Time 0.459475    
+2023-11-30 21:42:30,569 - Epoch: [7][27800/31148]    Overall Loss 0.010118    Objective Loss 0.000000    Distill Loss 0.010118                     LR 0.001000    Time 0.460110    
+2023-11-30 21:43:30,981 - Epoch: [7][27900/31148]    Overall Loss 0.010118    Objective Loss 0.000000    Distill Loss 0.010118                     LR 0.001000    Time 0.460626    
+2023-11-30 21:44:35,459 - Epoch: [7][28000/31148]    Overall Loss 0.010118    Objective Loss 0.000000    Distill Loss 0.010118                     LR 0.001000    Time 0.461283    
+2023-11-30 21:45:27,071 - Epoch: [7][28100/31148]    Overall Loss 0.010118    Objective Loss 0.000000    Distill Loss 0.010118                     LR 0.001000    Time 0.461478    
+2023-11-30 21:46:15,066 - Epoch: [7][28200/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.461543    
+2023-11-30 21:47:24,616 - Epoch: [7][28300/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.462370    
+2023-11-30 21:48:30,949 - Epoch: [7][28400/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.463077    
+2023-11-30 21:49:23,943 - Epoch: [7][28500/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.463311    
+2023-11-30 21:50:18,163 - Epoch: [7][28600/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.463587    
+2023-11-30 21:51:19,093 - Epoch: [7][28700/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.464094    
+2023-11-30 21:52:16,607 - Epoch: [7][28800/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.464480    
+2023-11-30 21:52:53,156 - Epoch: [7][28900/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.464137    
+2023-11-30 21:53:49,865 - Epoch: [7][29000/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.464492    
+2023-11-30 21:54:43,576 - Epoch: [7][29100/31148]    Overall Loss 0.010117    Objective Loss 0.000000    Distill Loss 0.010117                     LR 0.001000    Time 0.464741    
+2023-11-30 21:55:34,197 - Epoch: [7][29200/31148]    Overall Loss 0.010116    Objective Loss 0.000000    Distill Loss 0.010116                     LR 0.001000    Time 0.464883    
+2023-11-30 21:56:16,456 - Epoch: [7][29300/31148]    Overall Loss 0.010116    Objective Loss 0.000000    Distill Loss 0.010116                     LR 0.001000    Time 0.464738    
+2023-11-30 21:57:07,781 - Epoch: [7][29400/31148]    Overall Loss 0.010116    Objective Loss 0.000000    Distill Loss 0.010116                     LR 0.001000    Time 0.464903    
+2023-11-30 21:57:49,851 - Epoch: [7][29500/31148]    Overall Loss 0.010116    Objective Loss 0.000000    Distill Loss 0.010116                     LR 0.001000    Time 0.464753    
+2023-11-30 21:58:43,598 - Epoch: [7][29600/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.464998    
+2023-11-30 21:59:28,191 - Epoch: [7][29700/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.464934    
+2023-11-30 22:00:11,682 - Epoch: [7][29800/31148]    Overall Loss 0.010116    Objective Loss 0.000000    Distill Loss 0.010116                     LR 0.001000    Time 0.464833    
+2023-11-30 22:01:01,218 - Epoch: [7][29900/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.464935    
+2023-11-30 22:01:54,549 - Epoch: [7][30000/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.465162    
+2023-11-30 22:02:46,654 - Epoch: [7][30100/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.465348    
+2023-11-30 22:03:30,975 - Epoch: [7][30200/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.465274    
+2023-11-30 22:04:17,633 - Epoch: [7][30300/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.465278    
+2023-11-30 22:05:01,705 - Epoch: [7][30400/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.465197    
+2023-11-30 22:05:53,949 - Epoch: [7][30500/31148]    Overall Loss 0.010115    Objective Loss 0.000000    Distill Loss 0.010115                     LR 0.001000    Time 0.465385    
+2023-11-30 22:06:41,726 - Epoch: [7][30600/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465425    
+2023-11-30 22:07:30,813 - Epoch: [7][30700/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465508    
+2023-11-30 22:08:14,601 - Epoch: [7][30800/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465418    
+2023-11-30 22:09:00,352 - Epoch: [7][30900/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465392    
+2023-11-30 22:09:41,977 - Epoch: [7][31000/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465233    
+2023-11-30 22:10:33,540 - Epoch: [7][31100/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465395    
+2023-11-30 22:10:57,174 - Epoch: [7][31148/31148]    Overall Loss 0.010114    Objective Loss 0.000000    Distill Loss 0.010114                     LR 0.001000    Time 0.465436    
+2023-11-30 22:10:57,975 - --- validate (epoch=7)-----------
+2023-11-30 22:10:57,976 - 167951 samples (100 per mini-batch)
+2023-11-30 22:11:22,636 - Epoch: [7][  100/ 1680]    Loss 0.000000    Overall Loss 0.010769    
+2023-11-30 22:11:42,658 - Epoch: [7][  200/ 1680]    Loss 0.000000    Overall Loss 0.010786    
+2023-11-30 22:12:02,612 - Epoch: [7][  300/ 1680]    Loss 0.000000    Overall Loss 0.010771    
+2023-11-30 22:12:22,649 - Epoch: [7][  400/ 1680]    Loss 0.000000    Overall Loss 0.010781    
+2023-11-30 22:12:42,627 - Epoch: [7][  500/ 1680]    Loss 0.000000    Overall Loss 0.010782    
+2023-11-30 22:13:03,037 - Epoch: [7][  600/ 1680]    Loss 0.000000    Overall Loss 0.010788    
+2023-11-30 22:13:23,032 - Epoch: [7][  700/ 1680]    Loss 0.000000    Overall Loss 0.010788    
+2023-11-30 22:13:43,019 - Epoch: [7][  800/ 1680]    Loss 0.000000    Overall Loss 0.010795    
+2023-11-30 22:14:03,016 - Epoch: [7][  900/ 1680]    Loss 0.000000    Overall Loss 0.010794    
+2023-11-30 22:14:22,990 - Epoch: [7][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010795    
+2023-11-30 22:14:43,005 - Epoch: [7][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010793    
+2023-11-30 22:15:02,998 - Epoch: [7][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010795    
+2023-11-30 22:15:22,978 - Epoch: [7][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010793    
+2023-11-30 22:15:42,953 - Epoch: [7][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010791    
+2023-11-30 22:16:02,985 - Epoch: [7][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010789    
+2023-11-30 22:16:22,984 - Epoch: [7][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010789    
+2023-11-30 22:16:38,964 - Epoch: [7][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010789    
+2023-11-30 22:16:39,490 - ==> Overall Loss: 0.011
+
+2023-11-30 22:16:39,498 - ==> Best [Overall Loss: 0.010789 on epoch: 7]
+2023-11-30 22:16:39,498 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-11-30 22:16:39,564 - 
+
+2023-11-30 22:16:39,564 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-11-30 22:17:56,977 - Epoch: [8][  100/31148]    Overall Loss 0.009905    Objective Loss 0.000000    Distill Loss 0.009905                     LR 0.001000    Time 0.774020    
+2023-11-30 22:18:30,844 - Epoch: [8][  200/31148]    Overall Loss 0.009930    Objective Loss 0.000000    Distill Loss 0.009930                     LR 0.001000    Time 0.556309    
+2023-11-30 22:19:11,847 - Epoch: [8][  300/31148]    Overall Loss 0.009945    Objective Loss 0.000000    Distill Loss 0.009945                     LR 0.001000    Time 0.507520    
+2023-11-30 22:19:57,449 - Epoch: [8][  400/31148]    Overall Loss 0.009944    Objective Loss 0.000000    Distill Loss 0.009944                     LR 0.001000    Time 0.494628    
+2023-11-30 22:20:34,798 - Epoch: [8][  500/31148]    Overall Loss 0.009943    Objective Loss 0.000000    Distill Loss 0.009943                     LR 0.001000    Time 0.470384    
+2023-11-30 22:21:20,338 - Epoch: [8][  600/31148]    Overall Loss 0.009955    Objective Loss 0.000000    Distill Loss 0.009955                     LR 0.001000    Time 0.467875    
+2023-11-30 22:21:58,981 - Epoch: [8][  700/31148]    Overall Loss 0.009967    Objective Loss 0.000000    Distill Loss 0.009967                     LR 0.001000    Time 0.456228    
+2023-11-30 22:22:35,742 - Epoch: [8][  800/31148]    Overall Loss 0.009981    Objective Loss 0.000000    Distill Loss 0.009981                     LR 0.001000    Time 0.445142    
+2023-11-30 22:23:25,399 - Epoch: [8][  900/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.450848    
+2023-11-30 22:24:05,057 - Epoch: [8][ 1000/31148]    Overall Loss 0.009985    Objective Loss 0.000000    Distill Loss 0.009985                     LR 0.001000    Time 0.445413    
+2023-11-30 22:24:54,602 - Epoch: [8][ 1100/31148]    Overall Loss 0.009993    Objective Loss 0.000000    Distill Loss 0.009993                     LR 0.001000    Time 0.449955    
+2023-11-30 22:25:36,643 - Epoch: [8][ 1200/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.001000    Time 0.447487    
+2023-11-30 22:26:20,733 - Epoch: [8][ 1300/31148]    Overall Loss 0.009991    Objective Loss 0.000000    Distill Loss 0.009991                     LR 0.001000    Time 0.446975    
+2023-11-30 22:27:00,618 - Epoch: [8][ 1400/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.001000    Time 0.443532    
+2023-11-30 22:27:40,264 - Epoch: [8][ 1500/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.001000    Time 0.440389    
+2023-11-30 22:28:29,330 - Epoch: [8][ 1600/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.443526    
+2023-11-30 22:29:12,347 - Epoch: [8][ 1700/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.442736    
+2023-11-30 22:29:50,037 - Epoch: [8][ 1800/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.001000    Time 0.439073    
+2023-11-30 22:30:28,676 - Epoch: [8][ 1900/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.436297    
+2023-11-30 22:31:10,303 - Epoch: [8][ 2000/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.001000    Time 0.435291    
+2023-11-30 22:31:49,903 - Epoch: [8][ 2100/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.433417    
+2023-11-30 22:32:33,108 - Epoch: [8][ 2200/31148]    Overall Loss 0.010011    Objective Loss 0.000000    Distill Loss 0.010011                     LR 0.001000    Time 0.433352    
+2023-11-30 22:33:27,048 - Epoch: [8][ 2300/31148]    Overall Loss 0.010016    Objective Loss 0.000000    Distill Loss 0.010016                     LR 0.001000    Time 0.437959    
+2023-11-30 22:34:14,866 - Epoch: [8][ 2400/31148]    Overall Loss 0.010022    Objective Loss 0.000000    Distill Loss 0.010022                     LR 0.001000    Time 0.439632    
+2023-11-30 22:34:57,949 - Epoch: [8][ 2500/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.439277    
+2023-11-30 22:35:32,392 - Epoch: [8][ 2600/31148]    Overall Loss 0.010022    Objective Loss 0.000000    Distill Loss 0.010022                     LR 0.001000    Time 0.435626    
+2023-11-30 22:36:12,801 - Epoch: [8][ 2700/31148]    Overall Loss 0.010024    Objective Loss 0.000000    Distill Loss 0.010024                     LR 0.001000    Time 0.434456    
+2023-11-30 22:36:52,241 - Epoch: [8][ 2800/31148]    Overall Loss 0.010021    Objective Loss 0.000000    Distill Loss 0.010021                     LR 0.001000    Time 0.433022    
+2023-11-30 22:37:43,958 - Epoch: [8][ 2900/31148]    Overall Loss 0.010024    Objective Loss 0.000000    Distill Loss 0.010024                     LR 0.001000    Time 0.435921    
+2023-11-30 22:38:24,633 - Epoch: [8][ 3000/31148]    Overall Loss 0.010024    Objective Loss 0.000000    Distill Loss 0.010024                     LR 0.001000    Time 0.434946    
+2023-11-30 22:39:12,499 - Epoch: [8][ 3100/31148]    Overall Loss 0.010021    Objective Loss 0.000000    Distill Loss 0.010021                     LR 0.001000    Time 0.436354    
+2023-11-30 22:39:54,764 - Epoch: [8][ 3200/31148]    Overall Loss 0.010022    Objective Loss 0.000000    Distill Loss 0.010022                     LR 0.001000    Time 0.435923    
+2023-11-30 22:40:38,984 - Epoch: [8][ 3300/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.436111    
+2023-11-30 22:41:22,600 - Epoch: [8][ 3400/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.436110    
+2023-11-30 22:42:03,381 - Epoch: [8][ 3500/31148]    Overall Loss 0.010017    Objective Loss 0.000000    Distill Loss 0.010017                     LR 0.001000    Time 0.435300    
+2023-11-30 22:42:55,172 - Epoch: [8][ 3600/31148]    Overall Loss 0.010019    Objective Loss 0.000000    Distill Loss 0.010019                     LR 0.001000    Time 0.437592    
+2023-11-30 22:43:37,367 - Epoch: [8][ 3700/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.437167    
+2023-11-30 22:44:24,163 - Epoch: [8][ 3800/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.437975    
+2023-11-30 22:45:10,050 - Epoch: [8][ 3900/31148]    Overall Loss 0.010022    Objective Loss 0.000000    Distill Loss 0.010022                     LR 0.001000    Time 0.438509    
+2023-11-30 22:45:55,312 - Epoch: [8][ 4000/31148]    Overall Loss 0.010021    Objective Loss 0.000000    Distill Loss 0.010021                     LR 0.001000    Time 0.438860    
+2023-11-30 22:46:47,353 - Epoch: [8][ 4100/31148]    Overall Loss 0.010023    Objective Loss 0.000000    Distill Loss 0.010023                     LR 0.001000    Time 0.440847    
+2023-11-30 22:47:30,663 - Epoch: [8][ 4200/31148]    Overall Loss 0.010025    Objective Loss 0.000000    Distill Loss 0.010025                     LR 0.001000    Time 0.440661    
+2023-11-30 22:48:35,435 - Epoch: [8][ 4300/31148]    Overall Loss 0.010028    Objective Loss 0.000000    Distill Loss 0.010028                     LR 0.001000    Time 0.445474    
+2023-11-30 22:49:33,916 - Epoch: [8][ 4400/31148]    Overall Loss 0.010025    Objective Loss 0.000000    Distill Loss 0.010025                     LR 0.001000    Time 0.448640    
+2023-11-30 22:50:22,195 - Epoch: [8][ 4500/31148]    Overall Loss 0.010026    Objective Loss 0.000000    Distill Loss 0.010026                     LR 0.001000    Time 0.449397    
+2023-11-30 22:51:13,824 - Epoch: [8][ 4600/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.001000    Time 0.450849    
+2023-11-30 22:52:04,961 - Epoch: [8][ 4700/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.001000    Time 0.452136    
+2023-11-30 22:52:48,934 - Epoch: [8][ 4800/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.001000    Time 0.451876    
+2023-11-30 22:53:30,560 - Epoch: [8][ 4900/31148]    Overall Loss 0.010024    Objective Loss 0.000000    Distill Loss 0.010024                     LR 0.001000    Time 0.451147    
+2023-11-30 22:54:08,186 - Epoch: [8][ 5000/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.001000    Time 0.449648    
+2023-11-30 22:54:49,427 - Epoch: [8][ 5100/31148]    Overall Loss 0.010026    Objective Loss 0.000000    Distill Loss 0.010026                     LR 0.001000    Time 0.448916    
+2023-11-30 22:55:29,598 - Epoch: [8][ 5200/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.001000    Time 0.448007    
+2023-11-30 22:56:07,725 - Epoch: [8][ 5300/31148]    Overall Loss 0.010026    Objective Loss 0.000000    Distill Loss 0.010026                     LR 0.001000    Time 0.446747    
+2023-11-30 22:56:55,468 - Epoch: [8][ 5400/31148]    Overall Loss 0.010028    Objective Loss 0.000000    Distill Loss 0.010028                     LR 0.001000    Time 0.447313    
+2023-11-30 22:57:44,813 - Epoch: [8][ 5500/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.001000    Time 0.448151    
+2023-11-30 22:58:27,802 - Epoch: [8][ 5600/31148]    Overall Loss 0.010026    Objective Loss 0.000000    Distill Loss 0.010026                     LR 0.001000    Time 0.447823    
+2023-11-30 22:59:12,999 - Epoch: [8][ 5700/31148]    Overall Loss 0.010026    Objective Loss 0.000000    Distill Loss 0.010026                     LR 0.001000    Time 0.447895    
+2023-11-30 23:00:06,603 - Epoch: [8][ 5800/31148]    Overall Loss 0.010024    Objective Loss 0.000000    Distill Loss 0.010024                     LR 0.001000    Time 0.449413    
+2023-11-30 23:00:49,969 - Epoch: [8][ 5900/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.449145    
+2023-11-30 23:01:37,872 - Epoch: [8][ 6000/31148]    Overall Loss 0.010020    Objective Loss 0.000000    Distill Loss 0.010020                     LR 0.001000    Time 0.449642    
+2023-11-30 23:02:21,377 - Epoch: [8][ 6100/31148]    Overall Loss 0.010019    Objective Loss 0.000000    Distill Loss 0.010019                     LR 0.001000    Time 0.449401    
+2023-11-30 23:03:00,594 - Epoch: [8][ 6200/31148]    Overall Loss 0.010017    Objective Loss 0.000000    Distill Loss 0.010017                     LR 0.001000    Time 0.448476    
+2023-11-30 23:03:39,607 - Epoch: [8][ 6300/31148]    Overall Loss 0.010016    Objective Loss 0.000000    Distill Loss 0.010016                     LR 0.001000    Time 0.447549    
+2023-11-30 23:04:20,225 - Epoch: [8][ 6400/31148]    Overall Loss 0.010015    Objective Loss 0.000000    Distill Loss 0.010015                     LR 0.001000    Time 0.446901    
+2023-11-30 23:05:15,280 - Epoch: [8][ 6500/31148]    Overall Loss 0.010013    Objective Loss 0.000000    Distill Loss 0.010013                     LR 0.001000    Time 0.448495    
+2023-11-30 23:06:11,064 - Epoch: [8][ 6600/31148]    Overall Loss 0.010011    Objective Loss 0.000000    Distill Loss 0.010011                     LR 0.001000    Time 0.450150    
+2023-11-30 23:06:56,246 - Epoch: [8][ 6700/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.450174    
+2023-11-30 23:07:38,196 - Epoch: [8][ 6800/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.449722    
+2023-11-30 23:08:30,426 - Epoch: [8][ 6900/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.450773    
+2023-11-30 23:09:24,480 - Epoch: [8][ 7000/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.452054    
+2023-11-30 23:10:08,192 - Epoch: [8][ 7100/31148]    Overall Loss 0.010011    Objective Loss 0.000000    Distill Loss 0.010011                     LR 0.001000    Time 0.451843    
+2023-11-30 23:10:53,145 - Epoch: [8][ 7200/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.451809    
+2023-11-30 23:11:54,934 - Epoch: [8][ 7300/31148]    Overall Loss 0.010013    Objective Loss 0.000000    Distill Loss 0.010013                     LR 0.001000    Time 0.454084    
+2023-11-30 23:12:50,778 - Epoch: [8][ 7400/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.455493    
+2023-11-30 23:13:53,469 - Epoch: [8][ 7500/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.457778    
+2023-11-30 23:14:52,705 - Epoch: [8][ 7600/31148]    Overall Loss 0.010012    Objective Loss 0.000000    Distill Loss 0.010012                     LR 0.001000    Time 0.459548    
+2023-11-30 23:15:48,325 - Epoch: [8][ 7700/31148]    Overall Loss 0.010011    Objective Loss 0.000000    Distill Loss 0.010011                     LR 0.001000    Time 0.460802    
+2023-11-30 23:16:51,166 - Epoch: [8][ 7800/31148]    Overall Loss 0.010009    Objective Loss 0.000000    Distill Loss 0.010009                     LR 0.001000    Time 0.462950    
+2023-11-30 23:17:48,092 - Epoch: [8][ 7900/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.464295    
+2023-11-30 23:18:50,591 - Epoch: [8][ 8000/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.001000    Time 0.466303    
+2023-11-30 23:19:48,416 - Epoch: [8][ 8100/31148]    Overall Loss 0.010007    Objective Loss 0.000000    Distill Loss 0.010007                     LR 0.001000    Time 0.467684    
+2023-11-30 23:20:51,527 - Epoch: [8][ 8200/31148]    Overall Loss 0.010007    Objective Loss 0.000000    Distill Loss 0.010007                     LR 0.001000    Time 0.469676    
+2023-11-30 23:21:47,627 - Epoch: [8][ 8300/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.470776    
+2023-11-30 23:22:33,951 - Epoch: [8][ 8400/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.470685    
+2023-11-30 23:23:21,773 - Epoch: [8][ 8500/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.470773    
+2023-11-30 23:24:00,742 - Epoch: [8][ 8600/31148]    Overall Loss 0.010007    Objective Loss 0.000000    Distill Loss 0.010007                     LR 0.001000    Time 0.469829    
+2023-11-30 23:24:43,702 - Epoch: [8][ 8700/31148]    Overall Loss 0.010009    Objective Loss 0.000000    Distill Loss 0.010009                     LR 0.001000    Time 0.469366    
+2023-11-30 23:25:20,351 - Epoch: [8][ 8800/31148]    Overall Loss 0.010009    Objective Loss 0.000000    Distill Loss 0.010009                     LR 0.001000    Time 0.468196    
+2023-11-30 23:26:06,850 - Epoch: [8][ 8900/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.468159    
+2023-11-30 23:26:55,662 - Epoch: [8][ 9000/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.468380    
+2023-11-30 23:27:36,184 - Epoch: [8][ 9100/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.467685    
+2023-11-30 23:28:20,015 - Epoch: [8][ 9200/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.467365    
+2023-11-30 23:29:07,688 - Epoch: [8][ 9300/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.467465    
+2023-11-30 23:30:01,136 - Epoch: [8][ 9400/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.468177    
+2023-11-30 23:30:48,054 - Epoch: [8][ 9500/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.001000    Time 0.468187    
+2023-11-30 23:31:33,615 - Epoch: [8][ 9600/31148]    Overall Loss 0.010007    Objective Loss 0.000000    Distill Loss 0.010007                     LR 0.001000    Time 0.468056    
+2023-11-30 23:32:13,960 - Epoch: [8][ 9700/31148]    Overall Loss 0.010007    Objective Loss 0.000000    Distill Loss 0.010007                     LR 0.001000    Time 0.467389    
+2023-11-30 23:33:05,509 - Epoch: [8][ 9800/31148]    Overall Loss 0.010008    Objective Loss 0.000000    Distill Loss 0.010008                     LR 0.001000    Time 0.467879    
+2023-11-30 23:33:49,076 - Epoch: [8][ 9900/31148]    Overall Loss 0.010007    Objective Loss 0.000000    Distill Loss 0.010007                     LR 0.001000    Time 0.467553    
+2023-11-30 23:34:26,665 - Epoch: [8][10000/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.001000    Time 0.466636    
+2023-11-30 23:35:15,097 - Epoch: [8][10100/31148]    Overall Loss 0.010004    Objective Loss 0.000000    Distill Loss 0.010004                     LR 0.001000    Time 0.466810    
+2023-11-30 23:36:03,195 - Epoch: [8][10200/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.466948    
+2023-11-30 23:36:49,316 - Epoch: [8][10300/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.466892    
+2023-11-30 23:37:44,049 - Epoch: [8][10400/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.467664    
+2023-11-30 23:38:45,929 - Epoch: [8][10500/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.469103    
+2023-11-30 23:39:35,994 - Epoch: [8][10600/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.001000    Time 0.469400    
+2023-11-30 23:40:23,596 - Epoch: [8][10700/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.469461    
+2023-11-30 23:41:09,400 - Epoch: [8][10800/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.469355    
+2023-11-30 23:41:54,224 - Epoch: [8][10900/31148]    Overall Loss 0.010005    Objective Loss 0.000000    Distill Loss 0.010005                     LR 0.001000    Time 0.469160    
+2023-11-30 23:42:45,143 - Epoch: [8][11000/31148]    Overall Loss 0.010004    Objective Loss 0.000000    Distill Loss 0.010004                     LR 0.001000    Time 0.469524    
+2023-11-30 23:43:30,179 - Epoch: [8][11100/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.001000    Time 0.469350    
+2023-11-30 23:44:11,433 - Epoch: [8][11200/31148]    Overall Loss 0.010002    Objective Loss 0.000000    Distill Loss 0.010002                     LR 0.001000    Time 0.468843    
+2023-11-30 23:44:55,065 - Epoch: [8][11300/31148]    Overall Loss 0.010002    Objective Loss 0.000000    Distill Loss 0.010002                     LR 0.001000    Time 0.468554    
+2023-11-30 23:45:45,988 - Epoch: [8][11400/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.001000    Time 0.468910    
+2023-11-30 23:46:37,545 - Epoch: [8][11500/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.001000    Time 0.469315    
+2023-11-30 23:47:14,960 - Epoch: [8][11600/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.001000    Time 0.468494    
+2023-11-30 23:47:58,329 - Epoch: [8][11700/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.001000    Time 0.468196    
+2023-11-30 23:48:39,617 - Epoch: [8][11800/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.001000    Time 0.467727    
+2023-11-30 23:49:08,956 - Epoch: [8][11900/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.466261    
+2023-11-30 23:49:38,325 - Epoch: [8][12000/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.001000    Time 0.464823    
+2023-11-30 23:50:07,705 - Epoch: [8][12100/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.463409    
+2023-11-30 23:50:48,641 - Epoch: [8][12200/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.462966    
+2023-11-30 23:51:42,792 - Epoch: [8][12300/31148]    Overall Loss 0.009999    Objective Loss 0.000000    Distill Loss 0.009999                     LR 0.001000    Time 0.463604    
+2023-11-30 23:52:36,906 - Epoch: [8][12400/31148]    Overall Loss 0.009999    Objective Loss 0.000000    Distill Loss 0.009999                     LR 0.001000    Time 0.464229    
+2023-11-30 23:53:17,078 - Epoch: [8][12500/31148]    Overall Loss 0.009999    Objective Loss 0.000000    Distill Loss 0.009999                     LR 0.001000    Time 0.463729    
+2023-11-30 23:53:57,092 - Epoch: [8][12600/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.463224    
+2023-11-30 23:54:51,183 - Epoch: [8][12700/31148]    Overall Loss 0.009999    Objective Loss 0.000000    Distill Loss 0.009999                     LR 0.001000    Time 0.463835    
+2023-11-30 23:55:47,094 - Epoch: [8][12800/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.464579    
+2023-11-30 23:56:43,979 - Epoch: [8][12900/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.465387    
+2023-11-30 23:57:41,977 - Epoch: [8][13000/31148]    Overall Loss 0.009999    Objective Loss 0.000000    Distill Loss 0.009999                     LR 0.001000    Time 0.466268    
+2023-11-30 23:58:40,826 - Epoch: [8][13100/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.467200    
+2023-11-30 23:59:45,175 - Epoch: [8][13200/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.468535    
+2023-12-01 00:00:40,809 - Epoch: [8][13300/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.469195    
+2023-12-01 00:01:42,584 - Epoch: [8][13400/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.470303    
+2023-12-01 00:02:43,588 - Epoch: [8][13500/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.471338    
+2023-12-01 00:03:47,492 - Epoch: [8][13600/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.472570    
+2023-12-01 00:04:38,866 - Epoch: [8][13700/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.001000    Time 0.472870    
+2023-12-01 00:05:16,018 - Epoch: [8][13800/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.472135    
+2023-12-01 00:05:55,925 - Epoch: [8][13900/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.471609    
+2023-12-01 00:06:35,845 - Epoch: [8][14000/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.471091    
+2023-12-01 00:07:28,357 - Epoch: [8][14100/31148]    Overall Loss 0.010000    Objective Loss 0.000000    Distill Loss 0.010000                     LR 0.001000    Time 0.471474    
+2023-12-01 00:08:21,684 - Epoch: [8][14200/31148]    Overall Loss 0.009999    Objective Loss 0.000000    Distill Loss 0.009999                     LR 0.001000    Time 0.471909    
+2023-12-01 00:09:21,851 - Epoch: [8][14300/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.472816    
+2023-12-01 00:10:15,603 - Epoch: [8][14400/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.473264    
+2023-12-01 00:11:20,050 - Epoch: [8][14500/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.474445    
+2023-12-01 00:12:00,163 - Epoch: [8][14600/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.473942    
+2023-12-01 00:12:50,763 - Epoch: [8][14700/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.001000    Time 0.474160    
+2023-12-01 00:13:34,670 - Epoch: [8][14800/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.473922    
+2023-12-01 00:14:28,472 - Epoch: [8][14900/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474352    
+2023-12-01 00:15:14,992 - Epoch: [8][15000/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474290    
+2023-12-01 00:16:01,820 - Epoch: [8][15100/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474250    
+2023-12-01 00:16:39,489 - Epoch: [8][15200/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.473608    
+2023-12-01 00:17:33,362 - Epoch: [8][15300/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.474033    
+2023-12-01 00:18:32,557 - Epoch: [8][15400/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.474798    
+2023-12-01 00:19:17,178 - Epoch: [8][15500/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.001000    Time 0.474613    
+2023-12-01 00:20:01,868 - Epoch: [8][15600/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474435    
+2023-12-01 00:20:41,092 - Epoch: [8][15700/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.473911    
+2023-12-01 00:21:34,941 - Epoch: [8][15800/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474319    
+2023-12-01 00:22:18,501 - Epoch: [8][15900/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474075    
+2023-12-01 00:23:11,387 - Epoch: [8][16000/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474417    
+2023-12-01 00:23:56,329 - Epoch: [8][16100/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474261    
+2023-12-01 00:24:32,027 - Epoch: [8][16200/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.473537    
+2023-12-01 00:25:29,762 - Epoch: [8][16300/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.001000    Time 0.474173    
+2023-12-01 00:26:15,343 - Epoch: [8][16400/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.001000    Time 0.474061    
+2023-12-01 00:26:57,020 - Epoch: [8][16500/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.001000    Time 0.473713    
+2023-12-01 00:27:46,509 - Epoch: [8][16600/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.001000    Time 0.473840    
+2023-12-01 00:28:33,378 - Epoch: [8][16700/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.001000    Time 0.473809    
+2023-12-01 00:29:14,587 - Epoch: [8][16800/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.001000    Time 0.473441    
+2023-12-01 00:30:00,881 - Epoch: [8][16900/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.001000    Time 0.473379    
+2023-12-01 00:30:49,414 - Epoch: [8][17000/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.001000    Time 0.473449    
+2023-12-01 00:31:32,958 - Epoch: [8][17100/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.001000    Time 0.473226    
+2023-12-01 00:32:22,129 - Epoch: [8][17200/31148]    Overall Loss 0.009994    Objective Loss 0.000000    Distill Loss 0.009994                     LR 0.001000    Time 0.473333    
+2023-12-01 00:33:09,408 - Epoch: [8][17300/31148]    Overall Loss 0.009994    Objective Loss 0.000000    Distill Loss 0.009994                     LR 0.001000    Time 0.473329    
+2023-12-01 00:33:54,391 - Epoch: [8][17400/31148]    Overall Loss 0.009994    Objective Loss 0.000000    Distill Loss 0.009994                     LR 0.001000    Time 0.473194    
+2023-12-01 00:34:42,772 - Epoch: [8][17500/31148]    Overall Loss 0.009993    Objective Loss 0.000000    Distill Loss 0.009993                     LR 0.001000    Time 0.473254    
+2023-12-01 00:35:36,076 - Epoch: [8][17600/31148]    Overall Loss 0.009993    Objective Loss 0.000000    Distill Loss 0.009993                     LR 0.001000    Time 0.473593    
+2023-12-01 00:36:20,031 - Epoch: [8][17700/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.001000    Time 0.473401    
+2023-12-01 00:37:07,062 - Epoch: [8][17800/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.001000    Time 0.473383    
+2023-12-01 00:38:07,900 - Epoch: [8][17900/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.001000    Time 0.474137    
+2023-12-01 00:38:51,128 - Epoch: [8][18000/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.001000    Time 0.473904    
+2023-12-01 00:39:46,895 - Epoch: [8][18100/31148]    Overall Loss 0.009991    Objective Loss 0.000000    Distill Loss 0.009991                     LR 0.001000    Time 0.474366    
+2023-12-01 00:40:35,379 - Epoch: [8][18200/31148]    Overall Loss 0.009991    Objective Loss 0.000000    Distill Loss 0.009991                     LR 0.001000    Time 0.474423    
+2023-12-01 00:41:27,101 - Epoch: [8][18300/31148]    Overall Loss 0.009991    Objective Loss 0.000000    Distill Loss 0.009991                     LR 0.001000    Time 0.474656    
+2023-12-01 00:42:15,672 - Epoch: [8][18400/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.001000    Time 0.474716    
+2023-12-01 00:43:05,368 - Epoch: [8][18500/31148]    Overall Loss 0.009991    Objective Loss 0.000000    Distill Loss 0.009991                     LR 0.001000    Time 0.474836    
+2023-12-01 00:43:54,191 - Epoch: [8][18600/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474907    
+2023-12-01 00:44:36,606 - Epoch: [8][18700/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474636    
+2023-12-01 00:45:22,307 - Epoch: [8][18800/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474541    
+2023-12-01 00:46:06,119 - Epoch: [8][18900/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474348    
+2023-12-01 00:46:55,890 - Epoch: [8][19000/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474471    
+2023-12-01 00:47:44,417 - Epoch: [8][19100/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.474527    
+2023-12-01 00:48:31,721 - Epoch: [8][19200/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.474519    
+2023-12-01 00:49:17,917 - Epoch: [8][19300/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.474453    
+2023-12-01 00:50:07,011 - Epoch: [8][19400/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474538    
+2023-12-01 00:50:51,861 - Epoch: [8][19500/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474404    
+2023-12-01 00:51:34,482 - Epoch: [8][19600/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474158    
+2023-12-01 00:52:22,305 - Epoch: [8][19700/31148]    Overall Loss 0.009990    Objective Loss 0.000000    Distill Loss 0.009990                     LR 0.001000    Time 0.474178    
+2023-12-01 00:53:05,780 - Epoch: [8][19800/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.473979    
+2023-12-01 00:53:47,640 - Epoch: [8][19900/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.473700    
+2023-12-01 00:54:32,811 - Epoch: [8][20000/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.473590    
+2023-12-01 00:55:19,458 - Epoch: [8][20100/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.473554    
+2023-12-01 00:56:10,814 - Epoch: [8][20200/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.473752    
+2023-12-01 00:56:53,340 - Epoch: [8][20300/31148]    Overall Loss 0.009989    Objective Loss 0.000000    Distill Loss 0.009989                     LR 0.001000    Time 0.473512    
+2023-12-01 00:57:37,937 - Epoch: [8][20400/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.473377    
+2023-12-01 00:58:21,623 - Epoch: [8][20500/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.473199    
+2023-12-01 00:58:57,769 - Epoch: [8][20600/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.472656    
+2023-12-01 00:59:50,835 - Epoch: [8][20700/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.472936    
+2023-12-01 01:00:39,931 - Epoch: [8][20800/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.473022    
+2023-12-01 01:01:25,802 - Epoch: [8][20900/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.472953    
+2023-12-01 01:02:21,223 - Epoch: [8][21000/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473340    
+2023-12-01 01:03:08,609 - Epoch: [8][21100/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.473342    
+2023-12-01 01:04:00,075 - Epoch: [8][21200/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.001000    Time 0.473536    
+2023-12-01 01:04:42,210 - Epoch: [8][21300/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473291    
+2023-12-01 01:05:36,000 - Epoch: [8][21400/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473593    
+2023-12-01 01:06:29,478 - Epoch: [8][21500/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473877    
+2023-12-01 01:07:16,775 - Epoch: [8][21600/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473872    
+2023-12-01 01:08:01,643 - Epoch: [8][21700/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473756    
+2023-12-01 01:08:47,612 - Epoch: [8][21800/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473691    
+2023-12-01 01:09:30,444 - Epoch: [8][21900/31148]    Overall Loss 0.009986    Objective Loss 0.000000    Distill Loss 0.009986                     LR 0.001000    Time 0.473483    
+2023-12-01 01:10:18,358 - Epoch: [8][22000/31148]    Overall Loss 0.009986    Objective Loss 0.000000    Distill Loss 0.009986                     LR 0.001000    Time 0.473509    
+2023-12-01 01:10:58,349 - Epoch: [8][22100/31148]    Overall Loss 0.009987    Objective Loss 0.000000    Distill Loss 0.009987                     LR 0.001000    Time 0.473175    
+2023-12-01 01:11:49,115 - Epoch: [8][22200/31148]    Overall Loss 0.009986    Objective Loss 0.000000    Distill Loss 0.009986                     LR 0.001000    Time 0.473330    
+2023-12-01 01:12:36,170 - Epoch: [8][22300/31148]    Overall Loss 0.009986    Objective Loss 0.000000    Distill Loss 0.009986                     LR 0.001000    Time 0.473318    
+2023-12-01 01:13:21,874 - Epoch: [8][22400/31148]    Overall Loss 0.009986    Objective Loss 0.000000    Distill Loss 0.009986                     LR 0.001000    Time 0.473245    
+2023-12-01 01:14:15,172 - Epoch: [8][22500/31148]    Overall Loss 0.009985    Objective Loss 0.000000    Distill Loss 0.009985                     LR 0.001000    Time 0.473510    
+2023-12-01 01:15:04,231 - Epoch: [8][22600/31148]    Overall Loss 0.009985    Objective Loss 0.000000    Distill Loss 0.009985                     LR 0.001000    Time 0.473585    
+2023-12-01 01:15:48,349 - Epoch: [8][22700/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.473442    
+2023-12-01 01:16:30,571 - Epoch: [8][22800/31148]    Overall Loss 0.009985    Objective Loss 0.000000    Distill Loss 0.009985                     LR 0.001000    Time 0.473217    
+2023-12-01 01:17:11,851 - Epoch: [8][22900/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.472953    
+2023-12-01 01:18:02,101 - Epoch: [8][23000/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.473081    
+2023-12-01 01:18:52,229 - Epoch: [8][23100/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.473203    
+2023-12-01 01:19:32,450 - Epoch: [8][23200/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.472897    
+2023-12-01 01:20:29,166 - Epoch: [8][23300/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.473301    
+2023-12-01 01:21:12,511 - Epoch: [8][23400/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.473130    
+2023-12-01 01:21:56,814 - Epoch: [8][23500/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.473002    
+2023-12-01 01:22:41,731 - Epoch: [8][23600/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.472901    
+2023-12-01 01:23:21,143 - Epoch: [8][23700/31148]    Overall Loss 0.009984    Objective Loss 0.000000    Distill Loss 0.009984                     LR 0.001000    Time 0.472568    
+2023-12-01 01:24:03,791 - Epoch: [8][23800/31148]    Overall Loss 0.009983    Objective Loss 0.000000    Distill Loss 0.009983                     LR 0.001000    Time 0.472374    
+2023-12-01 01:24:55,027 - Epoch: [8][23900/31148]    Overall Loss 0.009983    Objective Loss 0.000000    Distill Loss 0.009983                     LR 0.001000    Time 0.472541    
+2023-12-01 01:25:38,452 - Epoch: [8][24000/31148]    Overall Loss 0.009983    Objective Loss 0.000000    Distill Loss 0.009983                     LR 0.001000    Time 0.472381    
+2023-12-01 01:26:19,142 - Epoch: [8][24100/31148]    Overall Loss 0.009983    Objective Loss 0.000000    Distill Loss 0.009983                     LR 0.001000    Time 0.472109    
+2023-12-01 01:26:57,912 - Epoch: [8][24200/31148]    Overall Loss 0.009983    Objective Loss 0.000000    Distill Loss 0.009983                     LR 0.001000    Time 0.471760    
+2023-12-01 01:27:42,515 - Epoch: [8][24300/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471654    
+2023-12-01 01:28:18,565 - Epoch: [8][24400/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471198    
+2023-12-01 01:29:17,407 - Epoch: [8][24500/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471676    
+2023-12-01 01:29:58,926 - Epoch: [8][24600/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471446    
+2023-12-01 01:30:42,189 - Epoch: [8][24700/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471289    
+2023-12-01 01:31:23,890 - Epoch: [8][24800/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471070    
+2023-12-01 01:32:30,381 - Epoch: [8][24900/31148]    Overall Loss 0.009982    Objective Loss 0.000000    Distill Loss 0.009982                     LR 0.001000    Time 0.471848    
+2023-12-01 01:33:15,494 - Epoch: [8][25000/31148]    Overall Loss 0.009981    Objective Loss 0.000000    Distill Loss 0.009981                     LR 0.001000    Time 0.471765    
+2023-12-01 01:34:12,792 - Epoch: [8][25100/31148]    Overall Loss 0.009981    Objective Loss 0.000000    Distill Loss 0.009981                     LR 0.001000    Time 0.472168    
+2023-12-01 01:34:56,298 - Epoch: [8][25200/31148]    Overall Loss 0.009981    Objective Loss 0.000000    Distill Loss 0.009981                     LR 0.001000    Time 0.472020    
+2023-12-01 01:35:34,079 - Epoch: [8][25300/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471647    
+2023-12-01 01:36:16,852 - Epoch: [8][25400/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471474    
+2023-12-01 01:37:09,315 - Epoch: [8][25500/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471682    
+2023-12-01 01:37:57,929 - Epoch: [8][25600/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471739    
+2023-12-01 01:38:38,616 - Epoch: [8][25700/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471486    
+2023-12-01 01:39:26,502 - Epoch: [8][25800/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471514    
+2023-12-01 01:40:10,125 - Epoch: [8][25900/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.471378    
+2023-12-01 01:40:45,477 - Epoch: [8][26000/31148]    Overall Loss 0.009980    Objective Loss 0.000000    Distill Loss 0.009980                     LR 0.001000    Time 0.470924    
+2023-12-01 01:41:40,637 - Epoch: [8][26100/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.471233    
+2023-12-01 01:42:17,626 - Epoch: [8][26200/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470846    
+2023-12-01 01:43:03,260 - Epoch: [8][26300/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470790    
+2023-12-01 01:43:46,354 - Epoch: [8][26400/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470639    
+2023-12-01 01:44:29,382 - Epoch: [8][26500/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470487    
+2023-12-01 01:45:08,900 - Epoch: [8][26600/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470203    
+2023-12-01 01:46:02,678 - Epoch: [8][26700/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470456    
+2023-12-01 01:46:49,849 - Epoch: [8][26800/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470460    
+2023-12-01 01:47:38,154 - Epoch: [8][26900/31148]    Overall Loss 0.009979    Objective Loss 0.000000    Distill Loss 0.009979                     LR 0.001000    Time 0.470507    
+2023-12-01 01:48:32,998 - Epoch: [8][27000/31148]    Overall Loss 0.009978    Objective Loss 0.000000    Distill Loss 0.009978                     LR 0.001000    Time 0.470795    
+2023-12-01 01:49:19,967 - Epoch: [8][27100/31148]    Overall Loss 0.009978    Objective Loss 0.000000    Distill Loss 0.009978                     LR 0.001000    Time 0.470791    
+2023-12-01 01:50:07,590 - Epoch: [8][27200/31148]    Overall Loss 0.009978    Objective Loss 0.000000    Distill Loss 0.009978                     LR 0.001000    Time 0.470811    
+2023-12-01 01:50:46,716 - Epoch: [8][27300/31148]    Overall Loss 0.009978    Objective Loss 0.000000    Distill Loss 0.009978                     LR 0.001000    Time 0.470519    
+2023-12-01 01:51:32,129 - Epoch: [8][27400/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.470459    
+2023-12-01 01:52:18,502 - Epoch: [8][27500/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.470434    
+2023-12-01 01:53:06,521 - Epoch: [8][27600/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.470469    
+2023-12-01 01:53:52,046 - Epoch: [8][27700/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.470414    
+2023-12-01 01:54:30,917 - Epoch: [8][27800/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.470120    
+2023-12-01 01:55:15,941 - Epoch: [8][27900/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.470048    
+2023-12-01 01:55:57,830 - Epoch: [8][28000/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.001000    Time 0.469865    
+2023-12-01 01:56:46,092 - Epoch: [8][28100/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.469910    
+2023-12-01 01:57:30,695 - Epoch: [8][28200/31148]    Overall Loss 0.009975    Objective Loss 0.000000    Distill Loss 0.009975                     LR 0.001000    Time 0.469825    
+2023-12-01 01:58:13,768 - Epoch: [8][28300/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.469687    
+2023-12-01 01:59:02,888 - Epoch: [8][28400/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.469762    
+2023-12-01 01:59:44,203 - Epoch: [8][28500/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.469564    
+2023-12-01 02:00:24,879 - Epoch: [8][28600/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.469344    
+2023-12-01 02:01:00,794 - Epoch: [8][28700/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.468960    
+2023-12-01 02:01:53,217 - Epoch: [8][28800/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.469151    
+2023-12-01 02:02:31,494 - Epoch: [8][28900/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.468852    
+2023-12-01 02:03:12,028 - Epoch: [8][29000/31148]    Overall Loss 0.009976    Objective Loss 0.000000    Distill Loss 0.009976                     LR 0.001000    Time 0.468633    
+2023-12-01 02:03:52,268 - Epoch: [8][29100/31148]    Overall Loss 0.009975    Objective Loss 0.000000    Distill Loss 0.009975                     LR 0.001000    Time 0.468405    
+2023-12-01 02:04:41,748 - Epoch: [8][29200/31148]    Overall Loss 0.009975    Objective Loss 0.000000    Distill Loss 0.009975                     LR 0.001000    Time 0.468495    
+2023-12-01 02:05:30,865 - Epoch: [8][29300/31148]    Overall Loss 0.009975    Objective Loss 0.000000    Distill Loss 0.009975                     LR 0.001000    Time 0.468572    
+2023-12-01 02:06:06,475 - Epoch: [8][29400/31148]    Overall Loss 0.009975    Objective Loss 0.000000    Distill Loss 0.009975                     LR 0.001000    Time 0.468189    
+2023-12-01 02:06:55,242 - Epoch: [8][29500/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468255    
+2023-12-01 02:07:42,939 - Epoch: [8][29600/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468284    
+2023-12-01 02:08:21,041 - Epoch: [8][29700/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.467990    
+2023-12-01 02:09:15,321 - Epoch: [8][29800/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468241    
+2023-12-01 02:09:56,027 - Epoch: [8][29900/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468036    
+2023-12-01 02:10:46,029 - Epoch: [8][30000/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468142    
+2023-12-01 02:11:34,121 - Epoch: [8][30100/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468185    
+2023-12-01 02:12:15,902 - Epoch: [8][30200/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468018    
+2023-12-01 02:13:05,962 - Epoch: [8][30300/31148]    Overall Loss 0.009974    Objective Loss 0.000000    Distill Loss 0.009974                     LR 0.001000    Time 0.468125    
+2023-12-01 02:13:48,392 - Epoch: [8][30400/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.467980    
+2023-12-01 02:14:35,202 - Epoch: [8][30500/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.467981    
+2023-12-01 02:15:28,395 - Epoch: [8][30600/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.468189    
+2023-12-01 02:16:10,268 - Epoch: [8][30700/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.468028    
+2023-12-01 02:16:55,736 - Epoch: [8][30800/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.467984    
+2023-12-01 02:17:41,807 - Epoch: [8][30900/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.467961    
+2023-12-01 02:18:19,586 - Epoch: [8][31000/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.467669    
+2023-12-01 02:19:03,322 - Epoch: [8][31100/31148]    Overall Loss 0.009973    Objective Loss 0.000000    Distill Loss 0.009973                     LR 0.001000    Time 0.467572    
+2023-12-01 02:19:21,926 - Epoch: [8][31148/31148]    Overall Loss 0.009972    Objective Loss 0.000000    Distill Loss 0.009972                     LR 0.001000    Time 0.467448    
+2023-12-01 02:19:22,800 - --- validate (epoch=8)-----------
+2023-12-01 02:19:22,800 - 167951 samples (100 per mini-batch)
+2023-12-01 02:19:50,244 - Epoch: [8][  100/ 1680]    Loss 0.000000    Overall Loss 0.010728    
+2023-12-01 02:20:10,262 - Epoch: [8][  200/ 1680]    Loss 0.000000    Overall Loss 0.010673    
+2023-12-01 02:20:30,248 - Epoch: [8][  300/ 1680]    Loss 0.000000    Overall Loss 0.010691    
+2023-12-01 02:20:50,256 - Epoch: [8][  400/ 1680]    Loss 0.000000    Overall Loss 0.010696    
+2023-12-01 02:21:10,270 - Epoch: [8][  500/ 1680]    Loss 0.000000    Overall Loss 0.010692    
+2023-12-01 02:21:30,216 - Epoch: [8][  600/ 1680]    Loss 0.000000    Overall Loss 0.010696    
+2023-12-01 02:21:50,220 - Epoch: [8][  700/ 1680]    Loss 0.000000    Overall Loss 0.010698    
+2023-12-01 02:22:10,215 - Epoch: [8][  800/ 1680]    Loss 0.000000    Overall Loss 0.010697    
+2023-12-01 02:22:30,218 - Epoch: [8][  900/ 1680]    Loss 0.000000    Overall Loss 0.010699    
+2023-12-01 02:22:50,206 - Epoch: [8][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010702    
+2023-12-01 02:23:10,253 - Epoch: [8][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010705    
+2023-12-01 02:23:30,254 - Epoch: [8][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010704    
+2023-12-01 02:23:50,329 - Epoch: [8][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010700    
+2023-12-01 02:24:10,370 - Epoch: [8][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010703    
+2023-12-01 02:24:30,385 - Epoch: [8][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010706    
+2023-12-01 02:24:50,329 - Epoch: [8][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010706    
+2023-12-01 02:25:06,233 - Epoch: [8][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010703    
+2023-12-01 02:25:06,732 - ==> Overall Loss: 0.011
+
+2023-12-01 02:25:06,741 - ==> Best [Overall Loss: 0.010703 on epoch: 8]
+2023-12-01 02:25:06,741 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-01 02:25:06,800 - 
+
+2023-12-01 02:25:06,800 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-01 02:26:05,087 - Epoch: [9][  100/31148]    Overall Loss 0.009882    Objective Loss 0.000000    Distill Loss 0.009882                     LR 0.001000    Time 0.582771    
+2023-12-01 02:26:50,862 - Epoch: [9][  200/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.520225    
+2023-12-01 02:27:35,830 - Epoch: [9][  300/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.496689    
+2023-12-01 02:28:26,685 - Epoch: [9][  400/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.499634    
+2023-12-01 02:29:10,966 - Epoch: [9][  500/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.488255    
+2023-12-01 02:29:54,057 - Epoch: [9][  600/31148]    Overall Loss 0.009846    Objective Loss 0.000000    Distill Loss 0.009846                     LR 0.001000    Time 0.478684    
+2023-12-01 02:30:37,357 - Epoch: [9][  700/31148]    Overall Loss 0.009860    Objective Loss 0.000000    Distill Loss 0.009860                     LR 0.001000    Time 0.472147    
+2023-12-01 02:31:25,221 - Epoch: [9][  800/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.001000    Time 0.472948    
+2023-12-01 02:32:07,893 - Epoch: [9][  900/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.467804    
+2023-12-01 02:32:55,521 - Epoch: [9][ 1000/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.468643    
+2023-12-01 02:33:32,817 - Epoch: [9][ 1100/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.459939    
+2023-12-01 02:34:28,593 - Epoch: [9][ 1200/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.468085    
+2023-12-01 02:35:17,359 - Epoch: [9][ 1300/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.469585    
+2023-12-01 02:36:06,491 - Epoch: [9][ 1400/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.471132    
+2023-12-01 02:36:44,732 - Epoch: [9][ 1500/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.465213    
+2023-12-01 02:37:21,803 - Epoch: [9][ 1600/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.001000    Time 0.459301    
+2023-12-01 02:37:58,787 - Epoch: [9][ 1700/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.454035    
+2023-12-01 02:38:36,520 - Epoch: [9][ 1800/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.001000    Time 0.449770    
+2023-12-01 02:39:19,593 - Epoch: [9][ 1900/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.448764    
+2023-12-01 02:40:01,823 - Epoch: [9][ 2000/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.447437    
+2023-12-01 02:40:40,728 - Epoch: [9][ 2100/31148]    Overall Loss 0.009882    Objective Loss 0.000000    Distill Loss 0.009882                     LR 0.001000    Time 0.444653    
+2023-12-01 02:41:19,290 - Epoch: [9][ 2200/31148]    Overall Loss 0.009880    Objective Loss 0.000000    Distill Loss 0.009880                     LR 0.001000    Time 0.441967    
+2023-12-01 02:42:00,700 - Epoch: [9][ 2300/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.001000    Time 0.440752    
+2023-12-01 02:42:49,366 - Epoch: [9][ 2400/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.442661    
+2023-12-01 02:43:24,370 - Epoch: [9][ 2500/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.001000    Time 0.438954    
+2023-12-01 02:44:11,002 - Epoch: [9][ 2600/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.001000    Time 0.440004    
+2023-12-01 02:44:57,152 - Epoch: [9][ 2700/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.440797    
+2023-12-01 02:45:37,928 - Epoch: [9][ 2800/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.001000    Time 0.439615    
+2023-12-01 02:46:21,196 - Epoch: [9][ 2900/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.001000    Time 0.439373    
+2023-12-01 02:47:09,833 - Epoch: [9][ 3000/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.440937    
+2023-12-01 02:48:07,283 - Epoch: [9][ 3100/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.445243    
+2023-12-01 02:48:58,097 - Epoch: [9][ 3200/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.001000    Time 0.447206    
+2023-12-01 02:49:33,902 - Epoch: [9][ 3300/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.444502    
+2023-12-01 02:50:19,144 - Epoch: [9][ 3400/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.444733    
+2023-12-01 02:51:07,661 - Epoch: [9][ 3500/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.445887    
+2023-12-01 02:51:45,472 - Epoch: [9][ 3600/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.001000    Time 0.444002    
+2023-12-01 02:52:24,460 - Epoch: [9][ 3700/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.442537    
+2023-12-01 02:53:15,061 - Epoch: [9][ 3800/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.001000    Time 0.444205    
+2023-12-01 02:53:54,802 - Epoch: [9][ 3900/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.443004    
+2023-12-01 02:54:44,091 - Epoch: [9][ 4000/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.001000    Time 0.444249    
+2023-12-01 02:55:19,191 - Epoch: [9][ 4100/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.001000    Time 0.441972    
+2023-12-01 02:55:57,970 - Epoch: [9][ 4200/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.001000    Time 0.440680    
+2023-12-01 02:56:35,238 - Epoch: [9][ 4300/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.001000    Time 0.439097    
+2023-12-01 02:57:13,246 - Epoch: [9][ 4400/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.437754    
+2023-12-01 02:57:53,547 - Epoch: [9][ 4500/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.436981    
+2023-12-01 02:58:30,610 - Epoch: [9][ 4600/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.001000    Time 0.435536    
+2023-12-01 02:59:16,276 - Epoch: [9][ 4700/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.435984    
+2023-12-01 03:00:03,056 - Epoch: [9][ 4800/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.436646    
+2023-12-01 03:00:51,506 - Epoch: [9][ 4900/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.001000    Time 0.437621    
+2023-12-01 03:01:29,066 - Epoch: [9][ 5000/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.001000    Time 0.436379    
+2023-12-01 03:02:16,696 - Epoch: [9][ 5100/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.437160    
+2023-12-01 03:03:03,972 - Epoch: [9][ 5200/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.001000    Time 0.437843    
+2023-12-01 03:03:44,166 - Epoch: [9][ 5300/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.001000    Time 0.437165    
+2023-12-01 03:04:24,559 - Epoch: [9][ 5400/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.001000    Time 0.436548    
+2023-12-01 03:05:04,703 - Epoch: [9][ 5500/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.001000    Time 0.435908    
+2023-12-01 03:05:54,013 - Epoch: [9][ 5600/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.001000    Time 0.436928    
+2023-12-01 03:06:37,028 - Epoch: [9][ 5700/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.001000    Time 0.436808    
+2023-12-01 03:07:17,409 - Epoch: [9][ 5800/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.436238    
+2023-12-01 03:07:54,075 - Epoch: [9][ 5900/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.001000    Time 0.435057    
+2023-12-01 03:08:39,997 - Epoch: [9][ 6000/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.001000    Time 0.435459    
+2023-12-01 03:09:20,319 - Epoch: [9][ 6100/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.001000    Time 0.434929    
+2023-12-01 03:10:01,349 - Epoch: [9][ 6200/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.001000    Time 0.434530    
+2023-12-01 03:10:49,062 - Epoch: [9][ 6300/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.001000    Time 0.435205    
+2023-12-01 03:11:28,122 - Epoch: [9][ 6400/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.001000    Time 0.434508    
+2023-12-01 03:12:22,326 - Epoch: [9][ 6500/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.436161    
+2023-12-01 03:13:03,803 - Epoch: [9][ 6600/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.001000    Time 0.435836    
+2023-12-01 03:13:46,356 - Epoch: [9][ 6700/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.435680    
+2023-12-01 03:14:20,784 - Epoch: [9][ 6800/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.001000    Time 0.434335    
+2023-12-01 03:15:02,921 - Epoch: [9][ 6900/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.001000    Time 0.434146    
+2023-12-01 03:15:41,864 - Epoch: [9][ 7000/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.001000    Time 0.433506    
+2023-12-01 03:16:31,692 - Epoch: [9][ 7100/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.001000    Time 0.434417    
+2023-12-01 03:17:18,633 - Epoch: [9][ 7200/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.001000    Time 0.434902    
+2023-12-01 03:18:01,459 - Epoch: [9][ 7300/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.001000    Time 0.434810    
+2023-12-01 03:18:47,463 - Epoch: [9][ 7400/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.001000    Time 0.435150    
+2023-12-01 03:19:33,091 - Epoch: [9][ 7500/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.001000    Time 0.435431    
+2023-12-01 03:20:06,929 - Epoch: [9][ 7600/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.001000    Time 0.434153    
+2023-12-01 03:20:52,390 - Epoch: [9][ 7700/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.001000    Time 0.434417    
+2023-12-01 03:21:23,606 - Epoch: [9][ 7800/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.001000    Time 0.432849    
+2023-12-01 03:21:52,257 - Epoch: [9][ 7900/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.001000    Time 0.430996    
+2023-12-01 03:22:19,173 - Epoch: [9][ 8000/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.428973    
+2023-12-01 03:22:46,492 - Epoch: [9][ 8100/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.001000    Time 0.427049    
+2023-12-01 03:23:14,382 - Epoch: [9][ 8200/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.425242    
+2023-12-01 03:23:42,420 - Epoch: [9][ 8300/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.423496    
+2023-12-01 03:24:09,832 - Epoch: [9][ 8400/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.421717    
+2023-12-01 03:24:38,983 - Epoch: [9][ 8500/31148]    Overall Loss 0.009883    Objective Loss 0.000000    Distill Loss 0.009883                     LR 0.001000    Time 0.420185    
+2023-12-01 03:25:07,094 - Epoch: [9][ 8600/31148]    Overall Loss 0.009882    Objective Loss 0.000000    Distill Loss 0.009882                     LR 0.001000    Time 0.418567    
+2023-12-01 03:25:33,760 - Epoch: [9][ 8700/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.416820    
+2023-12-01 03:26:01,685 - Epoch: [9][ 8800/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.415257    
+2023-12-01 03:26:28,658 - Epoch: [9][ 8900/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.413621    
+2023-12-01 03:27:11,135 - Epoch: [9][ 9000/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.413744    
+2023-12-01 03:27:55,413 - Epoch: [9][ 9100/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.414062    
+2023-12-01 03:28:36,167 - Epoch: [9][ 9200/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.413991    
+2023-12-01 03:29:22,598 - Epoch: [9][ 9300/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.414531    
+2023-12-01 03:30:03,604 - Epoch: [9][ 9400/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.414483    
+2023-12-01 03:30:51,408 - Epoch: [9][ 9500/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.415151    
+2023-12-01 03:31:36,250 - Epoch: [9][ 9600/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.415497    
+2023-12-01 03:32:24,535 - Epoch: [9][ 9700/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.416190    
+2023-12-01 03:33:09,122 - Epoch: [9][ 9800/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.001000    Time 0.416492    
+2023-12-01 03:33:58,002 - Epoch: [9][ 9900/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.001000    Time 0.417222    
+2023-12-01 03:34:38,645 - Epoch: [9][10000/31148]    Overall Loss 0.009883    Objective Loss 0.000000    Distill Loss 0.009883                     LR 0.001000    Time 0.417113    
+2023-12-01 03:35:28,333 - Epoch: [9][10100/31148]    Overall Loss 0.009882    Objective Loss 0.000000    Distill Loss 0.009882                     LR 0.001000    Time 0.417902    
+2023-12-01 03:36:19,602 - Epoch: [9][10200/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.001000    Time 0.418831    
+2023-12-01 03:37:12,455 - Epoch: [9][10300/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.001000    Time 0.419895    
+2023-12-01 03:38:05,863 - Epoch: [9][10400/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.001000    Time 0.420992    
+2023-12-01 03:38:52,979 - Epoch: [9][10500/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.001000    Time 0.421469    
+2023-12-01 03:39:38,295 - Epoch: [9][10600/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.001000    Time 0.421768    
+2023-12-01 03:40:34,402 - Epoch: [9][10700/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.001000    Time 0.423069    
+2023-12-01 03:41:26,531 - Epoch: [9][10800/31148]    Overall Loss 0.009880    Objective Loss 0.000000    Distill Loss 0.009880                     LR 0.001000    Time 0.423978    
+2023-12-01 03:42:17,414 - Epoch: [9][10900/31148]    Overall Loss 0.009880    Objective Loss 0.000000    Distill Loss 0.009880                     LR 0.001000    Time 0.424755    
+2023-12-01 03:43:03,175 - Epoch: [9][11000/31148]    Overall Loss 0.009880    Objective Loss 0.000000    Distill Loss 0.009880                     LR 0.001000    Time 0.425053    
+2023-12-01 03:43:44,339 - Epoch: [9][11100/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.001000    Time 0.424932    
+2023-12-01 03:44:38,795 - Epoch: [9][11200/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.425999    
+2023-12-01 03:45:31,455 - Epoch: [9][11300/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.426889    
+2023-12-01 03:46:31,662 - Epoch: [9][11400/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.001000    Time 0.428425    
+2023-12-01 03:47:19,607 - Epoch: [9][11500/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.001000    Time 0.428868    
+2023-12-01 03:48:13,980 - Epoch: [9][11600/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.001000    Time 0.429857    
+2023-12-01 03:49:04,141 - Epoch: [9][11700/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.001000    Time 0.430470    
+2023-12-01 03:49:49,629 - Epoch: [9][11800/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.430676    
+2023-12-01 03:50:35,703 - Epoch: [9][11900/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.430928    
+2023-12-01 03:51:11,113 - Epoch: [9][12000/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.430287    
+2023-12-01 03:52:03,005 - Epoch: [9][12100/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.431019    
+2023-12-01 03:52:56,397 - Epoch: [9][12200/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.431862    
+2023-12-01 03:53:43,514 - Epoch: [9][12300/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.432181    
+2023-12-01 03:54:34,990 - Epoch: [9][12400/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.432846    
+2023-12-01 03:55:25,498 - Epoch: [9][12500/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.433423    
+2023-12-01 03:56:24,751 - Epoch: [9][12600/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.434686    
+2023-12-01 03:57:07,585 - Epoch: [9][12700/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.434635    
+2023-12-01 03:57:50,049 - Epoch: [9][12800/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.434556    
+2023-12-01 03:58:38,014 - Epoch: [9][12900/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.434905    
+2023-12-01 03:59:18,693 - Epoch: [9][13000/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.434689    
+2023-12-01 04:00:05,856 - Epoch: [9][13100/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.434970    
+2023-12-01 04:00:46,317 - Epoch: [9][13200/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.434739    
+2023-12-01 04:01:30,817 - Epoch: [9][13300/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.434816    
+2023-12-01 04:02:16,451 - Epoch: [9][13400/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.434976    
+2023-12-01 04:03:03,329 - Epoch: [9][13500/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.435226    
+2023-12-01 04:03:56,743 - Epoch: [9][13600/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.435953    
+2023-12-01 04:04:56,825 - Epoch: [9][13700/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.437156    
+2023-12-01 04:05:53,203 - Epoch: [9][13800/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.001000    Time 0.438073    
+2023-12-01 04:06:44,574 - Epoch: [9][13900/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.438616    
+2023-12-01 04:07:27,336 - Epoch: [9][14000/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.438537    
+2023-12-01 04:08:12,578 - Epoch: [9][14100/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.438635    
+2023-12-01 04:08:56,582 - Epoch: [9][14200/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.001000    Time 0.438644    
+2023-12-01 04:09:39,859 - Epoch: [9][14300/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.001000    Time 0.438603    
+2023-12-01 04:10:22,414 - Epoch: [9][14400/31148]    Overall Loss 0.009875    Objective Loss 0.000000    Distill Loss 0.009875                     LR 0.001000    Time 0.438512    
+2023-12-01 04:11:14,769 - Epoch: [9][14500/31148]    Overall Loss 0.009875    Objective Loss 0.000000    Distill Loss 0.009875                     LR 0.001000    Time 0.439097    
+2023-12-01 04:11:55,389 - Epoch: [9][14600/31148]    Overall Loss 0.009875    Objective Loss 0.000000    Distill Loss 0.009875                     LR 0.001000    Time 0.438872    
+2023-12-01 04:12:37,017 - Epoch: [9][14700/31148]    Overall Loss 0.009875    Objective Loss 0.000000    Distill Loss 0.009875                     LR 0.001000    Time 0.438717    
+2023-12-01 04:13:23,810 - Epoch: [9][14800/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.438914    
+2023-12-01 04:14:07,956 - Epoch: [9][14900/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.438931    
+2023-12-01 04:15:00,359 - Epoch: [9][15000/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.439498    
+2023-12-01 04:15:56,736 - Epoch: [9][15100/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.440320    
+2023-12-01 04:16:41,389 - Epoch: [9][15200/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.440361    
+2023-12-01 04:17:38,540 - Epoch: [9][15300/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.441217    
+2023-12-01 04:18:14,160 - Epoch: [9][15400/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.440665    
+2023-12-01 04:19:05,472 - Epoch: [9][15500/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.001000    Time 0.441132    
+2023-12-01 04:19:52,975 - Epoch: [9][15600/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.001000    Time 0.441349    
+2023-12-01 04:20:42,655 - Epoch: [9][15700/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.001000    Time 0.441701    
+2023-12-01 04:21:28,440 - Epoch: [9][15800/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.001000    Time 0.441803    
+2023-12-01 04:22:18,878 - Epoch: [9][15900/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.001000    Time 0.442196    
+2023-12-01 04:23:03,124 - Epoch: [9][16000/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.001000    Time 0.442197    
+2023-12-01 04:23:53,379 - Epoch: [9][16100/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.001000    Time 0.442572    
+2023-12-01 04:24:33,175 - Epoch: [9][16200/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.001000    Time 0.442296    
+2023-12-01 04:25:20,133 - Epoch: [9][16300/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.001000    Time 0.442463    
+2023-12-01 04:25:55,968 - Epoch: [9][16400/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.001000    Time 0.441950    
+2023-12-01 04:26:40,743 - Epoch: [9][16500/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.001000    Time 0.441984    
+2023-12-01 04:27:28,922 - Epoch: [9][16600/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.001000    Time 0.442224    
+2023-12-01 04:28:18,523 - Epoch: [9][16700/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.442545    
+2023-12-01 04:29:00,409 - Epoch: [9][16800/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.442404    
+2023-12-01 04:29:50,445 - Epoch: [9][16900/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.442746    
+2023-12-01 04:30:41,712 - Epoch: [9][17000/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.443157    
+2023-12-01 04:31:17,480 - Epoch: [9][17100/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.442657    
+2023-12-01 04:32:08,668 - Epoch: [9][17200/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.443059    
+2023-12-01 04:32:57,313 - Epoch: [9][17300/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.443309    
+2023-12-01 04:33:39,723 - Epoch: [9][17400/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.443198    
+2023-12-01 04:34:37,349 - Epoch: [9][17500/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.443958    
+2023-12-01 04:35:18,023 - Epoch: [9][17600/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.001000    Time 0.443747    
+2023-12-01 04:36:02,456 - Epoch: [9][17700/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.001000    Time 0.443749    
+2023-12-01 04:36:49,214 - Epoch: [9][17800/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.001000    Time 0.443883    
+2023-12-01 04:37:27,450 - Epoch: [9][17900/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.001000    Time 0.443539    
+2023-12-01 04:38:10,550 - Epoch: [9][18000/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.001000    Time 0.443469    
+2023-12-01 04:38:55,720 - Epoch: [9][18100/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.443514    
+2023-12-01 04:39:38,238 - Epoch: [9][18200/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.443413    
+2023-12-01 04:40:28,409 - Epoch: [9][18300/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.443731    
+2023-12-01 04:41:16,319 - Epoch: [9][18400/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.001000    Time 0.443923    
+2023-12-01 04:42:04,324 - Epoch: [9][18500/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.444117    
+2023-12-01 04:42:52,485 - Epoch: [9][18600/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.444319    
+2023-12-01 04:43:46,271 - Epoch: [9][18700/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.444818    
+2023-12-01 04:44:32,693 - Epoch: [9][18800/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.444921    
+2023-12-01 04:45:21,664 - Epoch: [9][18900/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.445158    
+2023-12-01 04:46:03,877 - Epoch: [9][19000/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.445036    
+2023-12-01 04:46:52,295 - Epoch: [9][19100/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445241    
+2023-12-01 04:47:40,892 - Epoch: [9][19200/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445452    
+2023-12-01 04:48:28,853 - Epoch: [9][19300/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445629    
+2023-12-01 04:49:07,772 - Epoch: [9][19400/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445338    
+2023-12-01 04:49:53,072 - Epoch: [9][19500/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445377    
+2023-12-01 04:50:40,492 - Epoch: [9][19600/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445523    
+2023-12-01 04:51:26,997 - Epoch: [9][19700/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.001000    Time 0.445622    
+2023-12-01 04:52:09,701 - Epoch: [9][19800/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445528    
+2023-12-01 04:52:56,478 - Epoch: [9][19900/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445639    
+2023-12-01 04:53:46,854 - Epoch: [9][20000/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.445930    
+2023-12-01 04:54:33,895 - Epoch: [9][20100/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.446051    
+2023-12-01 04:55:18,330 - Epoch: [9][20200/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.446042    
+2023-12-01 04:56:02,632 - Epoch: [9][20300/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.446027    
+2023-12-01 04:56:55,791 - Epoch: [9][20400/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.001000    Time 0.446446    
+2023-12-01 04:57:43,457 - Epoch: [9][20500/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.446593    
+2023-12-01 04:58:32,511 - Epoch: [9][20600/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.446806    
+2023-12-01 04:59:26,155 - Epoch: [9][20700/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447239    
+2023-12-01 05:00:13,699 - Epoch: [9][20800/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447374    
+2023-12-01 05:01:09,847 - Epoch: [9][20900/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447920    
+2023-12-01 05:01:45,847 - Epoch: [9][21000/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447501    
+2023-12-01 05:02:31,880 - Epoch: [9][21100/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447561    
+2023-12-01 05:03:19,784 - Epoch: [9][21200/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447709    
+2023-12-01 05:04:06,735 - Epoch: [9][21300/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.447811    
+2023-12-01 05:05:04,697 - Epoch: [9][21400/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.448427    
+2023-12-01 05:05:51,180 - Epoch: [9][21500/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.448503    
+2023-12-01 05:06:39,716 - Epoch: [9][21600/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.001000    Time 0.448673    
+2023-12-01 05:07:35,792 - Epoch: [9][21700/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.449189    
+2023-12-01 05:08:22,863 - Epoch: [9][21800/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.001000    Time 0.449288    
+2023-12-01 05:09:12,839 - Epoch: [9][21900/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.001000    Time 0.449518    
+2023-12-01 05:09:51,891 - Epoch: [9][22000/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.449249    
+2023-12-01 05:10:46,945 - Epoch: [9][22100/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.449707    
+2023-12-01 05:11:35,185 - Epoch: [9][22200/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.001000    Time 0.449854    
+2023-12-01 05:12:24,939 - Epoch: [9][22300/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.001000    Time 0.450068    
+2023-12-01 05:13:05,887 - Epoch: [9][22400/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.449886    
+2023-12-01 05:13:54,720 - Epoch: [9][22500/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.450057    
+2023-12-01 05:14:44,538 - Epoch: [9][22600/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.450269    
+2023-12-01 05:15:34,780 - Epoch: [9][22700/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450499    
+2023-12-01 05:16:26,959 - Epoch: [9][22800/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450811    
+2023-12-01 05:17:11,970 - Epoch: [9][22900/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450808    
+2023-12-01 05:18:05,858 - Epoch: [9][23000/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.451190    
+2023-12-01 05:18:47,916 - Epoch: [9][23100/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.451057    
+2023-12-01 05:19:37,229 - Epoch: [9][23200/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.451238    
+2023-12-01 05:20:20,518 - Epoch: [9][23300/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.451159    
+2023-12-01 05:20:59,896 - Epoch: [9][23400/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450914    
+2023-12-01 05:21:45,022 - Epoch: [9][23500/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.450915    
+2023-12-01 05:22:31,067 - Epoch: [9][23600/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.450955    
+2023-12-01 05:23:11,102 - Epoch: [9][23700/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.450741    
+2023-12-01 05:24:03,234 - Epoch: [9][23800/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.451038    
+2023-12-01 05:24:46,387 - Epoch: [9][23900/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450956    
+2023-12-01 05:25:29,271 - Epoch: [9][24000/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450863    
+2023-12-01 05:26:09,260 - Epoch: [9][24100/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.001000    Time 0.450651    
+2023-12-01 05:27:01,623 - Epoch: [9][24200/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450953    
+2023-12-01 05:27:47,140 - Epoch: [9][24300/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450970    
+2023-12-01 05:28:25,548 - Epoch: [9][24400/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450695    
+2023-12-01 05:29:15,658 - Epoch: [9][24500/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450901    
+2023-12-01 05:29:57,758 - Epoch: [9][24600/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450779    
+2023-12-01 05:30:38,076 - Epoch: [9][24700/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450586    
+2023-12-01 05:31:30,370 - Epoch: [9][24800/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450877    
+2023-12-01 05:32:15,745 - Epoch: [9][24900/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.001000    Time 0.450889    
+2023-12-01 05:33:04,203 - Epoch: [9][25000/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.451023    
+2023-12-01 05:33:43,401 - Epoch: [9][25100/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450788    
+2023-12-01 05:34:28,478 - Epoch: [9][25200/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450787    
+2023-12-01 05:35:07,143 - Epoch: [9][25300/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450533    
+2023-12-01 05:35:56,290 - Epoch: [9][25400/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450694    
+2023-12-01 05:36:46,371 - Epoch: [9][25500/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450891    
+2023-12-01 05:37:31,990 - Epoch: [9][25600/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450911    
+2023-12-01 05:38:16,280 - Epoch: [9][25700/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450880    
+2023-12-01 05:38:56,254 - Epoch: [9][25800/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450681    
+2023-12-01 05:39:46,667 - Epoch: [9][25900/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.450887    
+2023-12-01 05:40:42,825 - Epoch: [9][26000/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.451313    
+2023-12-01 05:41:29,343 - Epoch: [9][26100/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.451366    
+2023-12-01 05:42:14,133 - Epoch: [9][26200/31148]    Overall Loss 0.009862    Objective Loss 0.000000    Distill Loss 0.009862                     LR 0.001000    Time 0.451352    
+2023-12-01 05:43:01,917 - Epoch: [9][26300/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.451452    
+2023-12-01 05:44:02,436 - Epoch: [9][26400/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452034    
+2023-12-01 05:44:48,787 - Epoch: [9][26500/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452077    
+2023-12-01 05:45:34,434 - Epoch: [9][26600/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452094    
+2023-12-01 05:46:23,526 - Epoch: [9][26700/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452239    
+2023-12-01 05:47:11,530 - Epoch: [9][26800/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452342    
+2023-12-01 05:47:49,755 - Epoch: [9][26900/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452081    
+2023-12-01 05:48:37,960 - Epoch: [9][27000/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452192    
+2023-12-01 05:49:22,178 - Epoch: [9][27100/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452155    
+2023-12-01 05:49:56,224 - Epoch: [9][27200/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.451744    
+2023-12-01 05:50:53,579 - Epoch: [9][27300/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452190    
+2023-12-01 05:51:42,689 - Epoch: [9][27400/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452332    
+2023-12-01 05:52:25,081 - Epoch: [9][27500/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452228    
+2023-12-01 05:53:14,854 - Epoch: [9][27600/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452393    
+2023-12-01 05:53:51,977 - Epoch: [9][27700/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.001000    Time 0.452099    
+2023-12-01 05:54:39,663 - Epoch: [9][27800/31148]    Overall Loss 0.009860    Objective Loss 0.000000    Distill Loss 0.009860                     LR 0.001000    Time 0.452188    
+2023-12-01 05:55:19,771 - Epoch: [9][27900/31148]    Overall Loss 0.009860    Objective Loss 0.000000    Distill Loss 0.009860                     LR 0.001000    Time 0.452005    
+2023-12-01 05:56:00,404 - Epoch: [9][28000/31148]    Overall Loss 0.009860    Objective Loss 0.000000    Distill Loss 0.009860                     LR 0.001000    Time 0.451841    
+2023-12-01 05:56:52,985 - Epoch: [9][28100/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452104    
+2023-12-01 05:57:40,844 - Epoch: [9][28200/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452198    
+2023-12-01 05:58:26,155 - Epoch: [9][28300/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452201    
+2023-12-01 05:59:12,886 - Epoch: [9][28400/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452254    
+2023-12-01 05:59:52,896 - Epoch: [9][28500/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452071    
+2023-12-01 06:00:44,830 - Epoch: [9][28600/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452306    
+2023-12-01 06:01:32,041 - Epoch: [9][28700/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452374    
+2023-12-01 06:02:15,051 - Epoch: [9][28800/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452297    
+2023-12-01 06:03:00,102 - Epoch: [9][28900/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452290    
+2023-12-01 06:03:40,229 - Epoch: [9][29000/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.001000    Time 0.452114    
+2023-12-01 06:04:15,122 - Epoch: [9][29100/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.451759    
+2023-12-01 06:05:08,302 - Epoch: [9][29200/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.452033    
+2023-12-01 06:05:55,852 - Epoch: [9][29300/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.452113    
+2023-12-01 06:06:34,291 - Epoch: [9][29400/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.451883    
+2023-12-01 06:07:18,742 - Epoch: [9][29500/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.451857    
+2023-12-01 06:08:07,500 - Epoch: [9][29600/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451978    
+2023-12-01 06:08:47,718 - Epoch: [9][29700/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451810    
+2023-12-01 06:09:25,370 - Epoch: [9][29800/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.001000    Time 0.451557    
+2023-12-01 06:10:08,624 - Epoch: [9][29900/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451493    
+2023-12-01 06:10:59,278 - Epoch: [9][30000/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451676    
+2023-12-01 06:11:37,126 - Epoch: [9][30100/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451433    
+2023-12-01 06:12:20,189 - Epoch: [9][30200/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451364    
+2023-12-01 06:13:10,717 - Epoch: [9][30300/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451541    
+2023-12-01 06:13:44,322 - Epoch: [9][30400/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451161    
+2023-12-01 06:14:30,724 - Epoch: [9][30500/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451203    
+2023-12-01 06:15:12,927 - Epoch: [9][30600/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.001000    Time 0.451108    
+2023-12-01 06:16:02,713 - Epoch: [9][30700/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.451260    
+2023-12-01 06:16:49,654 - Epoch: [9][30800/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.451318    
+2023-12-01 06:17:36,963 - Epoch: [9][30900/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.451389    
+2023-12-01 06:18:23,029 - Epoch: [9][31000/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.451418    
+2023-12-01 06:19:15,236 - Epoch: [9][31100/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.451645    
+2023-12-01 06:19:33,712 - Epoch: [9][31148/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.001000    Time 0.451542    
+2023-12-01 06:19:34,641 - --- validate (epoch=9)-----------
+2023-12-01 06:19:34,641 - 167951 samples (100 per mini-batch)
+2023-12-01 06:19:58,261 - Epoch: [9][  100/ 1680]    Loss 0.000000    Overall Loss 0.010645    
+2023-12-01 06:20:18,228 - Epoch: [9][  200/ 1680]    Loss 0.000000    Overall Loss 0.010668    
+2023-12-01 06:20:38,225 - Epoch: [9][  300/ 1680]    Loss 0.000000    Overall Loss 0.010678    
+2023-12-01 06:20:58,239 - Epoch: [9][  400/ 1680]    Loss 0.000000    Overall Loss 0.010679    
+2023-12-01 06:21:18,205 - Epoch: [9][  500/ 1680]    Loss 0.000000    Overall Loss 0.010676    
+2023-12-01 06:21:38,279 - Epoch: [9][  600/ 1680]    Loss 0.000000    Overall Loss 0.010682    
+2023-12-01 06:21:58,215 - Epoch: [9][  700/ 1680]    Loss 0.000000    Overall Loss 0.010683    
+2023-12-01 06:22:18,136 - Epoch: [9][  800/ 1680]    Loss 0.000000    Overall Loss 0.010681    
+2023-12-01 06:22:38,183 - Epoch: [9][  900/ 1680]    Loss 0.000000    Overall Loss 0.010676    
+2023-12-01 06:22:58,185 - Epoch: [9][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010670    
+2023-12-01 06:23:18,182 - Epoch: [9][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010667    
+2023-12-01 06:23:38,155 - Epoch: [9][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010669    
+2023-12-01 06:23:58,211 - Epoch: [9][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010665    
+2023-12-01 06:24:18,193 - Epoch: [9][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010668    
+2023-12-01 06:24:38,166 - Epoch: [9][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010669    
+2023-12-01 06:24:58,148 - Epoch: [9][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010667    
+2023-12-01 06:25:14,119 - Epoch: [9][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010667    
+2023-12-01 06:25:14,487 - ==> Overall Loss: 0.011
+
+2023-12-01 06:25:14,495 - ==> Best [Overall Loss: 0.010667 on epoch: 9]
+2023-12-01 06:25:14,495 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-01 06:25:14,538 - 
+
+2023-12-01 06:25:14,538 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-01 06:26:20,211 - Epoch: [10][  100/31148]    Overall Loss 0.009675    Objective Loss 0.000000    Distill Loss 0.009675                     LR 0.000500    Time 0.656638    
+2023-12-01 06:27:11,558 - Epoch: [10][  200/31148]    Overall Loss 0.009602    Objective Loss 0.000000    Distill Loss 0.009602                     LR 0.000500    Time 0.585017    
+2023-12-01 06:27:48,987 - Epoch: [10][  300/31148]    Overall Loss 0.009596    Objective Loss 0.000000    Distill Loss 0.009596                     LR 0.000500    Time 0.514752    
+2023-12-01 06:28:39,437 - Epoch: [10][  400/31148]    Overall Loss 0.009586    Objective Loss 0.000000    Distill Loss 0.009586                     LR 0.000500    Time 0.512169    
+2023-12-01 06:29:18,160 - Epoch: [10][  500/31148]    Overall Loss 0.009561    Objective Loss 0.000000    Distill Loss 0.009561                     LR 0.000500    Time 0.487164    
+2023-12-01 06:29:54,327 - Epoch: [10][  600/31148]    Overall Loss 0.009546    Objective Loss 0.000000    Distill Loss 0.009546                     LR 0.000500    Time 0.466237    
+2023-12-01 06:30:38,378 - Epoch: [10][  700/31148]    Overall Loss 0.009558    Objective Loss 0.000000    Distill Loss 0.009558                     LR 0.000500    Time 0.462550    
+2023-12-01 06:31:24,707 - Epoch: [10][  800/31148]    Overall Loss 0.009561    Objective Loss 0.000000    Distill Loss 0.009561                     LR 0.000500    Time 0.462632    
+2023-12-01 06:32:15,774 - Epoch: [10][  900/31148]    Overall Loss 0.009542    Objective Loss 0.000000    Distill Loss 0.009542                     LR 0.000500    Time 0.467962    
+2023-12-01 06:32:51,079 - Epoch: [10][ 1000/31148]    Overall Loss 0.009546    Objective Loss 0.000000    Distill Loss 0.009546                     LR 0.000500    Time 0.456464    
+2023-12-01 06:33:27,557 - Epoch: [10][ 1100/31148]    Overall Loss 0.009551    Objective Loss 0.000000    Distill Loss 0.009551                     LR 0.000500    Time 0.448118    
+2023-12-01 06:34:09,395 - Epoch: [10][ 1200/31148]    Overall Loss 0.009542    Objective Loss 0.000000    Distill Loss 0.009542                     LR 0.000500    Time 0.445634    
+2023-12-01 06:34:53,175 - Epoch: [10][ 1300/31148]    Overall Loss 0.009536    Objective Loss 0.000000    Distill Loss 0.009536                     LR 0.000500    Time 0.445026    
+2023-12-01 06:35:33,102 - Epoch: [10][ 1400/31148]    Overall Loss 0.009541    Objective Loss 0.000000    Distill Loss 0.009541                     LR 0.000500    Time 0.441752    
+2023-12-01 06:36:08,665 - Epoch: [10][ 1500/31148]    Overall Loss 0.009533    Objective Loss 0.000000    Distill Loss 0.009533                     LR 0.000500    Time 0.436005    
+2023-12-01 06:36:52,680 - Epoch: [10][ 1600/31148]    Overall Loss 0.009527    Objective Loss 0.000000    Distill Loss 0.009527                     LR 0.000500    Time 0.436259    
+2023-12-01 06:37:34,081 - Epoch: [10][ 1700/31148]    Overall Loss 0.009528    Objective Loss 0.000000    Distill Loss 0.009528                     LR 0.000500    Time 0.434946    
+2023-12-01 06:38:17,119 - Epoch: [10][ 1800/31148]    Overall Loss 0.009530    Objective Loss 0.000000    Distill Loss 0.009530                     LR 0.000500    Time 0.434688    
+2023-12-01 06:38:52,283 - Epoch: [10][ 1900/31148]    Overall Loss 0.009530    Objective Loss 0.000000    Distill Loss 0.009530                     LR 0.000500    Time 0.430313    
+2023-12-01 06:39:29,846 - Epoch: [10][ 2000/31148]    Overall Loss 0.009527    Objective Loss 0.000000    Distill Loss 0.009527                     LR 0.000500    Time 0.427576    
+2023-12-01 06:40:19,625 - Epoch: [10][ 2100/31148]    Overall Loss 0.009529    Objective Loss 0.000000    Distill Loss 0.009529                     LR 0.000500    Time 0.430915    
+2023-12-01 06:41:09,524 - Epoch: [10][ 2200/31148]    Overall Loss 0.009528    Objective Loss 0.000000    Distill Loss 0.009528                     LR 0.000500    Time 0.434006    
+2023-12-01 06:41:48,675 - Epoch: [10][ 2300/31148]    Overall Loss 0.009532    Objective Loss 0.000000    Distill Loss 0.009532                     LR 0.000500    Time 0.432155    
+2023-12-01 06:42:27,153 - Epoch: [10][ 2400/31148]    Overall Loss 0.009534    Objective Loss 0.000000    Distill Loss 0.009534                     LR 0.000500    Time 0.430178    
+2023-12-01 06:43:18,259 - Epoch: [10][ 2500/31148]    Overall Loss 0.009532    Objective Loss 0.000000    Distill Loss 0.009532                     LR 0.000500    Time 0.433410    
+2023-12-01 06:44:02,277 - Epoch: [10][ 2600/31148]    Overall Loss 0.009535    Objective Loss 0.000000    Distill Loss 0.009535                     LR 0.000500    Time 0.433667    
+2023-12-01 06:44:44,323 - Epoch: [10][ 2700/31148]    Overall Loss 0.009537    Objective Loss 0.000000    Distill Loss 0.009537                     LR 0.000500    Time 0.433175    
+2023-12-01 06:45:28,538 - Epoch: [10][ 2800/31148]    Overall Loss 0.009536    Objective Loss 0.000000    Distill Loss 0.009536                     LR 0.000500    Time 0.433493    
+2023-12-01 06:46:10,048 - Epoch: [10][ 2900/31148]    Overall Loss 0.009536    Objective Loss 0.000000    Distill Loss 0.009536                     LR 0.000500    Time 0.432856    
+2023-12-01 06:46:53,379 - Epoch: [10][ 3000/31148]    Overall Loss 0.009534    Objective Loss 0.000000    Distill Loss 0.009534                     LR 0.000500    Time 0.432868    
+2023-12-01 06:47:40,845 - Epoch: [10][ 3100/31148]    Overall Loss 0.009529    Objective Loss 0.000000    Distill Loss 0.009529                     LR 0.000500    Time 0.434214    
+2023-12-01 06:48:10,909 - Epoch: [10][ 3200/31148]    Overall Loss 0.009528    Objective Loss 0.000000    Distill Loss 0.009528                     LR 0.000500    Time 0.430038    
+2023-12-01 06:48:39,751 - Epoch: [10][ 3300/31148]    Overall Loss 0.009526    Objective Loss 0.000000    Distill Loss 0.009526                     LR 0.000500    Time 0.425745    
+2023-12-01 06:49:07,969 - Epoch: [10][ 3400/31148]    Overall Loss 0.009524    Objective Loss 0.000000    Distill Loss 0.009524                     LR 0.000500    Time 0.421521    
+2023-12-01 06:49:35,992 - Epoch: [10][ 3500/31148]    Overall Loss 0.009521    Objective Loss 0.000000    Distill Loss 0.009521                     LR 0.000500    Time 0.417483    
+2023-12-01 06:50:03,863 - Epoch: [10][ 3600/31148]    Overall Loss 0.009522    Objective Loss 0.000000    Distill Loss 0.009522                     LR 0.000500    Time 0.413627    
+2023-12-01 06:50:31,722 - Epoch: [10][ 3700/31148]    Overall Loss 0.009524    Objective Loss 0.000000    Distill Loss 0.009524                     LR 0.000500    Time 0.409976    
+2023-12-01 06:50:59,475 - Epoch: [10][ 3800/31148]    Overall Loss 0.009522    Objective Loss 0.000000    Distill Loss 0.009522                     LR 0.000500    Time 0.406489    
+2023-12-01 06:51:27,219 - Epoch: [10][ 3900/31148]    Overall Loss 0.009523    Objective Loss 0.000000    Distill Loss 0.009523                     LR 0.000500    Time 0.403179    
+2023-12-01 06:51:53,861 - Epoch: [10][ 4000/31148]    Overall Loss 0.009522    Objective Loss 0.000000    Distill Loss 0.009522                     LR 0.000500    Time 0.399759    
+2023-12-01 06:52:22,093 - Epoch: [10][ 4100/31148]    Overall Loss 0.009520    Objective Loss 0.000000    Distill Loss 0.009520                     LR 0.000500    Time 0.396894    
+2023-12-01 06:52:49,437 - Epoch: [10][ 4200/31148]    Overall Loss 0.009519    Objective Loss 0.000000    Distill Loss 0.009519                     LR 0.000500    Time 0.393953    
+2023-12-01 06:53:16,561 - Epoch: [10][ 4300/31148]    Overall Loss 0.009523    Objective Loss 0.000000    Distill Loss 0.009523                     LR 0.000500    Time 0.391099    
+2023-12-01 06:53:46,443 - Epoch: [10][ 4400/31148]    Overall Loss 0.009520    Objective Loss 0.000000    Distill Loss 0.009520                     LR 0.000500    Time 0.389000    
+2023-12-01 06:54:31,281 - Epoch: [10][ 4500/31148]    Overall Loss 0.009520    Objective Loss 0.000000    Distill Loss 0.009520                     LR 0.000500    Time 0.390318    
+2023-12-01 06:55:24,537 - Epoch: [10][ 4600/31148]    Overall Loss 0.009519    Objective Loss 0.000000    Distill Loss 0.009519                     LR 0.000500    Time 0.393408    
+2023-12-01 06:56:24,289 - Epoch: [10][ 4700/31148]    Overall Loss 0.009519    Objective Loss 0.000000    Distill Loss 0.009519                     LR 0.000500    Time 0.397749    
+2023-12-01 06:57:06,111 - Epoch: [10][ 4800/31148]    Overall Loss 0.009517    Objective Loss 0.000000    Distill Loss 0.009517                     LR 0.000500    Time 0.398174    
+2023-12-01 06:57:44,852 - Epoch: [10][ 4900/31148]    Overall Loss 0.009516    Objective Loss 0.000000    Distill Loss 0.009516                     LR 0.000500    Time 0.397953    
+2023-12-01 06:58:26,612 - Epoch: [10][ 5000/31148]    Overall Loss 0.009517    Objective Loss 0.000000    Distill Loss 0.009517                     LR 0.000500    Time 0.398345    
+2023-12-01 06:59:15,391 - Epoch: [10][ 5100/31148]    Overall Loss 0.009515    Objective Loss 0.000000    Distill Loss 0.009515                     LR 0.000500    Time 0.400096    
+2023-12-01 06:59:55,699 - Epoch: [10][ 5200/31148]    Overall Loss 0.009517    Objective Loss 0.000000    Distill Loss 0.009517                     LR 0.000500    Time 0.400152    
+2023-12-01 07:00:39,851 - Epoch: [10][ 5300/31148]    Overall Loss 0.009514    Objective Loss 0.000000    Distill Loss 0.009514                     LR 0.000500    Time 0.400931    
+2023-12-01 07:01:25,453 - Epoch: [10][ 5400/31148]    Overall Loss 0.009514    Objective Loss 0.000000    Distill Loss 0.009514                     LR 0.000500    Time 0.401950    
+2023-12-01 07:02:01,061 - Epoch: [10][ 5500/31148]    Overall Loss 0.009516    Objective Loss 0.000000    Distill Loss 0.009516                     LR 0.000500    Time 0.401114    
+2023-12-01 07:02:56,228 - Epoch: [10][ 5600/31148]    Overall Loss 0.009515    Objective Loss 0.000000    Distill Loss 0.009515                     LR 0.000500    Time 0.403801    
+2023-12-01 07:03:32,628 - Epoch: [10][ 5700/31148]    Overall Loss 0.009514    Objective Loss 0.000000    Distill Loss 0.009514                     LR 0.000500    Time 0.403102    
+2023-12-01 07:04:24,867 - Epoch: [10][ 5800/31148]    Overall Loss 0.009511    Objective Loss 0.000000    Distill Loss 0.009511                     LR 0.000500    Time 0.405157    
+2023-12-01 07:05:31,173 - Epoch: [10][ 5900/31148]    Overall Loss 0.009508    Objective Loss 0.000000    Distill Loss 0.009508                     LR 0.000500    Time 0.409527    
+2023-12-01 07:06:17,849 - Epoch: [10][ 6000/31148]    Overall Loss 0.009507    Objective Loss 0.000000    Distill Loss 0.009507                     LR 0.000500    Time 0.410480    
+2023-12-01 07:07:09,961 - Epoch: [10][ 6100/31148]    Overall Loss 0.009507    Objective Loss 0.000000    Distill Loss 0.009507                     LR 0.000500    Time 0.412292    
+2023-12-01 07:07:52,426 - Epoch: [10][ 6200/31148]    Overall Loss 0.009504    Objective Loss 0.000000    Distill Loss 0.009504                     LR 0.000500    Time 0.412490    
+2023-12-01 07:08:40,031 - Epoch: [10][ 6300/31148]    Overall Loss 0.009504    Objective Loss 0.000000    Distill Loss 0.009504                     LR 0.000500    Time 0.413498    
+2023-12-01 07:09:30,585 - Epoch: [10][ 6400/31148]    Overall Loss 0.009502    Objective Loss 0.000000    Distill Loss 0.009502                     LR 0.000500    Time 0.414935    
+2023-12-01 07:10:13,755 - Epoch: [10][ 6500/31148]    Overall Loss 0.009501    Objective Loss 0.000000    Distill Loss 0.009501                     LR 0.000500    Time 0.415192    
+2023-12-01 07:10:52,871 - Epoch: [10][ 6600/31148]    Overall Loss 0.009501    Objective Loss 0.000000    Distill Loss 0.009501                     LR 0.000500    Time 0.414827    
+2023-12-01 07:11:36,210 - Epoch: [10][ 6700/31148]    Overall Loss 0.009501    Objective Loss 0.000000    Distill Loss 0.009501                     LR 0.000500    Time 0.415102    
+2023-12-01 07:12:26,676 - Epoch: [10][ 6800/31148]    Overall Loss 0.009502    Objective Loss 0.000000    Distill Loss 0.009502                     LR 0.000500    Time 0.416418    
+2023-12-01 07:13:17,729 - Epoch: [10][ 6900/31148]    Overall Loss 0.009501    Objective Loss 0.000000    Distill Loss 0.009501                     LR 0.000500    Time 0.417781    
+2023-12-01 07:13:58,986 - Epoch: [10][ 7000/31148]    Overall Loss 0.009500    Objective Loss 0.000000    Distill Loss 0.009500                     LR 0.000500    Time 0.417706    
+2023-12-01 07:14:58,643 - Epoch: [10][ 7100/31148]    Overall Loss 0.009500    Objective Loss 0.000000    Distill Loss 0.009500                     LR 0.000500    Time 0.420224    
+2023-12-01 07:15:44,919 - Epoch: [10][ 7200/31148]    Overall Loss 0.009500    Objective Loss 0.000000    Distill Loss 0.009500                     LR 0.000500    Time 0.420814    
+2023-12-01 07:16:30,050 - Epoch: [10][ 7300/31148]    Overall Loss 0.009500    Objective Loss 0.000000    Distill Loss 0.009500                     LR 0.000500    Time 0.421230    
+2023-12-01 07:17:15,899 - Epoch: [10][ 7400/31148]    Overall Loss 0.009500    Objective Loss 0.000000    Distill Loss 0.009500                     LR 0.000500    Time 0.421733    
+2023-12-01 07:18:05,268 - Epoch: [10][ 7500/31148]    Overall Loss 0.009499    Objective Loss 0.000000    Distill Loss 0.009499                     LR 0.000500    Time 0.422691    
+2023-12-01 07:18:58,860 - Epoch: [10][ 7600/31148]    Overall Loss 0.009498    Objective Loss 0.000000    Distill Loss 0.009498                     LR 0.000500    Time 0.424180    
+2023-12-01 07:19:44,943 - Epoch: [10][ 7700/31148]    Overall Loss 0.009497    Objective Loss 0.000000    Distill Loss 0.009497                     LR 0.000500    Time 0.424655    
+2023-12-01 07:20:35,264 - Epoch: [10][ 7800/31148]    Overall Loss 0.009495    Objective Loss 0.000000    Distill Loss 0.009495                     LR 0.000500    Time 0.425661    
+2023-12-01 07:21:08,808 - Epoch: [10][ 7900/31148]    Overall Loss 0.009494    Objective Loss 0.000000    Distill Loss 0.009494                     LR 0.000500    Time 0.424518    
+2023-12-01 07:21:55,669 - Epoch: [10][ 8000/31148]    Overall Loss 0.009492    Objective Loss 0.000000    Distill Loss 0.009492                     LR 0.000500    Time 0.425068    
+2023-12-01 07:22:32,335 - Epoch: [10][ 8100/31148]    Overall Loss 0.009493    Objective Loss 0.000000    Distill Loss 0.009493                     LR 0.000500    Time 0.424346    
+2023-12-01 07:23:17,226 - Epoch: [10][ 8200/31148]    Overall Loss 0.009491    Objective Loss 0.000000    Distill Loss 0.009491                     LR 0.000500    Time 0.424645    
+2023-12-01 07:24:03,247 - Epoch: [10][ 8300/31148]    Overall Loss 0.009492    Objective Loss 0.000000    Distill Loss 0.009492                     LR 0.000500    Time 0.425072    
+2023-12-01 07:24:47,173 - Epoch: [10][ 8400/31148]    Overall Loss 0.009490    Objective Loss 0.000000    Distill Loss 0.009490                     LR 0.000500    Time 0.425240    
+2023-12-01 07:25:33,428 - Epoch: [10][ 8500/31148]    Overall Loss 0.009491    Objective Loss 0.000000    Distill Loss 0.009491                     LR 0.000500    Time 0.425678    
+2023-12-01 07:26:25,562 - Epoch: [10][ 8600/31148]    Overall Loss 0.009489    Objective Loss 0.000000    Distill Loss 0.009489                     LR 0.000500    Time 0.426790    
+2023-12-01 07:27:11,538 - Epoch: [10][ 8700/31148]    Overall Loss 0.009491    Objective Loss 0.000000    Distill Loss 0.009491                     LR 0.000500    Time 0.427168    
+2023-12-01 07:28:01,593 - Epoch: [10][ 8800/31148]    Overall Loss 0.009491    Objective Loss 0.000000    Distill Loss 0.009491                     LR 0.000500    Time 0.428001    
+2023-12-01 07:29:04,992 - Epoch: [10][ 8900/31148]    Overall Loss 0.009490    Objective Loss 0.000000    Distill Loss 0.009490                     LR 0.000500    Time 0.430315    
+2023-12-01 07:29:47,877 - Epoch: [10][ 9000/31148]    Overall Loss 0.009490    Objective Loss 0.000000    Distill Loss 0.009490                     LR 0.000500    Time 0.430297    
+2023-12-01 07:30:34,578 - Epoch: [10][ 9100/31148]    Overall Loss 0.009488    Objective Loss 0.000000    Distill Loss 0.009488                     LR 0.000500    Time 0.430700    
+2023-12-01 07:31:27,595 - Epoch: [10][ 9200/31148]    Overall Loss 0.009488    Objective Loss 0.000000    Distill Loss 0.009488                     LR 0.000500    Time 0.431780    
+2023-12-01 07:32:14,214 - Epoch: [10][ 9300/31148]    Overall Loss 0.009488    Objective Loss 0.000000    Distill Loss 0.009488                     LR 0.000500    Time 0.432149    
+2023-12-01 07:33:11,656 - Epoch: [10][ 9400/31148]    Overall Loss 0.009488    Objective Loss 0.000000    Distill Loss 0.009488                     LR 0.000500    Time 0.433662    
+2023-12-01 07:34:06,183 - Epoch: [10][ 9500/31148]    Overall Loss 0.009487    Objective Loss 0.000000    Distill Loss 0.009487                     LR 0.000500    Time 0.434836    
+2023-12-01 07:34:45,568 - Epoch: [10][ 9600/31148]    Overall Loss 0.009487    Objective Loss 0.000000    Distill Loss 0.009487                     LR 0.000500    Time 0.434408    
+2023-12-01 07:35:32,320 - Epoch: [10][ 9700/31148]    Overall Loss 0.009487    Objective Loss 0.000000    Distill Loss 0.009487                     LR 0.000500    Time 0.434749    
+2023-12-01 07:36:18,654 - Epoch: [10][ 9800/31148]    Overall Loss 0.009488    Objective Loss 0.000000    Distill Loss 0.009488                     LR 0.000500    Time 0.435040    
+2023-12-01 07:37:12,110 - Epoch: [10][ 9900/31148]    Overall Loss 0.009486    Objective Loss 0.000000    Distill Loss 0.009486                     LR 0.000500    Time 0.436044    
+2023-12-01 07:37:59,902 - Epoch: [10][10000/31148]    Overall Loss 0.009485    Objective Loss 0.000000    Distill Loss 0.009485                     LR 0.000500    Time 0.436462    
+2023-12-01 07:38:44,939 - Epoch: [10][10100/31148]    Overall Loss 0.009483    Objective Loss 0.000000    Distill Loss 0.009483                     LR 0.000500    Time 0.436599    
+2023-12-01 07:39:31,699 - Epoch: [10][10200/31148]    Overall Loss 0.009483    Objective Loss 0.000000    Distill Loss 0.009483                     LR 0.000500    Time 0.436903    
+2023-12-01 07:40:23,163 - Epoch: [10][10300/31148]    Overall Loss 0.009484    Objective Loss 0.000000    Distill Loss 0.009484                     LR 0.000500    Time 0.437657    
+2023-12-01 07:41:17,604 - Epoch: [10][10400/31148]    Overall Loss 0.009482    Objective Loss 0.000000    Distill Loss 0.009482                     LR 0.000500    Time 0.438682    
+2023-12-01 07:42:09,562 - Epoch: [10][10500/31148]    Overall Loss 0.009482    Objective Loss 0.000000    Distill Loss 0.009482                     LR 0.000500    Time 0.439452    
+2023-12-01 07:42:56,958 - Epoch: [10][10600/31148]    Overall Loss 0.009483    Objective Loss 0.000000    Distill Loss 0.009483                     LR 0.000500    Time 0.439777    
+2023-12-01 07:43:37,412 - Epoch: [10][10700/31148]    Overall Loss 0.009481    Objective Loss 0.000000    Distill Loss 0.009481                     LR 0.000500    Time 0.439447    
+2023-12-01 07:44:25,725 - Epoch: [10][10800/31148]    Overall Loss 0.009482    Objective Loss 0.000000    Distill Loss 0.009482                     LR 0.000500    Time 0.439850    
+2023-12-01 07:45:17,345 - Epoch: [10][10900/31148]    Overall Loss 0.009482    Objective Loss 0.000000    Distill Loss 0.009482                     LR 0.000500    Time 0.440550    
+2023-12-01 07:46:00,298 - Epoch: [10][11000/31148]    Overall Loss 0.009481    Objective Loss 0.000000    Distill Loss 0.009481                     LR 0.000500    Time 0.440449    
+2023-12-01 07:46:49,049 - Epoch: [10][11100/31148]    Overall Loss 0.009480    Objective Loss 0.000000    Distill Loss 0.009480                     LR 0.000500    Time 0.440872    
+2023-12-01 07:47:33,032 - Epoch: [10][11200/31148]    Overall Loss 0.009479    Objective Loss 0.000000    Distill Loss 0.009479                     LR 0.000500    Time 0.440862    
+2023-12-01 07:48:13,005 - Epoch: [10][11300/31148]    Overall Loss 0.009478    Objective Loss 0.000000    Distill Loss 0.009478                     LR 0.000500    Time 0.440498    
+2023-12-01 07:49:04,226 - Epoch: [10][11400/31148]    Overall Loss 0.009479    Objective Loss 0.000000    Distill Loss 0.009479                     LR 0.000500    Time 0.441126    
+2023-12-01 07:49:48,009 - Epoch: [10][11500/31148]    Overall Loss 0.009479    Objective Loss 0.000000    Distill Loss 0.009479                     LR 0.000500    Time 0.441097    
+2023-12-01 07:50:30,701 - Epoch: [10][11600/31148]    Overall Loss 0.009479    Objective Loss 0.000000    Distill Loss 0.009479                     LR 0.000500    Time 0.440974    
+2023-12-01 07:51:23,907 - Epoch: [10][11700/31148]    Overall Loss 0.009478    Objective Loss 0.000000    Distill Loss 0.009478                     LR 0.000500    Time 0.441752    
+2023-12-01 07:52:06,917 - Epoch: [10][11800/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.441652    
+2023-12-01 07:52:50,552 - Epoch: [10][11900/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.441607    
+2023-12-01 07:53:45,702 - Epoch: [10][12000/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.442522    
+2023-12-01 07:54:42,094 - Epoch: [10][12100/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.443525    
+2023-12-01 07:55:40,062 - Epoch: [10][12200/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.444640    
+2023-12-01 07:56:21,432 - Epoch: [10][12300/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.444388    
+2023-12-01 07:57:18,341 - Epoch: [10][12400/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.445393    
+2023-12-01 07:58:05,571 - Epoch: [10][12500/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.445608    
+2023-12-01 07:58:54,122 - Epoch: [10][12600/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.445924    
+2023-12-01 07:59:36,831 - Epoch: [10][12700/31148]    Overall Loss 0.009474    Objective Loss 0.000000    Distill Loss 0.009474                     LR 0.000500    Time 0.445775    
+2023-12-01 08:00:33,233 - Epoch: [10][12800/31148]    Overall Loss 0.009474    Objective Loss 0.000000    Distill Loss 0.009474                     LR 0.000500    Time 0.446698    
+2023-12-01 08:01:36,811 - Epoch: [10][12900/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.448163    
+2023-12-01 08:02:20,856 - Epoch: [10][13000/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.448103    
+2023-12-01 08:03:07,606 - Epoch: [10][13100/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.448251    
+2023-12-01 08:03:56,726 - Epoch: [10][13200/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.448576    
+2023-12-01 08:04:44,689 - Epoch: [10][13300/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.448809    
+2023-12-01 08:05:31,852 - Epoch: [10][13400/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.448978    
+2023-12-01 08:06:24,651 - Epoch: [10][13500/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.449563    
+2023-12-01 08:07:17,470 - Epoch: [10][13600/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.450141    
+2023-12-01 08:08:00,436 - Epoch: [10][13700/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.449991    
+2023-12-01 08:08:47,490 - Epoch: [10][13800/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.450139    
+2023-12-01 08:09:30,254 - Epoch: [10][13900/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.449977    
+2023-12-01 08:10:16,817 - Epoch: [10][14000/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.450088    
+2023-12-01 08:11:03,909 - Epoch: [10][14100/31148]    Overall Loss 0.009476    Objective Loss 0.000000    Distill Loss 0.009476                     LR 0.000500    Time 0.450235    
+2023-12-01 08:11:51,265 - Epoch: [10][14200/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.450399    
+2023-12-01 08:12:35,435 - Epoch: [10][14300/31148]    Overall Loss 0.009475    Objective Loss 0.000000    Distill Loss 0.009475                     LR 0.000500    Time 0.450338    
+2023-12-01 08:13:19,153 - Epoch: [10][14400/31148]    Overall Loss 0.009474    Objective Loss 0.000000    Distill Loss 0.009474                     LR 0.000500    Time 0.450246    
+2023-12-01 08:13:57,181 - Epoch: [10][14500/31148]    Overall Loss 0.009474    Objective Loss 0.000000    Distill Loss 0.009474                     LR 0.000500    Time 0.449763    
+2023-12-01 08:14:40,937 - Epoch: [10][14600/31148]    Overall Loss 0.009473    Objective Loss 0.000000    Distill Loss 0.009473                     LR 0.000500    Time 0.449679    
+2023-12-01 08:15:37,400 - Epoch: [10][14700/31148]    Overall Loss 0.009471    Objective Loss 0.000000    Distill Loss 0.009471                     LR 0.000500    Time 0.450460    
+2023-12-01 08:16:29,011 - Epoch: [10][14800/31148]    Overall Loss 0.009471    Objective Loss 0.000000    Distill Loss 0.009471                     LR 0.000500    Time 0.450903    
+2023-12-01 08:17:34,184 - Epoch: [10][14900/31148]    Overall Loss 0.009471    Objective Loss 0.000000    Distill Loss 0.009471                     LR 0.000500    Time 0.452250    
+2023-12-01 08:18:12,587 - Epoch: [10][15000/31148]    Overall Loss 0.009471    Objective Loss 0.000000    Distill Loss 0.009471                     LR 0.000500    Time 0.451795    
+2023-12-01 08:18:56,244 - Epoch: [10][15100/31148]    Overall Loss 0.009472    Objective Loss 0.000000    Distill Loss 0.009472                     LR 0.000500    Time 0.451694    
+2023-12-01 08:19:45,779 - Epoch: [10][15200/31148]    Overall Loss 0.009472    Objective Loss 0.000000    Distill Loss 0.009472                     LR 0.000500    Time 0.451981    
+2023-12-01 08:20:33,829 - Epoch: [10][15300/31148]    Overall Loss 0.009473    Objective Loss 0.000000    Distill Loss 0.009473                     LR 0.000500    Time 0.452166    
+2023-12-01 08:21:11,391 - Epoch: [10][15400/31148]    Overall Loss 0.009473    Objective Loss 0.000000    Distill Loss 0.009473                     LR 0.000500    Time 0.451669    
+2023-12-01 08:22:03,654 - Epoch: [10][15500/31148]    Overall Loss 0.009473    Objective Loss 0.000000    Distill Loss 0.009473                     LR 0.000500    Time 0.452126    
+2023-12-01 08:22:45,012 - Epoch: [10][15600/31148]    Overall Loss 0.009472    Objective Loss 0.000000    Distill Loss 0.009472                     LR 0.000500    Time 0.451879    
+2023-12-01 08:23:36,022 - Epoch: [10][15700/31148]    Overall Loss 0.009472    Objective Loss 0.000000    Distill Loss 0.009472                     LR 0.000500    Time 0.452249    
+2023-12-01 08:24:19,394 - Epoch: [10][15800/31148]    Overall Loss 0.009472    Objective Loss 0.000000    Distill Loss 0.009472                     LR 0.000500    Time 0.452131    
+2023-12-01 08:25:05,898 - Epoch: [10][15900/31148]    Overall Loss 0.009471    Objective Loss 0.000000    Distill Loss 0.009471                     LR 0.000500    Time 0.452212    
+2023-12-01 08:25:59,236 - Epoch: [10][16000/31148]    Overall Loss 0.009471    Objective Loss 0.000000    Distill Loss 0.009471                     LR 0.000500    Time 0.452719    
+2023-12-01 08:26:44,190 - Epoch: [10][16100/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.452699    
+2023-12-01 08:27:27,097 - Epoch: [10][16200/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.452552    
+2023-12-01 08:28:26,743 - Epoch: [10][16300/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.453435    
+2023-12-01 08:29:23,201 - Epoch: [10][16400/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.454112    
+2023-12-01 08:30:07,155 - Epoch: [10][16500/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.454023    
+2023-12-01 08:31:07,939 - Epoch: [10][16600/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.454949    
+2023-12-01 08:31:48,901 - Epoch: [10][16700/31148]    Overall Loss 0.009470    Objective Loss 0.000000    Distill Loss 0.009470                     LR 0.000500    Time 0.454677    
+2023-12-01 08:32:31,408 - Epoch: [10][16800/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.454501    
+2023-12-01 08:33:23,256 - Epoch: [10][16900/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.454879    
+2023-12-01 08:34:09,592 - Epoch: [10][17000/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.454928    
+2023-12-01 08:34:54,385 - Epoch: [10][17100/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.454887    
+2023-12-01 08:35:44,771 - Epoch: [10][17200/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.455171    
+2023-12-01 08:36:34,843 - Epoch: [10][17300/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.455434    
+2023-12-01 08:37:21,127 - Epoch: [10][17400/31148]    Overall Loss 0.009469    Objective Loss 0.000000    Distill Loss 0.009469                     LR 0.000500    Time 0.455476    
+2023-12-01 08:38:03,116 - Epoch: [10][17500/31148]    Overall Loss 0.009468    Objective Loss 0.000000    Distill Loss 0.009468                     LR 0.000500    Time 0.455273    
+2023-12-01 08:38:51,660 - Epoch: [10][17600/31148]    Overall Loss 0.009468    Objective Loss 0.000000    Distill Loss 0.009468                     LR 0.000500    Time 0.455444    
+2023-12-01 08:39:45,237 - Epoch: [10][17700/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.455897    
+2023-12-01 08:40:19,662 - Epoch: [10][17800/31148]    Overall Loss 0.009468    Objective Loss 0.000000    Distill Loss 0.009468                     LR 0.000500    Time 0.455269    
+2023-12-01 08:41:15,659 - Epoch: [10][17900/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.455854    
+2023-12-01 08:42:10,371 - Epoch: [10][18000/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456360    
+2023-12-01 08:42:59,674 - Epoch: [10][18100/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456563    
+2023-12-01 08:43:48,749 - Epoch: [10][18200/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456750    
+2023-12-01 08:44:32,186 - Epoch: [10][18300/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456627    
+2023-12-01 08:45:18,823 - Epoch: [10][18400/31148]    Overall Loss 0.009468    Objective Loss 0.000000    Distill Loss 0.009468                     LR 0.000500    Time 0.456680    
+2023-12-01 08:46:03,682 - Epoch: [10][18500/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456636    
+2023-12-01 08:46:42,827 - Epoch: [10][18600/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456285    
+2023-12-01 08:47:26,369 - Epoch: [10][18700/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456173    
+2023-12-01 08:48:16,095 - Epoch: [10][18800/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456391    
+2023-12-01 08:48:56,127 - Epoch: [10][18900/31148]    Overall Loss 0.009467    Objective Loss 0.000000    Distill Loss 0.009467                     LR 0.000500    Time 0.456094    
+2023-12-01 08:49:48,436 - Epoch: [10][19000/31148]    Overall Loss 0.009466    Objective Loss 0.000000    Distill Loss 0.009466                     LR 0.000500    Time 0.456446    
+2023-12-01 08:50:36,339 - Epoch: [10][19100/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456564    
+2023-12-01 08:51:29,146 - Epoch: [10][19200/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456936    
+2023-12-01 08:52:07,778 - Epoch: [10][19300/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456570    
+2023-12-01 08:52:53,856 - Epoch: [10][19400/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456591    
+2023-12-01 08:53:35,431 - Epoch: [10][19500/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456381    
+2023-12-01 08:54:34,972 - Epoch: [10][19600/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457090    
+2023-12-01 08:55:15,261 - Epoch: [10][19700/31148]    Overall Loss 0.009466    Objective Loss 0.000000    Distill Loss 0.009466                     LR 0.000500    Time 0.456815    
+2023-12-01 08:56:12,111 - Epoch: [10][19800/31148]    Overall Loss 0.009466    Objective Loss 0.000000    Distill Loss 0.009466                     LR 0.000500    Time 0.457379    
+2023-12-01 08:57:00,706 - Epoch: [10][19900/31148]    Overall Loss 0.009466    Objective Loss 0.000000    Distill Loss 0.009466                     LR 0.000500    Time 0.457522    
+2023-12-01 08:57:47,146 - Epoch: [10][20000/31148]    Overall Loss 0.009466    Objective Loss 0.000000    Distill Loss 0.009466                     LR 0.000500    Time 0.457556    
+2023-12-01 08:58:26,339 - Epoch: [10][20100/31148]    Overall Loss 0.009466    Objective Loss 0.000000    Distill Loss 0.009466                     LR 0.000500    Time 0.457229    
+2023-12-01 08:59:13,942 - Epoch: [10][20200/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457322    
+2023-12-01 09:00:08,390 - Epoch: [10][20300/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457751    
+2023-12-01 09:00:50,728 - Epoch: [10][20400/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457582    
+2023-12-01 09:01:36,104 - Epoch: [10][20500/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457563    
+2023-12-01 09:02:18,990 - Epoch: [10][20600/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457423    
+2023-12-01 09:03:05,095 - Epoch: [10][20700/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.457440    
+2023-12-01 09:03:45,757 - Epoch: [10][20800/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.457196    
+2023-12-01 09:04:33,144 - Epoch: [10][20900/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.457275    
+2023-12-01 09:05:11,866 - Epoch: [10][21000/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456941    
+2023-12-01 09:05:56,133 - Epoch: [10][21100/31148]    Overall Loss 0.009465    Objective Loss 0.000000    Distill Loss 0.009465                     LR 0.000500    Time 0.456873    
+2023-12-01 09:06:31,435 - Epoch: [10][21200/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.456383    
+2023-12-01 09:07:23,660 - Epoch: [10][21300/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.456692    
+2023-12-01 09:08:00,198 - Epoch: [10][21400/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.456265    
+2023-12-01 09:08:43,036 - Epoch: [10][21500/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.456135    
+2023-12-01 09:09:26,795 - Epoch: [10][21600/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.456048    
+2023-12-01 09:10:15,658 - Epoch: [10][21700/31148]    Overall Loss 0.009464    Objective Loss 0.000000    Distill Loss 0.009464                     LR 0.000500    Time 0.456198    
+2023-12-01 09:11:03,904 - Epoch: [10][21800/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.456318    
+2023-12-01 09:11:55,866 - Epoch: [10][21900/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.456607    
+2023-12-01 09:12:45,632 - Epoch: [10][22000/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.456793    
+2023-12-01 09:13:27,161 - Epoch: [10][22100/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.456605    
+2023-12-01 09:14:19,487 - Epoch: [10][22200/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.456905    
+2023-12-01 09:15:09,833 - Epoch: [10][22300/31148]    Overall Loss 0.009463    Objective Loss 0.000000    Distill Loss 0.009463                     LR 0.000500    Time 0.457113    
+2023-12-01 09:16:00,254 - Epoch: [10][22400/31148]    Overall Loss 0.009462    Objective Loss 0.000000    Distill Loss 0.009462                     LR 0.000500    Time 0.457323    
+2023-12-01 09:16:42,245 - Epoch: [10][22500/31148]    Overall Loss 0.009462    Objective Loss 0.000000    Distill Loss 0.009462                     LR 0.000500    Time 0.457157    
+2023-12-01 09:17:22,287 - Epoch: [10][22600/31148]    Overall Loss 0.009462    Objective Loss 0.000000    Distill Loss 0.009462                     LR 0.000500    Time 0.456905    
+2023-12-01 09:18:11,207 - Epoch: [10][22700/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457047    
+2023-12-01 09:19:00,255 - Epoch: [10][22800/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457194    
+2023-12-01 09:19:44,548 - Epoch: [10][22900/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457131    
+2023-12-01 09:20:36,610 - Epoch: [10][23000/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457407    
+2023-12-01 09:21:19,060 - Epoch: [10][23100/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457264    
+2023-12-01 09:22:04,572 - Epoch: [10][23200/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457254    
+2023-12-01 09:22:57,713 - Epoch: [10][23300/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457572    
+2023-12-01 09:23:49,059 - Epoch: [10][23400/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457811    
+2023-12-01 09:24:30,494 - Epoch: [10][23500/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457625    
+2023-12-01 09:25:14,438 - Epoch: [10][23600/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457548    
+2023-12-01 09:26:03,798 - Epoch: [10][23700/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457700    
+2023-12-01 09:26:42,470 - Epoch: [10][23800/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457401    
+2023-12-01 09:27:22,952 - Epoch: [10][23900/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457181    
+2023-12-01 09:28:02,409 - Epoch: [10][24000/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.456920    
+2023-12-01 09:28:56,316 - Epoch: [10][24100/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.457260    
+2023-12-01 09:29:35,132 - Epoch: [10][24200/31148]    Overall Loss 0.009461    Objective Loss 0.000000    Distill Loss 0.009461                     LR 0.000500    Time 0.456975    
+2023-12-01 09:30:26,492 - Epoch: [10][24300/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.457207    
+2023-12-01 09:31:08,478 - Epoch: [10][24400/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.457054    
+2023-12-01 09:31:53,154 - Epoch: [10][24500/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.457012    
+2023-12-01 09:32:38,467 - Epoch: [10][24600/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.456995    
+2023-12-01 09:33:29,610 - Epoch: [10][24700/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.457216    
+2023-12-01 09:34:14,942 - Epoch: [10][24800/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.457200    
+2023-12-01 09:35:00,921 - Epoch: [10][24900/31148]    Overall Loss 0.009460    Objective Loss 0.000000    Distill Loss 0.009460                     LR 0.000500    Time 0.457210    
+2023-12-01 09:35:47,812 - Epoch: [10][25000/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.457256    
+2023-12-01 09:36:27,483 - Epoch: [10][25100/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.457015    
+2023-12-01 09:37:16,495 - Epoch: [10][25200/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.457146    
+2023-12-01 09:37:56,371 - Epoch: [10][25300/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.456915    
+2023-12-01 09:38:41,584 - Epoch: [10][25400/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.456896    
+2023-12-01 09:39:38,606 - Epoch: [10][25500/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.457339    
+2023-12-01 09:40:17,669 - Epoch: [10][25600/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.457079    
+2023-12-01 09:41:00,431 - Epoch: [10][25700/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.456964    
+2023-12-01 09:41:45,550 - Epoch: [10][25800/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.456941    
+2023-12-01 09:42:33,092 - Epoch: [10][25900/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.457012    
+2023-12-01 09:43:13,265 - Epoch: [10][26000/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.456799    
+2023-12-01 09:43:59,745 - Epoch: [10][26100/31148]    Overall Loss 0.009459    Objective Loss 0.000000    Distill Loss 0.009459                     LR 0.000500    Time 0.456829    
+2023-12-01 09:44:48,830 - Epoch: [10][26200/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456959    
+2023-12-01 09:45:41,151 - Epoch: [10][26300/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.457211    
+2023-12-01 09:46:23,397 - Epoch: [10][26400/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.457079    
+2023-12-01 09:47:09,369 - Epoch: [10][26500/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.457088    
+2023-12-01 09:47:49,260 - Epoch: [10][26600/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456869    
+2023-12-01 09:48:30,426 - Epoch: [10][26700/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456700    
+2023-12-01 09:49:16,867 - Epoch: [10][26800/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456728    
+2023-12-01 09:50:02,495 - Epoch: [10][26900/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456726    
+2023-12-01 09:50:44,988 - Epoch: [10][27000/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456608    
+2023-12-01 09:51:32,266 - Epoch: [10][27100/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456668    
+2023-12-01 09:52:20,946 - Epoch: [10][27200/31148]    Overall Loss 0.009458    Objective Loss 0.000000    Distill Loss 0.009458                     LR 0.000500    Time 0.456778    
+2023-12-01 09:53:06,110 - Epoch: [10][27300/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456759    
+2023-12-01 09:53:52,622 - Epoch: [10][27400/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456789    
+2023-12-01 09:54:37,298 - Epoch: [10][27500/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456753    
+2023-12-01 09:55:17,174 - Epoch: [10][27600/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456542    
+2023-12-01 09:56:00,096 - Epoch: [10][27700/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456443    
+2023-12-01 09:56:48,627 - Epoch: [10][27800/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456547    
+2023-12-01 09:57:31,411 - Epoch: [10][27900/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456444    
+2023-12-01 09:58:18,407 - Epoch: [10][28000/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456492    
+2023-12-01 09:58:53,195 - Epoch: [10][28100/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456105    
+2023-12-01 09:59:41,711 - Epoch: [10][28200/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456208    
+2023-12-01 10:00:25,021 - Epoch: [10][28300/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456126    
+2023-12-01 10:01:12,004 - Epoch: [10][28400/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456174    
+2023-12-01 10:02:09,711 - Epoch: [10][28500/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456598    
+2023-12-01 10:02:54,495 - Epoch: [10][28600/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456567    
+2023-12-01 10:03:32,614 - Epoch: [10][28700/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456304    
+2023-12-01 10:04:19,192 - Epoch: [10][28800/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456337    
+2023-12-01 10:05:03,582 - Epoch: [10][28900/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456293    
+2023-12-01 10:05:43,730 - Epoch: [10][29000/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456104    
+2023-12-01 10:06:26,813 - Epoch: [10][29100/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456017    
+2023-12-01 10:07:11,971 - Epoch: [10][29200/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456001    
+2023-12-01 10:07:59,588 - Epoch: [10][29300/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.456070    
+2023-12-01 10:08:46,655 - Epoch: [10][29400/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.456119    
+2023-12-01 10:09:18,770 - Epoch: [10][29500/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.455662    
+2023-12-01 10:09:57,884 - Epoch: [10][29600/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.455443    
+2023-12-01 10:10:39,308 - Epoch: [10][29700/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.455304    
+2023-12-01 10:11:19,300 - Epoch: [10][29800/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.455118    
+2023-12-01 10:12:04,451 - Epoch: [10][29900/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.455106    
+2023-12-01 10:12:48,914 - Epoch: [10][30000/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.455071    
+2023-12-01 10:13:24,311 - Epoch: [10][30100/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.454735    
+2023-12-01 10:14:05,972 - Epoch: [10][30200/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.454608    
+2023-12-01 10:15:05,088 - Epoch: [10][30300/31148]    Overall Loss 0.009457    Objective Loss 0.000000    Distill Loss 0.009457                     LR 0.000500    Time 0.455059    
+2023-12-01 10:15:42,194 - Epoch: [10][30400/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.454782    
+2023-12-01 10:16:13,190 - Epoch: [10][30500/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.454307    
+2023-12-01 10:16:41,480 - Epoch: [10][30600/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.453747    
+2023-12-01 10:17:09,145 - Epoch: [10][30700/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.453170    
+2023-12-01 10:17:38,052 - Epoch: [10][30800/31148]    Overall Loss 0.009456    Objective Loss 0.000000    Distill Loss 0.009456                     LR 0.000500    Time 0.452637    
+2023-12-01 10:18:05,862 - Epoch: [10][30900/31148]    Overall Loss 0.009455    Objective Loss 0.000000    Distill Loss 0.009455                     LR 0.000500    Time 0.452072    
+2023-12-01 10:18:35,404 - Epoch: [10][31000/31148]    Overall Loss 0.009455    Objective Loss 0.000000    Distill Loss 0.009455                     LR 0.000500    Time 0.451566    
+2023-12-01 10:19:03,362 - Epoch: [10][31100/31148]    Overall Loss 0.009455    Objective Loss 0.000000    Distill Loss 0.009455                     LR 0.000500    Time 0.451013    
+2023-12-01 10:19:17,267 - Epoch: [10][31148/31148]    Overall Loss 0.009455    Objective Loss 0.000000    Distill Loss 0.009455                     LR 0.000500    Time 0.450764    
+2023-12-01 10:19:17,660 - --- validate (epoch=10)-----------
+2023-12-01 10:19:17,660 - 167951 samples (100 per mini-batch)
+2023-12-01 10:19:38,732 - Epoch: [10][  100/ 1680]    Loss 0.000000    Overall Loss 0.010058    
+2023-12-01 10:19:58,544 - Epoch: [10][  200/ 1680]    Loss 0.000000    Overall Loss 0.010067    
+2023-12-01 10:20:18,327 - Epoch: [10][  300/ 1680]    Loss 0.000000    Overall Loss 0.010079    
+2023-12-01 10:20:38,116 - Epoch: [10][  400/ 1680]    Loss 0.000000    Overall Loss 0.010078    
+2023-12-01 10:20:57,903 - Epoch: [10][  500/ 1680]    Loss 0.000000    Overall Loss 0.010085    
+2023-12-01 10:21:17,858 - Epoch: [10][  600/ 1680]    Loss 0.000000    Overall Loss 0.010081    
+2023-12-01 10:21:37,890 - Epoch: [10][  700/ 1680]    Loss 0.000000    Overall Loss 0.010093    
+2023-12-01 10:21:57,944 - Epoch: [10][  800/ 1680]    Loss 0.000000    Overall Loss 0.010087    
+2023-12-01 10:22:17,975 - Epoch: [10][  900/ 1680]    Loss 0.000000    Overall Loss 0.010083    
+2023-12-01 10:22:37,957 - Epoch: [10][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010082    
+2023-12-01 10:22:57,953 - Epoch: [10][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010079    
+2023-12-01 10:23:17,941 - Epoch: [10][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010075    
+2023-12-01 10:23:37,938 - Epoch: [10][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010074    
+2023-12-01 10:23:57,952 - Epoch: [10][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010075    
+2023-12-01 10:24:17,965 - Epoch: [10][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010078    
+2023-12-01 10:24:37,959 - Epoch: [10][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010081    
+2023-12-01 10:24:53,882 - Epoch: [10][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010078    
+2023-12-01 10:24:54,587 - ==> Overall Loss: 0.010
+
+2023-12-01 10:24:54,595 - ==> Best [Overall Loss: 0.010078 on epoch: 10]
+2023-12-01 10:24:54,595 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-01 10:24:54,646 - 
+
+2023-12-01 10:24:54,647 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-01 10:26:03,303 - Epoch: [11][  100/31148]    Overall Loss 0.009420    Objective Loss 0.000000    Distill Loss 0.009420                     LR 0.000500    Time 0.686478    
+2023-12-01 10:26:43,608 - Epoch: [11][  200/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.544701    
+2023-12-01 10:27:40,232 - Epoch: [11][  300/31148]    Overall Loss 0.009368    Objective Loss 0.000000    Distill Loss 0.009368                     LR 0.000500    Time 0.551856    
+2023-12-01 10:28:20,800 - Epoch: [11][  400/31148]    Overall Loss 0.009370    Objective Loss 0.000000    Distill Loss 0.009370                     LR 0.000500    Time 0.515292    
+2023-12-01 10:29:29,380 - Epoch: [11][  500/31148]    Overall Loss 0.009365    Objective Loss 0.000000    Distill Loss 0.009365                     LR 0.000500    Time 0.549377    
+2023-12-01 10:30:19,564 - Epoch: [11][  600/31148]    Overall Loss 0.009361    Objective Loss 0.000000    Distill Loss 0.009361                     LR 0.000500    Time 0.541442    
+2023-12-01 10:30:54,719 - Epoch: [11][  700/31148]    Overall Loss 0.009366    Objective Loss 0.000000    Distill Loss 0.009366                     LR 0.000500    Time 0.514304    
+2023-12-01 10:31:33,215 - Epoch: [11][  800/31148]    Overall Loss 0.009377    Objective Loss 0.000000    Distill Loss 0.009377                     LR 0.000500    Time 0.498128    
+2023-12-01 10:32:21,646 - Epoch: [11][  900/31148]    Overall Loss 0.009374    Objective Loss 0.000000    Distill Loss 0.009374                     LR 0.000500    Time 0.496583    
+2023-12-01 10:33:14,022 - Epoch: [11][ 1000/31148]    Overall Loss 0.009370    Objective Loss 0.000000    Distill Loss 0.009370                     LR 0.000500    Time 0.499292    
+2023-12-01 10:33:54,362 - Epoch: [11][ 1100/31148]    Overall Loss 0.009373    Objective Loss 0.000000    Distill Loss 0.009373                     LR 0.000500    Time 0.490568    
+2023-12-01 10:34:52,252 - Epoch: [11][ 1200/31148]    Overall Loss 0.009373    Objective Loss 0.000000    Distill Loss 0.009373                     LR 0.000500    Time 0.497923    
+2023-12-01 10:35:25,871 - Epoch: [11][ 1300/31148]    Overall Loss 0.009375    Objective Loss 0.000000    Distill Loss 0.009375                     LR 0.000500    Time 0.485476    
+2023-12-01 10:36:05,419 - Epoch: [11][ 1400/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.479042    
+2023-12-01 10:36:55,661 - Epoch: [11][ 1500/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.480596    
+2023-12-01 10:37:42,823 - Epoch: [11][ 1600/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.480030    
+2023-12-01 10:38:36,754 - Epoch: [11][ 1700/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.483512    
+2023-12-01 10:39:22,146 - Epoch: [11][ 1800/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.481863    
+2023-12-01 10:40:09,853 - Epoch: [11][ 1900/31148]    Overall Loss 0.009377    Objective Loss 0.000000    Distill Loss 0.009377                     LR 0.000500    Time 0.481607    
+2023-12-01 10:40:52,326 - Epoch: [11][ 2000/31148]    Overall Loss 0.009377    Objective Loss 0.000000    Distill Loss 0.009377                     LR 0.000500    Time 0.478760    
+2023-12-01 10:41:44,281 - Epoch: [11][ 2100/31148]    Overall Loss 0.009377    Objective Loss 0.000000    Distill Loss 0.009377                     LR 0.000500    Time 0.480698    
+2023-12-01 10:42:26,254 - Epoch: [11][ 2200/31148]    Overall Loss 0.009374    Objective Loss 0.000000    Distill Loss 0.009374                     LR 0.000500    Time 0.477923    
+2023-12-01 10:43:15,571 - Epoch: [11][ 2300/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.478583    
+2023-12-01 10:43:52,983 - Epoch: [11][ 2400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.474228    
+2023-12-01 10:44:32,458 - Epoch: [11][ 2500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.471045    
+2023-12-01 10:45:04,764 - Epoch: [11][ 2600/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.465351    
+2023-12-01 10:45:51,747 - Epoch: [11][ 2700/31148]    Overall Loss 0.009390    Objective Loss 0.000000    Distill Loss 0.009390                     LR 0.000500    Time 0.465514    
+2023-12-01 10:46:43,247 - Epoch: [11][ 2800/31148]    Overall Loss 0.009387    Objective Loss 0.000000    Distill Loss 0.009387                     LR 0.000500    Time 0.467279    
+2023-12-01 10:47:33,833 - Epoch: [11][ 2900/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.468607    
+2023-12-01 10:48:21,346 - Epoch: [11][ 3000/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.468821    
+2023-12-01 10:49:07,403 - Epoch: [11][ 3100/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.468553    
+2023-12-01 10:49:51,606 - Epoch: [11][ 3200/31148]    Overall Loss 0.009389    Objective Loss 0.000000    Distill Loss 0.009389                     LR 0.000500    Time 0.467722    
+2023-12-01 10:50:39,335 - Epoch: [11][ 3300/31148]    Overall Loss 0.009387    Objective Loss 0.000000    Distill Loss 0.009387                     LR 0.000500    Time 0.468009    
+2023-12-01 10:51:19,896 - Epoch: [11][ 3400/31148]    Overall Loss 0.009387    Objective Loss 0.000000    Distill Loss 0.009387                     LR 0.000500    Time 0.466172    
+2023-12-01 10:52:03,752 - Epoch: [11][ 3500/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.465380    
+2023-12-01 10:52:52,794 - Epoch: [11][ 3600/31148]    Overall Loss 0.009389    Objective Loss 0.000000    Distill Loss 0.009389                     LR 0.000500    Time 0.466074    
+2023-12-01 10:53:38,639 - Epoch: [11][ 3700/31148]    Overall Loss 0.009393    Objective Loss 0.000000    Distill Loss 0.009393                     LR 0.000500    Time 0.465866    
+2023-12-01 10:54:28,688 - Epoch: [11][ 3800/31148]    Overall Loss 0.009391    Objective Loss 0.000000    Distill Loss 0.009391                     LR 0.000500    Time 0.466775    
+2023-12-01 10:55:12,675 - Epoch: [11][ 3900/31148]    Overall Loss 0.009393    Objective Loss 0.000000    Distill Loss 0.009393                     LR 0.000500    Time 0.466082    
+2023-12-01 10:55:58,867 - Epoch: [11][ 4000/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.465977    
+2023-12-01 10:56:45,431 - Epoch: [11][ 4100/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.465966    
+2023-12-01 10:57:35,974 - Epoch: [11][ 4200/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.466904    
+2023-12-01 10:58:43,771 - Epoch: [11][ 4300/31148]    Overall Loss 0.009398    Objective Loss 0.000000    Distill Loss 0.009398                     LR 0.000500    Time 0.471811    
+2023-12-01 10:59:35,774 - Epoch: [11][ 4400/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.472905    
+2023-12-01 11:00:21,708 - Epoch: [11][ 4500/31148]    Overall Loss 0.009396    Objective Loss 0.000000    Distill Loss 0.009396                     LR 0.000500    Time 0.472602    
+2023-12-01 11:01:02,600 - Epoch: [11][ 4600/31148]    Overall Loss 0.009396    Objective Loss 0.000000    Distill Loss 0.009396                     LR 0.000500    Time 0.471215    
+2023-12-01 11:01:51,201 - Epoch: [11][ 4700/31148]    Overall Loss 0.009398    Objective Loss 0.000000    Distill Loss 0.009398                     LR 0.000500    Time 0.471528    
+2023-12-01 11:02:39,255 - Epoch: [11][ 4800/31148]    Overall Loss 0.009398    Objective Loss 0.000000    Distill Loss 0.009398                     LR 0.000500    Time 0.471715    
+2023-12-01 11:03:25,983 - Epoch: [11][ 4900/31148]    Overall Loss 0.009397    Objective Loss 0.000000    Distill Loss 0.009397                     LR 0.000500    Time 0.471623    
+2023-12-01 11:04:15,763 - Epoch: [11][ 5000/31148]    Overall Loss 0.009397    Objective Loss 0.000000    Distill Loss 0.009397                     LR 0.000500    Time 0.472145    
+2023-12-01 11:04:59,782 - Epoch: [11][ 5100/31148]    Overall Loss 0.009397    Objective Loss 0.000000    Distill Loss 0.009397                     LR 0.000500    Time 0.471517    
+2023-12-01 11:05:56,260 - Epoch: [11][ 5200/31148]    Overall Loss 0.009397    Objective Loss 0.000000    Distill Loss 0.009397                     LR 0.000500    Time 0.473309    
+2023-12-01 11:06:39,489 - Epoch: [11][ 5300/31148]    Overall Loss 0.009396    Objective Loss 0.000000    Distill Loss 0.009396                     LR 0.000500    Time 0.472533    
+2023-12-01 11:07:25,938 - Epoch: [11][ 5400/31148]    Overall Loss 0.009398    Objective Loss 0.000000    Distill Loss 0.009398                     LR 0.000500    Time 0.472383    
+2023-12-01 11:08:06,906 - Epoch: [11][ 5500/31148]    Overall Loss 0.009396    Objective Loss 0.000000    Distill Loss 0.009396                     LR 0.000500    Time 0.471242    
+2023-12-01 11:08:50,863 - Epoch: [11][ 5600/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.470675    
+2023-12-01 11:09:34,654 - Epoch: [11][ 5700/31148]    Overall Loss 0.009395    Objective Loss 0.000000    Distill Loss 0.009395                     LR 0.000500    Time 0.470099    
+2023-12-01 11:10:26,898 - Epoch: [11][ 5800/31148]    Overall Loss 0.009394    Objective Loss 0.000000    Distill Loss 0.009394                     LR 0.000500    Time 0.471000    
+2023-12-01 11:11:30,871 - Epoch: [11][ 5900/31148]    Overall Loss 0.009392    Objective Loss 0.000000    Distill Loss 0.009392                     LR 0.000500    Time 0.473858    
+2023-12-01 11:12:26,230 - Epoch: [11][ 6000/31148]    Overall Loss 0.009392    Objective Loss 0.000000    Distill Loss 0.009392                     LR 0.000500    Time 0.475186    
+2023-12-01 11:13:07,973 - Epoch: [11][ 6100/31148]    Overall Loss 0.009393    Objective Loss 0.000000    Distill Loss 0.009393                     LR 0.000500    Time 0.474238    
+2023-12-01 11:13:50,811 - Epoch: [11][ 6200/31148]    Overall Loss 0.009391    Objective Loss 0.000000    Distill Loss 0.009391                     LR 0.000500    Time 0.473497    
+2023-12-01 11:14:42,004 - Epoch: [11][ 6300/31148]    Overall Loss 0.009391    Objective Loss 0.000000    Distill Loss 0.009391                     LR 0.000500    Time 0.474105    
+2023-12-01 11:15:26,514 - Epoch: [11][ 6400/31148]    Overall Loss 0.009391    Objective Loss 0.000000    Distill Loss 0.009391                     LR 0.000500    Time 0.473651    
+2023-12-01 11:16:14,008 - Epoch: [11][ 6500/31148]    Overall Loss 0.009389    Objective Loss 0.000000    Distill Loss 0.009389                     LR 0.000500    Time 0.473670    
+2023-12-01 11:16:58,574 - Epoch: [11][ 6600/31148]    Overall Loss 0.009388    Objective Loss 0.000000    Distill Loss 0.009388                     LR 0.000500    Time 0.473244    
+2023-12-01 11:17:51,632 - Epoch: [11][ 6700/31148]    Overall Loss 0.009387    Objective Loss 0.000000    Distill Loss 0.009387                     LR 0.000500    Time 0.474099    
+2023-12-01 11:18:30,590 - Epoch: [11][ 6800/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.472855    
+2023-12-01 11:19:24,000 - Epoch: [11][ 6900/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.473741    
+2023-12-01 11:20:03,358 - Epoch: [11][ 7000/31148]    Overall Loss 0.009385    Objective Loss 0.000000    Distill Loss 0.009385                     LR 0.000500    Time 0.472595    
+2023-12-01 11:20:48,824 - Epoch: [11][ 7100/31148]    Overall Loss 0.009385    Objective Loss 0.000000    Distill Loss 0.009385                     LR 0.000500    Time 0.472341    
+2023-12-01 11:21:29,718 - Epoch: [11][ 7200/31148]    Overall Loss 0.009385    Objective Loss 0.000000    Distill Loss 0.009385                     LR 0.000500    Time 0.471460    
+2023-12-01 11:22:24,590 - Epoch: [11][ 7300/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.472517    
+2023-12-01 11:23:10,387 - Epoch: [11][ 7400/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.472319    
+2023-12-01 11:23:53,186 - Epoch: [11][ 7500/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.471727    
+2023-12-01 11:24:37,693 - Epoch: [11][ 7600/31148]    Overall Loss 0.009387    Objective Loss 0.000000    Distill Loss 0.009387                     LR 0.000500    Time 0.471375    
+2023-12-01 11:25:18,881 - Epoch: [11][ 7700/31148]    Overall Loss 0.009386    Objective Loss 0.000000    Distill Loss 0.009386                     LR 0.000500    Time 0.470602    
+2023-12-01 11:26:14,769 - Epoch: [11][ 7800/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.471733    
+2023-12-01 11:26:55,884 - Epoch: [11][ 7900/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.470965    
+2023-12-01 11:27:44,304 - Epoch: [11][ 8000/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.471129    
+2023-12-01 11:28:25,281 - Epoch: [11][ 8100/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.470371    
+2023-12-01 11:29:13,859 - Epoch: [11][ 8200/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.470558    
+2023-12-01 11:29:56,886 - Epoch: [11][ 8300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.470071    
+2023-12-01 11:30:41,101 - Epoch: [11][ 8400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.469738    
+2023-12-01 11:31:18,947 - Epoch: [11][ 8500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.468663    
+2023-12-01 11:32:12,419 - Epoch: [11][ 8600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.469430    
+2023-12-01 11:33:02,376 - Epoch: [11][ 8700/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.469776    
+2023-12-01 11:33:47,915 - Epoch: [11][ 8800/31148]    Overall Loss 0.009384    Objective Loss 0.000000    Distill Loss 0.009384                     LR 0.000500    Time 0.469612    
+2023-12-01 11:34:33,269 - Epoch: [11][ 8900/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.469430    
+2023-12-01 11:35:28,406 - Epoch: [11][ 9000/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.470340    
+2023-12-01 11:36:09,175 - Epoch: [11][ 9100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.469650    
+2023-12-01 11:36:42,162 - Epoch: [11][ 9200/31148]    Overall Loss 0.009384    Objective Loss 0.000000    Distill Loss 0.009384                     LR 0.000500    Time 0.468130    
+2023-12-01 11:37:34,685 - Epoch: [11][ 9300/31148]    Overall Loss 0.009384    Objective Loss 0.000000    Distill Loss 0.009384                     LR 0.000500    Time 0.468743    
+2023-12-01 11:38:25,542 - Epoch: [11][ 9400/31148]    Overall Loss 0.009384    Objective Loss 0.000000    Distill Loss 0.009384                     LR 0.000500    Time 0.469166    
+2023-12-01 11:39:11,626 - Epoch: [11][ 9500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.469078    
+2023-12-01 11:39:58,589 - Epoch: [11][ 9600/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.469083    
+2023-12-01 11:40:44,663 - Epoch: [11][ 9700/31148]    Overall Loss 0.009384    Objective Loss 0.000000    Distill Loss 0.009384                     LR 0.000500    Time 0.468996    
+2023-12-01 11:41:32,924 - Epoch: [11][ 9800/31148]    Overall Loss 0.009384    Objective Loss 0.000000    Distill Loss 0.009384                     LR 0.000500    Time 0.469134    
+2023-12-01 11:42:12,706 - Epoch: [11][ 9900/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.468413    
+2023-12-01 11:42:54,541 - Epoch: [11][10000/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.467912    
+2023-12-01 11:43:49,046 - Epoch: [11][10100/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.468675    
+2023-12-01 11:44:32,332 - Epoch: [11][10200/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.468323    
+2023-12-01 11:45:13,491 - Epoch: [11][10300/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.467771    
+2023-12-01 11:45:53,803 - Epoch: [11][10400/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.467149    
+2023-12-01 11:46:53,517 - Epoch: [11][10500/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.468386    
+2023-12-01 11:47:37,351 - Epoch: [11][10600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.468102    
+2023-12-01 11:48:29,822 - Epoch: [11][10700/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.468630    
+2023-12-01 11:49:23,927 - Epoch: [11][10800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.469300    
+2023-12-01 11:50:15,543 - Epoch: [11][10900/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.469729    
+2023-12-01 11:51:12,509 - Epoch: [11][11000/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.470637    
+2023-12-01 11:52:07,094 - Epoch: [11][11100/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.471314    
+2023-12-01 11:52:45,403 - Epoch: [11][11200/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470525    
+2023-12-01 11:53:23,109 - Epoch: [11][11300/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.469698    
+2023-12-01 11:54:16,324 - Epoch: [11][11400/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470245    
+2023-12-01 11:55:08,832 - Epoch: [11][11500/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470721    
+2023-12-01 11:56:00,512 - Epoch: [11][11600/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.471117    
+2023-12-01 11:56:42,807 - Epoch: [11][11700/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470705    
+2023-12-01 11:57:41,467 - Epoch: [11][11800/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.471687    
+2023-12-01 11:58:22,949 - Epoch: [11][11900/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.471208    
+2023-12-01 11:59:04,560 - Epoch: [11][12000/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470748    
+2023-12-01 11:59:51,678 - Epoch: [11][12100/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470751    
+2023-12-01 12:00:45,446 - Epoch: [11][12200/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.471299    
+2023-12-01 12:01:25,519 - Epoch: [11][12300/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.470725    
+2023-12-01 12:02:15,080 - Epoch: [11][12400/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.470925    
+2023-12-01 12:03:02,119 - Epoch: [11][12500/31148]    Overall Loss 0.009377    Objective Loss 0.000000    Distill Loss 0.009377                     LR 0.000500    Time 0.470920    
+2023-12-01 12:03:58,265 - Epoch: [11][12600/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.471638    
+2023-12-01 12:04:36,335 - Epoch: [11][12700/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.470921    
+2023-12-01 12:05:17,636 - Epoch: [11][12800/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470468    
+2023-12-01 12:06:13,638 - Epoch: [11][12900/31148]    Overall Loss 0.009378    Objective Loss 0.000000    Distill Loss 0.009378                     LR 0.000500    Time 0.471162    
+2023-12-01 12:06:57,788 - Epoch: [11][13000/31148]    Overall Loss 0.009379    Objective Loss 0.000000    Distill Loss 0.009379                     LR 0.000500    Time 0.470933    
+2023-12-01 12:07:42,003 - Epoch: [11][13100/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.470713    
+2023-12-01 12:08:27,716 - Epoch: [11][13200/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.470610    
+2023-12-01 12:09:06,222 - Epoch: [11][13300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.469966    
+2023-12-01 12:09:51,757 - Epoch: [11][13400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.469856    
+2023-12-01 12:10:41,937 - Epoch: [11][13500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.470092    
+2023-12-01 12:11:18,734 - Epoch: [11][13600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.469341    
+2023-12-01 12:12:19,828 - Epoch: [11][13700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.470374    
+2023-12-01 12:13:04,158 - Epoch: [11][13800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.470177    
+2023-12-01 12:13:53,386 - Epoch: [11][13900/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.470336    
+2023-12-01 12:14:27,891 - Epoch: [11][14000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.469440    
+2023-12-01 12:14:58,711 - Epoch: [11][14100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.468296    
+2023-12-01 12:15:47,438 - Epoch: [11][14200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.468429    
+2023-12-01 12:16:23,711 - Epoch: [11][14300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.467690    
+2023-12-01 12:17:03,603 - Epoch: [11][14400/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.467212    
+2023-12-01 12:17:59,598 - Epoch: [11][14500/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.467850    
+2023-12-01 12:18:38,851 - Epoch: [11][14600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.467334    
+2023-12-01 12:19:24,957 - Epoch: [11][14700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.467291    
+2023-12-01 12:20:08,149 - Epoch: [11][14800/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.467051    
+2023-12-01 12:20:49,208 - Epoch: [11][14900/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.466672    
+2023-12-01 12:21:35,210 - Epoch: [11][15000/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.466627    
+2023-12-01 12:22:19,671 - Epoch: [11][15100/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.466481    
+2023-12-01 12:23:03,670 - Epoch: [11][15200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.466306    
+2023-12-01 12:23:49,944 - Epoch: [11][15300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466282    
+2023-12-01 12:24:40,333 - Epoch: [11][15400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466526    
+2023-12-01 12:25:21,999 - Epoch: [11][15500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466204    
+2023-12-01 12:26:03,335 - Epoch: [11][15600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465864    
+2023-12-01 12:26:59,926 - Epoch: [11][15700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.466501    
+2023-12-01 12:27:52,718 - Epoch: [11][15800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.466889    
+2023-12-01 12:28:35,633 - Epoch: [11][15900/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.466652    
+2023-12-01 12:29:22,295 - Epoch: [11][16000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466651    
+2023-12-01 12:30:14,941 - Epoch: [11][16100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.467022    
+2023-12-01 12:30:52,617 - Epoch: [11][16200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466464    
+2023-12-01 12:31:33,241 - Epoch: [11][16300/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.466094    
+2023-12-01 12:32:14,529 - Epoch: [11][16400/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.465769    
+2023-12-01 12:33:02,737 - Epoch: [11][16500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.465868    
+2023-12-01 12:33:46,134 - Epoch: [11][16600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.465675    
+2023-12-01 12:34:33,669 - Epoch: [11][16700/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.465733    
+2023-12-01 12:35:29,864 - Epoch: [11][16800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466305    
+2023-12-01 12:36:14,933 - Epoch: [11][16900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466212    
+2023-12-01 12:36:57,302 - Epoch: [11][17000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.465962    
+2023-12-01 12:37:46,218 - Epoch: [11][17100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466097    
+2023-12-01 12:38:37,862 - Epoch: [11][17200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466389    
+2023-12-01 12:39:28,437 - Epoch: [11][17300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466616    
+2023-12-01 12:40:09,464 - Epoch: [11][17400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466292    
+2023-12-01 12:40:56,032 - Epoch: [11][17500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.466288    
+2023-12-01 12:41:36,747 - Epoch: [11][17600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465951    
+2023-12-01 12:42:20,851 - Epoch: [11][17700/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.465810    
+2023-12-01 12:43:07,423 - Epoch: [11][17800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465809    
+2023-12-01 12:43:58,930 - Epoch: [11][17900/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.466084    
+2023-12-01 12:44:35,464 - Epoch: [11][18000/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.465524    
+2023-12-01 12:45:15,640 - Epoch: [11][18100/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.465172    
+2023-12-01 12:46:05,379 - Epoch: [11][18200/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.465348    
+2023-12-01 12:46:43,547 - Epoch: [11][18300/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.464891    
+2023-12-01 12:47:36,285 - Epoch: [11][18400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465230    
+2023-12-01 12:48:18,717 - Epoch: [11][18500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465008    
+2023-12-01 12:49:08,393 - Epoch: [11][18600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465178    
+2023-12-01 12:49:58,536 - Epoch: [11][18700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465372    
+2023-12-01 12:50:46,532 - Epoch: [11][18800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.465449    
+2023-12-01 12:51:23,815 - Epoch: [11][18900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.464959    
+2023-12-01 12:52:07,126 - Epoch: [11][19000/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464791    
+2023-12-01 12:52:52,738 - Epoch: [11][19100/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.464745    
+2023-12-01 12:53:35,694 - Epoch: [11][19200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464561    
+2023-12-01 12:54:25,420 - Epoch: [11][19300/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.464730    
+2023-12-01 12:55:08,365 - Epoch: [11][19400/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.464548    
+2023-12-01 12:55:50,969 - Epoch: [11][19500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464350    
+2023-12-01 12:56:37,201 - Epoch: [11][19600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464339    
+2023-12-01 12:57:21,864 - Epoch: [11][19700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464249    
+2023-12-01 12:58:08,463 - Epoch: [11][19800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464257    
+2023-12-01 12:58:57,306 - Epoch: [11][19900/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464378    
+2023-12-01 12:59:35,734 - Epoch: [11][20000/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463977    
+2023-12-01 13:00:21,455 - Epoch: [11][20100/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463943    
+2023-12-01 13:01:04,477 - Epoch: [11][20200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463776    
+2023-12-01 13:01:57,451 - Epoch: [11][20300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464101    
+2023-12-01 13:02:43,232 - Epoch: [11][20400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464069    
+2023-12-01 13:03:27,222 - Epoch: [11][20500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463951    
+2023-12-01 13:04:07,607 - Epoch: [11][20600/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.463659    
+2023-12-01 13:04:57,264 - Epoch: [11][20700/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.463818    
+2023-12-01 13:05:44,427 - Epoch: [11][20800/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.463855    
+2023-12-01 13:06:43,471 - Epoch: [11][20900/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464460    
+2023-12-01 13:07:26,693 - Epoch: [11][21000/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464306    
+2023-12-01 13:08:12,947 - Epoch: [11][21100/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464298    
+2023-12-01 13:08:58,115 - Epoch: [11][21200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464238    
+2023-12-01 13:09:42,177 - Epoch: [11][21300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464126    
+2023-12-01 13:10:24,645 - Epoch: [11][21400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463942    
+2023-12-01 13:11:10,327 - Epoch: [11][21500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463908    
+2023-12-01 13:11:48,780 - Epoch: [11][21600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463540    
+2023-12-01 13:12:37,874 - Epoch: [11][21700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463666    
+2023-12-01 13:13:29,819 - Epoch: [11][21800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463922    
+2023-12-01 13:14:14,544 - Epoch: [11][21900/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463845    
+2023-12-01 13:15:06,092 - Epoch: [11][22000/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464080    
+2023-12-01 13:15:45,572 - Epoch: [11][22100/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463766    
+2023-12-01 13:16:26,750 - Epoch: [11][22200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463532    
+2023-12-01 13:17:15,448 - Epoch: [11][22300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463636    
+2023-12-01 13:18:00,558 - Epoch: [11][22400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463580    
+2023-12-01 13:18:42,683 - Epoch: [11][22500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463392    
+2023-12-01 13:19:31,488 - Epoch: [11][22600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463500    
+2023-12-01 13:20:18,646 - Epoch: [11][22700/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.463536    
+2023-12-01 13:21:01,845 - Epoch: [11][22800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463397    
+2023-12-01 13:21:53,772 - Epoch: [11][22900/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.463641    
+2023-12-01 13:22:38,673 - Epoch: [11][23000/31148]    Overall Loss 0.009380    Objective Loss 0.000000    Distill Loss 0.009380                     LR 0.000500    Time 0.463577    
+2023-12-01 13:23:26,077 - Epoch: [11][23100/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463622    
+2023-12-01 13:24:15,847 - Epoch: [11][23200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.463768    
+2023-12-01 13:24:59,768 - Epoch: [11][23300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463663    
+2023-12-01 13:25:47,191 - Epoch: [11][23400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463707    
+2023-12-01 13:26:37,808 - Epoch: [11][23500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463888    
+2023-12-01 13:27:29,227 - Epoch: [11][23600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.464101    
+2023-12-01 13:28:14,933 - Epoch: [11][23700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.464071    
+2023-12-01 13:29:02,046 - Epoch: [11][23800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.464100    
+2023-12-01 13:29:37,506 - Epoch: [11][23900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463641    
+2023-12-01 13:30:21,962 - Epoch: [11][24000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463562    
+2023-12-01 13:30:59,376 - Epoch: [11][24100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463190    
+2023-12-01 13:31:42,926 - Epoch: [11][24200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463076    
+2023-12-01 13:32:26,968 - Epoch: [11][24300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462982    
+2023-12-01 13:33:12,071 - Epoch: [11][24400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.462933    
+2023-12-01 13:33:56,837 - Epoch: [11][24500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462870    
+2023-12-01 13:34:38,693 - Epoch: [11][24600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462690    
+2023-12-01 13:35:25,335 - Epoch: [11][24700/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462704    
+2023-12-01 13:36:17,188 - Epoch: [11][24800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462929    
+2023-12-01 13:37:08,985 - Epoch: [11][24900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.463150    
+2023-12-01 13:37:46,544 - Epoch: [11][25000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462800    
+2023-12-01 13:38:30,315 - Epoch: [11][25100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462699    
+2023-12-01 13:39:12,455 - Epoch: [11][25200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462535    
+2023-12-01 13:39:54,484 - Epoch: [11][25300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462368    
+2023-12-01 13:40:40,295 - Epoch: [11][25400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462351    
+2023-12-01 13:41:26,764 - Epoch: [11][25500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462360    
+2023-12-01 13:42:09,911 - Epoch: [11][25600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.462239    
+2023-12-01 13:42:41,549 - Epoch: [11][25700/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.461671    
+2023-12-01 13:43:08,751 - Epoch: [11][25800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.460936    
+2023-12-01 13:43:35,930 - Epoch: [11][25900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.460205    
+2023-12-01 13:44:03,613 - Epoch: [11][26000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.459500    
+2023-12-01 13:44:31,892 - Epoch: [11][26100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458823    
+2023-12-01 13:45:00,805 - Epoch: [11][26200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458175    
+2023-12-01 13:45:28,579 - Epoch: [11][26300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457488    
+2023-12-01 13:45:56,741 - Epoch: [11][26400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.456822    
+2023-12-01 13:46:24,056 - Epoch: [11][26500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.456129    
+2023-12-01 13:46:53,174 - Epoch: [11][26600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455508    
+2023-12-01 13:47:20,351 - Epoch: [11][26700/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454820    
+2023-12-01 13:47:46,661 - Epoch: [11][26800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454105    
+2023-12-01 13:48:20,047 - Epoch: [11][26900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.453657    
+2023-12-01 13:48:52,465 - Epoch: [11][27000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.453178    
+2023-12-01 13:49:54,652 - Epoch: [11][27100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.453800    
+2023-12-01 13:50:53,385 - Epoch: [11][27200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454290    
+2023-12-01 13:51:36,110 - Epoch: [11][27300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454191    
+2023-12-01 13:52:29,059 - Epoch: [11][27400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454466    
+2023-12-01 13:53:18,883 - Epoch: [11][27500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454624    
+2023-12-01 13:54:05,013 - Epoch: [11][27600/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.454648    
+2023-12-01 13:54:54,658 - Epoch: [11][27700/31148]    Overall Loss 0.009383    Objective Loss 0.000000    Distill Loss 0.009383                     LR 0.000500    Time 0.454799    
+2023-12-01 13:55:38,017 - Epoch: [11][27800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454723    
+2023-12-01 13:56:23,052 - Epoch: [11][27900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454707    
+2023-12-01 13:57:06,710 - Epoch: [11][28000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454642    
+2023-12-01 13:57:49,938 - Epoch: [11][28100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.454562    
+2023-12-01 13:58:46,349 - Epoch: [11][28200/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.454950    
+2023-12-01 13:59:29,112 - Epoch: [11][28300/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.454853    
+2023-12-01 14:00:29,083 - Epoch: [11][28400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455363    
+2023-12-01 14:01:11,028 - Epoch: [11][28500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455237    
+2023-12-01 14:02:07,741 - Epoch: [11][28600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455628    
+2023-12-01 14:02:53,452 - Epoch: [11][28700/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455632    
+2023-12-01 14:03:38,088 - Epoch: [11][28800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455600    
+2023-12-01 14:04:29,342 - Epoch: [11][28900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455797    
+2023-12-01 14:05:19,554 - Epoch: [11][29000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.455956    
+2023-12-01 14:06:21,628 - Epoch: [11][29100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.456522    
+2023-12-01 14:07:24,559 - Epoch: [11][29200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457114    
+2023-12-01 14:08:19,983 - Epoch: [11][29300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457445    
+2023-12-01 14:09:15,512 - Epoch: [11][29400/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.457777    
+2023-12-01 14:10:10,278 - Epoch: [11][29500/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.458082    
+2023-12-01 14:10:55,198 - Epoch: [11][29600/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.458052    
+2023-12-01 14:11:44,789 - Epoch: [11][29700/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.458179    
+2023-12-01 14:12:24,378 - Epoch: [11][29800/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457970    
+2023-12-01 14:13:11,770 - Epoch: [11][29900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458023    
+2023-12-01 14:13:53,143 - Epoch: [11][30000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457875    
+2023-12-01 14:14:38,023 - Epoch: [11][30100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457844    
+2023-12-01 14:15:32,649 - Epoch: [11][30200/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458137    
+2023-12-01 14:16:15,069 - Epoch: [11][30300/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458025    
+2023-12-01 14:17:05,211 - Epoch: [11][30400/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458167    
+2023-12-01 14:17:44,929 - Epoch: [11][30500/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.457967    
+2023-12-01 14:18:43,273 - Epoch: [11][30600/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458377    
+2023-12-01 14:19:27,325 - Epoch: [11][30700/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458318    
+2023-12-01 14:20:15,642 - Epoch: [11][30800/31148]    Overall Loss 0.009381    Objective Loss 0.000000    Distill Loss 0.009381                     LR 0.000500    Time 0.458399    
+2023-12-01 14:20:59,961 - Epoch: [11][30900/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458349    
+2023-12-01 14:21:58,093 - Epoch: [11][31000/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.458746    
+2023-12-01 14:22:57,288 - Epoch: [11][31100/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.459174    
+2023-12-01 14:23:15,204 - Epoch: [11][31148/31148]    Overall Loss 0.009382    Objective Loss 0.000000    Distill Loss 0.009382                     LR 0.000500    Time 0.459041    
+2023-12-01 14:23:16,204 - --- validate (epoch=11)-----------
+2023-12-01 14:23:16,204 - 167951 samples (100 per mini-batch)
+2023-12-01 14:23:39,494 - Epoch: [11][  100/ 1680]    Loss 0.000000    Overall Loss 0.010171    
+2023-12-01 14:23:59,477 - Epoch: [11][  200/ 1680]    Loss 0.000000    Overall Loss 0.010136    
+2023-12-01 14:24:19,528 - Epoch: [11][  300/ 1680]    Loss 0.000000    Overall Loss 0.010110    
+2023-12-01 14:24:39,483 - Epoch: [11][  400/ 1680]    Loss 0.000000    Overall Loss 0.010121    
+2023-12-01 14:24:59,512 - Epoch: [11][  500/ 1680]    Loss 0.000000    Overall Loss 0.010110    
+2023-12-01 14:25:19,594 - Epoch: [11][  600/ 1680]    Loss 0.000000    Overall Loss 0.010110    
+2023-12-01 14:25:39,640 - Epoch: [11][  700/ 1680]    Loss 0.000000    Overall Loss 0.010108    
+2023-12-01 14:25:59,664 - Epoch: [11][  800/ 1680]    Loss 0.000000    Overall Loss 0.010108    
+2023-12-01 14:26:19,651 - Epoch: [11][  900/ 1680]    Loss 0.000000    Overall Loss 0.010113    
+2023-12-01 14:26:39,655 - Epoch: [11][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010114    
+2023-12-01 14:26:59,652 - Epoch: [11][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010111    
+2023-12-01 14:27:19,691 - Epoch: [11][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010110    
+2023-12-01 14:27:39,664 - Epoch: [11][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010106    
+2023-12-01 14:27:59,689 - Epoch: [11][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010101    
+2023-12-01 14:28:19,600 - Epoch: [11][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010106    
+2023-12-01 14:28:39,595 - Epoch: [11][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010103    
+2023-12-01 14:28:55,537 - Epoch: [11][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010101    
+2023-12-01 14:28:56,104 - ==> Overall Loss: 0.010
+
+2023-12-01 14:28:56,113 - ==> Best [Overall Loss: 0.010078 on epoch: 10]
+2023-12-01 14:28:56,113 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-01 14:28:56,159 - 
+
+2023-12-01 14:28:56,159 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-01 14:29:53,220 - Epoch: [12][  100/31148]    Overall Loss 0.009307    Objective Loss 0.000000    Distill Loss 0.009307                     LR 0.000500    Time 0.570502    
+2023-12-01 14:30:44,954 - Epoch: [12][  200/31148]    Overall Loss 0.009264    Objective Loss 0.000000    Distill Loss 0.009264                     LR 0.000500    Time 0.543885    
+2023-12-01 14:31:40,880 - Epoch: [12][  300/31148]    Overall Loss 0.009278    Objective Loss 0.000000    Distill Loss 0.009278                     LR 0.000500    Time 0.548987    
+2023-12-01 14:32:28,403 - Epoch: [12][  400/31148]    Overall Loss 0.009276    Objective Loss 0.000000    Distill Loss 0.009276                     LR 0.000500    Time 0.530529    
+2023-12-01 14:33:06,218 - Epoch: [12][  500/31148]    Overall Loss 0.009285    Objective Loss 0.000000    Distill Loss 0.009285                     LR 0.000500    Time 0.500037    
+2023-12-01 14:33:55,448 - Epoch: [12][  600/31148]    Overall Loss 0.009297    Objective Loss 0.000000    Distill Loss 0.009297                     LR 0.000500    Time 0.498735    
+2023-12-01 14:34:38,230 - Epoch: [12][  700/31148]    Overall Loss 0.009314    Objective Loss 0.000000    Distill Loss 0.009314                     LR 0.000500    Time 0.488594    
+2023-12-01 14:35:21,532 - Epoch: [12][  800/31148]    Overall Loss 0.009324    Objective Loss 0.000000    Distill Loss 0.009324                     LR 0.000500    Time 0.481636    
+2023-12-01 14:36:15,608 - Epoch: [12][  900/31148]    Overall Loss 0.009321    Objective Loss 0.000000    Distill Loss 0.009321                     LR 0.000500    Time 0.488197    
+2023-12-01 14:37:02,838 - Epoch: [12][ 1000/31148]    Overall Loss 0.009314    Objective Loss 0.000000    Distill Loss 0.009314                     LR 0.000500    Time 0.486600    
+2023-12-01 14:37:57,345 - Epoch: [12][ 1100/31148]    Overall Loss 0.009313    Objective Loss 0.000000    Distill Loss 0.009313                     LR 0.000500    Time 0.491908    
+2023-12-01 14:38:37,586 - Epoch: [12][ 1200/31148]    Overall Loss 0.009310    Objective Loss 0.000000    Distill Loss 0.009310                     LR 0.000500    Time 0.484444    
+2023-12-01 14:39:15,453 - Epoch: [12][ 1300/31148]    Overall Loss 0.009312    Objective Loss 0.000000    Distill Loss 0.009312                     LR 0.000500    Time 0.476302    
+2023-12-01 14:40:00,129 - Epoch: [12][ 1400/31148]    Overall Loss 0.009317    Objective Loss 0.000000    Distill Loss 0.009317                     LR 0.000500    Time 0.474186    
+2023-12-01 14:40:40,648 - Epoch: [12][ 1500/31148]    Overall Loss 0.009321    Objective Loss 0.000000    Distill Loss 0.009321                     LR 0.000500    Time 0.469581    
+2023-12-01 14:41:21,835 - Epoch: [12][ 1600/31148]    Overall Loss 0.009317    Objective Loss 0.000000    Distill Loss 0.009317                     LR 0.000500    Time 0.465970    
+2023-12-01 14:41:58,496 - Epoch: [12][ 1700/31148]    Overall Loss 0.009317    Objective Loss 0.000000    Distill Loss 0.009317                     LR 0.000500    Time 0.460121    
+2023-12-01 14:42:37,498 - Epoch: [12][ 1800/31148]    Overall Loss 0.009319    Objective Loss 0.000000    Distill Loss 0.009319                     LR 0.000500    Time 0.456222    
+2023-12-01 14:43:38,951 - Epoch: [12][ 1900/31148]    Overall Loss 0.009321    Objective Loss 0.000000    Distill Loss 0.009321                     LR 0.000500    Time 0.464550    
+2023-12-01 14:44:29,131 - Epoch: [12][ 2000/31148]    Overall Loss 0.009319    Objective Loss 0.000000    Distill Loss 0.009319                     LR 0.000500    Time 0.466409    
+2023-12-01 14:45:08,397 - Epoch: [12][ 2100/31148]    Overall Loss 0.009325    Objective Loss 0.000000    Distill Loss 0.009325                     LR 0.000500    Time 0.462893    
+2023-12-01 14:45:47,179 - Epoch: [12][ 2200/31148]    Overall Loss 0.009323    Objective Loss 0.000000    Distill Loss 0.009323                     LR 0.000500    Time 0.459477    
+2023-12-01 14:46:20,881 - Epoch: [12][ 2300/31148]    Overall Loss 0.009327    Objective Loss 0.000000    Distill Loss 0.009327                     LR 0.000500    Time 0.454150    
+2023-12-01 14:47:13,633 - Epoch: [12][ 2400/31148]    Overall Loss 0.009329    Objective Loss 0.000000    Distill Loss 0.009329                     LR 0.000500    Time 0.457204    
+2023-12-01 14:47:55,226 - Epoch: [12][ 2500/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.455550    
+2023-12-01 14:48:34,197 - Epoch: [12][ 2600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.453015    
+2023-12-01 14:49:19,563 - Epoch: [12][ 2700/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.453036    
+2023-12-01 14:50:05,041 - Epoch: [12][ 2800/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.453096    
+2023-12-01 14:50:47,633 - Epoch: [12][ 2900/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.452156    
+2023-12-01 14:51:31,925 - Epoch: [12][ 3000/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.451845    
+2023-12-01 14:52:10,917 - Epoch: [12][ 3100/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.449845    
+2023-12-01 14:52:55,132 - Epoch: [12][ 3200/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.449603    
+2023-12-01 14:53:38,197 - Epoch: [12][ 3300/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.449026    
+2023-12-01 14:54:23,179 - Epoch: [12][ 3400/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.449047    
+2023-12-01 14:55:10,096 - Epoch: [12][ 3500/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.449620    
+2023-12-01 14:55:53,789 - Epoch: [12][ 3600/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.449265    
+2023-12-01 14:56:36,426 - Epoch: [12][ 3700/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.448644    
+2023-12-01 14:57:17,278 - Epoch: [12][ 3800/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.447587    
+2023-12-01 14:58:14,220 - Epoch: [12][ 3900/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.450708    
+2023-12-01 14:58:52,401 - Epoch: [12][ 4000/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.448984    
+2023-12-01 14:59:38,843 - Epoch: [12][ 4100/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.449359    
+2023-12-01 15:00:38,101 - Epoch: [12][ 4200/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.452767    
+2023-12-01 15:01:23,098 - Epoch: [12][ 4300/31148]    Overall Loss 0.009343    Objective Loss 0.000000    Distill Loss 0.009343                     LR 0.000500    Time 0.452700    
+2023-12-01 15:02:01,126 - Epoch: [12][ 4400/31148]    Overall Loss 0.009340    Objective Loss 0.000000    Distill Loss 0.009340                     LR 0.000500    Time 0.451052    
+2023-12-01 15:02:36,063 - Epoch: [12][ 4500/31148]    Overall Loss 0.009342    Objective Loss 0.000000    Distill Loss 0.009342                     LR 0.000500    Time 0.448791    
+2023-12-01 15:03:17,241 - Epoch: [12][ 4600/31148]    Overall Loss 0.009342    Objective Loss 0.000000    Distill Loss 0.009342                     LR 0.000500    Time 0.447985    
+2023-12-01 15:04:07,814 - Epoch: [12][ 4700/31148]    Overall Loss 0.009341    Objective Loss 0.000000    Distill Loss 0.009341                     LR 0.000500    Time 0.449212    
+2023-12-01 15:04:52,599 - Epoch: [12][ 4800/31148]    Overall Loss 0.009342    Objective Loss 0.000000    Distill Loss 0.009342                     LR 0.000500    Time 0.449182    
+2023-12-01 15:05:45,080 - Epoch: [12][ 4900/31148]    Overall Loss 0.009343    Objective Loss 0.000000    Distill Loss 0.009343                     LR 0.000500    Time 0.450724    
+2023-12-01 15:06:19,675 - Epoch: [12][ 5000/31148]    Overall Loss 0.009346    Objective Loss 0.000000    Distill Loss 0.009346                     LR 0.000500    Time 0.448627    
+2023-12-01 15:07:09,407 - Epoch: [12][ 5100/31148]    Overall Loss 0.009344    Objective Loss 0.000000    Distill Loss 0.009344                     LR 0.000500    Time 0.449580    
+2023-12-01 15:07:47,108 - Epoch: [12][ 5200/31148]    Overall Loss 0.009346    Objective Loss 0.000000    Distill Loss 0.009346                     LR 0.000500    Time 0.448183    
+2023-12-01 15:08:29,516 - Epoch: [12][ 5300/31148]    Overall Loss 0.009343    Objective Loss 0.000000    Distill Loss 0.009343                     LR 0.000500    Time 0.447727    
+2023-12-01 15:09:09,654 - Epoch: [12][ 5400/31148]    Overall Loss 0.009346    Objective Loss 0.000000    Distill Loss 0.009346                     LR 0.000500    Time 0.446867    
+2023-12-01 15:09:55,115 - Epoch: [12][ 5500/31148]    Overall Loss 0.009347    Objective Loss 0.000000    Distill Loss 0.009347                     LR 0.000500    Time 0.447007    
+2023-12-01 15:10:28,773 - Epoch: [12][ 5600/31148]    Overall Loss 0.009345    Objective Loss 0.000000    Distill Loss 0.009345                     LR 0.000500    Time 0.445033    
+2023-12-01 15:11:01,823 - Epoch: [12][ 5700/31148]    Overall Loss 0.009344    Objective Loss 0.000000    Distill Loss 0.009344                     LR 0.000500    Time 0.443023    
+2023-12-01 15:11:41,314 - Epoch: [12][ 5800/31148]    Overall Loss 0.009344    Objective Loss 0.000000    Distill Loss 0.009344                     LR 0.000500    Time 0.442192    
+2023-12-01 15:12:39,591 - Epoch: [12][ 5900/31148]    Overall Loss 0.009341    Objective Loss 0.000000    Distill Loss 0.009341                     LR 0.000500    Time 0.444574    
+2023-12-01 15:13:29,883 - Epoch: [12][ 6000/31148]    Overall Loss 0.009340    Objective Loss 0.000000    Distill Loss 0.009340                     LR 0.000500    Time 0.445545    
+2023-12-01 15:14:05,649 - Epoch: [12][ 6100/31148]    Overall Loss 0.009341    Objective Loss 0.000000    Distill Loss 0.009341                     LR 0.000500    Time 0.444103    
+2023-12-01 15:15:05,226 - Epoch: [12][ 6200/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.446548    
+2023-12-01 15:15:46,008 - Epoch: [12][ 6300/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.445932    
+2023-12-01 15:16:26,100 - Epoch: [12][ 6400/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.445227    
+2023-12-01 15:17:14,505 - Epoch: [12][ 6500/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.445823    
+2023-12-01 15:17:50,800 - Epoch: [12][ 6600/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.444566    
+2023-12-01 15:18:35,213 - Epoch: [12][ 6700/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.444559    
+2023-12-01 15:19:22,404 - Epoch: [12][ 6800/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.444960    
+2023-12-01 15:20:07,952 - Epoch: [12][ 6900/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.445111    
+2023-12-01 15:20:56,667 - Epoch: [12][ 7000/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.445711    
+2023-12-01 15:21:35,939 - Epoch: [12][ 7100/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.444963    
+2023-12-01 15:22:22,010 - Epoch: [12][ 7200/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.445181    
+2023-12-01 15:23:05,315 - Epoch: [12][ 7300/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.445014    
+2023-12-01 15:24:09,053 - Epoch: [12][ 7400/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.447612    
+2023-12-01 15:24:54,506 - Epoch: [12][ 7500/31148]    Overall Loss 0.009339    Objective Loss 0.000000    Distill Loss 0.009339                     LR 0.000500    Time 0.447703    
+2023-12-01 15:25:41,016 - Epoch: [12][ 7600/31148]    Overall Loss 0.009339    Objective Loss 0.000000    Distill Loss 0.009339                     LR 0.000500    Time 0.447931    
+2023-12-01 15:26:24,297 - Epoch: [12][ 7700/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.447734    
+2023-12-01 15:27:14,380 - Epoch: [12][ 7800/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.448414    
+2023-12-01 15:28:11,045 - Epoch: [12][ 7900/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.449909    
+2023-12-01 15:28:59,613 - Epoch: [12][ 8000/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.450356    
+2023-12-01 15:29:45,041 - Epoch: [12][ 8100/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.450403    
+2023-12-01 15:30:26,440 - Epoch: [12][ 8200/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.449958    
+2023-12-01 15:31:29,708 - Epoch: [12][ 8300/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.452159    
+2023-12-01 15:32:06,495 - Epoch: [12][ 8400/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.451154    
+2023-12-01 15:32:48,033 - Epoch: [12][ 8500/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.450733    
+2023-12-01 15:33:38,253 - Epoch: [12][ 8600/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.451330    
+2023-12-01 15:34:27,831 - Epoch: [12][ 8700/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.451840    
+2023-12-01 15:35:05,407 - Epoch: [12][ 8800/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.450975    
+2023-12-01 15:35:45,009 - Epoch: [12][ 8900/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.450357    
+2023-12-01 15:36:31,448 - Epoch: [12][ 9000/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.450512    
+2023-12-01 15:37:24,822 - Epoch: [12][ 9100/31148]    Overall Loss 0.009336    Objective Loss 0.000000    Distill Loss 0.009336                     LR 0.000500    Time 0.451425    
+2023-12-01 15:38:06,340 - Epoch: [12][ 9200/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.451031    
+2023-12-01 15:38:54,820 - Epoch: [12][ 9300/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.451393    
+2023-12-01 15:39:40,609 - Epoch: [12][ 9400/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.451461    
+2023-12-01 15:40:22,978 - Epoch: [12][ 9500/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.451168    
+2023-12-01 15:41:06,727 - Epoch: [12][ 9600/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.451025    
+2023-12-01 15:41:48,839 - Epoch: [12][ 9700/31148]    Overall Loss 0.009338    Objective Loss 0.000000    Distill Loss 0.009338                     LR 0.000500    Time 0.450716    
+2023-12-01 15:42:38,890 - Epoch: [12][ 9800/31148]    Overall Loss 0.009339    Objective Loss 0.000000    Distill Loss 0.009339                     LR 0.000500    Time 0.451223    
+2023-12-01 15:43:25,623 - Epoch: [12][ 9900/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.451385    
+2023-12-01 15:44:22,887 - Epoch: [12][10000/31148]    Overall Loss 0.009337    Objective Loss 0.000000    Distill Loss 0.009337                     LR 0.000500    Time 0.452597    
+2023-12-01 15:45:11,501 - Epoch: [12][10100/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.452928    
+2023-12-01 15:45:58,636 - Epoch: [12][10200/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.453108    
+2023-12-01 15:46:46,200 - Epoch: [12][10300/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.453326    
+2023-12-01 15:47:30,979 - Epoch: [12][10400/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.453272    
+2023-12-01 15:48:13,354 - Epoch: [12][10500/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.452990    
+2023-12-01 15:49:09,983 - Epoch: [12][10600/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.454058    
+2023-12-01 15:50:08,319 - Epoch: [12][10700/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.455266    
+2023-12-01 15:50:51,471 - Epoch: [12][10800/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.455045    
+2023-12-01 15:51:33,031 - Epoch: [12][10900/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.454683    
+2023-12-01 15:52:17,554 - Epoch: [12][11000/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.454596    
+2023-12-01 15:53:09,240 - Epoch: [12][11100/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455156    
+2023-12-01 15:53:49,672 - Epoch: [12][11200/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.454702    
+2023-12-01 15:54:43,039 - Epoch: [12][11300/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455400    
+2023-12-01 15:55:32,960 - Epoch: [12][11400/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.455784    
+2023-12-01 15:56:26,047 - Epoch: [12][11500/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456436    
+2023-12-01 15:57:17,377 - Epoch: [12][11600/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456926    
+2023-12-01 15:58:04,433 - Epoch: [12][11700/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457042    
+2023-12-01 15:58:40,578 - Epoch: [12][11800/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456231    
+2023-12-01 15:59:28,781 - Epoch: [12][11900/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456447    
+2023-12-01 16:00:27,983 - Epoch: [12][12000/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457576    
+2023-12-01 16:01:13,211 - Epoch: [12][12100/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457532    
+2023-12-01 16:01:57,919 - Epoch: [12][12200/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.457446    
+2023-12-01 16:02:44,491 - Epoch: [12][12300/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457512    
+2023-12-01 16:03:28,358 - Epoch: [12][12400/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457360    
+2023-12-01 16:04:14,013 - Epoch: [12][12500/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457353    
+2023-12-01 16:05:02,365 - Epoch: [12][12600/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457560    
+2023-12-01 16:05:38,190 - Epoch: [12][12700/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456777    
+2023-12-01 16:06:26,414 - Epoch: [12][12800/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456976    
+2023-12-01 16:07:07,375 - Epoch: [12][12900/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456608    
+2023-12-01 16:07:49,746 - Epoch: [12][13000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456354    
+2023-12-01 16:08:33,342 - Epoch: [12][13100/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456198    
+2023-12-01 16:09:21,427 - Epoch: [12][13200/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456384    
+2023-12-01 16:10:07,659 - Epoch: [12][13300/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456428    
+2023-12-01 16:10:49,209 - Epoch: [12][13400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456122    
+2023-12-01 16:11:38,743 - Epoch: [12][13500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456412    
+2023-12-01 16:12:29,435 - Epoch: [12][13600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456783    
+2023-12-01 16:13:08,081 - Epoch: [12][13700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456269    
+2023-12-01 16:13:46,894 - Epoch: [12][13800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455775    
+2023-12-01 16:14:27,704 - Epoch: [12][13900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455431    
+2023-12-01 16:15:15,877 - Epoch: [12][14000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455619    
+2023-12-01 16:16:11,476 - Epoch: [12][14100/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456330    
+2023-12-01 16:16:57,772 - Epoch: [12][14200/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456376    
+2023-12-01 16:17:45,749 - Epoch: [12][14300/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456539    
+2023-12-01 16:18:29,539 - Epoch: [12][14400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456409    
+2023-12-01 16:19:08,238 - Epoch: [12][14500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455930    
+2023-12-01 16:19:49,913 - Epoch: [12][14600/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.455661    
+2023-12-01 16:20:33,980 - Epoch: [12][14700/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455559    
+2023-12-01 16:21:18,949 - Epoch: [12][14800/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455519    
+2023-12-01 16:22:08,335 - Epoch: [12][14900/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455776    
+2023-12-01 16:23:06,477 - Epoch: [12][15000/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456613    
+2023-12-01 16:23:53,518 - Epoch: [12][15100/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.456704    
+2023-12-01 16:24:36,452 - Epoch: [12][15200/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456523    
+2023-12-01 16:25:27,603 - Epoch: [12][15300/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456881    
+2023-12-01 16:26:09,828 - Epoch: [12][15400/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456656    
+2023-12-01 16:26:50,003 - Epoch: [12][15500/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456301    
+2023-12-01 16:27:33,021 - Epoch: [12][15600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456133    
+2023-12-01 16:28:22,424 - Epoch: [12][15700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456374    
+2023-12-01 16:29:11,460 - Epoch: [12][15800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456589    
+2023-12-01 16:30:01,445 - Epoch: [12][15900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456861    
+2023-12-01 16:30:45,724 - Epoch: [12][16000/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456772    
+2023-12-01 16:31:27,691 - Epoch: [12][16100/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456541    
+2023-12-01 16:32:17,834 - Epoch: [12][16200/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456818    
+2023-12-01 16:33:00,960 - Epoch: [12][16300/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456661    
+2023-12-01 16:33:40,682 - Epoch: [12][16400/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456298    
+2023-12-01 16:34:33,784 - Epoch: [12][16500/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456750    
+2023-12-01 16:35:18,500 - Epoch: [12][16600/31148]    Overall Loss 0.009335    Objective Loss 0.000000    Distill Loss 0.009335                     LR 0.000500    Time 0.456692    
+2023-12-01 16:36:05,518 - Epoch: [12][16700/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456772    
+2023-12-01 16:36:50,781 - Epoch: [12][16800/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456747    
+2023-12-01 16:37:35,106 - Epoch: [12][16900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456667    
+2023-12-01 16:38:32,843 - Epoch: [12][17000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.457377    
+2023-12-01 16:39:04,803 - Epoch: [12][17100/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.456571    
+2023-12-01 16:39:54,004 - Epoch: [12][17200/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456776    
+2023-12-01 16:40:29,833 - Epoch: [12][17300/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456207    
+2023-12-01 16:41:19,537 - Epoch: [12][17400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456441    
+2023-12-01 16:42:14,946 - Epoch: [12][17500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456999    
+2023-12-01 16:43:07,017 - Epoch: [12][17600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.457360    
+2023-12-01 16:43:55,176 - Epoch: [12][17700/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457497    
+2023-12-01 16:44:35,418 - Epoch: [12][17800/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457187    
+2023-12-01 16:45:20,710 - Epoch: [12][17900/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457162    
+2023-12-01 16:46:11,717 - Epoch: [12][18000/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457456    
+2023-12-01 16:46:54,108 - Epoch: [12][18100/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457270    
+2023-12-01 16:47:36,436 - Epoch: [12][18200/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457083    
+2023-12-01 16:48:26,072 - Epoch: [12][18300/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457297    
+2023-12-01 16:49:13,233 - Epoch: [12][18400/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457375    
+2023-12-01 16:50:03,180 - Epoch: [12][18500/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457602    
+2023-12-01 16:50:42,882 - Epoch: [12][18600/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457276    
+2023-12-01 16:51:18,819 - Epoch: [12][18700/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456752    
+2023-12-01 16:52:05,970 - Epoch: [12][18800/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456830    
+2023-12-01 16:52:51,043 - Epoch: [12][18900/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456797    
+2023-12-01 16:53:39,074 - Epoch: [12][19000/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456921    
+2023-12-01 16:54:16,734 - Epoch: [12][19100/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456500    
+2023-12-01 16:55:01,796 - Epoch: [12][19200/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456469    
+2023-12-01 16:55:54,136 - Epoch: [12][19300/31148]    Overall Loss 0.009329    Objective Loss 0.000000    Distill Loss 0.009329                     LR 0.000500    Time 0.456815    
+2023-12-01 16:56:40,388 - Epoch: [12][19400/31148]    Overall Loss 0.009329    Objective Loss 0.000000    Distill Loss 0.009329                     LR 0.000500    Time 0.456844    
+2023-12-01 16:57:15,043 - Epoch: [12][19500/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456278    
+2023-12-01 16:58:07,452 - Epoch: [12][19600/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456624    
+2023-12-01 16:58:53,962 - Epoch: [12][19700/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456666    
+2023-12-01 16:59:46,171 - Epoch: [12][19800/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456997    
+2023-12-01 17:00:24,997 - Epoch: [12][19900/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456651    
+2023-12-01 17:01:07,641 - Epoch: [12][20000/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456499    
+2023-12-01 17:01:58,527 - Epoch: [12][20100/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456759    
+2023-12-01 17:02:57,262 - Epoch: [12][20200/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.457406    
+2023-12-01 17:03:36,119 - Epoch: [12][20300/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.457066    
+2023-12-01 17:04:14,603 - Epoch: [12][20400/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456712    
+2023-12-01 17:04:58,689 - Epoch: [12][20500/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456634    
+2023-12-01 17:05:49,171 - Epoch: [12][20600/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456868    
+2023-12-01 17:06:32,534 - Epoch: [12][20700/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456755    
+2023-12-01 17:07:12,083 - Epoch: [12][20800/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.456460    
+2023-12-01 17:07:55,030 - Epoch: [12][20900/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.456331    
+2023-12-01 17:08:33,062 - Epoch: [12][21000/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455968    
+2023-12-01 17:09:03,509 - Epoch: [12][21100/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.455250    
+2023-12-01 17:09:31,519 - Epoch: [12][21200/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.454424    
+2023-12-01 17:09:59,763 - Epoch: [12][21300/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.453616    
+2023-12-01 17:10:29,371 - Epoch: [12][21400/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.452880    
+2023-12-01 17:10:57,038 - Epoch: [12][21500/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.452060    
+2023-12-01 17:11:25,859 - Epoch: [12][21600/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.451301    
+2023-12-01 17:11:53,690 - Epoch: [12][21700/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.450504    
+2023-12-01 17:12:20,801 - Epoch: [12][21800/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.449681    
+2023-12-01 17:12:49,413 - Epoch: [12][21900/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.448933    
+2023-12-01 17:13:17,790 - Epoch: [12][22000/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.448183    
+2023-12-01 17:13:45,042 - Epoch: [12][22100/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.447387    
+2023-12-01 17:14:12,637 - Epoch: [12][22200/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.446615    
+2023-12-01 17:14:54,178 - Epoch: [12][22300/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.446475    
+2023-12-01 17:15:45,685 - Epoch: [12][22400/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.446781    
+2023-12-01 17:16:33,849 - Epoch: [12][22500/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.446935    
+2023-12-01 17:17:21,261 - Epoch: [12][22600/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.447055    
+2023-12-01 17:18:09,132 - Epoch: [12][22700/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.447194    
+2023-12-01 17:18:59,220 - Epoch: [12][22800/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.447429    
+2023-12-01 17:19:45,406 - Epoch: [12][22900/31148]    Overall Loss 0.009329    Objective Loss 0.000000    Distill Loss 0.009329                     LR 0.000500    Time 0.447492    
+2023-12-01 17:20:27,486 - Epoch: [12][23000/31148]    Overall Loss 0.009329    Objective Loss 0.000000    Distill Loss 0.009329                     LR 0.000500    Time 0.447376    
+2023-12-01 17:21:14,294 - Epoch: [12][23100/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.447465    
+2023-12-01 17:22:06,010 - Epoch: [12][23200/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.447765    
+2023-12-01 17:22:56,217 - Epoch: [12][23300/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.447998    
+2023-12-01 17:23:42,674 - Epoch: [12][23400/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.448068    
+2023-12-01 17:24:35,553 - Epoch: [12][23500/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.448412    
+2023-12-01 17:25:31,702 - Epoch: [12][23600/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.448890    
+2023-12-01 17:26:22,003 - Epoch: [12][23700/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.449118    
+2023-12-01 17:27:18,194 - Epoch: [12][23800/31148]    Overall Loss 0.009330    Objective Loss 0.000000    Distill Loss 0.009330                     LR 0.000500    Time 0.449592    
+2023-12-01 17:28:19,271 - Epoch: [12][23900/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.450266    
+2023-12-01 17:29:02,178 - Epoch: [12][24000/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.450177    
+2023-12-01 17:29:48,364 - Epoch: [12][24100/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.450226    
+2023-12-01 17:30:32,865 - Epoch: [12][24200/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.450204    
+2023-12-01 17:31:29,459 - Epoch: [12][24300/31148]    Overall Loss 0.009331    Objective Loss 0.000000    Distill Loss 0.009331                     LR 0.000500    Time 0.450680    
+2023-12-01 17:32:14,432 - Epoch: [12][24400/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.450675    
+2023-12-01 17:33:13,568 - Epoch: [12][24500/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.451249    
+2023-12-01 17:33:57,938 - Epoch: [12][24600/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.451218    
+2023-12-01 17:34:51,365 - Epoch: [12][24700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.451554    
+2023-12-01 17:35:44,261 - Epoch: [12][24800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.451866    
+2023-12-01 17:36:29,571 - Epoch: [12][24900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.451871    
+2023-12-01 17:37:23,991 - Epoch: [12][25000/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.452240    
+2023-12-01 17:38:18,057 - Epoch: [12][25100/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.452592    
+2023-12-01 17:39:13,221 - Epoch: [12][25200/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.452985    
+2023-12-01 17:39:59,771 - Epoch: [12][25300/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.453034    
+2023-12-01 17:40:50,283 - Epoch: [12][25400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.453239    
+2023-12-01 17:41:32,409 - Epoch: [12][25500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.453113    
+2023-12-01 17:42:25,130 - Epoch: [12][25600/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.453402    
+2023-12-01 17:43:08,565 - Epoch: [12][25700/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.453328    
+2023-12-01 17:43:51,997 - Epoch: [12][25800/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.453254    
+2023-12-01 17:44:53,183 - Epoch: [12][25900/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.453866    
+2023-12-01 17:45:37,938 - Epoch: [12][26000/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.453841    
+2023-12-01 17:46:36,639 - Epoch: [12][26100/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.454351    
+2023-12-01 17:47:25,613 - Epoch: [12][26200/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.454486    
+2023-12-01 17:48:18,523 - Epoch: [12][26300/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.454770    
+2023-12-01 17:49:05,084 - Epoch: [12][26400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.454810    
+2023-12-01 17:49:53,261 - Epoch: [12][26500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.454912    
+2023-12-01 17:50:40,440 - Epoch: [12][26600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.454975    
+2023-12-01 17:51:33,972 - Epoch: [12][26700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455276    
+2023-12-01 17:52:24,710 - Epoch: [12][26800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455470    
+2023-12-01 17:53:11,927 - Epoch: [12][26900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455532    
+2023-12-01 17:53:53,036 - Epoch: [12][27000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455367    
+2023-12-01 17:54:45,104 - Epoch: [12][27100/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455608    
+2023-12-01 17:55:26,086 - Epoch: [12][27200/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455439    
+2023-12-01 17:56:17,252 - Epoch: [12][27300/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455645    
+2023-12-01 17:57:08,710 - Epoch: [12][27400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.455860    
+2023-12-01 17:58:08,760 - Epoch: [12][27500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456385    
+2023-12-01 17:58:53,593 - Epoch: [12][27600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456356    
+2023-12-01 17:59:54,404 - Epoch: [12][27700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.456903    
+2023-12-01 18:00:49,007 - Epoch: [12][27800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.457224    
+2023-12-01 18:01:40,975 - Epoch: [12][27900/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457447    
+2023-12-01 18:02:27,358 - Epoch: [12][28000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.457470    
+2023-12-01 18:03:28,495 - Epoch: [12][28100/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.458017    
+2023-12-01 18:04:09,407 - Epoch: [12][28200/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.457844    
+2023-12-01 18:05:07,280 - Epoch: [12][28300/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.458271    
+2023-12-01 18:06:05,678 - Epoch: [12][28400/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.458713    
+2023-12-01 18:06:58,173 - Epoch: [12][28500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.458945    
+2023-12-01 18:07:52,004 - Epoch: [12][28600/31148]    Overall Loss 0.009332    Objective Loss 0.000000    Distill Loss 0.009332                     LR 0.000500    Time 0.459222    
+2023-12-01 18:08:44,180 - Epoch: [12][28700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.459440    
+2023-12-01 18:09:26,974 - Epoch: [12][28800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.459331    
+2023-12-01 18:10:13,853 - Epoch: [12][28900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.459363    
+2023-12-01 18:10:54,783 - Epoch: [12][29000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.459190    
+2023-12-01 18:11:51,647 - Epoch: [12][29100/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.459566    
+2023-12-01 18:12:44,183 - Epoch: [12][29200/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.459791    
+2023-12-01 18:13:41,627 - Epoch: [12][29300/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460182    
+2023-12-01 18:14:27,488 - Epoch: [12][29400/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460177    
+2023-12-01 18:15:21,987 - Epoch: [12][29500/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460464    
+2023-12-01 18:16:05,486 - Epoch: [12][29600/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460378    
+2023-12-01 18:16:46,411 - Epoch: [12][29700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460205    
+2023-12-01 18:17:27,648 - Epoch: [12][29800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460044    
+2023-12-01 18:18:21,020 - Epoch: [12][29900/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460291    
+2023-12-01 18:19:02,765 - Epoch: [12][30000/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460148    
+2023-12-01 18:19:54,275 - Epoch: [12][30100/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460330    
+2023-12-01 18:20:39,192 - Epoch: [12][30200/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460293    
+2023-12-01 18:21:28,817 - Epoch: [12][30300/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460411    
+2023-12-01 18:22:15,889 - Epoch: [12][30400/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460445    
+2023-12-01 18:22:52,828 - Epoch: [12][30500/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460146    
+2023-12-01 18:23:40,967 - Epoch: [12][30600/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460215    
+2023-12-01 18:24:29,371 - Epoch: [12][30700/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460293    
+2023-12-01 18:25:18,964 - Epoch: [12][30800/31148]    Overall Loss 0.009333    Objective Loss 0.000000    Distill Loss 0.009333                     LR 0.000500    Time 0.460408    
+2023-12-01 18:26:04,751 - Epoch: [12][30900/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460400    
+2023-12-01 18:26:43,769 - Epoch: [12][31000/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460173    
+2023-12-01 18:27:35,461 - Epoch: [12][31100/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460355    
+2023-12-01 18:27:57,346 - Epoch: [12][31148/31148]    Overall Loss 0.009334    Objective Loss 0.000000    Distill Loss 0.009334                     LR 0.000500    Time 0.460348    
+2023-12-01 18:27:58,304 - --- validate (epoch=12)-----------
+2023-12-01 18:27:58,305 - 167951 samples (100 per mini-batch)
+2023-12-01 18:28:21,408 - Epoch: [12][  100/ 1680]    Loss 0.000000    Overall Loss 0.009945    
+2023-12-01 18:28:41,401 - Epoch: [12][  200/ 1680]    Loss 0.000000    Overall Loss 0.009959    
+2023-12-01 18:29:01,356 - Epoch: [12][  300/ 1680]    Loss 0.000000    Overall Loss 0.009956    
+2023-12-01 18:29:23,852 - Epoch: [12][  400/ 1680]    Loss 0.000000    Overall Loss 0.009950    
+2023-12-01 18:29:46,195 - Epoch: [12][  500/ 1680]    Loss 0.000000    Overall Loss 0.009965    
+2023-12-01 18:30:06,197 - Epoch: [12][  600/ 1680]    Loss 0.000000    Overall Loss 0.009970    
+2023-12-01 18:30:26,116 - Epoch: [12][  700/ 1680]    Loss 0.000000    Overall Loss 0.009967    
+2023-12-01 18:30:46,168 - Epoch: [12][  800/ 1680]    Loss 0.000000    Overall Loss 0.009970    
+2023-12-01 18:31:06,096 - Epoch: [12][  900/ 1680]    Loss 0.000000    Overall Loss 0.009975    
+2023-12-01 18:31:26,074 - Epoch: [12][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009972    
+2023-12-01 18:31:46,090 - Epoch: [12][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009975    
+2023-12-01 18:32:06,135 - Epoch: [12][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009975    
+2023-12-01 18:32:26,072 - Epoch: [12][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009971    
+2023-12-01 18:32:46,024 - Epoch: [12][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009971    
+2023-12-01 18:33:05,933 - Epoch: [12][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009969    
+2023-12-01 18:33:25,897 - Epoch: [12][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009974    
+2023-12-01 18:33:41,802 - Epoch: [12][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009972    
+2023-12-01 18:33:42,283 - ==> Overall Loss: 0.010
+
+2023-12-01 18:33:42,293 - ==> Best [Overall Loss: 0.009972 on epoch: 12]
+2023-12-01 18:33:42,294 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-01 18:33:42,358 - 
+
+2023-12-01 18:33:42,358 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-01 18:34:42,550 - Epoch: [13][  100/31148]    Overall Loss 0.009266    Objective Loss 0.000000    Distill Loss 0.009266                     LR 0.000500    Time 0.601806    
+2023-12-01 18:35:31,461 - Epoch: [13][  200/31148]    Overall Loss 0.009217    Objective Loss 0.000000    Distill Loss 0.009217                     LR 0.000500    Time 0.545425    
+2023-12-01 18:36:15,970 - Epoch: [13][  300/31148]    Overall Loss 0.009238    Objective Loss 0.000000    Distill Loss 0.009238                     LR 0.000500    Time 0.511956    
+2023-12-01 18:37:02,471 - Epoch: [13][  400/31148]    Overall Loss 0.009241    Objective Loss 0.000000    Distill Loss 0.009241                     LR 0.000500    Time 0.500203    
+2023-12-01 18:37:53,573 - Epoch: [13][  500/31148]    Overall Loss 0.009234    Objective Loss 0.000000    Distill Loss 0.009234                     LR 0.000500    Time 0.502351    
+2023-12-01 18:38:34,520 - Epoch: [13][  600/31148]    Overall Loss 0.009235    Objective Loss 0.000000    Distill Loss 0.009235                     LR 0.000500    Time 0.486859    
+2023-12-01 18:39:19,937 - Epoch: [13][  700/31148]    Overall Loss 0.009254    Objective Loss 0.000000    Distill Loss 0.009254                     LR 0.000500    Time 0.482180    
+2023-12-01 18:40:07,189 - Epoch: [13][  800/31148]    Overall Loss 0.009266    Objective Loss 0.000000    Distill Loss 0.009266                     LR 0.000500    Time 0.480963    
+2023-12-01 18:40:46,901 - Epoch: [13][  900/31148]    Overall Loss 0.009260    Objective Loss 0.000000    Distill Loss 0.009260                     LR 0.000500    Time 0.471639    
+2023-12-01 18:41:30,604 - Epoch: [13][ 1000/31148]    Overall Loss 0.009264    Objective Loss 0.000000    Distill Loss 0.009264                     LR 0.000500    Time 0.468171    
+2023-12-01 18:42:11,137 - Epoch: [13][ 1100/31148]    Overall Loss 0.009266    Objective Loss 0.000000    Distill Loss 0.009266                     LR 0.000500    Time 0.462452    
+2023-12-01 18:43:00,562 - Epoch: [13][ 1200/31148]    Overall Loss 0.009262    Objective Loss 0.000000    Distill Loss 0.009262                     LR 0.000500    Time 0.465095    
+2023-12-01 18:43:44,207 - Epoch: [13][ 1300/31148]    Overall Loss 0.009256    Objective Loss 0.000000    Distill Loss 0.009256                     LR 0.000500    Time 0.462886    
+2023-12-01 18:44:33,191 - Epoch: [13][ 1400/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.464807    
+2023-12-01 18:45:26,082 - Epoch: [13][ 1500/31148]    Overall Loss 0.009263    Objective Loss 0.000000    Distill Loss 0.009263                     LR 0.000500    Time 0.469076    
+2023-12-01 18:46:12,999 - Epoch: [13][ 1600/31148]    Overall Loss 0.009268    Objective Loss 0.000000    Distill Loss 0.009268                     LR 0.000500    Time 0.469076    
+2023-12-01 18:47:00,188 - Epoch: [13][ 1700/31148]    Overall Loss 0.009269    Objective Loss 0.000000    Distill Loss 0.009269                     LR 0.000500    Time 0.469237    
+2023-12-01 18:47:36,383 - Epoch: [13][ 1800/31148]    Overall Loss 0.009273    Objective Loss 0.000000    Distill Loss 0.009273                     LR 0.000500    Time 0.463274    
+2023-12-01 18:48:16,759 - Epoch: [13][ 1900/31148]    Overall Loss 0.009272    Objective Loss 0.000000    Distill Loss 0.009272                     LR 0.000500    Time 0.460137    
+2023-12-01 18:49:09,743 - Epoch: [13][ 2000/31148]    Overall Loss 0.009270    Objective Loss 0.000000    Distill Loss 0.009270                     LR 0.000500    Time 0.463620    
+2023-12-01 18:49:52,812 - Epoch: [13][ 2100/31148]    Overall Loss 0.009276    Objective Loss 0.000000    Distill Loss 0.009276                     LR 0.000500    Time 0.462048    
+2023-12-01 18:50:28,540 - Epoch: [13][ 2200/31148]    Overall Loss 0.009275    Objective Loss 0.000000    Distill Loss 0.009275                     LR 0.000500    Time 0.457282    
+2023-12-01 18:51:13,384 - Epoch: [13][ 2300/31148]    Overall Loss 0.009285    Objective Loss 0.000000    Distill Loss 0.009285                     LR 0.000500    Time 0.456895    
+2023-12-01 18:51:58,700 - Epoch: [13][ 2400/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.456736    
+2023-12-01 18:52:40,696 - Epoch: [13][ 2500/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.455262    
+2023-12-01 18:53:33,871 - Epoch: [13][ 2600/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.458201    
+2023-12-01 18:54:16,144 - Epoch: [13][ 2700/31148]    Overall Loss 0.009302    Objective Loss 0.000000    Distill Loss 0.009302                     LR 0.000500    Time 0.456885    
+2023-12-01 18:55:11,030 - Epoch: [13][ 2800/31148]    Overall Loss 0.009298    Objective Loss 0.000000    Distill Loss 0.009298                     LR 0.000500    Time 0.460167    
+2023-12-01 18:55:54,167 - Epoch: [13][ 2900/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.459172    
+2023-12-01 18:56:46,256 - Epoch: [13][ 3000/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.461227    
+2023-12-01 18:57:34,462 - Epoch: [13][ 3100/31148]    Overall Loss 0.009298    Objective Loss 0.000000    Distill Loss 0.009298                     LR 0.000500    Time 0.461896    
+2023-12-01 18:58:13,980 - Epoch: [13][ 3200/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.459810    
+2023-12-01 18:58:56,553 - Epoch: [13][ 3300/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.458774    
+2023-12-01 18:59:36,975 - Epoch: [13][ 3400/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.457168    
+2023-12-01 19:00:21,415 - Epoch: [13][ 3500/31148]    Overall Loss 0.009298    Objective Loss 0.000000    Distill Loss 0.009298                     LR 0.000500    Time 0.456801    
+2023-12-01 19:01:05,318 - Epoch: [13][ 3600/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.456306    
+2023-12-01 19:01:56,752 - Epoch: [13][ 3700/31148]    Overall Loss 0.009302    Objective Loss 0.000000    Distill Loss 0.009302                     LR 0.000500    Time 0.457872    
+2023-12-01 19:02:40,103 - Epoch: [13][ 3800/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.457229    
+2023-12-01 19:03:27,004 - Epoch: [13][ 3900/31148]    Overall Loss 0.009301    Objective Loss 0.000000    Distill Loss 0.009301                     LR 0.000500    Time 0.457529    
+2023-12-01 19:04:18,624 - Epoch: [13][ 4000/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.458994    
+2023-12-01 19:04:57,718 - Epoch: [13][ 4100/31148]    Overall Loss 0.009298    Objective Loss 0.000000    Distill Loss 0.009298                     LR 0.000500    Time 0.457333    
+2023-12-01 19:05:51,908 - Epoch: [13][ 4200/31148]    Overall Loss 0.009298    Objective Loss 0.000000    Distill Loss 0.009298                     LR 0.000500    Time 0.459345    
+2023-12-01 19:06:32,675 - Epoch: [13][ 4300/31148]    Overall Loss 0.009301    Objective Loss 0.000000    Distill Loss 0.009301                     LR 0.000500    Time 0.458141    
+2023-12-01 19:07:21,039 - Epoch: [13][ 4400/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.458719    
+2023-12-01 19:07:59,488 - Epoch: [13][ 4500/31148]    Overall Loss 0.009301    Objective Loss 0.000000    Distill Loss 0.009301                     LR 0.000500    Time 0.457068    
+2023-12-01 19:08:48,131 - Epoch: [13][ 4600/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.457705    
+2023-12-01 19:09:25,990 - Epoch: [13][ 4700/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.456020    
+2023-12-01 19:10:15,956 - Epoch: [13][ 4800/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.456928    
+2023-12-01 19:10:55,897 - Epoch: [13][ 4900/31148]    Overall Loss 0.009299    Objective Loss 0.000000    Distill Loss 0.009299                     LR 0.000500    Time 0.455750    
+2023-12-01 19:11:43,550 - Epoch: [13][ 5000/31148]    Overall Loss 0.009301    Objective Loss 0.000000    Distill Loss 0.009301                     LR 0.000500    Time 0.456165    
+2023-12-01 19:12:26,344 - Epoch: [13][ 5100/31148]    Overall Loss 0.009301    Objective Loss 0.000000    Distill Loss 0.009301                     LR 0.000500    Time 0.455610    
+2023-12-01 19:13:13,855 - Epoch: [13][ 5200/31148]    Overall Loss 0.009302    Objective Loss 0.000000    Distill Loss 0.009302                     LR 0.000500    Time 0.455984    
+2023-12-01 19:13:58,134 - Epoch: [13][ 5300/31148]    Overall Loss 0.009302    Objective Loss 0.000000    Distill Loss 0.009302                     LR 0.000500    Time 0.455733    
+2023-12-01 19:14:49,069 - Epoch: [13][ 5400/31148]    Overall Loss 0.009303    Objective Loss 0.000000    Distill Loss 0.009303                     LR 0.000500    Time 0.456725    
+2023-12-01 19:15:38,912 - Epoch: [13][ 5500/31148]    Overall Loss 0.009304    Objective Loss 0.000000    Distill Loss 0.009304                     LR 0.000500    Time 0.457482    
+2023-12-01 19:16:23,506 - Epoch: [13][ 5600/31148]    Overall Loss 0.009304    Objective Loss 0.000000    Distill Loss 0.009304                     LR 0.000500    Time 0.457274    
+2023-12-01 19:17:09,755 - Epoch: [13][ 5700/31148]    Overall Loss 0.009304    Objective Loss 0.000000    Distill Loss 0.009304                     LR 0.000500    Time 0.457365    
+2023-12-01 19:17:56,105 - Epoch: [13][ 5800/31148]    Overall Loss 0.009303    Objective Loss 0.000000    Distill Loss 0.009303                     LR 0.000500    Time 0.457469    
+2023-12-01 19:18:47,537 - Epoch: [13][ 5900/31148]    Overall Loss 0.009301    Objective Loss 0.000000    Distill Loss 0.009301                     LR 0.000500    Time 0.458432    
+2023-12-01 19:19:23,769 - Epoch: [13][ 6000/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.456829    
+2023-12-01 19:20:11,074 - Epoch: [13][ 6100/31148]    Overall Loss 0.009300    Objective Loss 0.000000    Distill Loss 0.009300                     LR 0.000500    Time 0.457093    
+2023-12-01 19:20:56,436 - Epoch: [13][ 6200/31148]    Overall Loss 0.009297    Objective Loss 0.000000    Distill Loss 0.009297                     LR 0.000500    Time 0.457036    
+2023-12-01 19:21:35,787 - Epoch: [13][ 6300/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.456027    
+2023-12-01 19:22:16,626 - Epoch: [13][ 6400/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.455281    
+2023-12-01 19:23:02,955 - Epoch: [13][ 6500/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.455403    
+2023-12-01 19:23:50,699 - Epoch: [13][ 6600/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.455736    
+2023-12-01 19:24:28,628 - Epoch: [13][ 6700/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.454594    
+2023-12-01 19:25:12,197 - Epoch: [13][ 6800/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.454315    
+2023-12-01 19:26:02,537 - Epoch: [13][ 6900/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.455026    
+2023-12-01 19:26:49,429 - Epoch: [13][ 7000/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.455223    
+2023-12-01 19:27:34,607 - Epoch: [13][ 7100/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.455173    
+2023-12-01 19:28:17,694 - Epoch: [13][ 7200/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.454835    
+2023-12-01 19:28:57,910 - Epoch: [13][ 7300/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.454112    
+2023-12-01 19:29:42,018 - Epoch: [13][ 7400/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.453935    
+2023-12-01 19:30:24,993 - Epoch: [13][ 7500/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.453612    
+2023-12-01 19:31:12,587 - Epoch: [13][ 7600/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.453905    
+2023-12-01 19:31:53,203 - Epoch: [13][ 7700/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.453284    
+2023-12-01 19:32:39,234 - Epoch: [13][ 7800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.453373    
+2023-12-01 19:33:20,594 - Epoch: [13][ 7900/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.452869    
+2023-12-01 19:34:04,397 - Epoch: [13][ 8000/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452682    
+2023-12-01 19:34:57,569 - Epoch: [13][ 8100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.453657    
+2023-12-01 19:35:35,822 - Epoch: [13][ 8200/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.452789    
+2023-12-01 19:36:17,531 - Epoch: [13][ 8300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452358    
+2023-12-01 19:36:57,426 - Epoch: [13][ 8400/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451721    
+2023-12-01 19:37:48,135 - Epoch: [13][ 8500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452372    
+2023-12-01 19:38:40,325 - Epoch: [13][ 8600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.453179    
+2023-12-01 19:39:18,776 - Epoch: [13][ 8700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452389    
+2023-12-01 19:40:10,162 - Epoch: [13][ 8800/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.453087    
+2023-12-01 19:40:52,794 - Epoch: [13][ 8900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452786    
+2023-12-01 19:41:39,529 - Epoch: [13][ 9000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452947    
+2023-12-01 19:42:24,285 - Epoch: [13][ 9100/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.452887    
+2023-12-01 19:43:06,652 - Epoch: [13][ 9200/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.452568    
+2023-12-01 19:43:59,606 - Epoch: [13][ 9300/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.453395    
+2023-12-01 19:44:51,410 - Epoch: [13][ 9400/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.454082    
+2023-12-01 19:45:42,828 - Epoch: [13][ 9500/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.454714    
+2023-12-01 19:46:33,028 - Epoch: [13][ 9600/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.455206    
+2023-12-01 19:47:20,816 - Epoch: [13][ 9700/31148]    Overall Loss 0.009297    Objective Loss 0.000000    Distill Loss 0.009297                     LR 0.000500    Time 0.455439    
+2023-12-01 19:48:02,075 - Epoch: [13][ 9800/31148]    Overall Loss 0.009298    Objective Loss 0.000000    Distill Loss 0.009298                     LR 0.000500    Time 0.455001    
+2023-12-01 19:48:40,681 - Epoch: [13][ 9900/31148]    Overall Loss 0.009297    Objective Loss 0.000000    Distill Loss 0.009297                     LR 0.000500    Time 0.454304    
+2023-12-01 19:49:25,154 - Epoch: [13][10000/31148]    Overall Loss 0.009297    Objective Loss 0.000000    Distill Loss 0.009297                     LR 0.000500    Time 0.454207    
+2023-12-01 19:50:07,171 - Epoch: [13][10100/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.453870    
+2023-12-01 19:50:50,030 - Epoch: [13][10200/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.453621    
+2023-12-01 19:51:34,720 - Epoch: [13][10300/31148]    Overall Loss 0.009297    Objective Loss 0.000000    Distill Loss 0.009297                     LR 0.000500    Time 0.453555    
+2023-12-01 19:52:24,968 - Epoch: [13][10400/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.454025    
+2023-12-01 19:53:08,759 - Epoch: [13][10500/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.453871    
+2023-12-01 19:54:02,350 - Epoch: [13][10600/31148]    Overall Loss 0.009296    Objective Loss 0.000000    Distill Loss 0.009296                     LR 0.000500    Time 0.454644    
+2023-12-01 19:54:42,543 - Epoch: [13][10700/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.454151    
+2023-12-01 19:55:28,377 - Epoch: [13][10800/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.454189    
+2023-12-01 19:56:06,292 - Epoch: [13][10900/31148]    Overall Loss 0.009295    Objective Loss 0.000000    Distill Loss 0.009295                     LR 0.000500    Time 0.453499    
+2023-12-01 19:56:55,925 - Epoch: [13][11000/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.453888    
+2023-12-01 19:57:33,063 - Epoch: [13][11100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.453144    
+2023-12-01 19:58:09,822 - Epoch: [13][11200/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452380    
+2023-12-01 19:58:52,756 - Epoch: [13][11300/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452175    
+2023-12-01 19:59:37,865 - Epoch: [13][11400/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.452165    
+2023-12-01 20:00:32,893 - Epoch: [13][11500/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.453018    
+2023-12-01 20:01:14,244 - Epoch: [13][11600/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.452676    
+2023-12-01 20:02:03,116 - Epoch: [13][11700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452984    
+2023-12-01 20:02:43,652 - Epoch: [13][11800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452580    
+2023-12-01 20:03:27,462 - Epoch: [13][11900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452457    
+2023-12-01 20:04:09,363 - Epoch: [13][12000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452178    
+2023-12-01 20:04:49,578 - Epoch: [13][12100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451764    
+2023-12-01 20:05:33,089 - Epoch: [13][12200/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451627    
+2023-12-01 20:06:14,065 - Epoch: [13][12300/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451286    
+2023-12-01 20:06:54,575 - Epoch: [13][12400/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.450913    
+2023-12-01 20:07:41,991 - Epoch: [13][12500/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.451098    
+2023-12-01 20:08:17,140 - Epoch: [13][12600/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.450307    
+2023-12-01 20:09:00,642 - Epoch: [13][12700/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.450186    
+2023-12-01 20:09:57,064 - Epoch: [13][12800/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.451077    
+2023-12-01 20:10:42,108 - Epoch: [13][12900/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.451071    
+2023-12-01 20:11:27,910 - Epoch: [13][13000/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451124    
+2023-12-01 20:12:11,337 - Epoch: [13][13100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.450995    
+2023-12-01 20:12:56,997 - Epoch: [13][13200/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451037    
+2023-12-01 20:13:40,781 - Epoch: [13][13300/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.450937    
+2023-12-01 20:14:23,134 - Epoch: [13][13400/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.450732    
+2023-12-01 20:15:08,869 - Epoch: [13][13500/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.450781    
+2023-12-01 20:15:57,675 - Epoch: [13][13600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.451054    
+2023-12-01 20:16:39,656 - Epoch: [13][13700/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.450826    
+2023-12-01 20:17:34,256 - Epoch: [13][13800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.451515    
+2023-12-01 20:18:16,822 - Epoch: [13][13900/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451328    
+2023-12-01 20:19:15,290 - Epoch: [13][14000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452280    
+2023-12-01 20:20:10,230 - Epoch: [13][14100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452968    
+2023-12-01 20:20:54,731 - Epoch: [13][14200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452912    
+2023-12-01 20:21:43,831 - Epoch: [13][14300/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.453178    
+2023-12-01 20:22:30,372 - Epoch: [13][14400/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.453262    
+2023-12-01 20:23:13,795 - Epoch: [13][14500/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.453130    
+2023-12-01 20:23:58,115 - Epoch: [13][14600/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.453062    
+2023-12-01 20:24:41,440 - Epoch: [13][14700/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.452927    
+2023-12-01 20:25:26,451 - Epoch: [13][14800/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.452907    
+2023-12-01 20:26:12,369 - Epoch: [13][14900/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.452949    
+2023-12-01 20:26:57,763 - Epoch: [13][15000/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.452955    
+2023-12-01 20:27:41,812 - Epoch: [13][15100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452872    
+2023-12-01 20:28:23,812 - Epoch: [13][15200/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452655    
+2023-12-01 20:29:03,848 - Epoch: [13][15300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452313    
+2023-12-01 20:29:52,397 - Epoch: [13][15400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452528    
+2023-12-01 20:30:36,639 - Epoch: [13][15500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452462    
+2023-12-01 20:31:23,201 - Epoch: [13][15600/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452546    
+2023-12-01 20:32:13,130 - Epoch: [13][15700/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452844    
+2023-12-01 20:32:53,920 - Epoch: [13][15800/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452559    
+2023-12-01 20:33:36,185 - Epoch: [13][15900/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452370    
+2023-12-01 20:34:21,257 - Epoch: [13][16000/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452359    
+2023-12-01 20:35:02,963 - Epoch: [13][16100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.452140    
+2023-12-01 20:35:39,476 - Epoch: [13][16200/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.451602    
+2023-12-01 20:36:33,320 - Epoch: [13][16300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452135    
+2023-12-01 20:37:18,150 - Epoch: [13][16400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452111    
+2023-12-01 20:38:03,028 - Epoch: [13][16500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452090    
+2023-12-01 20:38:45,090 - Epoch: [13][16600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.451900    
+2023-12-01 20:39:34,306 - Epoch: [13][16700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452141    
+2023-12-01 20:40:19,872 - Epoch: [13][16800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.452161    
+2023-12-01 20:40:57,967 - Epoch: [13][16900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.451739    
+2023-12-01 20:41:36,455 - Epoch: [13][17000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.451346    
+2023-12-01 20:42:05,008 - Epoch: [13][17100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.450376    
+2023-12-01 20:42:34,050 - Epoch: [13][17200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449446    
+2023-12-01 20:43:02,432 - Epoch: [13][17300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448488    
+2023-12-01 20:43:31,568 - Epoch: [13][17400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.447585    
+2023-12-01 20:44:01,102 - Epoch: [13][17500/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.446714    
+2023-12-01 20:44:29,488 - Epoch: [13][17600/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445789    
+2023-12-01 20:44:57,249 - Epoch: [13][17700/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.444838    
+2023-12-01 20:45:25,571 - Epoch: [13][17800/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.443930    
+2023-12-01 20:45:53,568 - Epoch: [13][17900/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.443014    
+2023-12-01 20:46:20,742 - Epoch: [13][18000/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.442062    
+2023-12-01 20:46:49,278 - Epoch: [13][18100/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.441196    
+2023-12-01 20:47:28,012 - Epoch: [13][18200/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.440900    
+2023-12-01 20:48:28,692 - Epoch: [13][18300/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.441806    
+2023-12-01 20:49:12,501 - Epoch: [13][18400/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.441785    
+2023-12-01 20:49:55,162 - Epoch: [13][18500/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.441703    
+2023-12-01 20:50:52,331 - Epoch: [13][18600/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.442401    
+2023-12-01 20:51:43,361 - Epoch: [13][18700/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.442764    
+2023-12-01 20:52:39,097 - Epoch: [13][18800/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.443373    
+2023-12-01 20:53:18,924 - Epoch: [13][18900/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.443134    
+2023-12-01 20:54:19,862 - Epoch: [13][19000/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.444009    
+2023-12-01 20:55:04,113 - Epoch: [13][19100/31148]    Overall Loss 0.009289    Objective Loss 0.000000    Distill Loss 0.009289                     LR 0.000500    Time 0.444001    
+2023-12-01 20:55:50,084 - Epoch: [13][19200/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.444082    
+2023-12-01 20:56:40,553 - Epoch: [13][19300/31148]    Overall Loss 0.009289    Objective Loss 0.000000    Distill Loss 0.009289                     LR 0.000500    Time 0.444396    
+2023-12-01 20:57:36,851 - Epoch: [13][19400/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.445007    
+2023-12-01 20:58:26,263 - Epoch: [13][19500/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.445258    
+2023-12-01 20:59:04,620 - Epoch: [13][19600/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.444943    
+2023-12-01 21:00:00,211 - Epoch: [13][19700/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.445506    
+2023-12-01 21:00:49,439 - Epoch: [13][19800/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.445742    
+2023-12-01 21:01:34,558 - Epoch: [13][19900/31148]    Overall Loss 0.009290    Objective Loss 0.000000    Distill Loss 0.009290                     LR 0.000500    Time 0.445769    
+2023-12-01 21:02:14,110 - Epoch: [13][20000/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.445517    
+2023-12-01 21:02:50,408 - Epoch: [13][20100/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.445106    
+2023-12-01 21:03:35,339 - Epoch: [13][20200/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.445127    
+2023-12-01 21:04:24,970 - Epoch: [13][20300/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445378    
+2023-12-01 21:05:09,955 - Epoch: [13][20400/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445400    
+2023-12-01 21:05:48,706 - Epoch: [13][20500/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.445117    
+2023-12-01 21:06:32,277 - Epoch: [13][20600/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.445071    
+2023-12-01 21:07:11,029 - Epoch: [13][20700/31148]    Overall Loss 0.009291    Objective Loss 0.000000    Distill Loss 0.009291                     LR 0.000500    Time 0.444793    
+2023-12-01 21:07:53,124 - Epoch: [13][20800/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.444678    
+2023-12-01 21:08:39,525 - Epoch: [13][20900/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.444770    
+2023-12-01 21:09:25,115 - Epoch: [13][21000/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.444823    
+2023-12-01 21:10:06,636 - Epoch: [13][21100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.444682    
+2023-12-01 21:10:59,460 - Epoch: [13][21200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445076    
+2023-12-01 21:11:45,471 - Epoch: [13][21300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445146    
+2023-12-01 21:12:34,732 - Epoch: [13][21400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445367    
+2023-12-01 21:13:22,769 - Epoch: [13][21500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445530    
+2023-12-01 21:14:05,185 - Epoch: [13][21600/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445431    
+2023-12-01 21:14:46,749 - Epoch: [13][21700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445293    
+2023-12-01 21:15:29,883 - Epoch: [13][21800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445229    
+2023-12-01 21:16:15,852 - Epoch: [13][21900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445294    
+2023-12-01 21:17:00,601 - Epoch: [13][22000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445304    
+2023-12-01 21:17:47,813 - Epoch: [13][22100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445425    
+2023-12-01 21:18:39,025 - Epoch: [13][22200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445725    
+2023-12-01 21:19:21,688 - Epoch: [13][22300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445639    
+2023-12-01 21:20:07,822 - Epoch: [13][22400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445709    
+2023-12-01 21:20:45,624 - Epoch: [13][22500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.445408    
+2023-12-01 21:21:31,597 - Epoch: [13][22600/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445471    
+2023-12-01 21:22:27,832 - Epoch: [13][22700/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445985    
+2023-12-01 21:23:10,916 - Epoch: [13][22800/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.445919    
+2023-12-01 21:24:09,093 - Epoch: [13][22900/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.446512    
+2023-12-01 21:24:52,368 - Epoch: [13][23000/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.446452    
+2023-12-01 21:25:37,975 - Epoch: [13][23100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.446493    
+2023-12-01 21:26:22,356 - Epoch: [13][23200/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.446481    
+2023-12-01 21:27:03,025 - Epoch: [13][23300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.446310    
+2023-12-01 21:27:57,992 - Epoch: [13][23400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.446751    
+2023-12-01 21:28:38,340 - Epoch: [13][23500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.446567    
+2023-12-01 21:29:31,669 - Epoch: [13][23600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.446934    
+2023-12-01 21:30:11,514 - Epoch: [13][23700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.446729    
+2023-12-01 21:31:03,359 - Epoch: [13][23800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.447030    
+2023-12-01 21:31:45,029 - Epoch: [13][23900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.446903    
+2023-12-01 21:32:35,676 - Epoch: [13][24000/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.447151    
+2023-12-01 21:33:30,502 - Epoch: [13][24100/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.447570    
+2023-12-01 21:34:20,367 - Epoch: [13][24200/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.447781    
+2023-12-01 21:35:15,332 - Epoch: [13][24300/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.448200    
+2023-12-01 21:35:54,658 - Epoch: [13][24400/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.447974    
+2023-12-01 21:36:41,889 - Epoch: [13][24500/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.448073    
+2023-12-01 21:37:23,910 - Epoch: [13][24600/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.447960    
+2023-12-01 21:38:13,502 - Epoch: [13][24700/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.448154    
+2023-12-01 21:39:01,719 - Epoch: [13][24800/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.448291    
+2023-12-01 21:39:52,837 - Epoch: [13][24900/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.448543    
+2023-12-01 21:40:38,975 - Epoch: [13][25000/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.448594    
+2023-12-01 21:41:33,981 - Epoch: [13][25100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448998    
+2023-12-01 21:42:19,209 - Epoch: [13][25200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449011    
+2023-12-01 21:43:17,420 - Epoch: [13][25300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449537    
+2023-12-01 21:44:06,959 - Epoch: [13][25400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449717    
+2023-12-01 21:44:58,382 - Epoch: [13][25500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449969    
+2023-12-01 21:45:52,458 - Epoch: [13][25600/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.450324    
+2023-12-01 21:46:34,893 - Epoch: [13][25700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.450223    
+2023-12-01 21:47:10,846 - Epoch: [13][25800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449871    
+2023-12-01 21:47:52,899 - Epoch: [13][25900/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.449757    
+2023-12-01 21:48:38,523 - Epoch: [13][26000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449782    
+2023-12-01 21:49:24,768 - Epoch: [13][26100/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.449830    
+2023-12-01 21:50:07,508 - Epoch: [13][26200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449744    
+2023-12-01 21:50:51,670 - Epoch: [13][26300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449713    
+2023-12-01 21:51:35,845 - Epoch: [13][26400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449683    
+2023-12-01 21:52:22,768 - Epoch: [13][26500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449756    
+2023-12-01 21:53:11,317 - Epoch: [13][26600/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.449890    
+2023-12-01 21:53:47,041 - Epoch: [13][26700/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.449543    
+2023-12-01 21:54:32,910 - Epoch: [13][26800/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.449577    
+2023-12-01 21:55:14,402 - Epoch: [13][26900/31148]    Overall Loss 0.009294    Objective Loss 0.000000    Distill Loss 0.009294                     LR 0.000500    Time 0.449448    
+2023-12-01 21:56:02,882 - Epoch: [13][27000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449578    
+2023-12-01 21:56:40,309 - Epoch: [13][27100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449300    
+2023-12-01 21:57:19,993 - Epoch: [13][27200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449107    
+2023-12-01 21:58:03,345 - Epoch: [13][27300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449050    
+2023-12-01 21:58:53,173 - Epoch: [13][27400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449229    
+2023-12-01 21:59:38,674 - Epoch: [13][27500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449250    
+2023-12-01 22:00:24,567 - Epoch: [13][27600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449285    
+2023-12-01 22:01:00,097 - Epoch: [13][27700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448945    
+2023-12-01 22:01:40,376 - Epoch: [13][27800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448779    
+2023-12-01 22:02:26,350 - Epoch: [13][27900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448818    
+2023-12-01 22:03:10,781 - Epoch: [13][28000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448802    
+2023-12-01 22:04:00,831 - Epoch: [13][28100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448985    
+2023-12-01 22:04:47,836 - Epoch: [13][28200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449060    
+2023-12-01 22:05:32,827 - Epoch: [13][28300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449062    
+2023-12-01 22:06:20,777 - Epoch: [13][28400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449169    
+2023-12-01 22:07:03,837 - Epoch: [13][28500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449104    
+2023-12-01 22:07:42,752 - Epoch: [13][28600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448894    
+2023-12-01 22:08:29,835 - Epoch: [13][28700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448970    
+2023-12-01 22:09:09,599 - Epoch: [13][28800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448792    
+2023-12-01 22:09:52,044 - Epoch: [13][28900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448707    
+2023-12-01 22:10:34,806 - Epoch: [13][29000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448634    
+2023-12-01 22:11:22,716 - Epoch: [13][29100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448739    
+2023-12-01 22:12:08,522 - Epoch: [13][29200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448770    
+2023-12-01 22:12:55,848 - Epoch: [13][29300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448854    
+2023-12-01 22:13:38,462 - Epoch: [13][29400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448776    
+2023-12-01 22:14:26,994 - Epoch: [13][29500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.448900    
+2023-12-01 22:15:15,497 - Epoch: [13][29600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449022    
+2023-12-01 22:16:11,669 - Epoch: [13][29700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449401    
+2023-12-01 22:16:57,880 - Epoch: [13][29800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449443    
+2023-12-01 22:17:49,882 - Epoch: [13][29900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449679    
+2023-12-01 22:18:35,354 - Epoch: [13][30000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449696    
+2023-12-01 22:19:22,357 - Epoch: [13][30100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449763    
+2023-12-01 22:20:03,268 - Epoch: [13][30200/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449628    
+2023-12-01 22:20:47,930 - Epoch: [13][30300/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449618    
+2023-12-01 22:21:29,425 - Epoch: [13][30400/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449504    
+2023-12-01 22:22:18,944 - Epoch: [13][30500/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449653    
+2023-12-01 22:23:03,486 - Epoch: [13][30600/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449639    
+2023-12-01 22:23:57,871 - Epoch: [13][30700/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449946    
+2023-12-01 22:24:41,326 - Epoch: [13][30800/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.449896    
+2023-12-01 22:25:30,949 - Epoch: [13][30900/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.450045    
+2023-12-01 22:26:18,019 - Epoch: [13][31000/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.450112    
+2023-12-01 22:27:03,227 - Epoch: [13][31100/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.450118    
+2023-12-01 22:27:26,252 - Epoch: [13][31148/31148]    Overall Loss 0.009293    Objective Loss 0.000000    Distill Loss 0.009293                     LR 0.000500    Time 0.450163    
+2023-12-01 22:27:27,212 - --- validate (epoch=13)-----------
+2023-12-01 22:27:27,213 - 167951 samples (100 per mini-batch)
+2023-12-01 22:27:53,378 - Epoch: [13][  100/ 1680]    Loss 0.000000    Overall Loss 0.009929    
+2023-12-01 22:28:13,335 - Epoch: [13][  200/ 1680]    Loss 0.000000    Overall Loss 0.009941    
+2023-12-01 22:28:33,534 - Epoch: [13][  300/ 1680]    Loss 0.000000    Overall Loss 0.009935    
+2023-12-01 22:28:53,543 - Epoch: [13][  400/ 1680]    Loss 0.000000    Overall Loss 0.009934    
+2023-12-01 22:29:13,540 - Epoch: [13][  500/ 1680]    Loss 0.000000    Overall Loss 0.009917    
+2023-12-01 22:29:33,571 - Epoch: [13][  600/ 1680]    Loss 0.000000    Overall Loss 0.009910    
+2023-12-01 22:29:53,601 - Epoch: [13][  700/ 1680]    Loss 0.000000    Overall Loss 0.009902    
+2023-12-01 22:30:13,601 - Epoch: [13][  800/ 1680]    Loss 0.000000    Overall Loss 0.009895    
+2023-12-01 22:30:33,595 - Epoch: [13][  900/ 1680]    Loss 0.000000    Overall Loss 0.009904    
+2023-12-01 22:30:53,504 - Epoch: [13][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009911    
+2023-12-01 22:31:13,504 - Epoch: [13][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009912    
+2023-12-01 22:31:33,491 - Epoch: [13][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009910    
+2023-12-01 22:31:53,541 - Epoch: [13][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009912    
+2023-12-01 22:32:13,502 - Epoch: [13][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009914    
+2023-12-01 22:32:33,549 - Epoch: [13][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009917    
+2023-12-01 22:32:53,498 - Epoch: [13][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009919    
+2023-12-01 22:33:09,526 - Epoch: [13][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009918    
+2023-12-01 22:33:10,091 - ==> Overall Loss: 0.010
+
+2023-12-01 22:33:10,105 - ==> Best [Overall Loss: 0.009918 on epoch: 13]
+2023-12-01 22:33:10,105 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-01 22:33:10,186 - 
+
+2023-12-01 22:33:10,186 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-01 22:34:24,803 - Epoch: [14][  100/31148]    Overall Loss 0.009292    Objective Loss 0.000000    Distill Loss 0.009292                     LR 0.000500    Time 0.746055    
+2023-12-01 22:35:10,073 - Epoch: [14][  200/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.599349    
+2023-12-01 22:35:53,465 - Epoch: [14][  300/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.544179    
+2023-12-01 22:36:36,463 - Epoch: [14][  400/31148]    Overall Loss 0.009224    Objective Loss 0.000000    Distill Loss 0.009224                     LR 0.000500    Time 0.515609    
+2023-12-01 22:37:15,827 - Epoch: [14][  500/31148]    Overall Loss 0.009214    Objective Loss 0.000000    Distill Loss 0.009214                     LR 0.000500    Time 0.491201    
+2023-12-01 22:38:00,280 - Epoch: [14][  600/31148]    Overall Loss 0.009222    Objective Loss 0.000000    Distill Loss 0.009222                     LR 0.000500    Time 0.483411    
+2023-12-01 22:38:43,830 - Epoch: [14][  700/31148]    Overall Loss 0.009234    Objective Loss 0.000000    Distill Loss 0.009234                     LR 0.000500    Time 0.476555    
+2023-12-01 22:39:28,107 - Epoch: [14][  800/31148]    Overall Loss 0.009243    Objective Loss 0.000000    Distill Loss 0.009243                     LR 0.000500    Time 0.472322    
+2023-12-01 22:40:07,552 - Epoch: [14][  900/31148]    Overall Loss 0.009240    Objective Loss 0.000000    Distill Loss 0.009240                     LR 0.000500    Time 0.463662    
+2023-12-01 22:40:54,772 - Epoch: [14][ 1000/31148]    Overall Loss 0.009236    Objective Loss 0.000000    Distill Loss 0.009236                     LR 0.000500    Time 0.464509    
+2023-12-01 22:41:43,591 - Epoch: [14][ 1100/31148]    Overall Loss 0.009241    Objective Loss 0.000000    Distill Loss 0.009241                     LR 0.000500    Time 0.466655    
+2023-12-01 22:42:27,317 - Epoch: [14][ 1200/31148]    Overall Loss 0.009237    Objective Loss 0.000000    Distill Loss 0.009237                     LR 0.000500    Time 0.464200    
+2023-12-01 22:43:10,292 - Epoch: [14][ 1300/31148]    Overall Loss 0.009236    Objective Loss 0.000000    Distill Loss 0.009236                     LR 0.000500    Time 0.461544    
+2023-12-01 22:43:54,030 - Epoch: [14][ 1400/31148]    Overall Loss 0.009238    Objective Loss 0.000000    Distill Loss 0.009238                     LR 0.000500    Time 0.459813    
+2023-12-01 22:44:33,684 - Epoch: [14][ 1500/31148]    Overall Loss 0.009238    Objective Loss 0.000000    Distill Loss 0.009238                     LR 0.000500    Time 0.455590    
+2023-12-01 22:45:17,929 - Epoch: [14][ 1600/31148]    Overall Loss 0.009233    Objective Loss 0.000000    Distill Loss 0.009233                     LR 0.000500    Time 0.454764    
+2023-12-01 22:46:01,675 - Epoch: [14][ 1700/31148]    Overall Loss 0.009236    Objective Loss 0.000000    Distill Loss 0.009236                     LR 0.000500    Time 0.453741    
+2023-12-01 22:46:38,800 - Epoch: [14][ 1800/31148]    Overall Loss 0.009237    Objective Loss 0.000000    Distill Loss 0.009237                     LR 0.000500    Time 0.449155    
+2023-12-01 22:47:17,544 - Epoch: [14][ 1900/31148]    Overall Loss 0.009236    Objective Loss 0.000000    Distill Loss 0.009236                     LR 0.000500    Time 0.445903    
+2023-12-01 22:48:02,073 - Epoch: [14][ 2000/31148]    Overall Loss 0.009233    Objective Loss 0.000000    Distill Loss 0.009233                     LR 0.000500    Time 0.445869    
+2023-12-01 22:48:41,843 - Epoch: [14][ 2100/31148]    Overall Loss 0.009236    Objective Loss 0.000000    Distill Loss 0.009236                     LR 0.000500    Time 0.443571    
+2023-12-01 22:49:23,289 - Epoch: [14][ 2200/31148]    Overall Loss 0.009236    Objective Loss 0.000000    Distill Loss 0.009236                     LR 0.000500    Time 0.442245    
+2023-12-01 22:50:00,784 - Epoch: [14][ 2300/31148]    Overall Loss 0.009240    Objective Loss 0.000000    Distill Loss 0.009240                     LR 0.000500    Time 0.439316    
+2023-12-01 22:50:49,418 - Epoch: [14][ 2400/31148]    Overall Loss 0.009245    Objective Loss 0.000000    Distill Loss 0.009245                     LR 0.000500    Time 0.441272    
+2023-12-01 22:51:32,978 - Epoch: [14][ 2500/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.441043    
+2023-12-01 22:52:18,026 - Epoch: [14][ 2600/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.441403    
+2023-12-01 22:52:58,606 - Epoch: [14][ 2700/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.440081    
+2023-12-01 22:53:39,717 - Epoch: [14][ 2800/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.439044    
+2023-12-01 22:54:22,125 - Epoch: [14][ 2900/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.438525    
+2023-12-01 22:55:04,007 - Epoch: [14][ 3000/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437866    
+2023-12-01 22:55:53,761 - Epoch: [14][ 3100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.439788    
+2023-12-01 22:56:39,184 - Epoch: [14][ 3200/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.440237    
+2023-12-01 22:57:21,036 - Epoch: [14][ 3300/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.439577    
+2023-12-01 22:57:56,093 - Epoch: [14][ 3400/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.436957    
+2023-12-01 22:58:36,243 - Epoch: [14][ 3500/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.435941    
+2023-12-01 22:59:13,318 - Epoch: [14][ 3600/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.434128    
+2023-12-01 22:59:53,753 - Epoch: [14][ 3700/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.433322    
+2023-12-01 23:00:33,597 - Epoch: [14][ 3800/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.432402    
+2023-12-01 23:01:22,673 - Epoch: [14][ 3900/31148]    Overall Loss 0.009255    Objective Loss 0.000000    Distill Loss 0.009255                     LR 0.000500    Time 0.433896    
+2023-12-01 23:02:01,077 - Epoch: [14][ 4000/31148]    Overall Loss 0.009257    Objective Loss 0.000000    Distill Loss 0.009257                     LR 0.000500    Time 0.432648    
+2023-12-01 23:02:40,442 - Epoch: [14][ 4100/31148]    Overall Loss 0.009256    Objective Loss 0.000000    Distill Loss 0.009256                     LR 0.000500    Time 0.431695    
+2023-12-01 23:03:25,648 - Epoch: [14][ 4200/31148]    Overall Loss 0.009256    Objective Loss 0.000000    Distill Loss 0.009256                     LR 0.000500    Time 0.432178    
+2023-12-01 23:03:59,836 - Epoch: [14][ 4300/31148]    Overall Loss 0.009259    Objective Loss 0.000000    Distill Loss 0.009259                     LR 0.000500    Time 0.430077    
+2023-12-01 23:04:48,283 - Epoch: [14][ 4400/31148]    Overall Loss 0.009257    Objective Loss 0.000000    Distill Loss 0.009257                     LR 0.000500    Time 0.431312    
+2023-12-01 23:05:25,994 - Epoch: [14][ 4500/31148]    Overall Loss 0.009259    Objective Loss 0.000000    Distill Loss 0.009259                     LR 0.000500    Time 0.430105    
+2023-12-01 23:06:04,837 - Epoch: [14][ 4600/31148]    Overall Loss 0.009260    Objective Loss 0.000000    Distill Loss 0.009260                     LR 0.000500    Time 0.429198    
+2023-12-01 23:06:45,898 - Epoch: [14][ 4700/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.428801    
+2023-12-01 23:07:37,217 - Epoch: [14][ 4800/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.430557    
+2023-12-01 23:08:25,494 - Epoch: [14][ 4900/31148]    Overall Loss 0.009259    Objective Loss 0.000000    Distill Loss 0.009259                     LR 0.000500    Time 0.431621    
+2023-12-01 23:09:03,764 - Epoch: [14][ 5000/31148]    Overall Loss 0.009260    Objective Loss 0.000000    Distill Loss 0.009260                     LR 0.000500    Time 0.430642    
+2023-12-01 23:09:50,073 - Epoch: [14][ 5100/31148]    Overall Loss 0.009258    Objective Loss 0.000000    Distill Loss 0.009258                     LR 0.000500    Time 0.431277    
+2023-12-01 23:10:33,143 - Epoch: [14][ 5200/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.431264    
+2023-12-01 23:11:23,120 - Epoch: [14][ 5300/31148]    Overall Loss 0.009258    Objective Loss 0.000000    Distill Loss 0.009258                     LR 0.000500    Time 0.432555    
+2023-12-01 23:12:03,549 - Epoch: [14][ 5400/31148]    Overall Loss 0.009260    Objective Loss 0.000000    Distill Loss 0.009260                     LR 0.000500    Time 0.432031    
+2023-12-01 23:12:45,092 - Epoch: [14][ 5500/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.431727    
+2023-12-01 23:13:25,635 - Epoch: [14][ 5600/31148]    Overall Loss 0.009262    Objective Loss 0.000000    Distill Loss 0.009262                     LR 0.000500    Time 0.431257    
+2023-12-01 23:14:09,920 - Epoch: [14][ 5700/31148]    Overall Loss 0.009261    Objective Loss 0.000000    Distill Loss 0.009261                     LR 0.000500    Time 0.431459    
+2023-12-01 23:14:53,845 - Epoch: [14][ 5800/31148]    Overall Loss 0.009259    Objective Loss 0.000000    Distill Loss 0.009259                     LR 0.000500    Time 0.431592    
+2023-12-01 23:15:38,706 - Epoch: [14][ 5900/31148]    Overall Loss 0.009257    Objective Loss 0.000000    Distill Loss 0.009257                     LR 0.000500    Time 0.431879    
+2023-12-01 23:16:15,282 - Epoch: [14][ 6000/31148]    Overall Loss 0.009255    Objective Loss 0.000000    Distill Loss 0.009255                     LR 0.000500    Time 0.430776    
+2023-12-01 23:17:02,979 - Epoch: [14][ 6100/31148]    Overall Loss 0.009255    Objective Loss 0.000000    Distill Loss 0.009255                     LR 0.000500    Time 0.431532    
+2023-12-01 23:17:52,026 - Epoch: [14][ 6200/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.432481    
+2023-12-01 23:18:32,113 - Epoch: [14][ 6300/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.431978    
+2023-12-01 23:19:11,395 - Epoch: [14][ 6400/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.431365    
+2023-12-01 23:19:55,799 - Epoch: [14][ 6500/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.431559    
+2023-12-01 23:20:35,732 - Epoch: [14][ 6600/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.431070    
+2023-12-01 23:21:14,262 - Epoch: [14][ 6700/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.430386    
+2023-12-01 23:21:56,270 - Epoch: [14][ 6800/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.430233    
+2023-12-01 23:22:41,466 - Epoch: [14][ 6900/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.430547    
+2023-12-01 23:23:31,245 - Epoch: [14][ 7000/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.431506    
+2023-12-01 23:24:15,602 - Epoch: [14][ 7100/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.431675    
+2023-12-01 23:24:55,002 - Epoch: [14][ 7200/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.431151    
+2023-12-01 23:25:42,115 - Epoch: [14][ 7300/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.431697    
+2023-12-01 23:26:25,429 - Epoch: [14][ 7400/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.431716    
+2023-12-01 23:27:06,414 - Epoch: [14][ 7500/31148]    Overall Loss 0.009254    Objective Loss 0.000000    Distill Loss 0.009254                     LR 0.000500    Time 0.431423    
+2023-12-01 23:27:54,047 - Epoch: [14][ 7600/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.432013    
+2023-12-01 23:28:40,736 - Epoch: [14][ 7700/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.432465    
+2023-12-01 23:29:28,671 - Epoch: [14][ 7800/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.433065    
+2023-12-01 23:30:14,752 - Epoch: [14][ 7900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.433416    
+2023-12-01 23:31:03,399 - Epoch: [14][ 8000/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.434078    
+2023-12-01 23:31:58,612 - Epoch: [14][ 8100/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.435535    
+2023-12-01 23:32:37,055 - Epoch: [14][ 8200/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.434910    
+2023-12-01 23:33:17,070 - Epoch: [14][ 8300/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.434491    
+2023-12-01 23:34:03,251 - Epoch: [14][ 8400/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.434815    
+2023-12-01 23:34:46,026 - Epoch: [14][ 8500/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.434731    
+2023-12-01 23:35:25,803 - Epoch: [14][ 8600/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.434301    
+2023-12-01 23:36:09,520 - Epoch: [14][ 8700/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.434333    
+2023-12-01 23:36:52,789 - Epoch: [14][ 8800/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.434313    
+2023-12-01 23:37:29,634 - Epoch: [14][ 8900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.433572    
+2023-12-01 23:38:11,080 - Epoch: [14][ 9000/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.433359    
+2023-12-01 23:38:58,068 - Epoch: [14][ 9100/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.433760    
+2023-12-01 23:39:42,841 - Epoch: [14][ 9200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.433911    
+2023-12-01 23:40:36,151 - Epoch: [14][ 9300/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.434977    
+2023-12-01 23:41:27,381 - Epoch: [14][ 9400/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.435798    
+2023-12-01 23:42:05,761 - Epoch: [14][ 9500/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.435250    
+2023-12-01 23:43:00,545 - Epoch: [14][ 9600/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.436422    
+2023-12-01 23:43:43,801 - Epoch: [14][ 9700/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.436382    
+2023-12-01 23:44:23,504 - Epoch: [14][ 9800/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.435980    
+2023-12-01 23:45:10,749 - Epoch: [14][ 9900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.436347    
+2023-12-01 23:45:59,787 - Epoch: [14][10000/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.436887    
+2023-12-01 23:46:49,952 - Epoch: [14][10100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.437527    
+2023-12-01 23:47:31,869 - Epoch: [14][10200/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437347    
+2023-12-01 23:48:13,546 - Epoch: [14][10300/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437146    
+2023-12-01 23:48:55,830 - Epoch: [14][10400/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.437008    
+2023-12-01 23:49:34,913 - Epoch: [14][10500/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.436568    
+2023-12-01 23:50:20,859 - Epoch: [14][10600/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.436783    
+2023-12-01 23:51:09,255 - Epoch: [14][10700/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437223    
+2023-12-01 23:51:50,137 - Epoch: [14][10800/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.436959    
+2023-12-01 23:52:39,223 - Epoch: [14][10900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437453    
+2023-12-01 23:53:15,477 - Epoch: [14][11000/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.436772    
+2023-12-01 23:54:06,595 - Epoch: [14][11100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.437441    
+2023-12-01 23:54:54,866 - Epoch: [14][11200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.437845    
+2023-12-01 23:55:34,822 - Epoch: [14][11300/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437505    
+2023-12-01 23:56:18,646 - Epoch: [14][11400/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.437511    
+2023-12-01 23:56:58,528 - Epoch: [14][11500/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.437174    
+2023-12-01 23:57:40,715 - Epoch: [14][11600/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.437042    
+2023-12-01 23:58:20,284 - Epoch: [14][11700/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.436688    
+2023-12-01 23:59:03,982 - Epoch: [14][11800/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.436690    
+2023-12-01 23:59:48,549 - Epoch: [14][11900/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.436764    
+2023-12-02 00:00:41,528 - Epoch: [14][12000/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.437539    
+2023-12-02 00:01:26,056 - Epoch: [14][12100/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437602    
+2023-12-02 00:02:11,988 - Epoch: [14][12200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.437780    
+2023-12-02 00:02:57,733 - Epoch: [14][12300/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437939    
+2023-12-02 00:03:41,960 - Epoch: [14][12400/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.437973    
+2023-12-02 00:04:21,078 - Epoch: [14][12500/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.437599    
+2023-12-02 00:05:16,477 - Epoch: [14][12600/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.438522    
+2023-12-02 00:06:13,076 - Epoch: [14][12700/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.439525    
+2023-12-02 00:06:52,079 - Epoch: [14][12800/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.439138    
+2023-12-02 00:07:33,619 - Epoch: [14][12900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.438953    
+2023-12-02 00:08:13,131 - Epoch: [14][13000/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.438615    
+2023-12-02 00:08:52,225 - Epoch: [14][13100/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438251    
+2023-12-02 00:09:34,107 - Epoch: [14][13200/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438103    
+2023-12-02 00:10:21,179 - Epoch: [14][13300/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438348    
+2023-12-02 00:10:57,766 - Epoch: [14][13400/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.437807    
+2023-12-02 00:11:46,643 - Epoch: [14][13500/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438184    
+2023-12-02 00:12:28,914 - Epoch: [14][13600/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438069    
+2023-12-02 00:13:14,104 - Epoch: [14][13700/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438170    
+2023-12-02 00:14:03,087 - Epoch: [14][13800/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.438543    
+2023-12-02 00:14:36,210 - Epoch: [14][13900/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.437771    
+2023-12-02 00:15:08,967 - Epoch: [14][14000/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.436983    
+2023-12-02 00:15:35,955 - Epoch: [14][14100/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.435798    
+2023-12-02 00:16:03,084 - Epoch: [14][14200/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.434639    
+2023-12-02 00:16:32,016 - Epoch: [14][14300/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.433623    
+2023-12-02 00:17:01,139 - Epoch: [14][14400/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.432634    
+2023-12-02 00:17:30,079 - Epoch: [14][14500/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.431645    
+2023-12-02 00:17:59,248 - Epoch: [14][14600/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.430686    
+2023-12-02 00:18:28,590 - Epoch: [14][14700/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.429752    
+2023-12-02 00:18:56,427 - Epoch: [14][14800/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.428729    
+2023-12-02 00:19:23,810 - Epoch: [14][14900/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.427689    
+2023-12-02 00:19:50,858 - Epoch: [14][15000/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.426641    
+2023-12-02 00:20:23,323 - Epoch: [14][15100/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.425965    
+2023-12-02 00:21:11,968 - Epoch: [14][15200/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.426363    
+2023-12-02 00:21:54,876 - Epoch: [14][15300/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.426380    
+2023-12-02 00:22:33,599 - Epoch: [14][15400/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.426125    
+2023-12-02 00:23:22,093 - Epoch: [14][15500/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.426504    
+2023-12-02 00:24:13,025 - Epoch: [14][15600/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.427034    
+2023-12-02 00:25:05,344 - Epoch: [14][15700/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.427646    
+2023-12-02 00:25:43,436 - Epoch: [14][15800/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.427350    
+2023-12-02 00:26:38,288 - Epoch: [14][15900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.428112    
+2023-12-02 00:27:36,109 - Epoch: [14][16000/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.429050    
+2023-12-02 00:28:26,022 - Epoch: [14][16100/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.429484    
+2023-12-02 00:29:19,648 - Epoch: [14][16200/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.430143    
+2023-12-02 00:30:05,684 - Epoch: [14][16300/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.430328    
+2023-12-02 00:30:55,150 - Epoch: [14][16400/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.430720    
+2023-12-02 00:31:39,609 - Epoch: [14][16500/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.430803    
+2023-12-02 00:32:24,619 - Epoch: [14][16600/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.430919    
+2023-12-02 00:33:08,495 - Epoch: [14][16700/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.430966    
+2023-12-02 00:34:00,220 - Epoch: [14][16800/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.431479    
+2023-12-02 00:34:44,340 - Epoch: [14][16900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.431536    
+2023-12-02 00:35:36,855 - Epoch: [14][17000/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.432086    
+2023-12-02 00:36:21,097 - Epoch: [14][17100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.432146    
+2023-12-02 00:37:14,674 - Epoch: [14][17200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.432748    
+2023-12-02 00:38:06,121 - Epoch: [14][17300/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.433220    
+2023-12-02 00:38:57,777 - Epoch: [14][17400/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.433699    
+2023-12-02 00:39:43,147 - Epoch: [14][17500/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.433812    
+2023-12-02 00:40:32,276 - Epoch: [14][17600/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.434139    
+2023-12-02 00:41:12,226 - Epoch: [14][17700/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.433943    
+2023-12-02 00:41:56,724 - Epoch: [14][17800/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.434004    
+2023-12-02 00:42:42,186 - Epoch: [14][17900/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.434119    
+2023-12-02 00:43:15,700 - Epoch: [14][18000/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.433569    
+2023-12-02 00:44:01,727 - Epoch: [14][18100/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.433716    
+2023-12-02 00:45:00,237 - Epoch: [14][18200/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.434547    
+2023-12-02 00:45:56,946 - Epoch: [14][18300/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.435271    
+2023-12-02 00:46:53,412 - Epoch: [14][18400/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.435974    
+2023-12-02 00:47:49,281 - Epoch: [14][18500/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436637    
+2023-12-02 00:48:23,543 - Epoch: [14][18600/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436131    
+2023-12-02 00:49:09,990 - Epoch: [14][18700/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436282    
+2023-12-02 00:49:49,919 - Epoch: [14][18800/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436085    
+2023-12-02 00:50:32,062 - Epoch: [14][18900/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.436007    
+2023-12-02 00:51:25,747 - Epoch: [14][19000/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436537    
+2023-12-02 00:52:08,032 - Epoch: [14][19100/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436465    
+2023-12-02 00:52:52,616 - Epoch: [14][19200/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436514    
+2023-12-02 00:53:37,495 - Epoch: [14][19300/31148]    Overall Loss 0.009245    Objective Loss 0.000000    Distill Loss 0.009245                     LR 0.000500    Time 0.436577    
+2023-12-02 00:54:21,585 - Epoch: [14][19400/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436599    
+2023-12-02 00:55:05,811 - Epoch: [14][19500/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.436628    
+2023-12-02 00:56:03,132 - Epoch: [14][19600/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.437324    
+2023-12-02 00:56:45,550 - Epoch: [14][19700/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.437257    
+2023-12-02 00:57:45,268 - Epoch: [14][19800/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.438064    
+2023-12-02 00:58:45,194 - Epoch: [14][19900/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.438874    
+2023-12-02 00:59:34,541 - Epoch: [14][20000/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.439147    
+2023-12-02 01:00:11,513 - Epoch: [14][20100/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.438801    
+2023-12-02 01:01:07,512 - Epoch: [14][20200/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.439400    
+2023-12-02 01:01:58,063 - Epoch: [14][20300/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.439726    
+2023-12-02 01:02:59,465 - Epoch: [14][20400/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.440580    
+2023-12-02 01:03:48,343 - Epoch: [14][20500/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.440814    
+2023-12-02 01:04:55,583 - Epoch: [14][20600/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.441938    
+2023-12-02 01:05:58,212 - Epoch: [14][20700/31148]    Overall Loss 0.009246    Objective Loss 0.000000    Distill Loss 0.009246                     LR 0.000500    Time 0.442829    
+2023-12-02 01:06:47,316 - Epoch: [14][20800/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.443060    
+2023-12-02 01:07:47,618 - Epoch: [14][20900/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.443825    
+2023-12-02 01:08:37,761 - Epoch: [14][21000/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.444099    
+2023-12-02 01:09:25,748 - Epoch: [14][21100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.444268    
+2023-12-02 01:10:18,909 - Epoch: [14][21200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.444680    
+2023-12-02 01:11:05,519 - Epoch: [14][21300/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.444780    
+2023-12-02 01:11:52,579 - Epoch: [14][21400/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.444901    
+2023-12-02 01:12:53,173 - Epoch: [14][21500/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.445649    
+2023-12-02 01:13:36,796 - Epoch: [14][21600/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.445605    
+2023-12-02 01:14:26,621 - Epoch: [14][21700/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.445848    
+2023-12-02 01:15:04,526 - Epoch: [14][21800/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.445541    
+2023-12-02 01:15:57,193 - Epoch: [14][21900/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.445911    
+2023-12-02 01:16:44,129 - Epoch: [14][22000/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446017    
+2023-12-02 01:17:30,067 - Epoch: [14][22100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446078    
+2023-12-02 01:18:14,626 - Epoch: [14][22200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446075    
+2023-12-02 01:19:04,576 - Epoch: [14][22300/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446314    
+2023-12-02 01:19:50,830 - Epoch: [14][22400/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446386    
+2023-12-02 01:20:38,063 - Epoch: [14][22500/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446502    
+2023-12-02 01:21:24,618 - Epoch: [14][22600/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446585    
+2023-12-02 01:22:08,013 - Epoch: [14][22700/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446530    
+2023-12-02 01:22:50,647 - Epoch: [14][22800/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446441    
+2023-12-02 01:23:38,967 - Epoch: [14][22900/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446601    
+2023-12-02 01:24:25,149 - Epoch: [14][23000/31148]    Overall Loss 0.009247    Objective Loss 0.000000    Distill Loss 0.009247                     LR 0.000500    Time 0.446667    
+2023-12-02 01:25:17,063 - Epoch: [14][23100/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446980    
+2023-12-02 01:25:58,209 - Epoch: [14][23200/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446827    
+2023-12-02 01:26:46,183 - Epoch: [14][23300/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446968    
+2023-12-02 01:27:31,501 - Epoch: [14][23400/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.446994    
+2023-12-02 01:28:33,275 - Epoch: [14][23500/31148]    Overall Loss 0.009248    Objective Loss 0.000000    Distill Loss 0.009248                     LR 0.000500    Time 0.447720    
+2023-12-02 01:29:11,653 - Epoch: [14][23600/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.447449    
+2023-12-02 01:30:00,249 - Epoch: [14][23700/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.447611    
+2023-12-02 01:30:59,276 - Epoch: [14][23800/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.448210    
+2023-12-02 01:31:41,977 - Epoch: [14][23900/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.448121    
+2023-12-02 01:32:20,996 - Epoch: [14][24000/31148]    Overall Loss 0.009249    Objective Loss 0.000000    Distill Loss 0.009249                     LR 0.000500    Time 0.447880    
+2023-12-02 01:33:01,725 - Epoch: [14][24100/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.447711    
+2023-12-02 01:33:57,725 - Epoch: [14][24200/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448175    
+2023-12-02 01:34:40,633 - Epoch: [14][24300/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448096    
+2023-12-02 01:35:16,839 - Epoch: [14][24400/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.447743    
+2023-12-02 01:36:05,485 - Epoch: [14][24500/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.447901    
+2023-12-02 01:37:05,882 - Epoch: [14][24600/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448535    
+2023-12-02 01:37:43,955 - Epoch: [14][24700/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.448260    
+2023-12-02 01:38:30,609 - Epoch: [14][24800/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.448334    
+2023-12-02 01:39:19,204 - Epoch: [14][24900/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.448484    
+2023-12-02 01:40:05,241 - Epoch: [14][25000/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448532    
+2023-12-02 01:40:54,410 - Epoch: [14][25100/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448703    
+2023-12-02 01:41:39,290 - Epoch: [14][25200/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448703    
+2023-12-02 01:42:34,444 - Epoch: [14][25300/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.449110    
+2023-12-02 01:43:12,217 - Epoch: [14][25400/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448828    
+2023-12-02 01:43:55,722 - Epoch: [14][25500/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.448774    
+2023-12-02 01:44:47,922 - Epoch: [14][25600/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.449060    
+2023-12-02 01:45:37,895 - Epoch: [14][25700/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.449257    
+2023-12-02 01:46:20,073 - Epoch: [14][25800/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.449150    
+2023-12-02 01:47:01,089 - Epoch: [14][25900/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.448999    
+2023-12-02 01:47:47,108 - Epoch: [14][26000/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.449042    
+2023-12-02 01:48:32,295 - Epoch: [14][26100/31148]    Overall Loss 0.009250    Objective Loss 0.000000    Distill Loss 0.009250                     LR 0.000500    Time 0.449053    
+2023-12-02 01:49:20,814 - Epoch: [14][26200/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449190    
+2023-12-02 01:50:11,833 - Epoch: [14][26300/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449422    
+2023-12-02 01:50:56,567 - Epoch: [14][26400/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449414    
+2023-12-02 01:51:42,586 - Epoch: [14][26500/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449454    
+2023-12-02 01:52:26,744 - Epoch: [14][26600/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449424    
+2023-12-02 01:53:21,915 - Epoch: [14][26700/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449807    
+2023-12-02 01:54:03,126 - Epoch: [14][26800/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449666    
+2023-12-02 01:54:47,183 - Epoch: [14][26900/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449632    
+2023-12-02 01:55:29,732 - Epoch: [14][27000/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449542    
+2023-12-02 01:56:13,008 - Epoch: [14][27100/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449480    
+2023-12-02 01:56:59,673 - Epoch: [14][27200/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449543    
+2023-12-02 01:57:48,320 - Epoch: [14][27300/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449678    
+2023-12-02 01:58:28,744 - Epoch: [14][27400/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449512    
+2023-12-02 01:59:08,928 - Epoch: [14][27500/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449338    
+2023-12-02 01:59:56,081 - Epoch: [14][27600/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449419    
+2023-12-02 02:00:36,434 - Epoch: [14][27700/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449253    
+2023-12-02 02:01:20,143 - Epoch: [14][27800/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449209    
+2023-12-02 02:02:09,185 - Epoch: [14][27900/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.449356    
+2023-12-02 02:02:54,929 - Epoch: [14][28000/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449385    
+2023-12-02 02:03:37,137 - Epoch: [14][28100/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449287    
+2023-12-02 02:04:25,854 - Epoch: [14][28200/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449422    
+2023-12-02 02:05:05,877 - Epoch: [14][28300/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449247    
+2023-12-02 02:05:58,222 - Epoch: [14][28400/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449508    
+2023-12-02 02:06:40,504 - Epoch: [14][28500/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449415    
+2023-12-02 02:07:28,726 - Epoch: [14][28600/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449529    
+2023-12-02 02:08:14,676 - Epoch: [14][28700/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449564    
+2023-12-02 02:09:01,394 - Epoch: [14][28800/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449625    
+2023-12-02 02:09:47,231 - Epoch: [14][28900/31148]    Overall Loss 0.009251    Objective Loss 0.000000    Distill Loss 0.009251                     LR 0.000500    Time 0.449655    
+2023-12-02 02:10:45,707 - Epoch: [14][29000/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450120    
+2023-12-02 02:11:34,486 - Epoch: [14][29100/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450249    
+2023-12-02 02:12:18,315 - Epoch: [14][29200/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450208    
+2023-12-02 02:13:03,177 - Epoch: [14][29300/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450203    
+2023-12-02 02:13:48,280 - Epoch: [14][29400/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450205    
+2023-12-02 02:14:39,266 - Epoch: [14][29500/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450407    
+2023-12-02 02:15:26,482 - Epoch: [14][29600/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450480    
+2023-12-02 02:16:11,125 - Epoch: [14][29700/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450466    
+2023-12-02 02:16:53,289 - Epoch: [14][29800/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450370    
+2023-12-02 02:17:40,491 - Epoch: [14][29900/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450442    
+2023-12-02 02:18:32,875 - Epoch: [14][30000/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450686    
+2023-12-02 02:19:16,147 - Epoch: [14][30100/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.450626    
+2023-12-02 02:20:12,552 - Epoch: [14][30200/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.451002    
+2023-12-02 02:20:57,828 - Epoch: [14][30300/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.451007    
+2023-12-02 02:21:38,213 - Epoch: [14][30400/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.450852    
+2023-12-02 02:22:26,837 - Epoch: [14][30500/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.450968    
+2023-12-02 02:23:24,544 - Epoch: [14][30600/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.451379    
+2023-12-02 02:24:03,062 - Epoch: [14][30700/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.451164    
+2023-12-02 02:24:52,966 - Epoch: [14][30800/31148]    Overall Loss 0.009252    Objective Loss 0.000000    Distill Loss 0.009252                     LR 0.000500    Time 0.451319    
+2023-12-02 02:25:36,787 - Epoch: [14][30900/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.451276    
+2023-12-02 02:26:17,968 - Epoch: [14][31000/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.451149    
+2023-12-02 02:27:01,943 - Epoch: [14][31100/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.451112    
+2023-12-02 02:27:20,542 - Epoch: [14][31148/31148]    Overall Loss 0.009253    Objective Loss 0.000000    Distill Loss 0.009253                     LR 0.000500    Time 0.451014    
+2023-12-02 02:27:21,355 - --- validate (epoch=14)-----------
+2023-12-02 02:27:21,356 - 167951 samples (100 per mini-batch)
+2023-12-02 02:27:44,998 - Epoch: [14][  100/ 1680]    Loss 0.000000    Overall Loss 0.009874    
+2023-12-02 02:28:04,931 - Epoch: [14][  200/ 1680]    Loss 0.000000    Overall Loss 0.009857    
+2023-12-02 02:28:25,005 - Epoch: [14][  300/ 1680]    Loss 0.000000    Overall Loss 0.009879    
+2023-12-02 02:28:45,044 - Epoch: [14][  400/ 1680]    Loss 0.000000    Overall Loss 0.009911    
+2023-12-02 02:29:05,094 - Epoch: [14][  500/ 1680]    Loss 0.000000    Overall Loss 0.009917    
+2023-12-02 02:29:25,086 - Epoch: [14][  600/ 1680]    Loss 0.000000    Overall Loss 0.009911    
+2023-12-02 02:29:45,093 - Epoch: [14][  700/ 1680]    Loss 0.000000    Overall Loss 0.009909    
+2023-12-02 02:30:05,081 - Epoch: [14][  800/ 1680]    Loss 0.000000    Overall Loss 0.009907    
+2023-12-02 02:30:25,101 - Epoch: [14][  900/ 1680]    Loss 0.000000    Overall Loss 0.009920    
+2023-12-02 02:30:45,132 - Epoch: [14][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009919    
+2023-12-02 02:31:05,069 - Epoch: [14][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009921    
+2023-12-02 02:31:25,019 - Epoch: [14][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009918    
+2023-12-02 02:31:45,034 - Epoch: [14][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009917    
+2023-12-02 02:32:05,049 - Epoch: [14][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009918    
+2023-12-02 02:32:25,022 - Epoch: [14][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009917    
+2023-12-02 02:32:45,000 - Epoch: [14][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009915    
+2023-12-02 02:33:01,074 - Epoch: [14][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009914    
+2023-12-02 02:33:01,594 - ==> Overall Loss: 0.010
+
+2023-12-02 02:33:01,603 - ==> Best [Overall Loss: 0.009914 on epoch: 14]
+2023-12-02 02:33:01,603 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-02 02:33:01,676 - 
+
+2023-12-02 02:33:01,676 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-02 02:34:10,792 - Epoch: [15][  100/31148]    Overall Loss 0.009158    Objective Loss 0.000000    Distill Loss 0.009158                     LR 0.000250    Time 0.691045    
+2023-12-02 02:34:52,407 - Epoch: [15][  200/31148]    Overall Loss 0.009083    Objective Loss 0.000000    Distill Loss 0.009083                     LR 0.000250    Time 0.553563    
+2023-12-02 02:35:33,968 - Epoch: [15][  300/31148]    Overall Loss 0.009096    Objective Loss 0.000000    Distill Loss 0.009096                     LR 0.000250    Time 0.507554    
+2023-12-02 02:36:19,898 - Epoch: [15][  400/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.495473    
+2023-12-02 02:37:03,195 - Epoch: [15][  500/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.482958    
+2023-12-02 02:37:46,895 - Epoch: [15][  600/31148]    Overall Loss 0.009054    Objective Loss 0.000000    Distill Loss 0.009054                     LR 0.000250    Time 0.475286    
+2023-12-02 02:38:36,960 - Epoch: [15][  700/31148]    Overall Loss 0.009083    Objective Loss 0.000000    Distill Loss 0.009083                     LR 0.000250    Time 0.478899    
+2023-12-02 02:39:19,074 - Epoch: [15][  800/31148]    Overall Loss 0.009090    Objective Loss 0.000000    Distill Loss 0.009090                     LR 0.000250    Time 0.471670    
+2023-12-02 02:40:04,496 - Epoch: [15][  900/31148]    Overall Loss 0.009085    Objective Loss 0.000000    Distill Loss 0.009085                     LR 0.000250    Time 0.469724    
+2023-12-02 02:40:48,268 - Epoch: [15][ 1000/31148]    Overall Loss 0.009074    Objective Loss 0.000000    Distill Loss 0.009074                     LR 0.000250    Time 0.466515    
+2023-12-02 02:41:25,135 - Epoch: [15][ 1100/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.457615    
+2023-12-02 02:42:06,280 - Epoch: [15][ 1200/31148]    Overall Loss 0.009074    Objective Loss 0.000000    Distill Loss 0.009074                     LR 0.000250    Time 0.453762    
+2023-12-02 02:42:52,340 - Epoch: [15][ 1300/31148]    Overall Loss 0.009073    Objective Loss 0.000000    Distill Loss 0.009073                     LR 0.000250    Time 0.454282    
+2023-12-02 02:43:37,102 - Epoch: [15][ 1400/31148]    Overall Loss 0.009077    Objective Loss 0.000000    Distill Loss 0.009077                     LR 0.000250    Time 0.453802    
+2023-12-02 02:44:25,879 - Epoch: [15][ 1500/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.456061    
+2023-12-02 02:45:10,834 - Epoch: [15][ 1600/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.455650    
+2023-12-02 02:45:52,673 - Epoch: [15][ 1700/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.453453    
+2023-12-02 02:46:48,958 - Epoch: [15][ 1800/31148]    Overall Loss 0.009077    Objective Loss 0.000000    Distill Loss 0.009077                     LR 0.000250    Time 0.459527    
+2023-12-02 02:47:33,166 - Epoch: [15][ 1900/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.458605    
+2023-12-02 02:48:14,503 - Epoch: [15][ 2000/31148]    Overall Loss 0.009077    Objective Loss 0.000000    Distill Loss 0.009077                     LR 0.000250    Time 0.456339    
+2023-12-02 02:48:58,130 - Epoch: [15][ 2100/31148]    Overall Loss 0.009079    Objective Loss 0.000000    Distill Loss 0.009079                     LR 0.000250    Time 0.455380    
+2023-12-02 02:49:41,792 - Epoch: [15][ 2200/31148]    Overall Loss 0.009080    Objective Loss 0.000000    Distill Loss 0.009080                     LR 0.000250    Time 0.454524    
+2023-12-02 02:50:25,298 - Epoch: [15][ 2300/31148]    Overall Loss 0.009083    Objective Loss 0.000000    Distill Loss 0.009083                     LR 0.000250    Time 0.453675    
+2023-12-02 02:51:09,459 - Epoch: [15][ 2400/31148]    Overall Loss 0.009082    Objective Loss 0.000000    Distill Loss 0.009082                     LR 0.000250    Time 0.453169    
+2023-12-02 02:51:58,192 - Epoch: [15][ 2500/31148]    Overall Loss 0.009079    Objective Loss 0.000000    Distill Loss 0.009079                     LR 0.000250    Time 0.454533    
+2023-12-02 02:52:36,317 - Epoch: [15][ 2600/31148]    Overall Loss 0.009083    Objective Loss 0.000000    Distill Loss 0.009083                     LR 0.000250    Time 0.451711    
+2023-12-02 02:53:24,060 - Epoch: [15][ 2700/31148]    Overall Loss 0.009085    Objective Loss 0.000000    Distill Loss 0.009085                     LR 0.000250    Time 0.452661    
+2023-12-02 02:54:07,910 - Epoch: [15][ 2800/31148]    Overall Loss 0.009084    Objective Loss 0.000000    Distill Loss 0.009084                     LR 0.000250    Time 0.452153    
+2023-12-02 02:54:49,540 - Epoch: [15][ 2900/31148]    Overall Loss 0.009085    Objective Loss 0.000000    Distill Loss 0.009085                     LR 0.000250    Time 0.450914    
+2023-12-02 02:55:33,473 - Epoch: [15][ 3000/31148]    Overall Loss 0.009086    Objective Loss 0.000000    Distill Loss 0.009086                     LR 0.000250    Time 0.450525    
+2023-12-02 02:56:10,055 - Epoch: [15][ 3100/31148]    Overall Loss 0.009084    Objective Loss 0.000000    Distill Loss 0.009084                     LR 0.000250    Time 0.447791    
+2023-12-02 02:56:44,810 - Epoch: [15][ 3200/31148]    Overall Loss 0.009084    Objective Loss 0.000000    Distill Loss 0.009084                     LR 0.000250    Time 0.444656    
+2023-12-02 02:57:28,891 - Epoch: [15][ 3300/31148]    Overall Loss 0.009082    Objective Loss 0.000000    Distill Loss 0.009082                     LR 0.000250    Time 0.444538    
+2023-12-02 02:58:09,072 - Epoch: [15][ 3400/31148]    Overall Loss 0.009083    Objective Loss 0.000000    Distill Loss 0.009083                     LR 0.000250    Time 0.443279    
+2023-12-02 02:58:54,964 - Epoch: [15][ 3500/31148]    Overall Loss 0.009081    Objective Loss 0.000000    Distill Loss 0.009081                     LR 0.000250    Time 0.443724    
+2023-12-02 02:59:39,046 - Epoch: [15][ 3600/31148]    Overall Loss 0.009084    Objective Loss 0.000000    Distill Loss 0.009084                     LR 0.000250    Time 0.443641    
+2023-12-02 03:00:28,465 - Epoch: [15][ 3700/31148]    Overall Loss 0.009085    Objective Loss 0.000000    Distill Loss 0.009085                     LR 0.000250    Time 0.445005    
+2023-12-02 03:01:15,626 - Epoch: [15][ 3800/31148]    Overall Loss 0.009085    Objective Loss 0.000000    Distill Loss 0.009085                     LR 0.000250    Time 0.445703    
+2023-12-02 03:01:56,846 - Epoch: [15][ 3900/31148]    Overall Loss 0.009088    Objective Loss 0.000000    Distill Loss 0.009088                     LR 0.000250    Time 0.444843    
+2023-12-02 03:02:39,617 - Epoch: [15][ 4000/31148]    Overall Loss 0.009088    Objective Loss 0.000000    Distill Loss 0.009088                     LR 0.000250    Time 0.444412    
+2023-12-02 03:03:27,862 - Epoch: [15][ 4100/31148]    Overall Loss 0.009087    Objective Loss 0.000000    Distill Loss 0.009087                     LR 0.000250    Time 0.445338    
+2023-12-02 03:04:13,401 - Epoch: [15][ 4200/31148]    Overall Loss 0.009087    Objective Loss 0.000000    Distill Loss 0.009087                     LR 0.000250    Time 0.445576    
+2023-12-02 03:05:01,275 - Epoch: [15][ 4300/31148]    Overall Loss 0.009092    Objective Loss 0.000000    Distill Loss 0.009092                     LR 0.000250    Time 0.446346    
+2023-12-02 03:05:42,714 - Epoch: [15][ 4400/31148]    Overall Loss 0.009090    Objective Loss 0.000000    Distill Loss 0.009090                     LR 0.000250    Time 0.445618    
+2023-12-02 03:06:17,511 - Epoch: [15][ 4500/31148]    Overall Loss 0.009091    Objective Loss 0.000000    Distill Loss 0.009091                     LR 0.000250    Time 0.443446    
+2023-12-02 03:06:56,267 - Epoch: [15][ 4600/31148]    Overall Loss 0.009089    Objective Loss 0.000000    Distill Loss 0.009089                     LR 0.000250    Time 0.442230    
+2023-12-02 03:07:37,538 - Epoch: [15][ 4700/31148]    Overall Loss 0.009089    Objective Loss 0.000000    Distill Loss 0.009089                     LR 0.000250    Time 0.441600    
+2023-12-02 03:08:23,542 - Epoch: [15][ 4800/31148]    Overall Loss 0.009088    Objective Loss 0.000000    Distill Loss 0.009088                     LR 0.000250    Time 0.441983    
+2023-12-02 03:09:02,472 - Epoch: [15][ 4900/31148]    Overall Loss 0.009087    Objective Loss 0.000000    Distill Loss 0.009087                     LR 0.000250    Time 0.440906    
+2023-12-02 03:09:52,527 - Epoch: [15][ 5000/31148]    Overall Loss 0.009089    Objective Loss 0.000000    Distill Loss 0.009089                     LR 0.000250    Time 0.442098    
+2023-12-02 03:10:33,024 - Epoch: [15][ 5100/31148]    Overall Loss 0.009088    Objective Loss 0.000000    Distill Loss 0.009088                     LR 0.000250    Time 0.441369    
+2023-12-02 03:11:17,836 - Epoch: [15][ 5200/31148]    Overall Loss 0.009089    Objective Loss 0.000000    Distill Loss 0.009089                     LR 0.000250    Time 0.441497    
+2023-12-02 03:12:02,107 - Epoch: [15][ 5300/31148]    Overall Loss 0.009088    Objective Loss 0.000000    Distill Loss 0.009088                     LR 0.000250    Time 0.441519    
+2023-12-02 03:12:50,214 - Epoch: [15][ 5400/31148]    Overall Loss 0.009090    Objective Loss 0.000000    Distill Loss 0.009090                     LR 0.000250    Time 0.442250    
+2023-12-02 03:13:35,587 - Epoch: [15][ 5500/31148]    Overall Loss 0.009090    Objective Loss 0.000000    Distill Loss 0.009090                     LR 0.000250    Time 0.442457    
+2023-12-02 03:14:27,808 - Epoch: [15][ 5600/31148]    Overall Loss 0.009090    Objective Loss 0.000000    Distill Loss 0.009090                     LR 0.000250    Time 0.443880    
+2023-12-02 03:15:11,366 - Epoch: [15][ 5700/31148]    Overall Loss 0.009089    Objective Loss 0.000000    Distill Loss 0.009089                     LR 0.000250    Time 0.443733    
+2023-12-02 03:15:54,727 - Epoch: [15][ 5800/31148]    Overall Loss 0.009088    Objective Loss 0.000000    Distill Loss 0.009088                     LR 0.000250    Time 0.443557    
+2023-12-02 03:16:35,514 - Epoch: [15][ 5900/31148]    Overall Loss 0.009086    Objective Loss 0.000000    Distill Loss 0.009086                     LR 0.000250    Time 0.442951    
+2023-12-02 03:17:24,520 - Epoch: [15][ 6000/31148]    Overall Loss 0.009084    Objective Loss 0.000000    Distill Loss 0.009084                     LR 0.000250    Time 0.443735    
+2023-12-02 03:18:07,141 - Epoch: [15][ 6100/31148]    Overall Loss 0.009084    Objective Loss 0.000000    Distill Loss 0.009084                     LR 0.000250    Time 0.443447    
+2023-12-02 03:18:54,977 - Epoch: [15][ 6200/31148]    Overall Loss 0.009080    Objective Loss 0.000000    Distill Loss 0.009080                     LR 0.000250    Time 0.444009    
+2023-12-02 03:19:42,762 - Epoch: [15][ 6300/31148]    Overall Loss 0.009079    Objective Loss 0.000000    Distill Loss 0.009079                     LR 0.000250    Time 0.444545    
+2023-12-02 03:20:24,071 - Epoch: [15][ 6400/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.444052    
+2023-12-02 03:21:21,365 - Epoch: [15][ 6500/31148]    Overall Loss 0.009077    Objective Loss 0.000000    Distill Loss 0.009077                     LR 0.000250    Time 0.446034    
+2023-12-02 03:22:04,574 - Epoch: [15][ 6600/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.445822    
+2023-12-02 03:22:45,693 - Epoch: [15][ 6700/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.445304    
+2023-12-02 03:23:31,111 - Epoch: [15][ 6800/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.445433    
+2023-12-02 03:24:10,186 - Epoch: [15][ 6900/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.444640    
+2023-12-02 03:24:48,674 - Epoch: [15][ 7000/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.443785    
+2023-12-02 03:25:30,047 - Epoch: [15][ 7100/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.443361    
+2023-12-02 03:26:20,007 - Epoch: [15][ 7200/31148]    Overall Loss 0.009078    Objective Loss 0.000000    Distill Loss 0.009078                     LR 0.000250    Time 0.444141    
+2023-12-02 03:27:10,076 - Epoch: [15][ 7300/31148]    Overall Loss 0.009079    Objective Loss 0.000000    Distill Loss 0.009079                     LR 0.000250    Time 0.444914    
+2023-12-02 03:27:52,390 - Epoch: [15][ 7400/31148]    Overall Loss 0.009080    Objective Loss 0.000000    Distill Loss 0.009080                     LR 0.000250    Time 0.444619    
+2023-12-02 03:28:46,741 - Epoch: [15][ 7500/31148]    Overall Loss 0.009080    Objective Loss 0.000000    Distill Loss 0.009080                     LR 0.000250    Time 0.445937    
+2023-12-02 03:29:32,509 - Epoch: [15][ 7600/31148]    Overall Loss 0.009079    Objective Loss 0.000000    Distill Loss 0.009079                     LR 0.000250    Time 0.446090    
+2023-12-02 03:30:15,119 - Epoch: [15][ 7700/31148]    Overall Loss 0.009076    Objective Loss 0.000000    Distill Loss 0.009076                     LR 0.000250    Time 0.445830    
+2023-12-02 03:31:07,565 - Epoch: [15][ 7800/31148]    Overall Loss 0.009074    Objective Loss 0.000000    Distill Loss 0.009074                     LR 0.000250    Time 0.446837    
+2023-12-02 03:31:50,890 - Epoch: [15][ 7900/31148]    Overall Loss 0.009074    Objective Loss 0.000000    Distill Loss 0.009074                     LR 0.000250    Time 0.446664    
+2023-12-02 03:32:40,836 - Epoch: [15][ 8000/31148]    Overall Loss 0.009072    Objective Loss 0.000000    Distill Loss 0.009072                     LR 0.000250    Time 0.447323    
+2023-12-02 03:33:31,708 - Epoch: [15][ 8100/31148]    Overall Loss 0.009072    Objective Loss 0.000000    Distill Loss 0.009072                     LR 0.000250    Time 0.448080    
+2023-12-02 03:34:12,002 - Epoch: [15][ 8200/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447529    
+2023-12-02 03:34:50,069 - Epoch: [15][ 8300/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.446723    
+2023-12-02 03:35:38,681 - Epoch: [15][ 8400/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447191    
+2023-12-02 03:36:26,394 - Epoch: [15][ 8500/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447542    
+2023-12-02 03:37:08,693 - Epoch: [15][ 8600/31148]    Overall Loss 0.009070    Objective Loss 0.000000    Distill Loss 0.009070                     LR 0.000250    Time 0.447256    
+2023-12-02 03:37:54,035 - Epoch: [15][ 8700/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447326    
+2023-12-02 03:38:39,274 - Epoch: [15][ 8800/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447383    
+2023-12-02 03:39:36,020 - Epoch: [15][ 8900/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.448731    
+2023-12-02 03:40:20,630 - Epoch: [15][ 9000/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.448701    
+2023-12-02 03:40:58,497 - Epoch: [15][ 9100/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447931    
+2023-12-02 03:41:49,666 - Epoch: [15][ 9200/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.448623    
+2023-12-02 03:42:35,276 - Epoch: [15][ 9300/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.448703    
+2023-12-02 03:43:14,467 - Epoch: [15][ 9400/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.448098    
+2023-12-02 03:43:55,797 - Epoch: [15][ 9500/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447731    
+2023-12-02 03:44:38,490 - Epoch: [15][ 9600/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.447513    
+2023-12-02 03:45:12,698 - Epoch: [15][ 9700/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.446426    
+2023-12-02 03:45:40,250 - Epoch: [15][ 9800/31148]    Overall Loss 0.009071    Objective Loss 0.000000    Distill Loss 0.009071                     LR 0.000250    Time 0.444682    
+2023-12-02 03:46:08,163 - Epoch: [15][ 9900/31148]    Overall Loss 0.009069    Objective Loss 0.000000    Distill Loss 0.009069                     LR 0.000250    Time 0.443009    
+2023-12-02 03:46:35,404 - Epoch: [15][10000/31148]    Overall Loss 0.009069    Objective Loss 0.000000    Distill Loss 0.009069                     LR 0.000250    Time 0.441302    
+2023-12-02 03:47:03,677 - Epoch: [15][10100/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.439732    
+2023-12-02 03:47:32,082 - Epoch: [15][10200/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.438205    
+2023-12-02 03:47:59,394 - Epoch: [15][10300/31148]    Overall Loss 0.009067    Objective Loss 0.000000    Distill Loss 0.009067                     LR 0.000250    Time 0.436602    
+2023-12-02 03:48:27,128 - Epoch: [15][10400/31148]    Overall Loss 0.009067    Objective Loss 0.000000    Distill Loss 0.009067                     LR 0.000250    Time 0.435070    
+2023-12-02 03:48:54,062 - Epoch: [15][10500/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.433491    
+2023-12-02 03:49:22,646 - Epoch: [15][10600/31148]    Overall Loss 0.009067    Objective Loss 0.000000    Distill Loss 0.009067                     LR 0.000250    Time 0.432098    
+2023-12-02 03:49:49,969 - Epoch: [15][10700/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.430613    
+2023-12-02 03:50:17,858 - Epoch: [15][10800/31148]    Overall Loss 0.009067    Objective Loss 0.000000    Distill Loss 0.009067                     LR 0.000250    Time 0.429208    
+2023-12-02 03:50:54,677 - Epoch: [15][10900/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.428647    
+2023-12-02 03:51:48,332 - Epoch: [15][11000/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.429627    
+2023-12-02 03:52:39,524 - Epoch: [15][11100/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.430368    
+2023-12-02 03:53:22,219 - Epoch: [15][11200/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.430337    
+2023-12-02 03:54:06,107 - Epoch: [15][11300/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.430412    
+2023-12-02 03:55:01,138 - Epoch: [15][11400/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.431463    
+2023-12-02 03:55:53,864 - Epoch: [15][11500/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.432296    
+2023-12-02 03:56:44,147 - Epoch: [15][11600/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.432903    
+2023-12-02 03:57:28,670 - Epoch: [15][11700/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.433008    
+2023-12-02 03:58:31,239 - Epoch: [15][11800/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.434640    
+2023-12-02 03:59:22,571 - Epoch: [15][11900/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.435301    
+2023-12-02 04:00:09,794 - Epoch: [15][12000/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.435608    
+2023-12-02 04:01:03,391 - Epoch: [15][12100/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.436437    
+2023-12-02 04:01:46,973 - Epoch: [15][12200/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.436431    
+2023-12-02 04:02:30,834 - Epoch: [15][12300/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.436448    
+2023-12-02 04:03:23,890 - Epoch: [15][12400/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.437206    
+2023-12-02 04:04:10,001 - Epoch: [15][12500/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.437397    
+2023-12-02 04:05:13,114 - Epoch: [15][12600/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.438934    
+2023-12-02 04:06:07,323 - Epoch: [15][12700/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.439746    
+2023-12-02 04:06:59,524 - Epoch: [15][12800/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.440388    
+2023-12-02 04:07:37,035 - Epoch: [15][12900/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.439881    
+2023-12-02 04:08:28,740 - Epoch: [15][13000/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.440474    
+2023-12-02 04:09:13,213 - Epoch: [15][13100/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.440506    
+2023-12-02 04:09:55,179 - Epoch: [15][13200/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.440348    
+2023-12-02 04:10:40,742 - Epoch: [15][13300/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.440462    
+2023-12-02 04:11:23,093 - Epoch: [15][13400/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.440335    
+2023-12-02 04:12:05,205 - Epoch: [15][13500/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.440192    
+2023-12-02 04:12:57,132 - Epoch: [15][13600/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.440773    
+2023-12-02 04:13:45,909 - Epoch: [15][13700/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.441115    
+2023-12-02 04:14:41,783 - Epoch: [15][13800/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.441967    
+2023-12-02 04:15:31,961 - Epoch: [15][13900/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.442397    
+2023-12-02 04:16:13,232 - Epoch: [15][14000/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.442184    
+2023-12-02 04:17:05,691 - Epoch: [15][14100/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.442768    
+2023-12-02 04:17:55,380 - Epoch: [15][14200/31148]    Overall Loss 0.009066    Objective Loss 0.000000    Distill Loss 0.009066                     LR 0.000250    Time 0.443149    
+2023-12-02 04:18:45,663 - Epoch: [15][14300/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.443566    
+2023-12-02 04:19:30,849 - Epoch: [15][14400/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.443623    
+2023-12-02 04:20:32,658 - Epoch: [15][14500/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444826    
+2023-12-02 04:21:20,197 - Epoch: [15][14600/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.445034    
+2023-12-02 04:22:12,607 - Epoch: [15][14700/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.445572    
+2023-12-02 04:22:51,869 - Epoch: [15][14800/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.445214    
+2023-12-02 04:23:34,521 - Epoch: [15][14900/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.445088    
+2023-12-02 04:24:16,706 - Epoch: [15][15000/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.444932    
+2023-12-02 04:25:02,448 - Epoch: [15][15100/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.445015    
+2023-12-02 04:25:43,985 - Epoch: [15][15200/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444819    
+2023-12-02 04:26:23,851 - Epoch: [15][15300/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444517    
+2023-12-02 04:27:07,949 - Epoch: [15][15400/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444494    
+2023-12-02 04:28:04,128 - Epoch: [15][15500/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.445250    
+2023-12-02 04:28:44,633 - Epoch: [15][15600/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444992    
+2023-12-02 04:29:21,655 - Epoch: [15][15700/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.444515    
+2023-12-02 04:29:58,948 - Epoch: [15][15800/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444061    
+2023-12-02 04:30:40,876 - Epoch: [15][15900/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.443905    
+2023-12-02 04:31:30,485 - Epoch: [15][16000/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444231    
+2023-12-02 04:32:22,545 - Epoch: [15][16100/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.444705    
+2023-12-02 04:33:20,605 - Epoch: [15][16200/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.445543    
+2023-12-02 04:34:07,086 - Epoch: [15][16300/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.445661    
+2023-12-02 04:35:05,242 - Epoch: [15][16400/31148]    Overall Loss 0.009065    Objective Loss 0.000000    Distill Loss 0.009065                     LR 0.000250    Time 0.446489    
+2023-12-02 04:35:58,024 - Epoch: [15][16500/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.446982    
+2023-12-02 04:36:44,018 - Epoch: [15][16600/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.447059    
+2023-12-02 04:37:37,097 - Epoch: [15][16700/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.447560    
+2023-12-02 04:38:26,185 - Epoch: [15][16800/31148]    Overall Loss 0.009064    Objective Loss 0.000000    Distill Loss 0.009064                     LR 0.000250    Time 0.447818    
+2023-12-02 04:39:14,896 - Epoch: [15][16900/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.448050    
+2023-12-02 04:40:00,723 - Epoch: [15][17000/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.448109    
+2023-12-02 04:40:51,027 - Epoch: [15][17100/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.448430    
+2023-12-02 04:41:39,498 - Epoch: [15][17200/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.448641    
+2023-12-02 04:42:27,203 - Epoch: [15][17300/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.448805    
+2023-12-02 04:43:22,377 - Epoch: [15][17400/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.449396    
+2023-12-02 04:44:05,509 - Epoch: [15][17500/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.449292    
+2023-12-02 04:44:57,440 - Epoch: [15][17600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.449689    
+2023-12-02 04:45:42,661 - Epoch: [15][17700/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.449703    
+2023-12-02 04:46:32,157 - Epoch: [15][17800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.449957    
+2023-12-02 04:47:15,829 - Epoch: [15][17900/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.449883    
+2023-12-02 04:48:12,138 - Epoch: [15][18000/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450511    
+2023-12-02 04:48:57,050 - Epoch: [15][18100/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450503    
+2023-12-02 04:49:38,934 - Epoch: [15][18200/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450329    
+2023-12-02 04:50:23,489 - Epoch: [15][18300/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450302    
+2023-12-02 04:51:15,497 - Epoch: [15][18400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.450681    
+2023-12-02 04:51:55,375 - Epoch: [15][18500/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450400    
+2023-12-02 04:52:46,766 - Epoch: [15][18600/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450741    
+2023-12-02 04:53:37,845 - Epoch: [15][18700/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.451062    
+2023-12-02 04:54:15,886 - Epoch: [15][18800/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.450686    
+2023-12-02 04:55:01,053 - Epoch: [15][18900/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.450691    
+2023-12-02 04:55:51,813 - Epoch: [15][19000/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.450990    
+2023-12-02 04:56:41,913 - Epoch: [15][19100/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.451251    
+2023-12-02 04:57:36,387 - Epoch: [15][19200/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.451738    
+2023-12-02 04:58:25,948 - Epoch: [15][19300/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.451965    
+2023-12-02 04:59:11,958 - Epoch: [15][19400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.452006    
+2023-12-02 05:00:09,528 - Epoch: [15][19500/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.452640    
+2023-12-02 05:01:10,358 - Epoch: [15][19600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.453434    
+2023-12-02 05:01:58,904 - Epoch: [15][19700/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.453596    
+2023-12-02 05:02:42,059 - Epoch: [15][19800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.453485    
+2023-12-02 05:03:30,407 - Epoch: [15][19900/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.453635    
+2023-12-02 05:04:18,042 - Epoch: [15][20000/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.453748    
+2023-12-02 05:05:03,904 - Epoch: [15][20100/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.453772    
+2023-12-02 05:05:50,460 - Epoch: [15][20200/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.453830    
+2023-12-02 05:06:43,959 - Epoch: [15][20300/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454229    
+2023-12-02 05:07:27,458 - Epoch: [15][20400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454135    
+2023-12-02 05:08:11,520 - Epoch: [15][20500/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.454068    
+2023-12-02 05:08:59,233 - Epoch: [15][20600/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.454180    
+2023-12-02 05:09:45,158 - Epoch: [15][20700/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.454204    
+2023-12-02 05:10:35,898 - Epoch: [15][20800/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.454460    
+2023-12-02 05:11:26,170 - Epoch: [15][20900/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454690    
+2023-12-02 05:12:05,594 - Epoch: [15][21000/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454402    
+2023-12-02 05:12:54,727 - Epoch: [15][21100/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454577    
+2023-12-02 05:13:36,816 - Epoch: [15][21200/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454418    
+2023-12-02 05:14:21,460 - Epoch: [15][21300/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454380    
+2023-12-02 05:15:11,745 - Epoch: [15][21400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454606    
+2023-12-02 05:16:04,930 - Epoch: [15][21500/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.454965    
+2023-12-02 05:17:05,086 - Epoch: [15][21600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.455643    
+2023-12-02 05:17:53,573 - Epoch: [15][21700/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.455777    
+2023-12-02 05:18:41,239 - Epoch: [15][21800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.455873    
+2023-12-02 05:19:18,684 - Epoch: [15][21900/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.455501    
+2023-12-02 05:20:15,154 - Epoch: [15][22000/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.455997    
+2023-12-02 05:21:05,514 - Epoch: [15][22100/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.456212    
+2023-12-02 05:21:49,412 - Epoch: [15][22200/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.456134    
+2023-12-02 05:22:40,926 - Epoch: [15][22300/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456398    
+2023-12-02 05:23:26,967 - Epoch: [15][22400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456416    
+2023-12-02 05:24:11,762 - Epoch: [15][22500/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.456378    
+2023-12-02 05:24:59,306 - Epoch: [15][22600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456462    
+2023-12-02 05:25:44,344 - Epoch: [15][22700/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456435    
+2023-12-02 05:26:25,350 - Epoch: [15][22800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456231    
+2023-12-02 05:27:17,780 - Epoch: [15][22900/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456528    
+2023-12-02 05:28:03,557 - Epoch: [15][23000/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456533    
+2023-12-02 05:28:46,261 - Epoch: [15][23100/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456405    
+2023-12-02 05:29:33,522 - Epoch: [15][23200/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456475    
+2023-12-02 05:30:22,809 - Epoch: [15][23300/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456631    
+2023-12-02 05:31:12,044 - Epoch: [15][23400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456783    
+2023-12-02 05:31:56,986 - Epoch: [15][23500/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456751    
+2023-12-02 05:32:47,653 - Epoch: [15][23600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456962    
+2023-12-02 05:33:26,868 - Epoch: [15][23700/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.456689    
+2023-12-02 05:34:06,285 - Epoch: [15][23800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456426    
+2023-12-02 05:34:50,423 - Epoch: [15][23900/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.456362    
+2023-12-02 05:35:55,620 - Epoch: [15][24000/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.457177    
+2023-12-02 05:36:47,218 - Epoch: [15][24100/31148]    Overall Loss 0.009063    Objective Loss 0.000000    Distill Loss 0.009063                     LR 0.000250    Time 0.457421    
+2023-12-02 05:37:31,504 - Epoch: [15][24200/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457360    
+2023-12-02 05:38:18,771 - Epoch: [15][24300/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457423    
+2023-12-02 05:39:04,026 - Epoch: [15][24400/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457403    
+2023-12-02 05:39:44,727 - Epoch: [15][24500/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457197    
+2023-12-02 05:40:29,683 - Epoch: [15][24600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457165    
+2023-12-02 05:41:09,107 - Epoch: [15][24700/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456910    
+2023-12-02 05:41:52,779 - Epoch: [15][24800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456829    
+2023-12-02 05:42:36,058 - Epoch: [15][24900/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.456732    
+2023-12-02 05:43:28,603 - Epoch: [15][25000/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457007    
+2023-12-02 05:44:05,780 - Epoch: [15][25100/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.456667    
+2023-12-02 05:44:50,717 - Epoch: [15][25200/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.456637    
+2023-12-02 05:45:43,850 - Epoch: [15][25300/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.456932    
+2023-12-02 05:46:33,221 - Epoch: [15][25400/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457077    
+2023-12-02 05:47:22,942 - Epoch: [15][25500/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457234    
+2023-12-02 05:48:13,679 - Epoch: [15][25600/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457430    
+2023-12-02 05:48:55,097 - Epoch: [15][25700/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457261    
+2023-12-02 05:49:44,218 - Epoch: [15][25800/31148]    Overall Loss 0.009062    Objective Loss 0.000000    Distill Loss 0.009062                     LR 0.000250    Time 0.457392    
+2023-12-02 05:50:28,950 - Epoch: [15][25900/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457353    
+2023-12-02 05:51:13,801 - Epoch: [15][26000/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457319    
+2023-12-02 05:52:01,883 - Epoch: [15][26100/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457409    
+2023-12-02 05:52:52,500 - Epoch: [15][26200/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457594    
+2023-12-02 05:53:38,773 - Epoch: [15][26300/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457614    
+2023-12-02 05:54:24,692 - Epoch: [15][26400/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457619    
+2023-12-02 05:55:13,867 - Epoch: [15][26500/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457748    
+2023-12-02 05:55:59,405 - Epoch: [15][26600/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457739    
+2023-12-02 05:56:50,799 - Epoch: [15][26700/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457949    
+2023-12-02 05:57:33,852 - Epoch: [15][26800/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457846    
+2023-12-02 05:58:15,283 - Epoch: [15][26900/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457684    
+2023-12-02 05:58:57,464 - Epoch: [15][27000/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457551    
+2023-12-02 05:59:41,222 - Epoch: [15][27100/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457477    
+2023-12-02 06:00:28,299 - Epoch: [15][27200/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457526    
+2023-12-02 06:01:11,605 - Epoch: [15][27300/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457436    
+2023-12-02 06:01:54,392 - Epoch: [15][27400/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457328    
+2023-12-02 06:02:37,282 - Epoch: [15][27500/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457224    
+2023-12-02 06:03:28,700 - Epoch: [15][27600/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457430    
+2023-12-02 06:04:17,791 - Epoch: [15][27700/31148]    Overall Loss 0.009061    Objective Loss 0.000000    Distill Loss 0.009061                     LR 0.000250    Time 0.457551    
+2023-12-02 06:04:56,740 - Epoch: [15][27800/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457306    
+2023-12-02 06:05:40,527 - Epoch: [15][27900/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457236    
+2023-12-02 06:06:22,002 - Epoch: [15][28000/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457084    
+2023-12-02 06:07:06,765 - Epoch: [15][28100/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457050    
+2023-12-02 06:07:50,992 - Epoch: [15][28200/31148]    Overall Loss 0.009059    Objective Loss 0.000000    Distill Loss 0.009059                     LR 0.000250    Time 0.456997    
+2023-12-02 06:08:34,353 - Epoch: [15][28300/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456915    
+2023-12-02 06:09:24,539 - Epoch: [15][28400/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.457073    
+2023-12-02 06:10:05,256 - Epoch: [15][28500/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456897    
+2023-12-02 06:10:48,447 - Epoch: [15][28600/31148]    Overall Loss 0.009059    Objective Loss 0.000000    Distill Loss 0.009059                     LR 0.000250    Time 0.456810    
+2023-12-02 06:11:36,889 - Epoch: [15][28700/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456906    
+2023-12-02 06:12:17,422 - Epoch: [15][28800/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456726    
+2023-12-02 06:12:57,860 - Epoch: [15][28900/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456545    
+2023-12-02 06:13:49,286 - Epoch: [15][29000/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456744    
+2023-12-02 06:14:36,133 - Epoch: [15][29100/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456784    
+2023-12-02 06:15:14,337 - Epoch: [15][29200/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456527    
+2023-12-02 06:15:57,445 - Epoch: [15][29300/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456440    
+2023-12-02 06:16:33,028 - Epoch: [15][29400/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456098    
+2023-12-02 06:17:20,907 - Epoch: [15][29500/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456175    
+2023-12-02 06:18:05,375 - Epoch: [15][29600/31148]    Overall Loss 0.009059    Objective Loss 0.000000    Distill Loss 0.009059                     LR 0.000250    Time 0.456135    
+2023-12-02 06:18:58,984 - Epoch: [15][29700/31148]    Overall Loss 0.009059    Objective Loss 0.000000    Distill Loss 0.009059                     LR 0.000250    Time 0.456404    
+2023-12-02 06:19:45,195 - Epoch: [15][29800/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456423    
+2023-12-02 06:20:24,370 - Epoch: [15][29900/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456207    
+2023-12-02 06:21:10,518 - Epoch: [15][30000/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456224    
+2023-12-02 06:21:53,598 - Epoch: [15][30100/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456139    
+2023-12-02 06:22:48,664 - Epoch: [15][30200/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456452    
+2023-12-02 06:23:39,103 - Epoch: [15][30300/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456610    
+2023-12-02 06:24:20,595 - Epoch: [15][30400/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456473    
+2023-12-02 06:25:12,725 - Epoch: [15][30500/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456685    
+2023-12-02 06:25:50,446 - Epoch: [15][30600/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456425    
+2023-12-02 06:26:35,932 - Epoch: [15][30700/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456420    
+2023-12-02 06:27:21,596 - Epoch: [15][30800/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456420    
+2023-12-02 06:28:02,755 - Epoch: [15][30900/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456275    
+2023-12-02 06:28:49,097 - Epoch: [15][31000/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456298    
+2023-12-02 06:29:39,562 - Epoch: [15][31100/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456453    
+2023-12-02 06:29:57,009 - Epoch: [15][31148/31148]    Overall Loss 0.009060    Objective Loss 0.000000    Distill Loss 0.009060                     LR 0.000250    Time 0.456309    
+2023-12-02 06:29:57,820 - --- validate (epoch=15)-----------
+2023-12-02 06:29:57,820 - 167951 samples (100 per mini-batch)
+2023-12-02 06:30:21,202 - Epoch: [15][  100/ 1680]    Loss 0.000000    Overall Loss 0.009658    
+2023-12-02 06:30:41,174 - Epoch: [15][  200/ 1680]    Loss 0.000000    Overall Loss 0.009674    
+2023-12-02 06:31:01,225 - Epoch: [15][  300/ 1680]    Loss 0.000000    Overall Loss 0.009670    
+2023-12-02 06:31:21,243 - Epoch: [15][  400/ 1680]    Loss 0.000000    Overall Loss 0.009678    
+2023-12-02 06:31:41,230 - Epoch: [15][  500/ 1680]    Loss 0.000000    Overall Loss 0.009683    
+2023-12-02 06:32:01,226 - Epoch: [15][  600/ 1680]    Loss 0.000000    Overall Loss 0.009694    
+2023-12-02 06:32:21,205 - Epoch: [15][  700/ 1680]    Loss 0.000000    Overall Loss 0.009680    
+2023-12-02 06:32:41,195 - Epoch: [15][  800/ 1680]    Loss 0.000000    Overall Loss 0.009684    
+2023-12-02 06:33:01,190 - Epoch: [15][  900/ 1680]    Loss 0.000000    Overall Loss 0.009692    
+2023-12-02 06:33:21,163 - Epoch: [15][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009683    
+2023-12-02 06:33:41,182 - Epoch: [15][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009682    
+2023-12-02 06:34:01,259 - Epoch: [15][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009678    
+2023-12-02 06:34:21,231 - Epoch: [15][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009673    
+2023-12-02 06:34:41,187 - Epoch: [15][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009670    
+2023-12-02 06:35:01,253 - Epoch: [15][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009672    
+2023-12-02 06:35:21,351 - Epoch: [15][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009672    
+2023-12-02 06:35:37,314 - Epoch: [15][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009673    
+2023-12-02 06:35:37,863 - ==> Overall Loss: 0.010
+
+2023-12-02 06:35:37,876 - ==> Best [Overall Loss: 0.009673 on epoch: 15]
+2023-12-02 06:35:37,877 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-02 06:35:37,958 - 
+
+2023-12-02 06:35:37,959 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-02 06:36:40,566 - Epoch: [16][  100/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.625978    
+2023-12-02 06:37:28,371 - Epoch: [16][  200/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.551980    
+2023-12-02 06:38:13,713 - Epoch: [16][  300/31148]    Overall Loss 0.009021    Objective Loss 0.000000    Distill Loss 0.009021                     LR 0.000250    Time 0.519100    
+2023-12-02 06:38:50,449 - Epoch: [16][  400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.481148    
+2023-12-02 06:39:40,167 - Epoch: [16][  500/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.484342    
+2023-12-02 06:40:19,887 - Epoch: [16][  600/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.469805    
+2023-12-02 06:41:05,953 - Epoch: [16][  700/31148]    Overall Loss 0.009018    Objective Loss 0.000000    Distill Loss 0.009018                     LR 0.000250    Time 0.468487    
+2023-12-02 06:41:46,799 - Epoch: [16][  800/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.460975    
+2023-12-02 06:42:37,514 - Epoch: [16][  900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.466096    
+2023-12-02 06:43:10,740 - Epoch: [16][ 1000/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.452706    
+2023-12-02 06:43:57,332 - Epoch: [16][ 1100/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.453901    
+2023-12-02 06:44:32,306 - Epoch: [16][ 1200/31148]    Overall Loss 0.009021    Objective Loss 0.000000    Distill Loss 0.009021                     LR 0.000250    Time 0.445214    
+2023-12-02 06:45:14,985 - Epoch: [16][ 1300/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.443791    
+2023-12-02 06:45:56,293 - Epoch: [16][ 1400/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.441592    
+2023-12-02 06:46:37,372 - Epoch: [16][ 1500/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.439534    
+2023-12-02 06:47:25,306 - Epoch: [16][ 1600/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.442017    
+2023-12-02 06:48:14,938 - Epoch: [16][ 1700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.445207    
+2023-12-02 06:48:56,301 - Epoch: [16][ 1800/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.443449    
+2023-12-02 06:49:37,130 - Epoch: [16][ 1900/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.441594    
+2023-12-02 06:50:20,288 - Epoch: [16][ 2000/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.441090    
+2023-12-02 06:51:02,214 - Epoch: [16][ 2100/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.440047    
+2023-12-02 06:51:38,123 - Epoch: [16][ 2200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.436364    
+2023-12-02 06:52:20,123 - Epoch: [16][ 2300/31148]    Overall Loss 0.009033    Objective Loss 0.000000    Distill Loss 0.009033                     LR 0.000250    Time 0.435649    
+2023-12-02 06:52:58,740 - Epoch: [16][ 2400/31148]    Overall Loss 0.009036    Objective Loss 0.000000    Distill Loss 0.009036                     LR 0.000250    Time 0.433584    
+2023-12-02 06:53:38,060 - Epoch: [16][ 2500/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.431966    
+2023-12-02 06:54:18,270 - Epoch: [16][ 2600/31148]    Overall Loss 0.009037    Objective Loss 0.000000    Distill Loss 0.009037                     LR 0.000250    Time 0.430814    
+2023-12-02 06:54:51,903 - Epoch: [16][ 2700/31148]    Overall Loss 0.009039    Objective Loss 0.000000    Distill Loss 0.009039                     LR 0.000250    Time 0.427312    
+2023-12-02 06:55:35,022 - Epoch: [16][ 2800/31148]    Overall Loss 0.009037    Objective Loss 0.000000    Distill Loss 0.009037                     LR 0.000250    Time 0.427448    
+2023-12-02 06:56:22,966 - Epoch: [16][ 2900/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.429238    
+2023-12-02 06:57:16,241 - Epoch: [16][ 3000/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.432686    
+2023-12-02 06:57:57,780 - Epoch: [16][ 3100/31148]    Overall Loss 0.009032    Objective Loss 0.000000    Distill Loss 0.009032                     LR 0.000250    Time 0.432126    
+2023-12-02 06:58:46,321 - Epoch: [16][ 3200/31148]    Overall Loss 0.009033    Objective Loss 0.000000    Distill Loss 0.009033                     LR 0.000250    Time 0.433789    
+2023-12-02 06:59:25,321 - Epoch: [16][ 3300/31148]    Overall Loss 0.009033    Objective Loss 0.000000    Distill Loss 0.009033                     LR 0.000250    Time 0.432460    
+2023-12-02 07:00:03,349 - Epoch: [16][ 3400/31148]    Overall Loss 0.009032    Objective Loss 0.000000    Distill Loss 0.009032                     LR 0.000250    Time 0.430923    
+2023-12-02 07:00:44,559 - Epoch: [16][ 3500/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.430383    
+2023-12-02 07:01:24,129 - Epoch: [16][ 3600/31148]    Overall Loss 0.009033    Objective Loss 0.000000    Distill Loss 0.009033                     LR 0.000250    Time 0.429418    
+2023-12-02 07:01:59,206 - Epoch: [16][ 3700/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.427290    
+2023-12-02 07:02:41,966 - Epoch: [16][ 3800/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.427296    
+2023-12-02 07:03:25,262 - Epoch: [16][ 3900/31148]    Overall Loss 0.009036    Objective Loss 0.000000    Distill Loss 0.009036                     LR 0.000250    Time 0.427440    
+2023-12-02 07:04:08,484 - Epoch: [16][ 4000/31148]    Overall Loss 0.009036    Objective Loss 0.000000    Distill Loss 0.009036                     LR 0.000250    Time 0.427557    
+2023-12-02 07:04:53,641 - Epoch: [16][ 4100/31148]    Overall Loss 0.009037    Objective Loss 0.000000    Distill Loss 0.009037                     LR 0.000250    Time 0.428141    
+2023-12-02 07:05:29,279 - Epoch: [16][ 4200/31148]    Overall Loss 0.009037    Objective Loss 0.000000    Distill Loss 0.009037                     LR 0.000250    Time 0.426430    
+2023-12-02 07:06:18,981 - Epoch: [16][ 4300/31148]    Overall Loss 0.009040    Objective Loss 0.000000    Distill Loss 0.009040                     LR 0.000250    Time 0.428070    
+2023-12-02 07:07:04,373 - Epoch: [16][ 4400/31148]    Overall Loss 0.009038    Objective Loss 0.000000    Distill Loss 0.009038                     LR 0.000250    Time 0.428656    
+2023-12-02 07:07:48,526 - Epoch: [16][ 4500/31148]    Overall Loss 0.009041    Objective Loss 0.000000    Distill Loss 0.009041                     LR 0.000250    Time 0.428941    
+2023-12-02 07:08:22,869 - Epoch: [16][ 4600/31148]    Overall Loss 0.009040    Objective Loss 0.000000    Distill Loss 0.009040                     LR 0.000250    Time 0.427080    
+2023-12-02 07:09:05,352 - Epoch: [16][ 4700/31148]    Overall Loss 0.009041    Objective Loss 0.000000    Distill Loss 0.009041                     LR 0.000250    Time 0.427031    
+2023-12-02 07:09:54,602 - Epoch: [16][ 4800/31148]    Overall Loss 0.009042    Objective Loss 0.000000    Distill Loss 0.009042                     LR 0.000250    Time 0.428393    
+2023-12-02 07:10:39,827 - Epoch: [16][ 4900/31148]    Overall Loss 0.009042    Objective Loss 0.000000    Distill Loss 0.009042                     LR 0.000250    Time 0.428879    
+2023-12-02 07:11:16,250 - Epoch: [16][ 5000/31148]    Overall Loss 0.009043    Objective Loss 0.000000    Distill Loss 0.009043                     LR 0.000250    Time 0.427584    
+2023-12-02 07:11:57,114 - Epoch: [16][ 5100/31148]    Overall Loss 0.009042    Objective Loss 0.000000    Distill Loss 0.009042                     LR 0.000250    Time 0.427211    
+2023-12-02 07:12:36,942 - Epoch: [16][ 5200/31148]    Overall Loss 0.009043    Objective Loss 0.000000    Distill Loss 0.009043                     LR 0.000250    Time 0.426654    
+2023-12-02 07:13:11,646 - Epoch: [16][ 5300/31148]    Overall Loss 0.009042    Objective Loss 0.000000    Distill Loss 0.009042                     LR 0.000250    Time 0.425150    
+2023-12-02 07:13:40,103 - Epoch: [16][ 5400/31148]    Overall Loss 0.009045    Objective Loss 0.000000    Distill Loss 0.009045                     LR 0.000250    Time 0.422546    
+2023-12-02 07:14:07,433 - Epoch: [16][ 5500/31148]    Overall Loss 0.009044    Objective Loss 0.000000    Distill Loss 0.009044                     LR 0.000250    Time 0.419832    
+2023-12-02 07:14:35,077 - Epoch: [16][ 5600/31148]    Overall Loss 0.009044    Objective Loss 0.000000    Distill Loss 0.009044                     LR 0.000250    Time 0.417270    
+2023-12-02 07:15:03,171 - Epoch: [16][ 5700/31148]    Overall Loss 0.009044    Objective Loss 0.000000    Distill Loss 0.009044                     LR 0.000250    Time 0.414878    
+2023-12-02 07:15:30,871 - Epoch: [16][ 5800/31148]    Overall Loss 0.009043    Objective Loss 0.000000    Distill Loss 0.009043                     LR 0.000250    Time 0.412500    
+2023-12-02 07:16:00,046 - Epoch: [16][ 5900/31148]    Overall Loss 0.009042    Objective Loss 0.000000    Distill Loss 0.009042                     LR 0.000250    Time 0.410452    
+2023-12-02 07:16:28,380 - Epoch: [16][ 6000/31148]    Overall Loss 0.009041    Objective Loss 0.000000    Distill Loss 0.009041                     LR 0.000250    Time 0.408333    
+2023-12-02 07:16:55,952 - Epoch: [16][ 6100/31148]    Overall Loss 0.009041    Objective Loss 0.000000    Distill Loss 0.009041                     LR 0.000250    Time 0.406158    
+2023-12-02 07:17:22,966 - Epoch: [16][ 6200/31148]    Overall Loss 0.009038    Objective Loss 0.000000    Distill Loss 0.009038                     LR 0.000250    Time 0.403964    
+2023-12-02 07:17:50,262 - Epoch: [16][ 6300/31148]    Overall Loss 0.009036    Objective Loss 0.000000    Distill Loss 0.009036                     LR 0.000250    Time 0.401884    
+2023-12-02 07:18:18,258 - Epoch: [16][ 6400/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.399978    
+2023-12-02 07:18:53,129 - Epoch: [16][ 6500/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.399188    
+2023-12-02 07:19:32,655 - Epoch: [16][ 6600/31148]    Overall Loss 0.009033    Objective Loss 0.000000    Distill Loss 0.009033                     LR 0.000250    Time 0.399127    
+2023-12-02 07:20:12,714 - Epoch: [16][ 6700/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.399148    
+2023-12-02 07:20:55,387 - Epoch: [16][ 6800/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.399553    
+2023-12-02 07:21:51,399 - Epoch: [16][ 6900/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.401879    
+2023-12-02 07:22:46,673 - Epoch: [16][ 7000/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.404033    
+2023-12-02 07:23:28,649 - Epoch: [16][ 7100/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.404253    
+2023-12-02 07:24:15,949 - Epoch: [16][ 7200/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.405207    
+2023-12-02 07:24:59,941 - Epoch: [16][ 7300/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.405681    
+2023-12-02 07:25:49,413 - Epoch: [16][ 7400/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.406884    
+2023-12-02 07:26:32,869 - Epoch: [16][ 7500/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.407252    
+2023-12-02 07:27:31,419 - Epoch: [16][ 7600/31148]    Overall Loss 0.009035    Objective Loss 0.000000    Distill Loss 0.009035                     LR 0.000250    Time 0.409596    
+2023-12-02 07:28:17,350 - Epoch: [16][ 7700/31148]    Overall Loss 0.009034    Objective Loss 0.000000    Distill Loss 0.009034                     LR 0.000250    Time 0.410241    
+2023-12-02 07:29:11,043 - Epoch: [16][ 7800/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.411864    
+2023-12-02 07:29:51,054 - Epoch: [16][ 7900/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.411714    
+2023-12-02 07:30:41,001 - Epoch: [16][ 8000/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.412810    
+2023-12-02 07:31:36,647 - Epoch: [16][ 8100/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.414583    
+2023-12-02 07:32:25,085 - Epoch: [16][ 8200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.415433    
+2023-12-02 07:33:15,194 - Epoch: [16][ 8300/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.416464    
+2023-12-02 07:33:56,319 - Epoch: [16][ 8400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.416401    
+2023-12-02 07:34:45,436 - Epoch: [16][ 8500/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.417280    
+2023-12-02 07:35:27,187 - Epoch: [16][ 8600/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.417282    
+2023-12-02 07:36:06,116 - Epoch: [16][ 8700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.416959    
+2023-12-02 07:36:49,211 - Epoch: [16][ 8800/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.417118    
+2023-12-02 07:37:30,033 - Epoch: [16][ 8900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.417017    
+2023-12-02 07:38:12,344 - Epoch: [16][ 9000/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.417084    
+2023-12-02 07:38:59,429 - Epoch: [16][ 9100/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.417674    
+2023-12-02 07:39:46,275 - Epoch: [16][ 9200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.418225    
+2023-12-02 07:40:32,475 - Epoch: [16][ 9300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.418695    
+2023-12-02 07:41:21,127 - Epoch: [16][ 9400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.419416    
+2023-12-02 07:42:03,148 - Epoch: [16][ 9500/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.419423    
+2023-12-02 07:42:52,459 - Epoch: [16][ 9600/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.420190    
+2023-12-02 07:43:33,485 - Epoch: [16][ 9700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.420087    
+2023-12-02 07:44:25,315 - Epoch: [16][ 9800/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.421088    
+2023-12-02 07:45:20,377 - Epoch: [16][ 9900/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.422396    
+2023-12-02 07:46:14,216 - Epoch: [16][10000/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.423555    
+2023-12-02 07:46:58,646 - Epoch: [16][10100/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.423760    
+2023-12-02 07:47:46,901 - Epoch: [16][10200/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.424335    
+2023-12-02 07:48:37,529 - Epoch: [16][10300/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.425130    
+2023-12-02 07:49:37,772 - Epoch: [16][10400/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.426834    
+2023-12-02 07:50:24,093 - Epoch: [16][10500/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.427180    
+2023-12-02 07:51:05,239 - Epoch: [16][10600/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.427031    
+2023-12-02 07:52:02,668 - Epoch: [16][10700/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.428406    
+2023-12-02 07:52:41,064 - Epoch: [16][10800/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.427994    
+2023-12-02 07:53:22,961 - Epoch: [16][10900/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.427911    
+2023-12-02 07:54:07,070 - Epoch: [16][11000/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.428030    
+2023-12-02 07:54:54,562 - Epoch: [16][11100/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.428452    
+2023-12-02 07:55:45,997 - Epoch: [16][11200/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.429218    
+2023-12-02 07:56:27,783 - Epoch: [16][11300/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.429117    
+2023-12-02 07:57:11,139 - Epoch: [16][11400/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.429155    
+2023-12-02 07:58:07,841 - Epoch: [16][11500/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.430353    
+2023-12-02 07:58:53,546 - Epoch: [16][11600/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.430583    
+2023-12-02 07:59:43,667 - Epoch: [16][11700/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.431186    
+2023-12-02 08:00:34,303 - Epoch: [16][11800/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431822    
+2023-12-02 08:01:20,361 - Epoch: [16][11900/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.432063    
+2023-12-02 08:02:00,896 - Epoch: [16][12000/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431840    
+2023-12-02 08:02:36,453 - Epoch: [16][12100/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431209    
+2023-12-02 08:03:24,818 - Epoch: [16][12200/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431638    
+2023-12-02 08:04:09,574 - Epoch: [16][12300/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431767    
+2023-12-02 08:04:50,020 - Epoch: [16][12400/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431546    
+2023-12-02 08:05:30,751 - Epoch: [16][12500/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431352    
+2023-12-02 08:06:15,822 - Epoch: [16][12600/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431505    
+2023-12-02 08:07:02,189 - Epoch: [16][12700/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.431758    
+2023-12-02 08:08:02,581 - Epoch: [16][12800/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.433102    
+2023-12-02 08:08:50,198 - Epoch: [16][12900/31148]    Overall Loss 0.009023    Objective Loss 0.000000    Distill Loss 0.009023                     LR 0.000250    Time 0.433435    
+2023-12-02 08:09:41,950 - Epoch: [16][13000/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.434082    
+2023-12-02 08:10:39,155 - Epoch: [16][13100/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.435134    
+2023-12-02 08:11:27,991 - Epoch: [16][13200/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.435537    
+2023-12-02 08:12:17,361 - Epoch: [16][13300/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.435974    
+2023-12-02 08:13:02,074 - Epoch: [16][13400/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.436056    
+2023-12-02 08:13:53,477 - Epoch: [16][13500/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.436633    
+2023-12-02 08:14:43,305 - Epoch: [16][13600/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.437086    
+2023-12-02 08:15:24,252 - Epoch: [16][13700/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.436884    
+2023-12-02 08:16:07,905 - Epoch: [16][13800/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.436881    
+2023-12-02 08:16:55,312 - Epoch: [16][13900/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.437148    
+2023-12-02 08:17:50,718 - Epoch: [16][14000/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.437983    
+2023-12-02 08:18:34,825 - Epoch: [16][14100/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.438004    
+2023-12-02 08:19:20,117 - Epoch: [16][14200/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.438108    
+2023-12-02 08:20:14,337 - Epoch: [16][14300/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.438836    
+2023-12-02 08:20:57,708 - Epoch: [16][14400/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.438800    
+2023-12-02 08:21:47,423 - Epoch: [16][14500/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.439202    
+2023-12-02 08:22:42,092 - Epoch: [16][14600/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.439937    
+2023-12-02 08:23:22,559 - Epoch: [16][14700/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.439697    
+2023-12-02 08:24:08,969 - Epoch: [16][14800/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.439861    
+2023-12-02 08:24:48,183 - Epoch: [16][14900/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.439541    
+2023-12-02 08:25:41,282 - Epoch: [16][15000/31148]    Overall Loss 0.009024    Objective Loss 0.000000    Distill Loss 0.009024                     LR 0.000250    Time 0.440150    
+2023-12-02 08:26:19,100 - Epoch: [16][15100/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.439739    
+2023-12-02 08:27:09,677 - Epoch: [16][15200/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.440173    
+2023-12-02 08:27:50,724 - Epoch: [16][15300/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.439978    
+2023-12-02 08:28:45,006 - Epoch: [16][15400/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.440645    
+2023-12-02 08:29:37,639 - Epoch: [16][15500/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.441197    
+2023-12-02 08:30:27,768 - Epoch: [16][15600/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.441582    
+2023-12-02 08:31:12,385 - Epoch: [16][15700/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.441611    
+2023-12-02 08:32:08,268 - Epoch: [16][15800/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.442352    
+2023-12-02 08:32:52,887 - Epoch: [16][15900/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.442376    
+2023-12-02 08:33:48,897 - Epoch: [16][16000/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.443111    
+2023-12-02 08:34:37,053 - Epoch: [16][16100/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.443350    
+2023-12-02 08:35:19,006 - Epoch: [16][16200/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.443202    
+2023-12-02 08:36:01,575 - Epoch: [16][16300/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.443094    
+2023-12-02 08:36:50,703 - Epoch: [16][16400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.443388    
+2023-12-02 08:37:39,918 - Epoch: [16][16500/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.443683    
+2023-12-02 08:38:32,680 - Epoch: [16][16600/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.444188    
+2023-12-02 08:39:15,641 - Epoch: [16][16700/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.444100    
+2023-12-02 08:40:01,151 - Epoch: [16][16800/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.444165    
+2023-12-02 08:40:41,621 - Epoch: [16][16900/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.443931    
+2023-12-02 08:41:37,109 - Epoch: [16][17000/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.444584    
+2023-12-02 08:42:17,357 - Epoch: [16][17100/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.444337    
+2023-12-02 08:42:59,895 - Epoch: [16][17200/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.444226    
+2023-12-02 08:43:41,214 - Epoch: [16][17300/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.444046    
+2023-12-02 08:44:46,478 - Epoch: [16][17400/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.445245    
+2023-12-02 08:45:27,111 - Epoch: [16][17500/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445022    
+2023-12-02 08:46:10,081 - Epoch: [16][17600/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.444935    
+2023-12-02 08:46:57,396 - Epoch: [16][17700/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.445094    
+2023-12-02 08:47:41,762 - Epoch: [16][17800/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445085    
+2023-12-02 08:48:29,839 - Epoch: [16][17900/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445284    
+2023-12-02 08:49:14,987 - Epoch: [16][18000/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445318    
+2023-12-02 08:50:01,927 - Epoch: [16][18100/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445451    
+2023-12-02 08:50:54,942 - Epoch: [16][18200/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445916    
+2023-12-02 08:51:34,729 - Epoch: [16][18300/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445653    
+2023-12-02 08:52:17,329 - Epoch: [16][18400/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.445546    
+2023-12-02 08:53:01,350 - Epoch: [16][18500/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445516    
+2023-12-02 08:53:44,260 - Epoch: [16][18600/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445428    
+2023-12-02 08:54:27,978 - Epoch: [16][18700/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445383    
+2023-12-02 08:55:16,319 - Epoch: [16][18800/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445585    
+2023-12-02 08:56:02,509 - Epoch: [16][18900/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445671    
+2023-12-02 08:56:48,314 - Epoch: [16][19000/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.445736    
+2023-12-02 08:57:25,815 - Epoch: [16][19100/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.445365    
+2023-12-02 08:58:05,983 - Epoch: [16][19200/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445138    
+2023-12-02 08:58:52,736 - Epoch: [16][19300/31148]    Overall Loss 0.009025    Objective Loss 0.000000    Distill Loss 0.009025                     LR 0.000250    Time 0.445253    
+2023-12-02 08:59:47,812 - Epoch: [16][19400/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445797    
+2023-12-02 09:00:26,534 - Epoch: [16][19500/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445496    
+2023-12-02 09:01:12,409 - Epoch: [16][19600/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.445563    
+2023-12-02 09:02:05,736 - Epoch: [16][19700/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.446008    
+2023-12-02 09:02:53,049 - Epoch: [16][19800/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.446145    
+2023-12-02 09:03:44,649 - Epoch: [16][19900/31148]    Overall Loss 0.009026    Objective Loss 0.000000    Distill Loss 0.009026                     LR 0.000250    Time 0.446495    
+2023-12-02 09:04:37,354 - Epoch: [16][20000/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446898    
+2023-12-02 09:05:29,038 - Epoch: [16][20100/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.447245    
+2023-12-02 09:06:05,260 - Epoch: [16][20200/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446824    
+2023-12-02 09:06:51,989 - Epoch: [16][20300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446924    
+2023-12-02 09:07:34,810 - Epoch: [16][20400/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446832    
+2023-12-02 09:08:18,000 - Epoch: [16][20500/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446759    
+2023-12-02 09:08:59,353 - Epoch: [16][20600/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446597    
+2023-12-02 09:09:45,957 - Epoch: [16][20700/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446691    
+2023-12-02 09:10:38,046 - Epoch: [16][20800/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.447047    
+2023-12-02 09:11:23,860 - Epoch: [16][20900/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.447100    
+2023-12-02 09:12:09,502 - Epoch: [16][21000/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.447144    
+2023-12-02 09:12:44,086 - Epoch: [16][21100/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446664    
+2023-12-02 09:13:40,920 - Epoch: [16][21200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447237    
+2023-12-02 09:14:29,550 - Epoch: [16][21300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447420    
+2023-12-02 09:15:12,895 - Epoch: [16][21400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447355    
+2023-12-02 09:15:53,986 - Epoch: [16][21500/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447185    
+2023-12-02 09:16:29,324 - Epoch: [16][21600/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446750    
+2023-12-02 09:17:13,635 - Epoch: [16][21700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446733    
+2023-12-02 09:17:53,469 - Epoch: [16][21800/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446511    
+2023-12-02 09:18:30,347 - Epoch: [16][21900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446156    
+2023-12-02 09:19:12,093 - Epoch: [16][22000/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446025    
+2023-12-02 09:19:56,095 - Epoch: [16][22100/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.445997    
+2023-12-02 09:20:35,242 - Epoch: [16][22200/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.445752    
+2023-12-02 09:21:25,395 - Epoch: [16][22300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446001    
+2023-12-02 09:22:11,737 - Epoch: [16][22400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446079    
+2023-12-02 09:22:52,123 - Epoch: [16][22500/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.445891    
+2023-12-02 09:23:40,798 - Epoch: [16][22600/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446071    
+2023-12-02 09:24:28,301 - Epoch: [16][22700/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446199    
+2023-12-02 09:25:17,182 - Epoch: [16][22800/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446385    
+2023-12-02 09:25:58,732 - Epoch: [16][22900/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446250    
+2023-12-02 09:26:48,984 - Epoch: [16][23000/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446494    
+2023-12-02 09:27:38,649 - Epoch: [16][23100/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446711    
+2023-12-02 09:28:22,925 - Epoch: [16][23200/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446694    
+2023-12-02 09:29:02,317 - Epoch: [16][23300/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446467    
+2023-12-02 09:29:54,768 - Epoch: [16][23400/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.446800    
+2023-12-02 09:30:39,691 - Epoch: [16][23500/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.446810    
+2023-12-02 09:31:29,642 - Epoch: [16][23600/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447033    
+2023-12-02 09:32:19,047 - Epoch: [16][23700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447231    
+2023-12-02 09:33:16,193 - Epoch: [16][23800/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447753    
+2023-12-02 09:34:06,012 - Epoch: [16][23900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447964    
+2023-12-02 09:34:51,642 - Epoch: [16][24000/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.447998    
+2023-12-02 09:35:32,475 - Epoch: [16][24100/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.447833    
+2023-12-02 09:36:25,188 - Epoch: [16][24200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448161    
+2023-12-02 09:37:16,213 - Epoch: [16][24300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448416    
+2023-12-02 09:38:01,362 - Epoch: [16][24400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448428    
+2023-12-02 09:38:42,807 - Epoch: [16][24500/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448289    
+2023-12-02 09:39:29,065 - Epoch: [16][24600/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.448347    
+2023-12-02 09:40:19,327 - Epoch: [16][24700/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.448566    
+2023-12-02 09:41:05,700 - Epoch: [16][24800/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.448627    
+2023-12-02 09:41:46,078 - Epoch: [16][24900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448447    
+2023-12-02 09:42:30,748 - Epoch: [16][25000/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448440    
+2023-12-02 09:43:15,780 - Epoch: [16][25100/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448447    
+2023-12-02 09:44:12,234 - Epoch: [16][25200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.448907    
+2023-12-02 09:45:14,199 - Epoch: [16][25300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449582    
+2023-12-02 09:45:56,497 - Epoch: [16][25400/31148]    Overall Loss 0.009027    Objective Loss 0.000000    Distill Loss 0.009027                     LR 0.000250    Time 0.449477    
+2023-12-02 09:46:47,552 - Epoch: [16][25500/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449716    
+2023-12-02 09:47:37,666 - Epoch: [16][25600/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449917    
+2023-12-02 09:48:31,363 - Epoch: [16][25700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450255    
+2023-12-02 09:49:14,047 - Epoch: [16][25800/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450164    
+2023-12-02 09:50:01,571 - Epoch: [16][25900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450261    
+2023-12-02 09:50:38,437 - Epoch: [16][26000/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449946    
+2023-12-02 09:51:25,431 - Epoch: [16][26100/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450023    
+2023-12-02 09:52:07,895 - Epoch: [16][26200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449926    
+2023-12-02 09:52:48,867 - Epoch: [16][26300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449772    
+2023-12-02 09:53:24,891 - Epoch: [16][26400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449433    
+2023-12-02 09:54:06,281 - Epoch: [16][26500/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449299    
+2023-12-02 09:55:01,278 - Epoch: [16][26600/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449677    
+2023-12-02 09:55:45,537 - Epoch: [16][26700/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449650    
+2023-12-02 09:56:28,370 - Epoch: [16][26800/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449570    
+2023-12-02 09:57:18,942 - Epoch: [16][26900/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.449779    
+2023-12-02 09:58:10,192 - Epoch: [16][27000/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450011    
+2023-12-02 09:58:57,621 - Epoch: [16][27100/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450100    
+2023-12-02 09:59:45,842 - Epoch: [16][27200/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450218    
+2023-12-02 10:00:34,681 - Epoch: [16][27300/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450357    
+2023-12-02 10:01:21,740 - Epoch: [16][27400/31148]    Overall Loss 0.009028    Objective Loss 0.000000    Distill Loss 0.009028                     LR 0.000250    Time 0.450431    
+2023-12-02 10:02:02,039 - Epoch: [16][27500/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450258    
+2023-12-02 10:02:46,472 - Epoch: [16][27600/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450236    
+2023-12-02 10:03:29,497 - Epoch: [16][27700/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450164    
+2023-12-02 10:04:10,756 - Epoch: [16][27800/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450028    
+2023-12-02 10:04:51,906 - Epoch: [16][27900/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.449890    
+2023-12-02 10:05:39,637 - Epoch: [16][28000/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.449988    
+2023-12-02 10:06:29,270 - Epoch: [16][28100/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450152    
+2023-12-02 10:07:14,799 - Epoch: [16][28200/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450170    
+2023-12-02 10:08:00,834 - Epoch: [16][28300/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450206    
+2023-12-02 10:08:46,687 - Epoch: [16][28400/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450235    
+2023-12-02 10:09:35,784 - Epoch: [16][28500/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450378    
+2023-12-02 10:10:17,443 - Epoch: [16][28600/31148]    Overall Loss 0.009029    Objective Loss 0.000000    Distill Loss 0.009029                     LR 0.000250    Time 0.450259    
+2023-12-02 10:10:57,184 - Epoch: [16][28700/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450075    
+2023-12-02 10:11:53,866 - Epoch: [16][28800/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450480    
+2023-12-02 10:12:38,589 - Epoch: [16][28900/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450469    
+2023-12-02 10:13:23,490 - Epoch: [16][29000/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450463    
+2023-12-02 10:14:06,289 - Epoch: [16][29100/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450386    
+2023-12-02 10:14:45,879 - Epoch: [16][29200/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450199    
+2023-12-02 10:15:33,166 - Epoch: [16][29300/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450276    
+2023-12-02 10:16:17,908 - Epoch: [16][29400/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450266    
+2023-12-02 10:17:05,119 - Epoch: [16][29500/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450340    
+2023-12-02 10:17:46,605 - Epoch: [16][29600/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450220    
+2023-12-02 10:18:30,209 - Epoch: [16][29700/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450172    
+2023-12-02 10:19:10,523 - Epoch: [16][29800/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.450014    
+2023-12-02 10:19:53,587 - Epoch: [16][29900/31148]    Overall Loss 0.009030    Objective Loss 0.000000    Distill Loss 0.009030                     LR 0.000250    Time 0.449949    
+2023-12-02 10:20:35,864 - Epoch: [16][30000/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449858    
+2023-12-02 10:21:13,725 - Epoch: [16][30100/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449621    
+2023-12-02 10:22:03,004 - Epoch: [16][30200/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449764    
+2023-12-02 10:22:51,358 - Epoch: [16][30300/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449875    
+2023-12-02 10:23:40,856 - Epoch: [16][30400/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.450023    
+2023-12-02 10:24:18,718 - Epoch: [16][30500/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449789    
+2023-12-02 10:24:55,891 - Epoch: [16][30600/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449534    
+2023-12-02 10:25:47,521 - Epoch: [16][30700/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449751    
+2023-12-02 10:26:31,079 - Epoch: [16][30800/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449705    
+2023-12-02 10:27:19,657 - Epoch: [16][30900/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449821    
+2023-12-02 10:28:10,570 - Epoch: [16][31000/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.450012    
+2023-12-02 10:28:53,872 - Epoch: [16][31100/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449957    
+2023-12-02 10:29:16,716 - Epoch: [16][31148/31148]    Overall Loss 0.009031    Objective Loss 0.000000    Distill Loss 0.009031                     LR 0.000250    Time 0.449997    
+2023-12-02 10:29:17,739 - --- validate (epoch=16)-----------
+2023-12-02 10:29:17,739 - 167951 samples (100 per mini-batch)
+2023-12-02 10:29:41,497 - Epoch: [16][  100/ 1680]    Loss 0.000000    Overall Loss 0.009657    
+2023-12-02 10:30:01,521 - Epoch: [16][  200/ 1680]    Loss 0.000000    Overall Loss 0.009663    
+2023-12-02 10:30:21,438 - Epoch: [16][  300/ 1680]    Loss 0.000000    Overall Loss 0.009689    
+2023-12-02 10:30:41,378 - Epoch: [16][  400/ 1680]    Loss 0.000000    Overall Loss 0.009682    
+2023-12-02 10:31:01,393 - Epoch: [16][  500/ 1680]    Loss 0.000000    Overall Loss 0.009682    
+2023-12-02 10:31:21,445 - Epoch: [16][  600/ 1680]    Loss 0.000000    Overall Loss 0.009677    
+2023-12-02 10:31:41,454 - Epoch: [16][  700/ 1680]    Loss 0.000000    Overall Loss 0.009674    
+2023-12-02 10:32:01,394 - Epoch: [16][  800/ 1680]    Loss 0.000000    Overall Loss 0.009674    
+2023-12-02 10:32:21,371 - Epoch: [16][  900/ 1680]    Loss 0.000000    Overall Loss 0.009672    
+2023-12-02 10:32:41,362 - Epoch: [16][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009666    
+2023-12-02 10:33:01,376 - Epoch: [16][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009666    
+2023-12-02 10:33:21,385 - Epoch: [16][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009659    
+2023-12-02 10:33:41,334 - Epoch: [16][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009658    
+2023-12-02 10:34:01,341 - Epoch: [16][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009658    
+2023-12-02 10:34:21,323 - Epoch: [16][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009662    
+2023-12-02 10:34:41,327 - Epoch: [16][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009659    
+2023-12-02 10:34:57,279 - Epoch: [16][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009658    
+2023-12-02 10:34:57,892 - ==> Overall Loss: 0.010
+
+2023-12-02 10:34:57,898 - ==> Best [Overall Loss: 0.009658 on epoch: 16]
+2023-12-02 10:34:57,898 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-02 10:34:57,958 - 
+
+2023-12-02 10:34:57,958 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-02 10:36:00,185 - Epoch: [17][  100/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.622184    
+2023-12-02 10:36:38,053 - Epoch: [17][  200/31148]    Overall Loss 0.008917    Objective Loss 0.000000    Distill Loss 0.008917                     LR 0.000250    Time 0.500395    
+2023-12-02 10:37:17,508 - Epoch: [17][  300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.465093    
+2023-12-02 10:38:02,451 - Epoch: [17][  400/31148]    Overall Loss 0.008956    Objective Loss 0.000000    Distill Loss 0.008956                     LR 0.000250    Time 0.461156    
+2023-12-02 10:38:50,371 - Epoch: [17][  500/31148]    Overall Loss 0.008945    Objective Loss 0.000000    Distill Loss 0.008945                     LR 0.000250    Time 0.464749    
+2023-12-02 10:39:33,783 - Epoch: [17][  600/31148]    Overall Loss 0.008955    Objective Loss 0.000000    Distill Loss 0.008955                     LR 0.000250    Time 0.459633    
+2023-12-02 10:40:13,016 - Epoch: [17][  700/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.450007    
+2023-12-02 10:40:43,021 - Epoch: [17][  800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.431256    
+2023-12-02 10:41:09,771 - Epoch: [17][  900/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.413056    
+2023-12-02 10:41:37,196 - Epoch: [17][ 1000/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.399170    
+2023-12-02 10:42:04,557 - Epoch: [17][ 1100/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.387751    
+2023-12-02 10:42:32,688 - Epoch: [17][ 1200/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.378877    
+2023-12-02 10:43:00,545 - Epoch: [17][ 1300/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.371158    
+2023-12-02 10:43:28,467 - Epoch: [17][ 1400/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.364588    
+2023-12-02 10:43:56,978 - Epoch: [17][ 1500/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.359286    
+2023-12-02 10:44:24,431 - Epoch: [17][ 1600/31148]    Overall Loss 0.009000    Objective Loss 0.000000    Distill Loss 0.009000                     LR 0.000250    Time 0.353986    
+2023-12-02 10:44:52,345 - Epoch: [17][ 1700/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.349581    
+2023-12-02 10:45:20,002 - Epoch: [17][ 1800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.345522    
+2023-12-02 10:45:46,826 - Epoch: [17][ 1900/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.341453    
+2023-12-02 10:46:20,600 - Epoch: [17][ 2000/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.341265    
+2023-12-02 10:47:12,816 - Epoch: [17][ 2100/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.349875    
+2023-12-02 10:47:58,897 - Epoch: [17][ 2200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.354914    
+2023-12-02 10:48:46,218 - Epoch: [17][ 2300/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.360055    
+2023-12-02 10:49:33,835 - Epoch: [17][ 2400/31148]    Overall Loss 0.009012    Objective Loss 0.000000    Distill Loss 0.009012                     LR 0.000250    Time 0.364889    
+2023-12-02 10:50:17,881 - Epoch: [17][ 2500/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.367909    
+2023-12-02 10:51:00,660 - Epoch: [17][ 2600/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.370209    
+2023-12-02 10:51:44,258 - Epoch: [17][ 2700/31148]    Overall Loss 0.009018    Objective Loss 0.000000    Distill Loss 0.009018                     LR 0.000250    Time 0.372643    
+2023-12-02 10:52:40,839 - Epoch: [17][ 2800/31148]    Overall Loss 0.009015    Objective Loss 0.000000    Distill Loss 0.009015                     LR 0.000250    Time 0.379539    
+2023-12-02 10:53:25,912 - Epoch: [17][ 2900/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.381991    
+2023-12-02 10:54:20,456 - Epoch: [17][ 3000/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.387437    
+2023-12-02 10:55:10,992 - Epoch: [17][ 3100/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.391238    
+2023-12-02 10:55:59,147 - Epoch: [17][ 3200/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.394058    
+2023-12-02 10:56:35,270 - Epoch: [17][ 3300/31148]    Overall Loss 0.009012    Objective Loss 0.000000    Distill Loss 0.009012                     LR 0.000250    Time 0.393061    
+2023-12-02 10:57:21,413 - Epoch: [17][ 3400/31148]    Overall Loss 0.009012    Objective Loss 0.000000    Distill Loss 0.009012                     LR 0.000250    Time 0.395070    
+2023-12-02 10:58:05,661 - Epoch: [17][ 3500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.396422    
+2023-12-02 10:58:53,477 - Epoch: [17][ 3600/31148]    Overall Loss 0.009011    Objective Loss 0.000000    Distill Loss 0.009011                     LR 0.000250    Time 0.398690    
+2023-12-02 10:59:35,886 - Epoch: [17][ 3700/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.399375    
+2023-12-02 11:00:33,164 - Epoch: [17][ 3800/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.403936    
+2023-12-02 11:01:19,073 - Epoch: [17][ 3900/31148]    Overall Loss 0.009015    Objective Loss 0.000000    Distill Loss 0.009015                     LR 0.000250    Time 0.405348    
+2023-12-02 11:02:03,740 - Epoch: [17][ 4000/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.406379    
+2023-12-02 11:02:44,519 - Epoch: [17][ 4100/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.406412    
+2023-12-02 11:03:35,884 - Epoch: [17][ 4200/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.408964    
+2023-12-02 11:04:27,052 - Epoch: [17][ 4300/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.411351    
+2023-12-02 11:05:13,664 - Epoch: [17][ 4400/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.412594    
+2023-12-02 11:05:59,309 - Epoch: [17][ 4500/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.413567    
+2023-12-02 11:06:41,183 - Epoch: [17][ 4600/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.413678    
+2023-12-02 11:07:29,002 - Epoch: [17][ 4700/31148]    Overall Loss 0.009013    Objective Loss 0.000000    Distill Loss 0.009013                     LR 0.000250    Time 0.415049    
+2023-12-02 11:08:19,375 - Epoch: [17][ 4800/31148]    Overall Loss 0.009015    Objective Loss 0.000000    Distill Loss 0.009015                     LR 0.000250    Time 0.416895    
+2023-12-02 11:09:05,601 - Epoch: [17][ 4900/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.417819    
+2023-12-02 11:09:50,131 - Epoch: [17][ 5000/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.418367    
+2023-12-02 11:10:24,434 - Epoch: [17][ 5100/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.416888    
+2023-12-02 11:11:15,542 - Epoch: [17][ 5200/31148]    Overall Loss 0.009015    Objective Loss 0.000000    Distill Loss 0.009015                     LR 0.000250    Time 0.418698    
+2023-12-02 11:11:53,273 - Epoch: [17][ 5300/31148]    Overall Loss 0.009014    Objective Loss 0.000000    Distill Loss 0.009014                     LR 0.000250    Time 0.417916    
+2023-12-02 11:12:41,527 - Epoch: [17][ 5400/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.419111    
+2023-12-02 11:13:30,340 - Epoch: [17][ 5500/31148]    Overall Loss 0.009017    Objective Loss 0.000000    Distill Loss 0.009017                     LR 0.000250    Time 0.420365    
+2023-12-02 11:14:10,462 - Epoch: [17][ 5600/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.420022    
+2023-12-02 11:14:58,393 - Epoch: [17][ 5700/31148]    Overall Loss 0.009016    Objective Loss 0.000000    Distill Loss 0.009016                     LR 0.000250    Time 0.421060    
+2023-12-02 11:15:54,607 - Epoch: [17][ 5800/31148]    Overall Loss 0.009015    Objective Loss 0.000000    Distill Loss 0.009015                     LR 0.000250    Time 0.423492    
+2023-12-02 11:16:30,086 - Epoch: [17][ 5900/31148]    Overall Loss 0.009013    Objective Loss 0.000000    Distill Loss 0.009013                     LR 0.000250    Time 0.422326    
+2023-12-02 11:17:15,581 - Epoch: [17][ 6000/31148]    Overall Loss 0.009011    Objective Loss 0.000000    Distill Loss 0.009011                     LR 0.000250    Time 0.422868    
+2023-12-02 11:18:02,640 - Epoch: [17][ 6100/31148]    Overall Loss 0.009011    Objective Loss 0.000000    Distill Loss 0.009011                     LR 0.000250    Time 0.423650    
+2023-12-02 11:18:44,910 - Epoch: [17][ 6200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.423633    
+2023-12-02 11:19:34,114 - Epoch: [17][ 6300/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.424718    
+2023-12-02 11:20:31,561 - Epoch: [17][ 6400/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.427056    
+2023-12-02 11:21:23,143 - Epoch: [17][ 6500/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.428421    
+2023-12-02 11:22:29,111 - Epoch: [17][ 6600/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.431924    
+2023-12-02 11:23:18,328 - Epoch: [17][ 6700/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.432822    
+2023-12-02 11:24:02,095 - Epoch: [17][ 6800/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.432892    
+2023-12-02 11:24:45,358 - Epoch: [17][ 6900/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.432887    
+2023-12-02 11:25:25,185 - Epoch: [17][ 7000/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.432391    
+2023-12-02 11:26:16,124 - Epoch: [17][ 7100/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.433475    
+2023-12-02 11:27:04,796 - Epoch: [17][ 7200/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.434213    
+2023-12-02 11:27:50,011 - Epoch: [17][ 7300/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.434458    
+2023-12-02 11:28:41,971 - Epoch: [17][ 7400/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.435607    
+2023-12-02 11:29:26,965 - Epoch: [17][ 7500/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.435797    
+2023-12-02 11:30:03,187 - Epoch: [17][ 7600/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.434828    
+2023-12-02 11:30:55,100 - Epoch: [17][ 7700/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.435922    
+2023-12-02 11:31:43,472 - Epoch: [17][ 7800/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.436534    
+2023-12-02 11:32:34,250 - Epoch: [17][ 7900/31148]    Overall Loss 0.009002    Objective Loss 0.000000    Distill Loss 0.009002                     LR 0.000250    Time 0.437435    
+2023-12-02 11:33:21,714 - Epoch: [17][ 8000/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.437899    
+2023-12-02 11:34:02,826 - Epoch: [17][ 8100/31148]    Overall Loss 0.009002    Objective Loss 0.000000    Distill Loss 0.009002                     LR 0.000250    Time 0.437567    
+2023-12-02 11:34:58,746 - Epoch: [17][ 8200/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.439050    
+2023-12-02 11:35:42,875 - Epoch: [17][ 8300/31148]    Overall Loss 0.009002    Objective Loss 0.000000    Distill Loss 0.009002                     LR 0.000250    Time 0.439076    
+2023-12-02 11:36:25,619 - Epoch: [17][ 8400/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.438936    
+2023-12-02 11:37:08,816 - Epoch: [17][ 8500/31148]    Overall Loss 0.009002    Objective Loss 0.000000    Distill Loss 0.009002                     LR 0.000250    Time 0.438854    
+2023-12-02 11:37:57,237 - Epoch: [17][ 8600/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.439380    
+2023-12-02 11:38:43,379 - Epoch: [17][ 8700/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.439633    
+2023-12-02 11:39:27,815 - Epoch: [17][ 8800/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.439685    
+2023-12-02 11:40:30,827 - Epoch: [17][ 8900/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.441824    
+2023-12-02 11:41:11,887 - Epoch: [17][ 9000/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.441477    
+2023-12-02 11:42:00,998 - Epoch: [17][ 9100/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.442021    
+2023-12-02 11:42:34,608 - Epoch: [17][ 9200/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.440869    
+2023-12-02 11:43:24,590 - Epoch: [17][ 9300/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.441502    
+2023-12-02 11:44:05,361 - Epoch: [17][ 9400/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.441142    
+2023-12-02 11:44:42,230 - Epoch: [17][ 9500/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.440378    
+2023-12-02 11:45:29,946 - Epoch: [17][ 9600/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.440761    
+2023-12-02 11:46:19,296 - Epoch: [17][ 9700/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.441304    
+2023-12-02 11:47:09,624 - Epoch: [17][ 9800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.441935    
+2023-12-02 11:47:54,312 - Epoch: [17][ 9900/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.441985    
+2023-12-02 11:48:44,572 - Epoch: [17][10000/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.442590    
+2023-12-02 11:49:25,458 - Epoch: [17][10100/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.442255    
+2023-12-02 11:50:20,501 - Epoch: [17][10200/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.443315    
+2023-12-02 11:51:08,662 - Epoch: [17][10300/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.443686    
+2023-12-02 11:51:49,424 - Epoch: [17][10400/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.443339    
+2023-12-02 11:52:48,532 - Epoch: [17][10500/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.444745    
+2023-12-02 11:53:28,126 - Epoch: [17][10600/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.444284    
+2023-12-02 11:54:25,924 - Epoch: [17][10700/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.445533    
+2023-12-02 11:55:12,337 - Epoch: [17][10800/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.445704    
+2023-12-02 11:55:53,967 - Epoch: [17][10900/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.445434    
+2023-12-02 11:56:42,194 - Epoch: [17][11000/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.445768    
+2023-12-02 11:57:24,045 - Epoch: [17][11100/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.445522    
+2023-12-02 11:58:08,560 - Epoch: [17][11200/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.445518    
+2023-12-02 11:58:48,586 - Epoch: [17][11300/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.445117    
+2023-12-02 11:59:30,801 - Epoch: [17][11400/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.444915    
+2023-12-02 12:00:30,577 - Epoch: [17][11500/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.446243    
+2023-12-02 12:01:26,974 - Epoch: [17][11600/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.447257    
+2023-12-02 12:02:09,406 - Epoch: [17][11700/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.447061    
+2023-12-02 12:02:58,333 - Epoch: [17][11800/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447418    
+2023-12-02 12:03:43,245 - Epoch: [17][11900/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447431    
+2023-12-02 12:04:19,708 - Epoch: [17][12000/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.446741    
+2023-12-02 12:05:12,249 - Epoch: [17][12100/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447390    
+2023-12-02 12:06:01,696 - Epoch: [17][12200/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447776    
+2023-12-02 12:06:46,169 - Epoch: [17][12300/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447750    
+2023-12-02 12:07:30,994 - Epoch: [17][12400/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447754    
+2023-12-02 12:08:08,303 - Epoch: [17][12500/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447156    
+2023-12-02 12:08:49,265 - Epoch: [17][12600/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.446857    
+2023-12-02 12:09:37,805 - Epoch: [17][12700/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447160    
+2023-12-02 12:10:33,512 - Epoch: [17][12800/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.448018    
+2023-12-02 12:11:14,105 - Epoch: [17][12900/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.447691    
+2023-12-02 12:11:56,423 - Epoch: [17][13000/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.447502    
+2023-12-02 12:12:48,842 - Epoch: [17][13100/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.448087    
+2023-12-02 12:13:34,771 - Epoch: [17][13200/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.448171    
+2023-12-02 12:14:19,293 - Epoch: [17][13300/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.448148    
+2023-12-02 12:15:14,159 - Epoch: [17][13400/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.448898    
+2023-12-02 12:15:58,419 - Epoch: [17][13500/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.448851    
+2023-12-02 12:16:44,814 - Epoch: [17][13600/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.448961    
+2023-12-02 12:17:30,280 - Epoch: [17][13700/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.449002    
+2023-12-02 12:18:12,387 - Epoch: [17][13800/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.448799    
+2023-12-02 12:19:02,350 - Epoch: [17][13900/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.449165    
+2023-12-02 12:19:55,689 - Epoch: [17][14000/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449766    
+2023-12-02 12:20:38,319 - Epoch: [17][14100/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449599    
+2023-12-02 12:21:19,341 - Epoch: [17][14200/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449321    
+2023-12-02 12:22:07,002 - Epoch: [17][14300/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449511    
+2023-12-02 12:22:46,342 - Epoch: [17][14400/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.449121    
+2023-12-02 12:23:30,893 - Epoch: [17][14500/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449096    
+2023-12-02 12:24:10,864 - Epoch: [17][14600/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.448757    
+2023-12-02 12:24:56,255 - Epoch: [17][14700/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.448791    
+2023-12-02 12:25:46,794 - Epoch: [17][14800/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.449173    
+2023-12-02 12:26:31,919 - Epoch: [17][14900/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.449187    
+2023-12-02 12:27:14,504 - Epoch: [17][15000/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.449031    
+2023-12-02 12:27:59,141 - Epoch: [17][15100/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449013    
+2023-12-02 12:28:43,036 - Epoch: [17][15200/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.448946    
+2023-12-02 12:29:29,167 - Epoch: [17][15300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449026    
+2023-12-02 12:30:18,314 - Epoch: [17][15400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449301    
+2023-12-02 12:31:13,141 - Epoch: [17][15500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449939    
+2023-12-02 12:31:50,648 - Epoch: [17][15600/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449459    
+2023-12-02 12:32:32,852 - Epoch: [17][15700/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449284    
+2023-12-02 12:33:09,664 - Epoch: [17][15800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.448770    
+2023-12-02 12:33:57,214 - Epoch: [17][15900/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.448937    
+2023-12-02 12:34:45,618 - Epoch: [17][16000/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449156    
+2023-12-02 12:35:40,954 - Epoch: [17][16100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449803    
+2023-12-02 12:36:33,726 - Epoch: [17][16200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450284    
+2023-12-02 12:37:20,725 - Epoch: [17][16300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450404    
+2023-12-02 12:38:02,500 - Epoch: [17][16400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450204    
+2023-12-02 12:38:57,021 - Epoch: [17][16500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450780    
+2023-12-02 12:39:50,875 - Epoch: [17][16600/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451308    
+2023-12-02 12:40:41,330 - Epoch: [17][16700/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451626    
+2023-12-02 12:41:22,808 - Epoch: [17][16800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451407    
+2023-12-02 12:42:04,860 - Epoch: [17][16900/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451223    
+2023-12-02 12:42:50,621 - Epoch: [17][17000/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451260    
+2023-12-02 12:43:41,821 - Epoch: [17][17100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451615    
+2023-12-02 12:44:27,121 - Epoch: [17][17200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451623    
+2023-12-02 12:45:06,844 - Epoch: [17][17300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451308    
+2023-12-02 12:45:54,064 - Epoch: [17][17400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451428    
+2023-12-02 12:46:43,199 - Epoch: [17][17500/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.451655    
+2023-12-02 12:47:27,189 - Epoch: [17][17600/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.451588    
+2023-12-02 12:48:07,152 - Epoch: [17][17700/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.451294    
+2023-12-02 12:48:46,583 - Epoch: [17][17800/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450974    
+2023-12-02 12:49:31,718 - Epoch: [17][17900/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450975    
+2023-12-02 12:50:12,068 - Epoch: [17][18000/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450711    
+2023-12-02 12:50:59,295 - Epoch: [17][18100/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450830    
+2023-12-02 12:51:41,871 - Epoch: [17][18200/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450692    
+2023-12-02 12:52:23,790 - Epoch: [17][18300/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.450519    
+2023-12-02 12:53:06,625 - Epoch: [17][18400/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450399    
+2023-12-02 12:53:47,957 - Epoch: [17][18500/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450198    
+2023-12-02 12:54:25,519 - Epoch: [17][18600/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449796    
+2023-12-02 12:55:14,001 - Epoch: [17][18700/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449983    
+2023-12-02 12:56:01,688 - Epoch: [17][18800/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450126    
+2023-12-02 12:56:54,329 - Epoch: [17][18900/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450529    
+2023-12-02 12:57:33,584 - Epoch: [17][19000/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450223    
+2023-12-02 12:58:17,337 - Epoch: [17][19100/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.450157    
+2023-12-02 12:59:04,226 - Epoch: [17][19200/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450254    
+2023-12-02 12:59:47,118 - Epoch: [17][19300/31148]    Overall Loss 0.009006    Objective Loss 0.000000    Distill Loss 0.009006                     LR 0.000250    Time 0.450143    
+2023-12-02 13:00:34,846 - Epoch: [17][19400/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450283    
+2023-12-02 13:01:25,630 - Epoch: [17][19500/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450577    
+2023-12-02 13:02:06,452 - Epoch: [17][19600/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450361    
+2023-12-02 13:02:47,152 - Epoch: [17][19700/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450140    
+2023-12-02 13:03:39,506 - Epoch: [17][19800/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450511    
+2023-12-02 13:04:25,609 - Epoch: [17][19900/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.450563    
+2023-12-02 13:05:09,223 - Epoch: [17][20000/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450491    
+2023-12-02 13:05:48,622 - Epoch: [17][20100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450209    
+2023-12-02 13:06:26,889 - Epoch: [17][20200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449875    
+2023-12-02 13:07:01,806 - Epoch: [17][20300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449378    
+2023-12-02 13:07:52,908 - Epoch: [17][20400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449680    
+2023-12-02 13:08:28,959 - Epoch: [17][20500/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449245    
+2023-12-02 13:09:12,686 - Epoch: [17][20600/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449186    
+2023-12-02 13:09:59,882 - Epoch: [17][20700/31148]    Overall Loss 0.009007    Objective Loss 0.000000    Distill Loss 0.009007                     LR 0.000250    Time 0.449296    
+2023-12-02 13:10:42,365 - Epoch: [17][20800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449178    
+2023-12-02 13:11:24,816 - Epoch: [17][20900/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449060    
+2023-12-02 13:12:09,948 - Epoch: [17][21000/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449070    
+2023-12-02 13:12:50,051 - Epoch: [17][21100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.448842    
+2023-12-02 13:13:44,824 - Epoch: [17][21200/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449308    
+2023-12-02 13:14:32,143 - Epoch: [17][21300/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449420    
+2023-12-02 13:15:15,123 - Epoch: [17][21400/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449328    
+2023-12-02 13:15:59,026 - Epoch: [17][21500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449280    
+2023-12-02 13:16:40,625 - Epoch: [17][21600/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449125    
+2023-12-02 13:17:33,398 - Epoch: [17][21700/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449487    
+2023-12-02 13:18:16,877 - Epoch: [17][21800/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449419    
+2023-12-02 13:18:59,160 - Epoch: [17][21900/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449297    
+2023-12-02 13:19:45,200 - Epoch: [17][22000/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449348    
+2023-12-02 13:20:26,252 - Epoch: [17][22100/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449172    
+2023-12-02 13:21:07,987 - Epoch: [17][22200/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449028    
+2023-12-02 13:21:55,678 - Epoch: [17][22300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449153    
+2023-12-02 13:22:47,312 - Epoch: [17][22400/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449452    
+2023-12-02 13:23:30,677 - Epoch: [17][22500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449382    
+2023-12-02 13:24:16,044 - Epoch: [17][22600/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449400    
+2023-12-02 13:24:55,881 - Epoch: [17][22700/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449175    
+2023-12-02 13:25:50,919 - Epoch: [17][22800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449619    
+2023-12-02 13:26:32,649 - Epoch: [17][22900/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449478    
+2023-12-02 13:27:10,244 - Epoch: [17][23000/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449157    
+2023-12-02 13:27:58,731 - Epoch: [17][23100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.449312    
+2023-12-02 13:28:45,267 - Epoch: [17][23200/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449381    
+2023-12-02 13:29:23,180 - Epoch: [17][23300/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449079    
+2023-12-02 13:30:12,184 - Epoch: [17][23400/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449254    
+2023-12-02 13:30:49,827 - Epoch: [17][23500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.448943    
+2023-12-02 13:31:41,235 - Epoch: [17][23600/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449219    
+2023-12-02 13:32:35,084 - Epoch: [17][23700/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.449595    
+2023-12-02 13:33:33,433 - Epoch: [17][23800/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450158    
+2023-12-02 13:34:22,059 - Epoch: [17][23900/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450308    
+2023-12-02 13:35:14,818 - Epoch: [17][24000/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450630    
+2023-12-02 13:35:53,785 - Epoch: [17][24100/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.450377    
+2023-12-02 13:36:39,490 - Epoch: [17][24200/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450404    
+2023-12-02 13:37:29,792 - Epoch: [17][24300/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450620    
+2023-12-02 13:38:15,123 - Epoch: [17][24400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450631    
+2023-12-02 13:39:07,782 - Epoch: [17][24500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450941    
+2023-12-02 13:40:01,063 - Epoch: [17][24600/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451273    
+2023-12-02 13:40:46,975 - Epoch: [17][24700/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451305    
+2023-12-02 13:41:30,721 - Epoch: [17][24800/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451249    
+2023-12-02 13:42:11,951 - Epoch: [17][24900/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451092    
+2023-12-02 13:43:03,169 - Epoch: [17][25000/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451336    
+2023-12-02 13:43:54,269 - Epoch: [17][25100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451574    
+2023-12-02 13:44:37,574 - Epoch: [17][25200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451500    
+2023-12-02 13:45:28,474 - Epoch: [17][25300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451727    
+2023-12-02 13:46:13,774 - Epoch: [17][25400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451731    
+2023-12-02 13:46:52,491 - Epoch: [17][25500/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451478    
+2023-12-02 13:47:33,484 - Epoch: [17][25600/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451315    
+2023-12-02 13:48:10,198 - Epoch: [17][25700/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450988    
+2023-12-02 13:48:53,531 - Epoch: [17][25800/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450919    
+2023-12-02 13:49:31,920 - Epoch: [17][25900/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450660    
+2023-12-02 13:50:15,408 - Epoch: [17][26000/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450599    
+2023-12-02 13:51:00,217 - Epoch: [17][26100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450589    
+2023-12-02 13:51:45,454 - Epoch: [17][26200/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450595    
+2023-12-02 13:52:35,773 - Epoch: [17][26300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450795    
+2023-12-02 13:53:20,222 - Epoch: [17][26400/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450771    
+2023-12-02 13:53:57,771 - Epoch: [17][26500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450487    
+2023-12-02 13:54:37,558 - Epoch: [17][26600/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450289    
+2023-12-02 13:55:24,313 - Epoch: [17][26700/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450353    
+2023-12-02 13:56:17,488 - Epoch: [17][26800/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450656    
+2023-12-02 13:56:58,913 - Epoch: [17][26900/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450521    
+2023-12-02 13:57:43,679 - Epoch: [17][27000/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450510    
+2023-12-02 13:58:37,019 - Epoch: [17][27100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450816    
+2023-12-02 13:59:22,064 - Epoch: [17][27200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450814    
+2023-12-02 14:00:10,334 - Epoch: [17][27300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450930    
+2023-12-02 14:00:52,722 - Epoch: [17][27400/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450831    
+2023-12-02 14:01:41,849 - Epoch: [17][27500/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450978    
+2023-12-02 14:02:19,205 - Epoch: [17][27600/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450698    
+2023-12-02 14:03:08,264 - Epoch: [17][27700/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450841    
+2023-12-02 14:03:55,778 - Epoch: [17][27800/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450928    
+2023-12-02 14:04:42,808 - Epoch: [17][27900/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450998    
+2023-12-02 14:05:32,639 - Epoch: [17][28000/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451166    
+2023-12-02 14:06:13,004 - Epoch: [17][28100/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.450997    
+2023-12-02 14:07:05,232 - Epoch: [17][28200/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451249    
+2023-12-02 14:07:47,545 - Epoch: [17][28300/31148]    Overall Loss 0.009008    Objective Loss 0.000000    Distill Loss 0.009008                     LR 0.000250    Time 0.451150    
+2023-12-02 14:08:35,049 - Epoch: [17][28400/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451234    
+2023-12-02 14:09:12,972 - Epoch: [17][28500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450981    
+2023-12-02 14:10:03,630 - Epoch: [17][28600/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451175    
+2023-12-02 14:10:53,590 - Epoch: [17][28700/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451343    
+2023-12-02 14:11:32,901 - Epoch: [17][28800/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.451141    
+2023-12-02 14:12:05,409 - Epoch: [17][28900/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.450705    
+2023-12-02 14:12:34,236 - Epoch: [17][29000/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.450144    
+2023-12-02 14:13:00,539 - Epoch: [17][29100/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.449501    
+2023-12-02 14:13:30,747 - Epoch: [17][29200/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.448996    
+2023-12-02 14:13:59,218 - Epoch: [17][29300/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.448435    
+2023-12-02 14:14:29,610 - Epoch: [17][29400/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.447944    
+2023-12-02 14:14:57,659 - Epoch: [17][29500/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.447376    
+2023-12-02 14:15:26,156 - Epoch: [17][29600/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.446827    
+2023-12-02 14:15:54,083 - Epoch: [17][29700/31148]    Overall Loss 0.009009    Objective Loss 0.000000    Distill Loss 0.009009                     LR 0.000250    Time 0.446263    
+2023-12-02 14:16:22,484 - Epoch: [17][29800/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445718    
+2023-12-02 14:16:50,312 - Epoch: [17][29900/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445158    
+2023-12-02 14:17:21,473 - Epoch: [17][30000/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.444713    
+2023-12-02 14:18:10,562 - Epoch: [17][30100/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.444866    
+2023-12-02 14:19:08,070 - Epoch: [17][30200/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445297    
+2023-12-02 14:19:53,861 - Epoch: [17][30300/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445338    
+2023-12-02 14:20:53,318 - Epoch: [17][30400/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445829    
+2023-12-02 14:21:41,320 - Epoch: [17][30500/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445941    
+2023-12-02 14:22:27,893 - Epoch: [17][30600/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.446005    
+2023-12-02 14:23:07,495 - Epoch: [17][30700/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.445842    
+2023-12-02 14:24:09,426 - Epoch: [17][30800/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.446405    
+2023-12-02 14:24:46,370 - Epoch: [17][30900/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.446156    
+2023-12-02 14:25:38,307 - Epoch: [17][31000/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.446391    
+2023-12-02 14:26:23,760 - Epoch: [17][31100/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.446417    
+2023-12-02 14:26:44,842 - Epoch: [17][31148/31148]    Overall Loss 0.009010    Objective Loss 0.000000    Distill Loss 0.009010                     LR 0.000250    Time 0.446406    
+2023-12-02 14:26:46,030 - --- validate (epoch=17)-----------
+2023-12-02 14:26:46,030 - 167951 samples (100 per mini-batch)
+2023-12-02 14:27:10,473 - Epoch: [17][  100/ 1680]    Loss 0.000000    Overall Loss 0.009636    
+2023-12-02 14:27:30,483 - Epoch: [17][  200/ 1680]    Loss 0.000000    Overall Loss 0.009619    
+2023-12-02 14:27:50,437 - Epoch: [17][  300/ 1680]    Loss 0.000000    Overall Loss 0.009619    
+2023-12-02 14:28:10,404 - Epoch: [17][  400/ 1680]    Loss 0.000000    Overall Loss 0.009613    
+2023-12-02 14:28:30,423 - Epoch: [17][  500/ 1680]    Loss 0.000000    Overall Loss 0.009615    
+2023-12-02 14:28:50,431 - Epoch: [17][  600/ 1680]    Loss 0.000000    Overall Loss 0.009618    
+2023-12-02 14:29:10,422 - Epoch: [17][  700/ 1680]    Loss 0.000000    Overall Loss 0.009621    
+2023-12-02 14:29:30,472 - Epoch: [17][  800/ 1680]    Loss 0.000000    Overall Loss 0.009622    
+2023-12-02 14:29:50,472 - Epoch: [17][  900/ 1680]    Loss 0.000000    Overall Loss 0.009628    
+2023-12-02 14:30:10,470 - Epoch: [17][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009624    
+2023-12-02 14:30:30,554 - Epoch: [17][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009624    
+2023-12-02 14:30:50,561 - Epoch: [17][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009626    
+2023-12-02 14:31:10,554 - Epoch: [17][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009633    
+2023-12-02 14:31:30,554 - Epoch: [17][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009635    
+2023-12-02 14:31:50,588 - Epoch: [17][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009635    
+2023-12-02 14:32:10,582 - Epoch: [17][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009631    
+2023-12-02 14:32:26,598 - Epoch: [17][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009635    
+2023-12-02 14:32:27,402 - ==> Overall Loss: 0.010
+
+2023-12-02 14:32:27,412 - ==> Best [Overall Loss: 0.009635 on epoch: 17]
+2023-12-02 14:32:27,412 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-02 14:32:27,474 - 
+
+2023-12-02 14:32:27,474 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-02 14:33:30,178 - Epoch: [18][  100/31148]    Overall Loss 0.008938    Objective Loss 0.000000    Distill Loss 0.008938                     LR 0.000250    Time 0.626930    
+2023-12-02 14:34:16,474 - Epoch: [18][  200/31148]    Overall Loss 0.008922    Objective Loss 0.000000    Distill Loss 0.008922                     LR 0.000250    Time 0.544913    
+2023-12-02 14:35:06,383 - Epoch: [18][  300/31148]    Overall Loss 0.008939    Objective Loss 0.000000    Distill Loss 0.008939                     LR 0.000250    Time 0.529616    
+2023-12-02 14:35:48,819 - Epoch: [18][  400/31148]    Overall Loss 0.008941    Objective Loss 0.000000    Distill Loss 0.008941                     LR 0.000250    Time 0.503285    
+2023-12-02 14:36:39,063 - Epoch: [18][  500/31148]    Overall Loss 0.008933    Objective Loss 0.000000    Distill Loss 0.008933                     LR 0.000250    Time 0.503101    
+2023-12-02 14:37:28,842 - Epoch: [18][  600/31148]    Overall Loss 0.008932    Objective Loss 0.000000    Distill Loss 0.008932                     LR 0.000250    Time 0.502204    
+2023-12-02 14:38:16,212 - Epoch: [18][  700/31148]    Overall Loss 0.008950    Objective Loss 0.000000    Distill Loss 0.008950                     LR 0.000250    Time 0.498122    
+2023-12-02 14:39:04,471 - Epoch: [18][  800/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.496170    
+2023-12-02 14:39:57,379 - Epoch: [18][  900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.499819    
+2023-12-02 14:40:39,820 - Epoch: [18][ 1000/31148]    Overall Loss 0.008967    Objective Loss 0.000000    Distill Loss 0.008967                     LR 0.000250    Time 0.492271    
+2023-12-02 14:41:30,527 - Epoch: [18][ 1100/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.493610    
+2023-12-02 14:42:23,778 - Epoch: [18][ 1200/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.496845    
+2023-12-02 14:43:14,468 - Epoch: [18][ 1300/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.497613    
+2023-12-02 14:43:58,324 - Epoch: [18][ 1400/31148]    Overall Loss 0.008984    Objective Loss 0.000000    Distill Loss 0.008984                     LR 0.000250    Time 0.493389    
+2023-12-02 14:44:41,876 - Epoch: [18][ 1500/31148]    Overall Loss 0.008983    Objective Loss 0.000000    Distill Loss 0.008983                     LR 0.000250    Time 0.489526    
+2023-12-02 14:45:31,803 - Epoch: [18][ 1600/31148]    Overall Loss 0.008984    Objective Loss 0.000000    Distill Loss 0.008984                     LR 0.000250    Time 0.490130    
+2023-12-02 14:46:11,278 - Epoch: [18][ 1700/31148]    Overall Loss 0.008981    Objective Loss 0.000000    Distill Loss 0.008981                     LR 0.000250    Time 0.484515    
+2023-12-02 14:47:06,901 - Epoch: [18][ 1800/31148]    Overall Loss 0.008982    Objective Loss 0.000000    Distill Loss 0.008982                     LR 0.000250    Time 0.488495    
+2023-12-02 14:47:51,576 - Epoch: [18][ 1900/31148]    Overall Loss 0.008980    Objective Loss 0.000000    Distill Loss 0.008980                     LR 0.000250    Time 0.486294    
+2023-12-02 14:48:25,302 - Epoch: [18][ 2000/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.478838    
+2023-12-02 14:49:01,240 - Epoch: [18][ 2100/31148]    Overall Loss 0.008980    Objective Loss 0.000000    Distill Loss 0.008980                     LR 0.000250    Time 0.473147    
+2023-12-02 14:49:36,896 - Epoch: [18][ 2200/31148]    Overall Loss 0.008979    Objective Loss 0.000000    Distill Loss 0.008979                     LR 0.000250    Time 0.467844    
+2023-12-02 14:50:28,810 - Epoch: [18][ 2300/31148]    Overall Loss 0.008981    Objective Loss 0.000000    Distill Loss 0.008981                     LR 0.000250    Time 0.470071    
+2023-12-02 14:51:11,690 - Epoch: [18][ 2400/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.468348    
+2023-12-02 14:51:51,309 - Epoch: [18][ 2500/31148]    Overall Loss 0.008987    Objective Loss 0.000000    Distill Loss 0.008987                     LR 0.000250    Time 0.465459    
+2023-12-02 14:52:33,988 - Epoch: [18][ 2600/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.463969    
+2023-12-02 14:53:24,889 - Epoch: [18][ 2700/31148]    Overall Loss 0.008996    Objective Loss 0.000000    Distill Loss 0.008996                     LR 0.000250    Time 0.465635    
+2023-12-02 14:54:06,559 - Epoch: [18][ 2800/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.463884    
+2023-12-02 14:54:46,509 - Epoch: [18][ 2900/31148]    Overall Loss 0.008994    Objective Loss 0.000000    Distill Loss 0.008994                     LR 0.000250    Time 0.461661    
+2023-12-02 14:55:25,713 - Epoch: [18][ 3000/31148]    Overall Loss 0.008994    Objective Loss 0.000000    Distill Loss 0.008994                     LR 0.000250    Time 0.459338    
+2023-12-02 14:56:11,262 - Epoch: [18][ 3100/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.459212    
+2023-12-02 14:57:01,864 - Epoch: [18][ 3200/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.460672    
+2023-12-02 14:57:40,388 - Epoch: [18][ 3300/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.458384    
+2023-12-02 14:58:25,709 - Epoch: [18][ 3400/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.458229    
+2023-12-02 14:59:08,903 - Epoch: [18][ 3500/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.457476    
+2023-12-02 14:59:49,431 - Epoch: [18][ 3600/31148]    Overall Loss 0.008994    Objective Loss 0.000000    Distill Loss 0.008994                     LR 0.000250    Time 0.456025    
+2023-12-02 15:00:33,370 - Epoch: [18][ 3700/31148]    Overall Loss 0.008996    Objective Loss 0.000000    Distill Loss 0.008996                     LR 0.000250    Time 0.455573    
+2023-12-02 15:01:17,149 - Epoch: [18][ 3800/31148]    Overall Loss 0.008996    Objective Loss 0.000000    Distill Loss 0.008996                     LR 0.000250    Time 0.455103    
+2023-12-02 15:02:08,074 - Epoch: [18][ 3900/31148]    Overall Loss 0.008998    Objective Loss 0.000000    Distill Loss 0.008998                     LR 0.000250    Time 0.456489    
+2023-12-02 15:02:41,645 - Epoch: [18][ 4000/31148]    Overall Loss 0.008998    Objective Loss 0.000000    Distill Loss 0.008998                     LR 0.000250    Time 0.453468    
+2023-12-02 15:03:26,333 - Epoch: [18][ 4100/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.453306    
+2023-12-02 15:04:13,544 - Epoch: [18][ 4200/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.453751    
+2023-12-02 15:05:02,961 - Epoch: [18][ 4300/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.454689    
+2023-12-02 15:05:52,307 - Epoch: [18][ 4400/31148]    Overall Loss 0.009000    Objective Loss 0.000000    Distill Loss 0.009000                     LR 0.000250    Time 0.455569    
+2023-12-02 15:06:42,548 - Epoch: [18][ 4500/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.456608    
+2023-12-02 15:07:34,898 - Epoch: [18][ 4600/31148]    Overall Loss 0.009000    Objective Loss 0.000000    Distill Loss 0.009000                     LR 0.000250    Time 0.458061    
+2023-12-02 15:08:17,894 - Epoch: [18][ 4700/31148]    Overall Loss 0.008999    Objective Loss 0.000000    Distill Loss 0.008999                     LR 0.000250    Time 0.457461    
+2023-12-02 15:09:01,983 - Epoch: [18][ 4800/31148]    Overall Loss 0.009000    Objective Loss 0.000000    Distill Loss 0.009000                     LR 0.000250    Time 0.457114    
+2023-12-02 15:09:44,891 - Epoch: [18][ 4900/31148]    Overall Loss 0.009000    Objective Loss 0.000000    Distill Loss 0.009000                     LR 0.000250    Time 0.456541    
+2023-12-02 15:10:21,155 - Epoch: [18][ 5000/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.454661    
+2023-12-02 15:11:11,943 - Epoch: [18][ 5100/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.455703    
+2023-12-02 15:12:00,135 - Epoch: [18][ 5200/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.456206    
+2023-12-02 15:12:42,790 - Epoch: [18][ 5300/31148]    Overall Loss 0.009002    Objective Loss 0.000000    Distill Loss 0.009002                     LR 0.000250    Time 0.455645    
+2023-12-02 15:13:22,642 - Epoch: [18][ 5400/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.454586    
+2023-12-02 15:14:10,285 - Epoch: [18][ 5500/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.454982    
+2023-12-02 15:14:56,594 - Epoch: [18][ 5600/31148]    Overall Loss 0.009005    Objective Loss 0.000000    Distill Loss 0.009005                     LR 0.000250    Time 0.455125    
+2023-12-02 15:16:00,620 - Epoch: [18][ 5700/31148]    Overall Loss 0.009004    Objective Loss 0.000000    Distill Loss 0.009004                     LR 0.000250    Time 0.458372    
+2023-12-02 15:16:39,958 - Epoch: [18][ 5800/31148]    Overall Loss 0.009003    Objective Loss 0.000000    Distill Loss 0.009003                     LR 0.000250    Time 0.457250    
+2023-12-02 15:17:31,639 - Epoch: [18][ 5900/31148]    Overall Loss 0.009002    Objective Loss 0.000000    Distill Loss 0.009002                     LR 0.000250    Time 0.458258    
+2023-12-02 15:18:24,346 - Epoch: [18][ 6000/31148]    Overall Loss 0.009000    Objective Loss 0.000000    Distill Loss 0.009000                     LR 0.000250    Time 0.459404    
+2023-12-02 15:19:14,159 - Epoch: [18][ 6100/31148]    Overall Loss 0.009001    Objective Loss 0.000000    Distill Loss 0.009001                     LR 0.000250    Time 0.460038    
+2023-12-02 15:20:03,360 - Epoch: [18][ 6200/31148]    Overall Loss 0.008999    Objective Loss 0.000000    Distill Loss 0.008999                     LR 0.000250    Time 0.460552    
+2023-12-02 15:20:36,422 - Epoch: [18][ 6300/31148]    Overall Loss 0.008998    Objective Loss 0.000000    Distill Loss 0.008998                     LR 0.000250    Time 0.458488    
+2023-12-02 15:21:29,458 - Epoch: [18][ 6400/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.459610    
+2023-12-02 15:22:20,904 - Epoch: [18][ 6500/31148]    Overall Loss 0.008996    Objective Loss 0.000000    Distill Loss 0.008996                     LR 0.000250    Time 0.460453    
+2023-12-02 15:23:10,688 - Epoch: [18][ 6600/31148]    Overall Loss 0.008994    Objective Loss 0.000000    Distill Loss 0.008994                     LR 0.000250    Time 0.461018    
+2023-12-02 15:23:51,345 - Epoch: [18][ 6700/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.460204    
+2023-12-02 15:24:38,246 - Epoch: [18][ 6800/31148]    Overall Loss 0.008994    Objective Loss 0.000000    Distill Loss 0.008994                     LR 0.000250    Time 0.460333    
+2023-12-02 15:25:21,397 - Epoch: [18][ 6900/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.459914    
+2023-12-02 15:25:53,769 - Epoch: [18][ 7000/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.457967    
+2023-12-02 15:26:46,193 - Epoch: [18][ 7100/31148]    Overall Loss 0.008996    Objective Loss 0.000000    Distill Loss 0.008996                     LR 0.000250    Time 0.458900    
+2023-12-02 15:27:31,551 - Epoch: [18][ 7200/31148]    Overall Loss 0.008996    Objective Loss 0.000000    Distill Loss 0.008996                     LR 0.000250    Time 0.458825    
+2023-12-02 15:28:17,486 - Epoch: [18][ 7300/31148]    Overall Loss 0.008998    Objective Loss 0.000000    Distill Loss 0.008998                     LR 0.000250    Time 0.458831    
+2023-12-02 15:29:00,762 - Epoch: [18][ 7400/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.458478    
+2023-12-02 15:29:48,654 - Epoch: [18][ 7500/31148]    Overall Loss 0.008998    Objective Loss 0.000000    Distill Loss 0.008998                     LR 0.000250    Time 0.458749    
+2023-12-02 15:30:37,376 - Epoch: [18][ 7600/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.459123    
+2023-12-02 15:31:20,800 - Epoch: [18][ 7700/31148]    Overall Loss 0.008997    Objective Loss 0.000000    Distill Loss 0.008997                     LR 0.000250    Time 0.458799    
+2023-12-02 15:32:01,058 - Epoch: [18][ 7800/31148]    Overall Loss 0.008995    Objective Loss 0.000000    Distill Loss 0.008995                     LR 0.000250    Time 0.458077    
+2023-12-02 15:32:38,564 - Epoch: [18][ 7900/31148]    Overall Loss 0.008994    Objective Loss 0.000000    Distill Loss 0.008994                     LR 0.000250    Time 0.457025    
+2023-12-02 15:33:18,051 - Epoch: [18][ 8000/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.456247    
+2023-12-02 15:34:00,246 - Epoch: [18][ 8100/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.455823    
+2023-12-02 15:34:35,554 - Epoch: [18][ 8200/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.454569    
+2023-12-02 15:35:28,078 - Epoch: [18][ 8300/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.455420    
+2023-12-02 15:36:10,664 - Epoch: [18][ 8400/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.455067    
+2023-12-02 15:36:55,016 - Epoch: [18][ 8500/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.454930    
+2023-12-02 15:37:38,429 - Epoch: [18][ 8600/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.454688    
+2023-12-02 15:38:34,526 - Epoch: [18][ 8700/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.455908    
+2023-12-02 15:39:16,102 - Epoch: [18][ 8800/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.455451    
+2023-12-02 15:39:59,520 - Epoch: [18][ 8900/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.455211    
+2023-12-02 15:40:36,860 - Epoch: [18][ 9000/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.454302    
+2023-12-02 15:41:21,307 - Epoch: [18][ 9100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454193    
+2023-12-02 15:42:03,558 - Epoch: [18][ 9200/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.453848    
+2023-12-02 15:42:50,924 - Epoch: [18][ 9300/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.454060    
+2023-12-02 15:43:37,668 - Epoch: [18][ 9400/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.454201    
+2023-12-02 15:44:24,218 - Epoch: [18][ 9500/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.454319    
+2023-12-02 15:45:13,563 - Epoch: [18][ 9600/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.454726    
+2023-12-02 15:46:00,349 - Epoch: [18][ 9700/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.454861    
+2023-12-02 15:46:39,357 - Epoch: [18][ 9800/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.454199    
+2023-12-02 15:47:17,285 - Epoch: [18][ 9900/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.453441    
+2023-12-02 15:48:02,145 - Epoch: [18][10000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453392    
+2023-12-02 15:48:42,360 - Epoch: [18][10100/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.452884    
+2023-12-02 15:49:20,994 - Epoch: [18][10200/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.452231    
+2023-12-02 15:49:59,774 - Epoch: [18][10300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.451605    
+2023-12-02 15:50:42,839 - Epoch: [18][10400/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.451403    
+2023-12-02 15:51:38,860 - Epoch: [18][10500/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.452438    
+2023-12-02 15:52:29,747 - Epoch: [18][10600/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.452970    
+2023-12-02 15:53:27,493 - Epoch: [18][10700/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454133    
+2023-12-02 15:54:18,770 - Epoch: [18][10800/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454675    
+2023-12-02 15:55:12,291 - Epoch: [18][10900/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455413    
+2023-12-02 15:55:59,666 - Epoch: [18][11000/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455579    
+2023-12-02 15:56:51,091 - Epoch: [18][11100/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.456107    
+2023-12-02 15:57:40,256 - Epoch: [18][11200/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.456424    
+2023-12-02 15:58:26,105 - Epoch: [18][11300/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.456441    
+2023-12-02 15:59:18,498 - Epoch: [18][11400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.457033    
+2023-12-02 16:00:11,607 - Epoch: [18][11500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.457676    
+2023-12-02 16:00:51,444 - Epoch: [18][11600/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.457164    
+2023-12-02 16:01:44,139 - Epoch: [18][11700/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457760    
+2023-12-02 16:02:29,876 - Epoch: [18][11800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.457756    
+2023-12-02 16:03:11,538 - Epoch: [18][11900/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457410    
+2023-12-02 16:03:55,009 - Epoch: [18][12000/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457220    
+2023-12-02 16:04:39,980 - Epoch: [18][12100/31148]    Overall Loss 0.008987    Objective Loss 0.000000    Distill Loss 0.008987                     LR 0.000250    Time 0.457157    
+2023-12-02 16:05:25,554 - Epoch: [18][12200/31148]    Overall Loss 0.008987    Objective Loss 0.000000    Distill Loss 0.008987                     LR 0.000250    Time 0.457145    
+2023-12-02 16:06:02,065 - Epoch: [18][12300/31148]    Overall Loss 0.008987    Objective Loss 0.000000    Distill Loss 0.008987                     LR 0.000250    Time 0.456396    
+2023-12-02 16:06:51,624 - Epoch: [18][12400/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.456712    
+2023-12-02 16:07:29,251 - Epoch: [18][12500/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.456068    
+2023-12-02 16:08:17,896 - Epoch: [18][12600/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.456308    
+2023-12-02 16:09:05,965 - Epoch: [18][12700/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.456500    
+2023-12-02 16:09:58,641 - Epoch: [18][12800/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.457048    
+2023-12-02 16:10:51,251 - Epoch: [18][12900/31148]    Overall Loss 0.008986    Objective Loss 0.000000    Distill Loss 0.008986                     LR 0.000250    Time 0.457583    
+2023-12-02 16:11:29,812 - Epoch: [18][13000/31148]    Overall Loss 0.008987    Objective Loss 0.000000    Distill Loss 0.008987                     LR 0.000250    Time 0.457028    
+2023-12-02 16:12:17,182 - Epoch: [18][13100/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457155    
+2023-12-02 16:13:05,037 - Epoch: [18][13200/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457317    
+2023-12-02 16:13:48,476 - Epoch: [18][13300/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457144    
+2023-12-02 16:14:39,425 - Epoch: [18][13400/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.457534    
+2023-12-02 16:15:42,948 - Epoch: [18][13500/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.458850    
+2023-12-02 16:16:28,419 - Epoch: [18][13600/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.458819    
+2023-12-02 16:17:14,650 - Epoch: [18][13700/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.458844    
+2023-12-02 16:18:02,003 - Epoch: [18][13800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458949    
+2023-12-02 16:18:44,745 - Epoch: [18][13900/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458722    
+2023-12-02 16:19:23,943 - Epoch: [18][14000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.458245    
+2023-12-02 16:20:06,854 - Epoch: [18][14100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.458038    
+2023-12-02 16:21:01,488 - Epoch: [18][14200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.458659    
+2023-12-02 16:21:45,032 - Epoch: [18][14300/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458496    
+2023-12-02 16:22:28,835 - Epoch: [18][14400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458354    
+2023-12-02 16:23:15,579 - Epoch: [18][14500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458416    
+2023-12-02 16:23:59,953 - Epoch: [18][14600/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458315    
+2023-12-02 16:24:38,599 - Epoch: [18][14700/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.457825    
+2023-12-02 16:25:28,476 - Epoch: [18][14800/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.458101    
+2023-12-02 16:26:16,436 - Epoch: [18][14900/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.458245    
+2023-12-02 16:26:59,850 - Epoch: [18][15000/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.458084    
+2023-12-02 16:27:41,169 - Epoch: [18][15100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.457786    
+2023-12-02 16:28:20,123 - Epoch: [18][15200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.457337    
+2023-12-02 16:29:09,128 - Epoch: [18][15300/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.457550    
+2023-12-02 16:29:59,763 - Epoch: [18][15400/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.457867    
+2023-12-02 16:31:00,632 - Epoch: [18][15500/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.458839    
+2023-12-02 16:31:39,158 - Epoch: [18][15600/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.458367    
+2023-12-02 16:32:22,856 - Epoch: [18][15700/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.458230    
+2023-12-02 16:33:09,348 - Epoch: [18][15800/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.458272    
+2023-12-02 16:33:52,431 - Epoch: [18][15900/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.458098    
+2023-12-02 16:34:34,943 - Epoch: [18][16000/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.457892    
+2023-12-02 16:35:19,325 - Epoch: [18][16100/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.457804    
+2023-12-02 16:35:58,601 - Epoch: [18][16200/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.457402    
+2023-12-02 16:36:34,678 - Epoch: [18][16300/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.456809    
+2023-12-02 16:37:21,935 - Epoch: [18][16400/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.456904    
+2023-12-02 16:38:07,308 - Epoch: [18][16500/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.456885    
+2023-12-02 16:38:46,288 - Epoch: [18][16600/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.456480    
+2023-12-02 16:39:22,412 - Epoch: [18][16700/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.455909    
+2023-12-02 16:40:03,633 - Epoch: [18][16800/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.455649    
+2023-12-02 16:40:38,258 - Epoch: [18][16900/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.455001    
+2023-12-02 16:41:22,462 - Epoch: [18][17000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454925    
+2023-12-02 16:42:04,566 - Epoch: [18][17100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454726    
+2023-12-02 16:42:49,286 - Epoch: [18][17200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454682    
+2023-12-02 16:43:36,940 - Epoch: [18][17300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454808    
+2023-12-02 16:44:24,335 - Epoch: [18][17400/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454917    
+2023-12-02 16:45:13,080 - Epoch: [18][17500/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.455103    
+2023-12-02 16:45:52,589 - Epoch: [18][17600/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454761    
+2023-12-02 16:46:38,122 - Epoch: [18][17700/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.454764    
+2023-12-02 16:47:37,471 - Epoch: [18][17800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455543    
+2023-12-02 16:48:20,049 - Epoch: [18][17900/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455377    
+2023-12-02 16:49:08,063 - Epoch: [18][18000/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455514    
+2023-12-02 16:49:57,271 - Epoch: [18][18100/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455715    
+2023-12-02 16:50:40,022 - Epoch: [18][18200/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455560    
+2023-12-02 16:51:22,803 - Epoch: [18][18300/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455408    
+2023-12-02 16:52:18,511 - Epoch: [18][18400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455960    
+2023-12-02 16:52:56,260 - Epoch: [18][18500/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455536    
+2023-12-02 16:53:43,814 - Epoch: [18][18600/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455643    
+2023-12-02 16:54:24,922 - Epoch: [18][18700/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455404    
+2023-12-02 16:55:09,606 - Epoch: [18][18800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455358    
+2023-12-02 16:55:50,481 - Epoch: [18][18900/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455111    
+2023-12-02 16:56:36,245 - Epoch: [18][19000/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.455124    
+2023-12-02 16:57:20,971 - Epoch: [18][19100/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.455083    
+2023-12-02 16:58:03,224 - Epoch: [18][19200/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454913    
+2023-12-02 16:58:44,864 - Epoch: [18][19300/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.454713    
+2023-12-02 16:59:27,398 - Epoch: [18][19400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454561    
+2023-12-02 17:00:13,592 - Epoch: [18][19500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454598    
+2023-12-02 17:00:55,457 - Epoch: [18][19600/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454415    
+2023-12-02 17:01:46,488 - Epoch: [18][19700/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454698    
+2023-12-02 17:02:27,475 - Epoch: [18][19800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454471    
+2023-12-02 17:03:11,259 - Epoch: [18][19900/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.454387    
+2023-12-02 17:03:56,663 - Epoch: [18][20000/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454385    
+2023-12-02 17:04:46,172 - Epoch: [18][20100/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454587    
+2023-12-02 17:05:33,871 - Epoch: [18][20200/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454698    
+2023-12-02 17:06:12,523 - Epoch: [18][20300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.454362    
+2023-12-02 17:07:02,521 - Epoch: [18][20400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454585    
+2023-12-02 17:07:48,642 - Epoch: [18][20500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454617    
+2023-12-02 17:08:39,663 - Epoch: [18][20600/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454886    
+2023-12-02 17:09:15,782 - Epoch: [18][20700/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454433    
+2023-12-02 17:10:03,889 - Epoch: [18][20800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454561    
+2023-12-02 17:10:48,157 - Epoch: [18][20900/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454503    
+2023-12-02 17:11:26,719 - Epoch: [18][21000/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454175    
+2023-12-02 17:12:06,791 - Epoch: [18][21100/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453921    
+2023-12-02 17:12:55,504 - Epoch: [18][21200/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454078    
+2023-12-02 17:13:41,425 - Epoch: [18][21300/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454101    
+2023-12-02 17:14:23,645 - Epoch: [18][21400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453952    
+2023-12-02 17:15:02,154 - Epoch: [18][21500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453631    
+2023-12-02 17:15:44,516 - Epoch: [18][21600/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.453492    
+2023-12-02 17:16:29,727 - Epoch: [18][21700/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453485    
+2023-12-02 17:17:16,297 - Epoch: [18][21800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453541    
+2023-12-02 17:18:08,372 - Epoch: [18][21900/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453848    
+2023-12-02 17:18:55,555 - Epoch: [18][22000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453929    
+2023-12-02 17:19:42,665 - Epoch: [18][22100/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454006    
+2023-12-02 17:20:29,074 - Epoch: [18][22200/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454052    
+2023-12-02 17:21:14,401 - Epoch: [18][22300/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454048    
+2023-12-02 17:22:02,629 - Epoch: [18][22400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454174    
+2023-12-02 17:22:44,375 - Epoch: [18][22500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.454010    
+2023-12-02 17:23:28,663 - Epoch: [18][22600/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453960    
+2023-12-02 17:24:04,837 - Epoch: [18][22700/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.453554    
+2023-12-02 17:24:47,100 - Epoch: [18][22800/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453418    
+2023-12-02 17:25:41,424 - Epoch: [18][22900/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.453810    
+2023-12-02 17:26:31,847 - Epoch: [18][23000/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.454029    
+2023-12-02 17:27:08,779 - Epoch: [18][23100/31148]    Overall Loss 0.008988    Objective Loss 0.000000    Distill Loss 0.008988                     LR 0.000250    Time 0.453662    
+2023-12-02 17:27:54,567 - Epoch: [18][23200/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453680    
+2023-12-02 17:28:36,611 - Epoch: [18][23300/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453537    
+2023-12-02 17:29:26,168 - Epoch: [18][23400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453716    
+2023-12-02 17:30:12,137 - Epoch: [18][23500/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.453741    
+2023-12-02 17:30:59,568 - Epoch: [18][23600/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453828    
+2023-12-02 17:31:40,375 - Epoch: [18][23700/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453635    
+2023-12-02 17:32:16,987 - Epoch: [18][23800/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453267    
+2023-12-02 17:33:06,416 - Epoch: [18][23900/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453438    
+2023-12-02 17:33:46,289 - Epoch: [18][24000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453210    
+2023-12-02 17:34:35,808 - Epoch: [18][24100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453384    
+2023-12-02 17:35:24,455 - Epoch: [18][24200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453520    
+2023-12-02 17:36:04,139 - Epoch: [18][24300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453287    
+2023-12-02 17:36:46,833 - Epoch: [18][24400/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453178    
+2023-12-02 17:37:33,763 - Epoch: [18][24500/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.453244    
+2023-12-02 17:38:09,308 - Epoch: [18][24600/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.452846    
+2023-12-02 17:38:51,523 - Epoch: [18][24700/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.452721    
+2023-12-02 17:39:24,815 - Epoch: [18][24800/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.452238    
+2023-12-02 17:40:11,843 - Epoch: [18][24900/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.452310    
+2023-12-02 17:40:52,897 - Epoch: [18][25000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.452143    
+2023-12-02 17:41:34,707 - Epoch: [18][25100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.452007    
+2023-12-02 17:42:16,052 - Epoch: [18][25200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.451854    
+2023-12-02 17:42:51,310 - Epoch: [18][25300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.451461    
+2023-12-02 17:43:22,665 - Epoch: [18][25400/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.450918    
+2023-12-02 17:43:52,361 - Epoch: [18][25500/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.450314    
+2023-12-02 17:44:19,933 - Epoch: [18][25600/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.449632    
+2023-12-02 17:44:47,215 - Epoch: [18][25700/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.448944    
+2023-12-02 17:45:14,777 - Epoch: [18][25800/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.448272    
+2023-12-02 17:45:44,241 - Epoch: [18][25900/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.447678    
+2023-12-02 17:46:11,367 - Epoch: [18][26000/31148]    Overall Loss 0.008989    Objective Loss 0.000000    Distill Loss 0.008989                     LR 0.000250    Time 0.447000    
+2023-12-02 17:46:40,140 - Epoch: [18][26100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.446389    
+2023-12-02 17:47:08,739 - Epoch: [18][26200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.445777    
+2023-12-02 17:47:37,683 - Epoch: [18][26300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.445182    
+2023-12-02 17:48:05,206 - Epoch: [18][26400/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.444538    
+2023-12-02 17:48:43,500 - Epoch: [18][26500/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.444306    
+2023-12-02 17:49:52,019 - Epoch: [18][26600/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.445211    
+2023-12-02 17:50:36,573 - Epoch: [18][26700/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.445212    
+2023-12-02 17:51:26,202 - Epoch: [18][26800/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.445402    
+2023-12-02 17:52:24,582 - Epoch: [18][26900/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.445916    
+2023-12-02 17:53:21,808 - Epoch: [18][27000/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.446384    
+2023-12-02 17:54:05,837 - Epoch: [18][27100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.446361    
+2023-12-02 17:54:51,917 - Epoch: [18][27200/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.446414    
+2023-12-02 17:55:38,382 - Epoch: [18][27300/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.446481    
+2023-12-02 17:56:36,300 - Epoch: [18][27400/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.446965    
+2023-12-02 17:57:27,515 - Epoch: [18][27500/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.447201    
+2023-12-02 17:58:22,328 - Epoch: [18][27600/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.447567    
+2023-12-02 17:59:15,755 - Epoch: [18][27700/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.447880    
+2023-12-02 18:00:03,399 - Epoch: [18][27800/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.447982    
+2023-12-02 18:00:47,962 - Epoch: [18][27900/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.447973    
+2023-12-02 18:01:31,647 - Epoch: [18][28000/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.447933    
+2023-12-02 18:02:32,498 - Epoch: [18][28100/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.448505    
+2023-12-02 18:03:07,735 - Epoch: [18][28200/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.448163    
+2023-12-02 18:03:58,466 - Epoch: [18][28300/31148]    Overall Loss 0.008990    Objective Loss 0.000000    Distill Loss 0.008990                     LR 0.000250    Time 0.448372    
+2023-12-02 18:04:40,133 - Epoch: [18][28400/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.448260    
+2023-12-02 18:05:32,267 - Epoch: [18][28500/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.448516    
+2023-12-02 18:06:19,542 - Epoch: [18][28600/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.448601    
+2023-12-02 18:07:19,041 - Epoch: [18][28700/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449111    
+2023-12-02 18:08:03,259 - Epoch: [18][28800/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449086    
+2023-12-02 18:08:42,574 - Epoch: [18][28900/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.448892    
+2023-12-02 18:09:36,018 - Epoch: [18][29000/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449187    
+2023-12-02 18:10:19,432 - Epoch: [18][29100/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449135    
+2023-12-02 18:11:09,760 - Epoch: [18][29200/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449320    
+2023-12-02 18:11:54,062 - Epoch: [18][29300/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449299    
+2023-12-02 18:12:38,179 - Epoch: [18][29400/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449271    
+2023-12-02 18:13:26,457 - Epoch: [18][29500/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449384    
+2023-12-02 18:14:09,544 - Epoch: [18][29600/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449321    
+2023-12-02 18:15:07,755 - Epoch: [18][29700/31148]    Overall Loss 0.008991    Objective Loss 0.000000    Distill Loss 0.008991                     LR 0.000250    Time 0.449768    
+2023-12-02 18:16:13,034 - Epoch: [18][29800/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.450449    
+2023-12-02 18:16:53,053 - Epoch: [18][29900/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.450281    
+2023-12-02 18:17:35,423 - Epoch: [18][30000/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.450192    
+2023-12-02 18:18:22,722 - Epoch: [18][30100/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.450267    
+2023-12-02 18:19:35,349 - Epoch: [18][30200/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.451181    
+2023-12-02 18:20:27,268 - Epoch: [18][30300/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.451405    
+2023-12-02 18:21:19,301 - Epoch: [18][30400/31148]    Overall Loss 0.008992    Objective Loss 0.000000    Distill Loss 0.008992                     LR 0.000250    Time 0.451632    
+2023-12-02 18:22:06,842 - Epoch: [18][30500/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.451710    
+2023-12-02 18:22:53,649 - Epoch: [18][30600/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.451763    
+2023-12-02 18:23:33,752 - Epoch: [18][30700/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.451597    
+2023-12-02 18:24:34,110 - Epoch: [18][30800/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.452090    
+2023-12-02 18:25:23,915 - Epoch: [18][30900/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.452239    
+2023-12-02 18:26:15,320 - Epoch: [18][31000/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.452438    
+2023-12-02 18:27:00,644 - Epoch: [18][31100/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.452440    
+2023-12-02 18:27:27,260 - Epoch: [18][31148/31148]    Overall Loss 0.008993    Objective Loss 0.000000    Distill Loss 0.008993                     LR 0.000250    Time 0.452598    
+2023-12-02 18:27:28,300 - --- validate (epoch=18)-----------
+2023-12-02 18:27:28,301 - 167951 samples (100 per mini-batch)
+2023-12-02 18:27:51,516 - Epoch: [18][  100/ 1680]    Loss 0.000000    Overall Loss 0.009636    
+2023-12-02 18:28:11,466 - Epoch: [18][  200/ 1680]    Loss 0.000000    Overall Loss 0.009612    
+2023-12-02 18:28:31,409 - Epoch: [18][  300/ 1680]    Loss 0.000000    Overall Loss 0.009604    
+2023-12-02 18:28:51,383 - Epoch: [18][  400/ 1680]    Loss 0.000000    Overall Loss 0.009595    
+2023-12-02 18:29:11,360 - Epoch: [18][  500/ 1680]    Loss 0.000000    Overall Loss 0.009598    
+2023-12-02 18:29:31,397 - Epoch: [18][  600/ 1680]    Loss 0.000000    Overall Loss 0.009603    
+2023-12-02 18:29:51,361 - Epoch: [18][  700/ 1680]    Loss 0.000000    Overall Loss 0.009607    
+2023-12-02 18:30:11,346 - Epoch: [18][  800/ 1680]    Loss 0.000000    Overall Loss 0.009606    
+2023-12-02 18:30:31,323 - Epoch: [18][  900/ 1680]    Loss 0.000000    Overall Loss 0.009608    
+2023-12-02 18:30:51,313 - Epoch: [18][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009603    
+2023-12-02 18:31:11,288 - Epoch: [18][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009603    
+2023-12-02 18:31:31,264 - Epoch: [18][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009609    
+2023-12-02 18:31:51,210 - Epoch: [18][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009610    
+2023-12-02 18:32:11,168 - Epoch: [18][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009613    
+2023-12-02 18:32:31,125 - Epoch: [18][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009613    
+2023-12-02 18:32:51,069 - Epoch: [18][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009614    
+2023-12-02 18:33:07,115 - Epoch: [18][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009611    
+2023-12-02 18:33:07,627 - ==> Overall Loss: 0.010
+
+2023-12-02 18:33:07,635 - ==> Best [Overall Loss: 0.009611 on epoch: 18]
+2023-12-02 18:33:07,635 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-02 18:33:07,725 - 
+
+2023-12-02 18:33:07,726 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-02 18:34:24,524 - Epoch: [19][  100/31148]    Overall Loss 0.008919    Objective Loss 0.000000    Distill Loss 0.008919                     LR 0.000250    Time 0.767879    
+2023-12-02 18:35:05,893 - Epoch: [19][  200/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000250    Time 0.590746    
+2023-12-02 18:35:50,240 - Epoch: [19][  300/31148]    Overall Loss 0.008930    Objective Loss 0.000000    Distill Loss 0.008930                     LR 0.000250    Time 0.541629    
+2023-12-02 18:36:34,947 - Epoch: [19][  400/31148]    Overall Loss 0.008934    Objective Loss 0.000000    Distill Loss 0.008934                     LR 0.000250    Time 0.517972    
+2023-12-02 18:37:13,392 - Epoch: [19][  500/31148]    Overall Loss 0.008927    Objective Loss 0.000000    Distill Loss 0.008927                     LR 0.000250    Time 0.491252    
+2023-12-02 18:38:01,591 - Epoch: [19][  600/31148]    Overall Loss 0.008932    Objective Loss 0.000000    Distill Loss 0.008932                     LR 0.000250    Time 0.489697    
+2023-12-02 18:38:48,155 - Epoch: [19][  700/31148]    Overall Loss 0.008944    Objective Loss 0.000000    Distill Loss 0.008944                     LR 0.000250    Time 0.486248    
+2023-12-02 18:39:41,286 - Epoch: [19][  800/31148]    Overall Loss 0.008950    Objective Loss 0.000000    Distill Loss 0.008950                     LR 0.000250    Time 0.491873    
+2023-12-02 18:40:16,150 - Epoch: [19][  900/31148]    Overall Loss 0.008941    Objective Loss 0.000000    Distill Loss 0.008941                     LR 0.000250    Time 0.475948    
+2023-12-02 18:40:51,880 - Epoch: [19][ 1000/31148]    Overall Loss 0.008943    Objective Loss 0.000000    Distill Loss 0.008943                     LR 0.000250    Time 0.464077    
+2023-12-02 18:41:31,432 - Epoch: [19][ 1100/31148]    Overall Loss 0.008939    Objective Loss 0.000000    Distill Loss 0.008939                     LR 0.000250    Time 0.457836    
+2023-12-02 18:42:20,432 - Epoch: [19][ 1200/31148]    Overall Loss 0.008941    Objective Loss 0.000000    Distill Loss 0.008941                     LR 0.000250    Time 0.460510    
+2023-12-02 18:42:57,468 - Epoch: [19][ 1300/31148]    Overall Loss 0.008941    Objective Loss 0.000000    Distill Loss 0.008941                     LR 0.000250    Time 0.453570    
+2023-12-02 18:43:40,031 - Epoch: [19][ 1400/31148]    Overall Loss 0.008942    Objective Loss 0.000000    Distill Loss 0.008942                     LR 0.000250    Time 0.451569    
+2023-12-02 18:44:22,911 - Epoch: [19][ 1500/31148]    Overall Loss 0.008940    Objective Loss 0.000000    Distill Loss 0.008940                     LR 0.000250    Time 0.450046    
+2023-12-02 18:45:13,724 - Epoch: [19][ 1600/31148]    Overall Loss 0.008942    Objective Loss 0.000000    Distill Loss 0.008942                     LR 0.000250    Time 0.453672    
+2023-12-02 18:46:00,588 - Epoch: [19][ 1700/31148]    Overall Loss 0.008944    Objective Loss 0.000000    Distill Loss 0.008944                     LR 0.000250    Time 0.454548    
+2023-12-02 18:46:48,975 - Epoch: [19][ 1800/31148]    Overall Loss 0.008948    Objective Loss 0.000000    Distill Loss 0.008948                     LR 0.000250    Time 0.456172    
+2023-12-02 18:47:29,129 - Epoch: [19][ 1900/31148]    Overall Loss 0.008951    Objective Loss 0.000000    Distill Loss 0.008951                     LR 0.000250    Time 0.453293    
+2023-12-02 18:48:11,292 - Epoch: [19][ 2000/31148]    Overall Loss 0.008955    Objective Loss 0.000000    Distill Loss 0.008955                     LR 0.000250    Time 0.451706    
+2023-12-02 18:49:06,518 - Epoch: [19][ 2100/31148]    Overall Loss 0.008958    Objective Loss 0.000000    Distill Loss 0.008958                     LR 0.000250    Time 0.456491    
+2023-12-02 18:49:56,260 - Epoch: [19][ 2200/31148]    Overall Loss 0.008957    Objective Loss 0.000000    Distill Loss 0.008957                     LR 0.000250    Time 0.458347    
+2023-12-02 18:50:40,303 - Epoch: [19][ 2300/31148]    Overall Loss 0.008966    Objective Loss 0.000000    Distill Loss 0.008966                     LR 0.000250    Time 0.457565    
+2023-12-02 18:51:22,387 - Epoch: [19][ 2400/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.456031    
+2023-12-02 18:52:12,438 - Epoch: [19][ 2500/31148]    Overall Loss 0.008966    Objective Loss 0.000000    Distill Loss 0.008966                     LR 0.000250    Time 0.457807    
+2023-12-02 18:52:50,175 - Epoch: [19][ 2600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.454711    
+2023-12-02 18:53:30,852 - Epoch: [19][ 2700/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.452932    
+2023-12-02 18:54:21,856 - Epoch: [19][ 2800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.454969    
+2023-12-02 18:55:06,133 - Epoch: [19][ 2900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.454546    
+2023-12-02 18:56:02,087 - Epoch: [19][ 3000/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.458043    
+2023-12-02 18:56:58,634 - Epoch: [19][ 3100/31148]    Overall Loss 0.008967    Objective Loss 0.000000    Distill Loss 0.008967                     LR 0.000250    Time 0.461506    
+2023-12-02 18:57:46,858 - Epoch: [19][ 3200/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.462151    
+2023-12-02 18:58:23,069 - Epoch: [19][ 3300/31148]    Overall Loss 0.008965    Objective Loss 0.000000    Distill Loss 0.008965                     LR 0.000250    Time 0.459118    
+2023-12-02 18:59:10,262 - Epoch: [19][ 3400/31148]    Overall Loss 0.008966    Objective Loss 0.000000    Distill Loss 0.008966                     LR 0.000250    Time 0.459492    
+2023-12-02 18:59:47,241 - Epoch: [19][ 3500/31148]    Overall Loss 0.008963    Objective Loss 0.000000    Distill Loss 0.008963                     LR 0.000250    Time 0.456927    
+2023-12-02 19:00:30,638 - Epoch: [19][ 3600/31148]    Overall Loss 0.008967    Objective Loss 0.000000    Distill Loss 0.008967                     LR 0.000250    Time 0.456288    
+2023-12-02 19:01:23,004 - Epoch: [19][ 3700/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.458106    
+2023-12-02 19:02:09,443 - Epoch: [19][ 3800/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.458269    
+2023-12-02 19:03:04,155 - Epoch: [19][ 3900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.460546    
+2023-12-02 19:03:50,012 - Epoch: [19][ 4000/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.460494    
+2023-12-02 19:04:43,168 - Epoch: [19][ 4100/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.462226    
+2023-12-02 19:05:20,023 - Epoch: [19][ 4200/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.459994    
+2023-12-02 19:05:59,282 - Epoch: [19][ 4300/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.458424    
+2023-12-02 19:06:36,125 - Epoch: [19][ 4400/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.456378    
+2023-12-02 19:07:21,896 - Epoch: [19][ 4500/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.456406    
+2023-12-02 19:08:01,984 - Epoch: [19][ 4600/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.455197    
+2023-12-02 19:08:47,286 - Epoch: [19][ 4700/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.455149    
+2023-12-02 19:09:27,711 - Epoch: [19][ 4800/31148]    Overall Loss 0.008978    Objective Loss 0.000000    Distill Loss 0.008978                     LR 0.000250    Time 0.454087    
+2023-12-02 19:10:08,190 - Epoch: [19][ 4900/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.453079    
+2023-12-02 19:11:01,937 - Epoch: [19][ 5000/31148]    Overall Loss 0.008979    Objective Loss 0.000000    Distill Loss 0.008979                     LR 0.000250    Time 0.454765    
+2023-12-02 19:11:45,302 - Epoch: [19][ 5100/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454350    
+2023-12-02 19:12:35,932 - Epoch: [19][ 5200/31148]    Overall Loss 0.008979    Objective Loss 0.000000    Distill Loss 0.008979                     LR 0.000250    Time 0.455348    
+2023-12-02 19:13:29,177 - Epoch: [19][ 5300/31148]    Overall Loss 0.008978    Objective Loss 0.000000    Distill Loss 0.008978                     LR 0.000250    Time 0.456801    
+2023-12-02 19:14:12,151 - Epoch: [19][ 5400/31148]    Overall Loss 0.008980    Objective Loss 0.000000    Distill Loss 0.008980                     LR 0.000250    Time 0.456298    
+2023-12-02 19:14:56,534 - Epoch: [19][ 5500/31148]    Overall Loss 0.008981    Objective Loss 0.000000    Distill Loss 0.008981                     LR 0.000250    Time 0.456071    
+2023-12-02 19:15:37,129 - Epoch: [19][ 5600/31148]    Overall Loss 0.008981    Objective Loss 0.000000    Distill Loss 0.008981                     LR 0.000250    Time 0.455174    
+2023-12-02 19:16:16,239 - Epoch: [19][ 5700/31148]    Overall Loss 0.008979    Objective Loss 0.000000    Distill Loss 0.008979                     LR 0.000250    Time 0.454049    
+2023-12-02 19:17:05,878 - Epoch: [19][ 5800/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454777    
+2023-12-02 19:17:47,999 - Epoch: [19][ 5900/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454207    
+2023-12-02 19:18:31,679 - Epoch: [19][ 6000/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.453916    
+2023-12-02 19:19:05,356 - Epoch: [19][ 6100/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.451994    
+2023-12-02 19:19:44,133 - Epoch: [19][ 6200/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.450957    
+2023-12-02 19:20:30,973 - Epoch: [19][ 6300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451233    
+2023-12-02 19:21:08,206 - Epoch: [19][ 6400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.449999    
+2023-12-02 19:21:53,788 - Epoch: [19][ 6500/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450087    
+2023-12-02 19:22:41,272 - Epoch: [19][ 6600/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450461    
+2023-12-02 19:23:21,453 - Epoch: [19][ 6700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.449734    
+2023-12-02 19:24:06,544 - Epoch: [19][ 6800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.449749    
+2023-12-02 19:24:53,648 - Epoch: [19][ 6900/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450056    
+2023-12-02 19:25:37,200 - Epoch: [19][ 7000/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.449848    
+2023-12-02 19:26:25,755 - Epoch: [19][ 7100/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450350    
+2023-12-02 19:27:10,943 - Epoch: [19][ 7200/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450370    
+2023-12-02 19:27:57,415 - Epoch: [19][ 7300/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450565    
+2023-12-02 19:28:39,491 - Epoch: [19][ 7400/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450162    
+2023-12-02 19:29:21,752 - Epoch: [19][ 7500/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449793    
+2023-12-02 19:30:03,841 - Epoch: [19][ 7600/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449412    
+2023-12-02 19:30:42,683 - Epoch: [19][ 7700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.448619    
+2023-12-02 19:31:42,300 - Epoch: [19][ 7800/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.450510    
+2023-12-02 19:32:33,564 - Epoch: [19][ 7900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.451295    
+2023-12-02 19:33:18,184 - Epoch: [19][ 8000/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.451230    
+2023-12-02 19:34:02,774 - Epoch: [19][ 8100/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.451163    
+2023-12-02 19:34:57,619 - Epoch: [19][ 8200/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.452349    
+2023-12-02 19:35:39,621 - Epoch: [19][ 8300/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.451959    
+2023-12-02 19:36:21,664 - Epoch: [19][ 8400/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.451582    
+2023-12-02 19:37:14,285 - Epoch: [19][ 8500/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452460    
+2023-12-02 19:38:01,264 - Epoch: [19][ 8600/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.452660    
+2023-12-02 19:38:43,884 - Epoch: [19][ 8700/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452355    
+2023-12-02 19:39:32,991 - Epoch: [19][ 8800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.452794    
+2023-12-02 19:40:17,568 - Epoch: [19][ 8900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452715    
+2023-12-02 19:41:09,254 - Epoch: [19][ 9000/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.453426    
+2023-12-02 19:42:06,598 - Epoch: [19][ 9100/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.454745    
+2023-12-02 19:42:50,046 - Epoch: [19][ 9200/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.454523    
+2023-12-02 19:43:28,689 - Epoch: [19][ 9300/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.453790    
+2023-12-02 19:44:12,456 - Epoch: [19][ 9400/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.453618    
+2023-12-02 19:44:55,180 - Epoch: [19][ 9500/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453340    
+2023-12-02 19:45:42,353 - Epoch: [19][ 9600/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453530    
+2023-12-02 19:46:24,946 - Epoch: [19][ 9700/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.453245    
+2023-12-02 19:47:09,051 - Epoch: [19][ 9800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.453120    
+2023-12-02 19:47:53,471 - Epoch: [19][ 9900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.453029    
+2023-12-02 19:48:40,555 - Epoch: [19][10000/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453206    
+2023-12-02 19:49:26,250 - Epoch: [19][10100/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.453243    
+2023-12-02 19:50:06,973 - Epoch: [19][10200/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.452791    
+2023-12-02 19:50:53,632 - Epoch: [19][10300/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452924    
+2023-12-02 19:51:37,193 - Epoch: [19][10400/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452757    
+2023-12-02 19:52:27,357 - Epoch: [19][10500/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453222    
+2023-12-02 19:53:16,051 - Epoch: [19][10600/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.453539    
+2023-12-02 19:53:58,479 - Epoch: [19][10700/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453265    
+2023-12-02 19:54:38,220 - Epoch: [19][10800/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452747    
+2023-12-02 19:55:21,381 - Epoch: [19][10900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452552    
+2023-12-02 19:56:04,191 - Epoch: [19][11000/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452330    
+2023-12-02 19:56:54,930 - Epoch: [19][11100/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452825    
+2023-12-02 19:57:35,272 - Epoch: [19][11200/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.452383    
+2023-12-02 19:58:21,800 - Epoch: [19][11300/31148]    Overall Loss 0.008968    Objective Loss 0.000000    Distill Loss 0.008968                     LR 0.000250    Time 0.452497    
+2023-12-02 19:59:10,739 - Epoch: [19][11400/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452820    
+2023-12-02 19:59:59,841 - Epoch: [19][11500/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453151    
+2023-12-02 20:00:43,503 - Epoch: [19][11600/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453008    
+2023-12-02 20:01:35,769 - Epoch: [19][11700/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453603    
+2023-12-02 20:02:21,128 - Epoch: [19][11800/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453602    
+2023-12-02 20:03:08,030 - Epoch: [19][11900/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453731    
+2023-12-02 20:03:48,103 - Epoch: [19][12000/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453289    
+2023-12-02 20:04:30,609 - Epoch: [19][12100/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.453055    
+2023-12-02 20:05:10,508 - Epoch: [19][12200/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452611    
+2023-12-02 20:05:57,984 - Epoch: [19][12300/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452791    
+2023-12-02 20:06:40,573 - Epoch: [19][12400/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452573    
+2023-12-02 20:07:19,509 - Epoch: [19][12500/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452067    
+2023-12-02 20:08:07,973 - Epoch: [19][12600/31148]    Overall Loss 0.008969    Objective Loss 0.000000    Distill Loss 0.008969                     LR 0.000250    Time 0.452325    
+2023-12-02 20:08:59,517 - Epoch: [19][12700/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452821    
+2023-12-02 20:09:40,619 - Epoch: [19][12800/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452494    
+2023-12-02 20:10:27,317 - Epoch: [19][12900/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.452606    
+2023-12-02 20:11:18,394 - Epoch: [19][13000/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.453053    
+2023-12-02 20:11:54,841 - Epoch: [19][13100/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.452376    
+2023-12-02 20:12:49,548 - Epoch: [19][13200/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.453093    
+2023-12-02 20:13:34,458 - Epoch: [19][13300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.453062    
+2023-12-02 20:14:15,839 - Epoch: [19][13400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.452769    
+2023-12-02 20:14:54,380 - Epoch: [19][13500/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.452269    
+2023-12-02 20:15:29,956 - Epoch: [19][13600/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.451559    
+2023-12-02 20:16:13,533 - Epoch: [19][13700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451443    
+2023-12-02 20:17:04,926 - Epoch: [19][13800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451895    
+2023-12-02 20:17:46,326 - Epoch: [19][13900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451622    
+2023-12-02 20:18:30,446 - Epoch: [19][14000/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451547    
+2023-12-02 20:19:13,234 - Epoch: [19][14100/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.451379    
+2023-12-02 20:19:57,594 - Epoch: [19][14200/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.451324    
+2023-12-02 20:20:43,783 - Epoch: [19][14300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451397    
+2023-12-02 20:21:26,145 - Epoch: [19][14400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451204    
+2023-12-02 20:22:12,928 - Epoch: [19][14500/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451318    
+2023-12-02 20:22:51,461 - Epoch: [19][14600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450865    
+2023-12-02 20:23:33,097 - Epoch: [19][14700/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450630    
+2023-12-02 20:24:19,786 - Epoch: [19][14800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450740    
+2023-12-02 20:25:07,991 - Epoch: [19][14900/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450949    
+2023-12-02 20:25:47,958 - Epoch: [19][15000/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450607    
+2023-12-02 20:26:32,609 - Epoch: [19][15100/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450579    
+2023-12-02 20:27:17,346 - Epoch: [19][15200/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450558    
+2023-12-02 20:27:57,747 - Epoch: [19][15300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450253    
+2023-12-02 20:28:44,845 - Epoch: [19][15400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450387    
+2023-12-02 20:29:27,859 - Epoch: [19][15500/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450256    
+2023-12-02 20:30:09,049 - Epoch: [19][15600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450010    
+2023-12-02 20:31:01,449 - Epoch: [19][15700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450480    
+2023-12-02 20:31:47,368 - Epoch: [19][15800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450535    
+2023-12-02 20:32:29,862 - Epoch: [19][15900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450374    
+2023-12-02 20:33:15,168 - Epoch: [19][16000/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450390    
+2023-12-02 20:33:59,704 - Epoch: [19][16100/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450358    
+2023-12-02 20:34:38,575 - Epoch: [19][16200/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.449977    
+2023-12-02 20:35:23,724 - Epoch: [19][16300/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.449986    
+2023-12-02 20:36:10,289 - Epoch: [19][16400/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450081    
+2023-12-02 20:36:54,130 - Epoch: [19][16500/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450010    
+2023-12-02 20:37:41,366 - Epoch: [19][16600/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450144    
+2023-12-02 20:38:25,571 - Epoch: [19][16700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450095    
+2023-12-02 20:39:12,143 - Epoch: [19][16800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450188    
+2023-12-02 20:39:59,145 - Epoch: [19][16900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450305    
+2023-12-02 20:40:41,809 - Epoch: [19][17000/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450165    
+2023-12-02 20:41:38,247 - Epoch: [19][17100/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450833    
+2023-12-02 20:42:29,599 - Epoch: [19][17200/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451197    
+2023-12-02 20:43:05,739 - Epoch: [19][17300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450677    
+2023-12-02 20:43:54,590 - Epoch: [19][17400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450894    
+2023-12-02 20:44:32,250 - Epoch: [19][17500/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450469    
+2023-12-02 20:45:17,792 - Epoch: [19][17600/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450497    
+2023-12-02 20:46:01,274 - Epoch: [19][17700/31148]    Overall Loss 0.008970    Objective Loss 0.000000    Distill Loss 0.008970                     LR 0.000250    Time 0.450408    
+2023-12-02 20:46:43,923 - Epoch: [19][17800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450273    
+2023-12-02 20:47:29,664 - Epoch: [19][17900/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450313    
+2023-12-02 20:48:14,264 - Epoch: [19][18000/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450288    
+2023-12-02 20:49:07,772 - Epoch: [19][18100/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450756    
+2023-12-02 20:49:57,792 - Epoch: [19][18200/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.451028    
+2023-12-02 20:50:34,866 - Epoch: [19][18300/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450589    
+2023-12-02 20:51:26,758 - Epoch: [19][18400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450960    
+2023-12-02 20:52:12,317 - Epoch: [19][18500/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450984    
+2023-12-02 20:53:01,273 - Epoch: [19][18600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451191    
+2023-12-02 20:53:37,386 - Epoch: [19][18700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450709    
+2023-12-02 20:54:22,380 - Epoch: [19][18800/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450705    
+2023-12-02 20:55:08,995 - Epoch: [19][18900/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.450786    
+2023-12-02 20:56:01,665 - Epoch: [19][19000/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.451185    
+2023-12-02 20:56:45,565 - Epoch: [19][19100/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.451121    
+2023-12-02 20:57:43,788 - Epoch: [19][19200/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.451804    
+2023-12-02 20:58:29,036 - Epoch: [19][19300/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.451807    
+2023-12-02 20:59:10,077 - Epoch: [19][19400/31148]    Overall Loss 0.008971    Objective Loss 0.000000    Distill Loss 0.008971                     LR 0.000250    Time 0.451593    
+2023-12-02 20:59:53,875 - Epoch: [19][19500/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451523    
+2023-12-02 21:00:33,855 - Epoch: [19][19600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451259    
+2023-12-02 21:01:14,215 - Epoch: [19][19700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451016    
+2023-12-02 21:01:59,572 - Epoch: [19][19800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451029    
+2023-12-02 21:02:41,680 - Epoch: [19][19900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450878    
+2023-12-02 21:03:23,145 - Epoch: [19][20000/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450697    
+2023-12-02 21:04:09,973 - Epoch: [19][20100/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.450784    
+2023-12-02 21:05:01,652 - Epoch: [19][20200/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451110    
+2023-12-02 21:05:48,226 - Epoch: [19][20300/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.451182    
+2023-12-02 21:06:30,973 - Epoch: [19][20400/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.451065    
+2023-12-02 21:07:12,086 - Epoch: [19][20500/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450870    
+2023-12-02 21:08:02,650 - Epoch: [19][20600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451136    
+2023-12-02 21:08:54,062 - Epoch: [19][20700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451440    
+2023-12-02 21:09:38,248 - Epoch: [19][20800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451393    
+2023-12-02 21:10:27,900 - Epoch: [19][20900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451609    
+2023-12-02 21:11:08,433 - Epoch: [19][21000/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.451388    
+2023-12-02 21:11:39,905 - Epoch: [19][21100/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.450740    
+2023-12-02 21:12:08,301 - Epoch: [19][21200/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.449953    
+2023-12-02 21:12:38,296 - Epoch: [19][21300/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.449249    
+2023-12-02 21:13:06,302 - Epoch: [19][21400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.448458    
+2023-12-02 21:13:34,914 - Epoch: [19][21500/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.447703    
+2023-12-02 21:14:02,560 - Epoch: [19][21600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.446910    
+2023-12-02 21:14:32,453 - Epoch: [19][21700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.446227    
+2023-12-02 21:15:02,828 - Epoch: [19][21800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.445574    
+2023-12-02 21:15:31,194 - Epoch: [19][21900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.444834    
+2023-12-02 21:15:58,909 - Epoch: [19][22000/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.444072    
+2023-12-02 21:16:27,301 - Epoch: [19][22100/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.443347    
+2023-12-02 21:16:58,439 - Epoch: [19][22200/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.442752    
+2023-12-02 21:17:41,666 - Epoch: [19][22300/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.442705    
+2023-12-02 21:18:17,186 - Epoch: [19][22400/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.442314    
+2023-12-02 21:19:03,477 - Epoch: [19][22500/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.442405    
+2023-12-02 21:19:56,206 - Epoch: [19][22600/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.442780    
+2023-12-02 21:20:50,937 - Epoch: [19][22700/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.443240    
+2023-12-02 21:21:31,534 - Epoch: [19][22800/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.443077    
+2023-12-02 21:22:18,175 - Epoch: [19][22900/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.443178    
+2023-12-02 21:23:03,340 - Epoch: [19][23000/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.443215    
+2023-12-02 21:23:55,658 - Epoch: [19][23100/31148]    Overall Loss 0.008972    Objective Loss 0.000000    Distill Loss 0.008972                     LR 0.000250    Time 0.443561    
+2023-12-02 21:24:48,396 - Epoch: [19][23200/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.443921    
+2023-12-02 21:25:32,494 - Epoch: [19][23300/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.443909    
+2023-12-02 21:26:14,311 - Epoch: [19][23400/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.443798    
+2023-12-02 21:27:03,139 - Epoch: [19][23500/31148]    Overall Loss 0.008973    Objective Loss 0.000000    Distill Loss 0.008973                     LR 0.000250    Time 0.443987    
+2023-12-02 21:27:51,613 - Epoch: [19][23600/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444160    
+2023-12-02 21:28:38,723 - Epoch: [19][23700/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444273    
+2023-12-02 21:29:30,448 - Epoch: [19][23800/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444579    
+2023-12-02 21:30:13,908 - Epoch: [19][23900/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444537    
+2023-12-02 21:31:05,919 - Epoch: [19][24000/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444852    
+2023-12-02 21:31:52,572 - Epoch: [19][24100/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444941    
+2023-12-02 21:32:36,808 - Epoch: [19][24200/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444930    
+2023-12-02 21:33:20,556 - Epoch: [19][24300/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.444899    
+2023-12-02 21:34:25,056 - Epoch: [19][24400/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.445719    
+2023-12-02 21:35:23,306 - Epoch: [19][24500/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.446277    
+2023-12-02 21:36:16,895 - Epoch: [19][24600/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.446641    
+2023-12-02 21:37:12,902 - Epoch: [19][24700/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.447100    
+2023-12-02 21:37:50,681 - Epoch: [19][24800/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.446820    
+2023-12-02 21:38:40,329 - Epoch: [19][24900/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.447020    
+2023-12-02 21:39:29,568 - Epoch: [19][25000/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.447201    
+2023-12-02 21:40:23,153 - Epoch: [19][25100/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.447554    
+2023-12-02 21:41:32,733 - Epoch: [19][25200/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.448538    
+2023-12-02 21:42:39,903 - Epoch: [19][25300/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449420    
+2023-12-02 21:43:24,402 - Epoch: [19][25400/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449402    
+2023-12-02 21:44:01,486 - Epoch: [19][25500/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449094    
+2023-12-02 21:44:46,564 - Epoch: [19][25600/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449100    
+2023-12-02 21:45:32,086 - Epoch: [19][25700/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449124    
+2023-12-02 21:46:16,262 - Epoch: [19][25800/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449095    
+2023-12-02 21:47:04,128 - Epoch: [19][25900/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.449209    
+2023-12-02 21:47:54,047 - Epoch: [19][26000/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449401    
+2023-12-02 21:48:52,402 - Epoch: [19][26100/31148]    Overall Loss 0.008974    Objective Loss 0.000000    Distill Loss 0.008974                     LR 0.000250    Time 0.449915    
+2023-12-02 21:49:40,286 - Epoch: [19][26200/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450025    
+2023-12-02 21:50:27,412 - Epoch: [19][26300/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450105    
+2023-12-02 21:51:08,246 - Epoch: [19][26400/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.449947    
+2023-12-02 21:52:06,038 - Epoch: [19][26500/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450429    
+2023-12-02 21:52:56,694 - Epoch: [19][26600/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450640    
+2023-12-02 21:53:48,179 - Epoch: [19][26700/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450880    
+2023-12-02 21:54:33,088 - Epoch: [19][26800/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450873    
+2023-12-02 21:55:19,401 - Epoch: [19][26900/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450919    
+2023-12-02 21:56:07,461 - Epoch: [19][27000/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.451028    
+2023-12-02 21:56:54,409 - Epoch: [19][27100/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.451096    
+2023-12-02 21:57:35,892 - Epoch: [19][27200/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450963    
+2023-12-02 21:58:12,500 - Epoch: [19][27300/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450651    
+2023-12-02 21:58:59,074 - Epoch: [19][27400/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450706    
+2023-12-02 21:59:50,748 - Epoch: [19][27500/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.450946    
+2023-12-02 22:00:38,246 - Epoch: [19][27600/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.451033    
+2023-12-02 22:01:21,104 - Epoch: [19][27700/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.450952    
+2023-12-02 22:02:06,960 - Epoch: [19][27800/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.450979    
+2023-12-02 22:03:01,802 - Epoch: [19][27900/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.451328    
+2023-12-02 22:04:01,202 - Epoch: [19][28000/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.451837    
+2023-12-02 22:04:41,240 - Epoch: [19][28100/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.451653    
+2023-12-02 22:05:25,596 - Epoch: [19][28200/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.451625    
+2023-12-02 22:06:17,523 - Epoch: [19][28300/31148]    Overall Loss 0.008975    Objective Loss 0.000000    Distill Loss 0.008975                     LR 0.000250    Time 0.451863    
+2023-12-02 22:06:59,217 - Epoch: [19][28400/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.451740    
+2023-12-02 22:08:06,149 - Epoch: [19][28500/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.452503    
+2023-12-02 22:08:59,289 - Epoch: [19][28600/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.452779    
+2023-12-02 22:09:43,105 - Epoch: [19][28700/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.452728    
+2023-12-02 22:10:39,458 - Epoch: [19][28800/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453112    
+2023-12-02 22:11:21,699 - Epoch: [19][28900/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453006    
+2023-12-02 22:12:16,326 - Epoch: [19][29000/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453327    
+2023-12-02 22:12:56,184 - Epoch: [19][29100/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453139    
+2023-12-02 22:13:42,362 - Epoch: [19][29200/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453168    
+2023-12-02 22:14:32,562 - Epoch: [19][29300/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453334    
+2023-12-02 22:15:11,296 - Epoch: [19][29400/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453110    
+2023-12-02 22:16:01,731 - Epoch: [19][29500/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453283    
+2023-12-02 22:16:54,906 - Epoch: [19][29600/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453548    
+2023-12-02 22:17:37,019 - Epoch: [19][29700/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453439    
+2023-12-02 22:18:33,813 - Epoch: [19][29800/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453823    
+2023-12-02 22:19:19,587 - Epoch: [19][29900/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453835    
+2023-12-02 22:20:07,370 - Epoch: [19][30000/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.453915    
+2023-12-02 22:21:00,742 - Epoch: [19][30100/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454180    
+2023-12-02 22:21:47,769 - Epoch: [19][30200/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454233    
+2023-12-02 22:22:37,104 - Epoch: [19][30300/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454362    
+2023-12-02 22:23:27,069 - Epoch: [19][30400/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454511    
+2023-12-02 22:24:13,722 - Epoch: [19][30500/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454550    
+2023-12-02 22:24:56,443 - Epoch: [19][30600/31148]    Overall Loss 0.008977    Objective Loss 0.000000    Distill Loss 0.008977                     LR 0.000250    Time 0.454460    
+2023-12-02 22:25:42,748 - Epoch: [19][30700/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454488    
+2023-12-02 22:26:26,482 - Epoch: [19][30800/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454432    
+2023-12-02 22:27:09,666 - Epoch: [19][30900/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454359    
+2023-12-02 22:27:57,472 - Epoch: [19][31000/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454435    
+2023-12-02 22:28:42,668 - Epoch: [19][31100/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454427    
+2023-12-02 22:29:03,099 - Epoch: [19][31148/31148]    Overall Loss 0.008976    Objective Loss 0.000000    Distill Loss 0.008976                     LR 0.000250    Time 0.454382    
+2023-12-02 22:29:03,998 - --- validate (epoch=19)-----------
+2023-12-02 22:29:03,998 - 167951 samples (100 per mini-batch)
+2023-12-02 22:29:27,394 - Epoch: [19][  100/ 1680]    Loss 0.000000    Overall Loss 0.009691    
+2023-12-02 22:29:47,340 - Epoch: [19][  200/ 1680]    Loss 0.000000    Overall Loss 0.009651    
+2023-12-02 22:30:07,298 - Epoch: [19][  300/ 1680]    Loss 0.000000    Overall Loss 0.009643    
+2023-12-02 22:30:27,307 - Epoch: [19][  400/ 1680]    Loss 0.000000    Overall Loss 0.009644    
+2023-12-02 22:30:47,308 - Epoch: [19][  500/ 1680]    Loss 0.000000    Overall Loss 0.009655    
+2023-12-02 22:31:07,299 - Epoch: [19][  600/ 1680]    Loss 0.000000    Overall Loss 0.009657    
+2023-12-02 22:31:27,305 - Epoch: [19][  700/ 1680]    Loss 0.000000    Overall Loss 0.009650    
+2023-12-02 22:31:47,232 - Epoch: [19][  800/ 1680]    Loss 0.000000    Overall Loss 0.009653    
+2023-12-02 22:32:07,158 - Epoch: [19][  900/ 1680]    Loss 0.000000    Overall Loss 0.009651    
+2023-12-02 22:32:27,135 - Epoch: [19][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009645    
+2023-12-02 22:32:47,087 - Epoch: [19][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009647    
+2023-12-02 22:33:07,048 - Epoch: [19][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009645    
+2023-12-02 22:33:26,980 - Epoch: [19][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009646    
+2023-12-02 22:33:46,962 - Epoch: [19][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009645    
+2023-12-02 22:34:06,951 - Epoch: [19][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009643    
+2023-12-02 22:34:26,871 - Epoch: [19][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009644    
+2023-12-02 22:34:42,843 - Epoch: [19][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009647    
+2023-12-02 22:34:43,406 - ==> Overall Loss: 0.010
+
+2023-12-02 22:34:43,411 - ==> Best [Overall Loss: 0.009611 on epoch: 18]
+2023-12-02 22:34:43,411 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-02 22:34:43,455 - 
+
+2023-12-02 22:34:43,455 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-02 22:35:59,982 - Epoch: [20][  100/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.765153    
+2023-12-02 22:36:37,475 - Epoch: [20][  200/31148]    Overall Loss 0.008802    Objective Loss 0.000000    Distill Loss 0.008802                     LR 0.000125    Time 0.570004    
+2023-12-02 22:37:18,198 - Epoch: [20][  300/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.515722    
+2023-12-02 22:38:05,191 - Epoch: [20][  400/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.504256    
+2023-12-02 22:38:49,815 - Epoch: [20][  500/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.492638    
+2023-12-02 22:39:38,743 - Epoch: [20][  600/31148]    Overall Loss 0.008865    Objective Loss 0.000000    Distill Loss 0.008865                     LR 0.000125    Time 0.492068    
+2023-12-02 22:40:36,451 - Epoch: [20][  700/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.504201    
+2023-12-02 22:41:19,376 - Epoch: [20][  800/31148]    Overall Loss 0.008886    Objective Loss 0.000000    Distill Loss 0.008886                     LR 0.000125    Time 0.494824    
+2023-12-02 22:42:18,423 - Epoch: [20][  900/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.505443    
+2023-12-02 22:43:02,765 - Epoch: [20][ 1000/31148]    Overall Loss 0.008872    Objective Loss 0.000000    Distill Loss 0.008872                     LR 0.000125    Time 0.499233    
+2023-12-02 22:43:55,390 - Epoch: [20][ 1100/31148]    Overall Loss 0.008868    Objective Loss 0.000000    Distill Loss 0.008868                     LR 0.000125    Time 0.501682    
+2023-12-02 22:44:42,376 - Epoch: [20][ 1200/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.499024    
+2023-12-02 22:45:29,986 - Epoch: [20][ 1300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.497255    
+2023-12-02 22:46:22,695 - Epoch: [20][ 1400/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.499380    
+2023-12-02 22:47:05,822 - Epoch: [20][ 1500/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.494835    
+2023-12-02 22:47:55,387 - Epoch: [20][ 1600/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.494880    
+2023-12-02 22:48:53,224 - Epoch: [20][ 1700/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.499787    
+2023-12-02 22:49:32,673 - Epoch: [20][ 1800/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.493933    
+2023-12-02 22:50:12,804 - Epoch: [20][ 1900/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.489054    
+2023-12-02 22:50:55,921 - Epoch: [20][ 2000/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.486156    
+2023-12-02 22:51:43,450 - Epoch: [20][ 2100/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.485635    
+2023-12-02 22:52:29,264 - Epoch: [20][ 2200/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.484381    
+2023-12-02 22:53:22,850 - Epoch: [20][ 2300/31148]    Overall Loss 0.008865    Objective Loss 0.000000    Distill Loss 0.008865                     LR 0.000125    Time 0.486617    
+2023-12-02 22:54:04,504 - Epoch: [20][ 2400/31148]    Overall Loss 0.008869    Objective Loss 0.000000    Distill Loss 0.008869                     LR 0.000125    Time 0.483693    
+2023-12-02 22:54:52,150 - Epoch: [20][ 2500/31148]    Overall Loss 0.008868    Objective Loss 0.000000    Distill Loss 0.008868                     LR 0.000125    Time 0.483401    
+2023-12-02 22:55:29,817 - Epoch: [20][ 2600/31148]    Overall Loss 0.008872    Objective Loss 0.000000    Distill Loss 0.008872                     LR 0.000125    Time 0.479293    
+2023-12-02 22:56:18,727 - Epoch: [20][ 2700/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.479654    
+2023-12-02 22:57:08,146 - Epoch: [20][ 2800/31148]    Overall Loss 0.008873    Objective Loss 0.000000    Distill Loss 0.008873                     LR 0.000125    Time 0.480171    
+2023-12-02 22:58:00,275 - Epoch: [20][ 2900/31148]    Overall Loss 0.008871    Objective Loss 0.000000    Distill Loss 0.008871                     LR 0.000125    Time 0.481586    
+2023-12-02 22:58:47,718 - Epoch: [20][ 3000/31148]    Overall Loss 0.008872    Objective Loss 0.000000    Distill Loss 0.008872                     LR 0.000125    Time 0.481345    
+2023-12-02 22:59:24,537 - Epoch: [20][ 3100/31148]    Overall Loss 0.008870    Objective Loss 0.000000    Distill Loss 0.008870                     LR 0.000125    Time 0.477692    
+2023-12-02 23:00:02,604 - Epoch: [20][ 3200/31148]    Overall Loss 0.008873    Objective Loss 0.000000    Distill Loss 0.008873                     LR 0.000125    Time 0.474658    
+2023-12-02 23:00:48,728 - Epoch: [20][ 3300/31148]    Overall Loss 0.008870    Objective Loss 0.000000    Distill Loss 0.008870                     LR 0.000125    Time 0.474249    
+2023-12-02 23:01:32,602 - Epoch: [20][ 3400/31148]    Overall Loss 0.008871    Objective Loss 0.000000    Distill Loss 0.008871                     LR 0.000125    Time 0.473202    
+2023-12-02 23:02:23,426 - Epoch: [20][ 3500/31148]    Overall Loss 0.008869    Objective Loss 0.000000    Distill Loss 0.008869                     LR 0.000125    Time 0.474201    
+2023-12-02 23:03:10,999 - Epoch: [20][ 3600/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.474242    
+2023-12-02 23:03:54,730 - Epoch: [20][ 3700/31148]    Overall Loss 0.008873    Objective Loss 0.000000    Distill Loss 0.008873                     LR 0.000125    Time 0.473241    
+2023-12-02 23:04:34,963 - Epoch: [20][ 3800/31148]    Overall Loss 0.008873    Objective Loss 0.000000    Distill Loss 0.008873                     LR 0.000125    Time 0.471373    
+2023-12-02 23:05:15,715 - Epoch: [20][ 3900/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.469734    
+2023-12-02 23:05:59,590 - Epoch: [20][ 4000/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.468958    
+2023-12-02 23:06:38,571 - Epoch: [20][ 4100/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.467025    
+2023-12-02 23:07:20,359 - Epoch: [20][ 4200/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.465854    
+2023-12-02 23:07:59,656 - Epoch: [20][ 4300/31148]    Overall Loss 0.008881    Objective Loss 0.000000    Distill Loss 0.008881                     LR 0.000125    Time 0.464157    
+2023-12-02 23:08:38,085 - Epoch: [20][ 4400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.462340    
+2023-12-02 23:09:20,060 - Epoch: [20][ 4500/31148]    Overall Loss 0.008881    Objective Loss 0.000000    Distill Loss 0.008881                     LR 0.000125    Time 0.461392    
+2023-12-02 23:10:04,428 - Epoch: [20][ 4600/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.461005    
+2023-12-02 23:10:58,479 - Epoch: [20][ 4700/31148]    Overall Loss 0.008882    Objective Loss 0.000000    Distill Loss 0.008882                     LR 0.000125    Time 0.462695    
+2023-12-02 23:11:38,875 - Epoch: [20][ 4800/31148]    Overall Loss 0.008882    Objective Loss 0.000000    Distill Loss 0.008882                     LR 0.000125    Time 0.461470    
+2023-12-02 23:12:14,056 - Epoch: [20][ 4900/31148]    Overall Loss 0.008883    Objective Loss 0.000000    Distill Loss 0.008883                     LR 0.000125    Time 0.459230    
+2023-12-02 23:12:56,998 - Epoch: [20][ 5000/31148]    Overall Loss 0.008884    Objective Loss 0.000000    Distill Loss 0.008884                     LR 0.000125    Time 0.458632    
+2023-12-02 23:13:46,831 - Epoch: [20][ 5100/31148]    Overall Loss 0.008882    Objective Loss 0.000000    Distill Loss 0.008882                     LR 0.000125    Time 0.459409    
+2023-12-02 23:14:27,763 - Epoch: [20][ 5200/31148]    Overall Loss 0.008885    Objective Loss 0.000000    Distill Loss 0.008885                     LR 0.000125    Time 0.458445    
+2023-12-02 23:15:18,311 - Epoch: [20][ 5300/31148]    Overall Loss 0.008884    Objective Loss 0.000000    Distill Loss 0.008884                     LR 0.000125    Time 0.459330    
+2023-12-02 23:15:55,130 - Epoch: [20][ 5400/31148]    Overall Loss 0.008886    Objective Loss 0.000000    Distill Loss 0.008886                     LR 0.000125    Time 0.457641    
+2023-12-02 23:16:38,989 - Epoch: [20][ 5500/31148]    Overall Loss 0.008887    Objective Loss 0.000000    Distill Loss 0.008887                     LR 0.000125    Time 0.457294    
+2023-12-02 23:17:37,657 - Epoch: [20][ 5600/31148]    Overall Loss 0.008887    Objective Loss 0.000000    Distill Loss 0.008887                     LR 0.000125    Time 0.459603    
+2023-12-02 23:18:23,667 - Epoch: [20][ 5700/31148]    Overall Loss 0.008886    Objective Loss 0.000000    Distill Loss 0.008886                     LR 0.000125    Time 0.459610    
+2023-12-02 23:19:08,517 - Epoch: [20][ 5800/31148]    Overall Loss 0.008884    Objective Loss 0.000000    Distill Loss 0.008884                     LR 0.000125    Time 0.459417    
+2023-12-02 23:19:46,663 - Epoch: [20][ 5900/31148]    Overall Loss 0.008883    Objective Loss 0.000000    Distill Loss 0.008883                     LR 0.000125    Time 0.458095    
+2023-12-02 23:20:28,306 - Epoch: [20][ 6000/31148]    Overall Loss 0.008882    Objective Loss 0.000000    Distill Loss 0.008882                     LR 0.000125    Time 0.457399    
+2023-12-02 23:21:11,310 - Epoch: [20][ 6100/31148]    Overall Loss 0.008883    Objective Loss 0.000000    Distill Loss 0.008883                     LR 0.000125    Time 0.456950    
+2023-12-02 23:21:56,090 - Epoch: [20][ 6200/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.456801    
+2023-12-02 23:22:41,776 - Epoch: [20][ 6300/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.456800    
+2023-12-02 23:23:24,754 - Epoch: [20][ 6400/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.456377    
+2023-12-02 23:23:58,423 - Epoch: [20][ 6500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.454534    
+2023-12-02 23:24:35,523 - Epoch: [20][ 6600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.453267    
+2023-12-02 23:25:19,283 - Epoch: [20][ 6700/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.453033    
+2023-12-02 23:25:57,868 - Epoch: [20][ 6800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.452044    
+2023-12-02 23:26:40,625 - Epoch: [20][ 6900/31148]    Overall Loss 0.008881    Objective Loss 0.000000    Distill Loss 0.008881                     LR 0.000125    Time 0.451688    
+2023-12-02 23:27:34,798 - Epoch: [20][ 7000/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.452973    
+2023-12-02 23:28:13,875 - Epoch: [20][ 7100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.452096    
+2023-12-02 23:28:53,031 - Epoch: [20][ 7200/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451254    
+2023-12-02 23:29:27,610 - Epoch: [20][ 7300/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.449808    
+2023-12-02 23:30:12,232 - Epoch: [20][ 7400/31148]    Overall Loss 0.008881    Objective Loss 0.000000    Distill Loss 0.008881                     LR 0.000125    Time 0.449759    
+2023-12-02 23:31:01,945 - Epoch: [20][ 7500/31148]    Overall Loss 0.008881    Objective Loss 0.000000    Distill Loss 0.008881                     LR 0.000125    Time 0.450390    
+2023-12-02 23:31:38,962 - Epoch: [20][ 7600/31148]    Overall Loss 0.008881    Objective Loss 0.000000    Distill Loss 0.008881                     LR 0.000125    Time 0.449333    
+2023-12-02 23:32:18,566 - Epoch: [20][ 7700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448640    
+2023-12-02 23:33:01,839 - Epoch: [20][ 7800/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.448435    
+2023-12-02 23:33:35,371 - Epoch: [20][ 7900/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.447002    
+2023-12-02 23:34:14,412 - Epoch: [20][ 8000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.446294    
+2023-12-02 23:34:56,045 - Epoch: [20][ 8100/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445923    
+2023-12-02 23:35:42,631 - Epoch: [20][ 8200/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.446165    
+2023-12-02 23:36:32,545 - Epoch: [20][ 8300/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.446803    
+2023-12-02 23:37:21,958 - Epoch: [20][ 8400/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.447365    
+2023-12-02 23:37:58,153 - Epoch: [20][ 8500/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.446360    
+2023-12-02 23:38:33,330 - Epoch: [20][ 8600/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445259    
+2023-12-02 23:39:16,488 - Epoch: [20][ 8700/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.445101    
+2023-12-02 23:40:03,764 - Epoch: [20][ 8800/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.445414    
+2023-12-02 23:40:41,008 - Epoch: [20][ 8900/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.444594    
+2023-12-02 23:41:27,332 - Epoch: [20][ 9000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.444800    
+2023-12-02 23:42:14,029 - Epoch: [20][ 9100/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445043    
+2023-12-02 23:42:58,297 - Epoch: [20][ 9200/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.445016    
+2023-12-02 23:43:36,906 - Epoch: [20][ 9300/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.444382    
+2023-12-02 23:44:21,398 - Epoch: [20][ 9400/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.444387    
+2023-12-02 23:45:09,147 - Epoch: [20][ 9500/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.444735    
+2023-12-02 23:46:02,038 - Epoch: [20][ 9600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.445611    
+2023-12-02 23:46:46,968 - Epoch: [20][ 9700/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.445648    
+2023-12-02 23:47:32,072 - Epoch: [20][ 9800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.445702    
+2023-12-02 23:48:17,006 - Epoch: [20][ 9900/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.445738    
+2023-12-02 23:48:58,095 - Epoch: [20][10000/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.445388    
+2023-12-02 23:49:40,756 - Epoch: [20][10100/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445202    
+2023-12-02 23:50:24,894 - Epoch: [20][10200/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445163    
+2023-12-02 23:51:06,569 - Epoch: [20][10300/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.444887    
+2023-12-02 23:51:42,274 - Epoch: [20][10400/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.444042    
+2023-12-02 23:52:32,676 - Epoch: [20][10500/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.444612    
+2023-12-02 23:53:27,217 - Epoch: [20][10600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.445563    
+2023-12-02 23:54:14,343 - Epoch: [20][10700/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445802    
+2023-12-02 23:55:00,002 - Epoch: [20][10800/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445901    
+2023-12-02 23:55:40,951 - Epoch: [20][10900/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445566    
+2023-12-02 23:56:36,219 - Epoch: [20][11000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.446539    
+2023-12-02 23:57:24,841 - Epoch: [20][11100/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.446896    
+2023-12-02 23:58:09,753 - Epoch: [20][11200/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.446916    
+2023-12-02 23:58:47,660 - Epoch: [20][11300/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.446315    
+2023-12-02 23:59:33,691 - Epoch: [20][11400/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.446437    
+2023-12-03 00:00:14,109 - Epoch: [20][11500/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.446069    
+2023-12-03 00:00:50,642 - Epoch: [20][11600/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.445372    
+2023-12-03 00:01:39,641 - Epoch: [20][11700/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.445753    
+2023-12-03 00:02:19,560 - Epoch: [20][11800/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.445358    
+2023-12-03 00:02:58,537 - Epoch: [20][11900/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.444890    
+2023-12-03 00:03:40,439 - Epoch: [20][12000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.444674    
+2023-12-03 00:04:22,174 - Epoch: [20][12100/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.444447    
+2023-12-03 00:05:14,169 - Epoch: [20][12200/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.445066    
+2023-12-03 00:05:57,545 - Epoch: [20][12300/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.444973    
+2023-12-03 00:06:41,870 - Epoch: [20][12400/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.444959    
+2023-12-03 00:07:23,662 - Epoch: [20][12500/31148]    Overall Loss 0.008873    Objective Loss 0.000000    Distill Loss 0.008873                     LR 0.000125    Time 0.444742    
+2023-12-03 00:08:12,112 - Epoch: [20][12600/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.445057    
+2023-12-03 00:09:01,878 - Epoch: [20][12700/31148]    Overall Loss 0.008874    Objective Loss 0.000000    Distill Loss 0.008874                     LR 0.000125    Time 0.445471    
+2023-12-03 00:09:37,424 - Epoch: [20][12800/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.444767    
+2023-12-03 00:10:17,451 - Epoch: [20][12900/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.444421    
+2023-12-03 00:10:51,558 - Epoch: [20][13000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.443626    
+2023-12-03 00:11:38,912 - Epoch: [20][13100/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443854    
+2023-12-03 00:12:16,347 - Epoch: [20][13200/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443326    
+2023-12-03 00:13:04,749 - Epoch: [20][13300/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443632    
+2023-12-03 00:13:51,094 - Epoch: [20][13400/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443779    
+2023-12-03 00:14:31,849 - Epoch: [20][13500/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443510    
+2023-12-03 00:15:12,309 - Epoch: [20][13600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443224    
+2023-12-03 00:15:48,614 - Epoch: [20][13700/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.442638    
+2023-12-03 00:16:41,998 - Epoch: [20][13800/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443298    
+2023-12-03 00:17:31,824 - Epoch: [20][13900/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443693    
+2023-12-03 00:18:12,330 - Epoch: [20][14000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443417    
+2023-12-03 00:18:54,455 - Epoch: [20][14100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443259    
+2023-12-03 00:19:42,440 - Epoch: [20][14200/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443516    
+2023-12-03 00:20:24,744 - Epoch: [20][14300/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443373    
+2023-12-03 00:21:05,650 - Epoch: [20][14400/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443134    
+2023-12-03 00:21:50,600 - Epoch: [20][14500/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.443177    
+2023-12-03 00:22:31,607 - Epoch: [20][14600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.442950    
+2023-12-03 00:23:10,033 - Epoch: [20][14700/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.442550    
+2023-12-03 00:23:45,993 - Epoch: [20][14800/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.441989    
+2023-12-03 00:24:35,911 - Epoch: [20][14900/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.442373    
+2023-12-03 00:25:23,674 - Epoch: [20][15000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.442607    
+2023-12-03 00:26:05,646 - Epoch: [20][15100/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.442455    
+2023-12-03 00:26:53,655 - Epoch: [20][15200/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.442702    
+2023-12-03 00:27:35,335 - Epoch: [20][15300/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.442533    
+2023-12-03 00:28:23,370 - Epoch: [20][15400/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.442778    
+2023-12-03 00:29:07,342 - Epoch: [20][15500/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.442758    
+2023-12-03 00:29:42,738 - Epoch: [20][15600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.442188    
+2023-12-03 00:30:22,244 - Epoch: [20][15700/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.441887    
+2023-12-03 00:30:56,310 - Epoch: [20][15800/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.441246    
+2023-12-03 00:31:38,875 - Epoch: [20][15900/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.441148    
+2023-12-03 00:32:19,703 - Epoch: [20][16000/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440942    
+2023-12-03 00:32:55,353 - Epoch: [20][16100/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440417    
+2023-12-03 00:33:33,437 - Epoch: [20][16200/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440049    
+2023-12-03 00:34:26,896 - Epoch: [20][16300/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440628    
+2023-12-03 00:35:16,800 - Epoch: [20][16400/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440984    
+2023-12-03 00:35:58,533 - Epoch: [20][16500/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440840    
+2023-12-03 00:36:37,615 - Epoch: [20][16600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440538    
+2023-12-03 00:37:15,846 - Epoch: [20][16700/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.440189    
+2023-12-03 00:37:57,091 - Epoch: [20][16800/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.440024    
+2023-12-03 00:38:38,388 - Epoch: [20][16900/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.439863    
+2023-12-03 00:39:36,413 - Epoch: [20][17000/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.440689    
+2023-12-03 00:40:23,734 - Epoch: [20][17100/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.440879    
+2023-12-03 00:41:03,837 - Epoch: [20][17200/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.440647    
+2023-12-03 00:41:33,062 - Epoch: [20][17300/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.439789    
+2023-12-03 00:42:01,581 - Epoch: [20][17400/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.438900    
+2023-12-03 00:42:28,911 - Epoch: [20][17500/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.437953    
+2023-12-03 00:42:56,546 - Epoch: [20][17600/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.437035    
+2023-12-03 00:43:24,541 - Epoch: [20][17700/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.436147    
+2023-12-03 00:43:53,011 - Epoch: [20][17800/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.435296    
+2023-12-03 00:44:20,722 - Epoch: [20][17900/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.434412    
+2023-12-03 00:44:48,653 - Epoch: [20][18000/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.433550    
+2023-12-03 00:45:15,237 - Epoch: [20][18100/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.432623    
+2023-12-03 00:45:43,735 - Epoch: [20][18200/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.431812    
+2023-12-03 00:46:11,173 - Epoch: [20][18300/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.430951    
+2023-12-03 00:46:44,721 - Epoch: [20][18400/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.430432    
+2023-12-03 00:47:34,710 - Epoch: [20][18500/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.430807    
+2023-12-03 00:48:16,907 - Epoch: [20][18600/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.430759    
+2023-12-03 00:49:05,066 - Epoch: [20][18700/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.431031    
+2023-12-03 00:49:51,522 - Epoch: [20][18800/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.431209    
+2023-12-03 00:50:50,129 - Epoch: [20][18900/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.432028    
+2023-12-03 00:51:40,615 - Epoch: [20][19000/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.432410    
+2023-12-03 00:52:31,647 - Epoch: [20][19100/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.432818    
+2023-12-03 00:53:35,080 - Epoch: [20][19200/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.433867    
+2023-12-03 00:54:28,964 - Epoch: [20][19300/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.434411    
+2023-12-03 00:55:26,573 - Epoch: [20][19400/31148]    Overall Loss 0.008875    Objective Loss 0.000000    Distill Loss 0.008875                     LR 0.000125    Time 0.435141    
+2023-12-03 00:56:07,424 - Epoch: [20][19500/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.435004    
+2023-12-03 00:56:54,876 - Epoch: [20][19600/31148]    Overall Loss 0.008876    Objective Loss 0.000000    Distill Loss 0.008876                     LR 0.000125    Time 0.435205    
+2023-12-03 00:57:45,724 - Epoch: [20][19700/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.435576    
+2023-12-03 00:58:29,233 - Epoch: [20][19800/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.435574    
+2023-12-03 00:59:17,418 - Epoch: [20][19900/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.435806    
+2023-12-03 01:00:03,904 - Epoch: [20][20000/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.435951    
+2023-12-03 01:00:53,491 - Epoch: [20][20100/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.436248    
+2023-12-03 01:01:57,826 - Epoch: [20][20200/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.437273    
+2023-12-03 01:02:56,888 - Epoch: [20][20300/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.438028    
+2023-12-03 01:03:44,057 - Epoch: [20][20400/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.438193    
+2023-12-03 01:04:25,121 - Epoch: [20][20500/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.438058    
+2023-12-03 01:05:11,719 - Epoch: [20][20600/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.438193    
+2023-12-03 01:06:00,825 - Epoch: [20][20700/31148]    Overall Loss 0.008877    Objective Loss 0.000000    Distill Loss 0.008877                     LR 0.000125    Time 0.438448    
+2023-12-03 01:06:45,147 - Epoch: [20][20800/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.438471    
+2023-12-03 01:07:32,196 - Epoch: [20][20900/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.438624    
+2023-12-03 01:08:27,946 - Epoch: [20][21000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439190    
+2023-12-03 01:09:10,165 - Epoch: [20][21100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439109    
+2023-12-03 01:10:00,026 - Epoch: [20][21200/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439389    
+2023-12-03 01:10:50,100 - Epoch: [20][21300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439677    
+2023-12-03 01:11:40,610 - Epoch: [20][21400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439982    
+2023-12-03 01:12:24,015 - Epoch: [20][21500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439954    
+2023-12-03 01:13:03,439 - Epoch: [20][21600/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.439742    
+2023-12-03 01:13:48,380 - Epoch: [20][21700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.439786    
+2023-12-03 01:14:49,795 - Epoch: [20][21800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.440586    
+2023-12-03 01:15:25,229 - Epoch: [20][21900/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.440192    
+2023-12-03 01:16:23,390 - Epoch: [20][22000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.440834    
+2023-12-03 01:17:07,027 - Epoch: [20][22100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.440814    
+2023-12-03 01:18:01,870 - Epoch: [20][22200/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.441298    
+2023-12-03 01:18:41,243 - Epoch: [20][22300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.441084    
+2023-12-03 01:19:29,898 - Epoch: [20][22400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.441287    
+2023-12-03 01:20:14,696 - Epoch: [20][22500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.441316    
+2023-12-03 01:21:11,375 - Epoch: [20][22600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.441871    
+2023-12-03 01:22:07,690 - Epoch: [20][22700/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.442405    
+2023-12-03 01:22:56,128 - Epoch: [20][22800/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.442589    
+2023-12-03 01:23:50,238 - Epoch: [20][22900/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443019    
+2023-12-03 01:24:38,254 - Epoch: [20][23000/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443180    
+2023-12-03 01:25:21,463 - Epoch: [20][23100/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443132    
+2023-12-03 01:26:05,705 - Epoch: [20][23200/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.443128    
+2023-12-03 01:26:48,443 - Epoch: [20][23300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443060    
+2023-12-03 01:27:30,992 - Epoch: [20][23400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.442985    
+2023-12-03 01:28:12,186 - Epoch: [20][23500/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.442853    
+2023-12-03 01:28:56,663 - Epoch: [20][23600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.442860    
+2023-12-03 01:29:45,799 - Epoch: [20][23700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443065    
+2023-12-03 01:30:32,924 - Epoch: [20][23800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443183    
+2023-12-03 01:31:26,372 - Epoch: [20][23900/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443565    
+2023-12-03 01:32:10,323 - Epoch: [20][24000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443547    
+2023-12-03 01:32:56,952 - Epoch: [20][24100/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.443641    
+2023-12-03 01:33:40,204 - Epoch: [20][24200/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443595    
+2023-12-03 01:34:25,282 - Epoch: [20][24300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443624    
+2023-12-03 01:35:10,995 - Epoch: [20][24400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443679    
+2023-12-03 01:35:52,966 - Epoch: [20][24500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.443581    
+2023-12-03 01:36:50,801 - Epoch: [20][24600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.444129    
+2023-12-03 01:37:40,939 - Epoch: [20][24700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.444360    
+2023-12-03 01:38:29,426 - Epoch: [20][24800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.444523    
+2023-12-03 01:39:13,964 - Epoch: [20][24900/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.444527    
+2023-12-03 01:39:59,453 - Epoch: [20][25000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.444568    
+2023-12-03 01:40:49,357 - Epoch: [20][25100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.444784    
+2023-12-03 01:41:40,076 - Epoch: [20][25200/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.445032    
+2023-12-03 01:42:37,098 - Epoch: [20][25300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.445526    
+2023-12-03 01:43:22,021 - Epoch: [20][25400/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.445541    
+2023-12-03 01:44:18,985 - Epoch: [20][25500/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.446027    
+2023-12-03 01:45:19,512 - Epoch: [20][25600/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.446649    
+2023-12-03 01:46:08,272 - Epoch: [20][25700/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.446808    
+2023-12-03 01:46:45,715 - Epoch: [20][25800/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.446527    
+2023-12-03 01:47:29,370 - Epoch: [20][25900/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.446488    
+2023-12-03 01:48:10,028 - Epoch: [20][26000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.446334    
+2023-12-03 01:49:05,061 - Epoch: [20][26100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.446733    
+2023-12-03 01:50:01,819 - Epoch: [20][26200/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.447194    
+2023-12-03 01:50:52,276 - Epoch: [20][26300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.447411    
+2023-12-03 01:51:42,955 - Epoch: [20][26400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.447636    
+2023-12-03 01:52:30,621 - Epoch: [20][26500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.447745    
+2023-12-03 01:53:19,895 - Epoch: [20][26600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.447914    
+2023-12-03 01:54:08,748 - Epoch: [20][26700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448066    
+2023-12-03 01:55:01,616 - Epoch: [20][26800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448367    
+2023-12-03 01:55:53,991 - Epoch: [20][26900/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.448646    
+2023-12-03 01:56:35,550 - Epoch: [20][27000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448524    
+2023-12-03 01:57:22,526 - Epoch: [20][27100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448602    
+2023-12-03 01:58:06,625 - Epoch: [20][27200/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448574    
+2023-12-03 01:58:42,272 - Epoch: [20][27300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448236    
+2023-12-03 01:59:26,734 - Epoch: [20][27400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448223    
+2023-12-03 02:00:12,111 - Epoch: [20][27500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448243    
+2023-12-03 02:00:52,475 - Epoch: [20][27600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448081    
+2023-12-03 02:01:51,028 - Epoch: [20][27700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448577    
+2023-12-03 02:02:36,065 - Epoch: [20][27800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448583    
+2023-12-03 02:03:28,654 - Epoch: [20][27900/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448860    
+2023-12-03 02:04:16,740 - Epoch: [20][28000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.448974    
+2023-12-03 02:05:06,603 - Epoch: [20][28100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.449150    
+2023-12-03 02:06:00,913 - Epoch: [20][28200/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.449483    
+2023-12-03 02:06:46,537 - Epoch: [20][28300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.449507    
+2023-12-03 02:07:36,979 - Epoch: [20][28400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.449700    
+2023-12-03 02:08:26,459 - Epoch: [20][28500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.449858    
+2023-12-03 02:09:09,725 - Epoch: [20][28600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.449797    
+2023-12-03 02:10:00,536 - Epoch: [20][28700/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.450000    
+2023-12-03 02:10:43,385 - Epoch: [20][28800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.449925    
+2023-12-03 02:11:33,701 - Epoch: [20][28900/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.450109    
+2023-12-03 02:12:17,935 - Epoch: [20][29000/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.450082    
+2023-12-03 02:13:15,216 - Epoch: [20][29100/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.450504    
+2023-12-03 02:14:09,649 - Epoch: [20][29200/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.450825    
+2023-12-03 02:15:03,404 - Epoch: [20][29300/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451121    
+2023-12-03 02:15:44,830 - Epoch: [20][29400/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.450995    
+2023-12-03 02:16:35,172 - Epoch: [20][29500/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451172    
+2023-12-03 02:17:27,526 - Epoch: [20][29600/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451417    
+2023-12-03 02:18:12,295 - Epoch: [20][29700/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451404    
+2023-12-03 02:19:01,057 - Epoch: [20][29800/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451525    
+2023-12-03 02:19:47,413 - Epoch: [20][29900/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451565    
+2023-12-03 02:20:23,912 - Epoch: [20][30000/31148]    Overall Loss 0.008879    Objective Loss 0.000000    Distill Loss 0.008879                     LR 0.000125    Time 0.451276    
+2023-12-03 02:21:05,715 - Epoch: [20][30100/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451166    
+2023-12-03 02:21:53,312 - Epoch: [20][30200/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451248    
+2023-12-03 02:22:42,383 - Epoch: [20][30300/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451378    
+2023-12-03 02:23:24,237 - Epoch: [20][30400/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451269    
+2023-12-03 02:24:12,624 - Epoch: [20][30500/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451376    
+2023-12-03 02:25:07,779 - Epoch: [20][30600/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451703    
+2023-12-03 02:25:49,102 - Epoch: [20][30700/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451578    
+2023-12-03 02:26:43,291 - Epoch: [20][30800/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451871    
+2023-12-03 02:27:28,064 - Epoch: [20][30900/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451857    
+2023-12-03 02:28:11,320 - Epoch: [20][31000/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451794    
+2023-12-03 02:28:50,895 - Epoch: [20][31100/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451614    
+2023-12-03 02:29:13,548 - Epoch: [20][31148/31148]    Overall Loss 0.008880    Objective Loss 0.000000    Distill Loss 0.008880                     LR 0.000125    Time 0.451645    
+2023-12-03 02:29:14,519 - --- validate (epoch=20)-----------
+2023-12-03 02:29:14,519 - 167951 samples (100 per mini-batch)
+2023-12-03 02:29:38,101 - Epoch: [20][  100/ 1680]    Loss 0.000000    Overall Loss 0.009436    
+2023-12-03 02:29:58,076 - Epoch: [20][  200/ 1680]    Loss 0.000000    Overall Loss 0.009430    
+2023-12-03 02:30:18,094 - Epoch: [20][  300/ 1680]    Loss 0.000000    Overall Loss 0.009447    
+2023-12-03 02:30:38,094 - Epoch: [20][  400/ 1680]    Loss 0.000000    Overall Loss 0.009453    
+2023-12-03 02:30:58,090 - Epoch: [20][  500/ 1680]    Loss 0.000000    Overall Loss 0.009462    
+2023-12-03 02:31:18,056 - Epoch: [20][  600/ 1680]    Loss 0.000000    Overall Loss 0.009468    
+2023-12-03 02:31:38,060 - Epoch: [20][  700/ 1680]    Loss 0.000000    Overall Loss 0.009466    
+2023-12-03 02:31:58,074 - Epoch: [20][  800/ 1680]    Loss 0.000000    Overall Loss 0.009471    
+2023-12-03 02:32:18,054 - Epoch: [20][  900/ 1680]    Loss 0.000000    Overall Loss 0.009470    
+2023-12-03 02:32:38,080 - Epoch: [20][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009473    
+2023-12-03 02:32:58,050 - Epoch: [20][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 02:33:17,988 - Epoch: [20][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 02:33:38,014 - Epoch: [20][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 02:33:58,002 - Epoch: [20][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009478    
+2023-12-03 02:34:18,030 - Epoch: [20][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009484    
+2023-12-03 02:34:38,000 - Epoch: [20][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009484    
+2023-12-03 02:34:54,023 - Epoch: [20][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009485    
+2023-12-03 02:34:54,496 - ==> Overall Loss: 0.009
+
+2023-12-03 02:34:54,504 - ==> Best [Overall Loss: 0.009485 on epoch: 20]
+2023-12-03 02:34:54,505 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-03 02:34:54,556 - 
+
+2023-12-03 02:34:54,557 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-03 02:35:55,596 - Epoch: [21][  100/31148]    Overall Loss 0.008889    Objective Loss 0.000000    Distill Loss 0.008889                     LR 0.000125    Time 0.610307    
+2023-12-03 02:36:30,421 - Epoch: [21][  200/31148]    Overall Loss 0.008812    Objective Loss 0.000000    Distill Loss 0.008812                     LR 0.000125    Time 0.479241    
+2023-12-03 02:37:09,680 - Epoch: [21][  300/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450333    
+2023-12-03 02:37:52,658 - Epoch: [21][  400/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.445178    
+2023-12-03 02:38:28,817 - Epoch: [21][  500/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.428445    
+2023-12-03 02:39:03,455 - Epoch: [21][  600/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.414756    
+2023-12-03 02:39:41,897 - Epoch: [21][  700/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.410410    
+2023-12-03 02:40:25,270 - Epoch: [21][  800/31148]    Overall Loss 0.008864    Objective Loss 0.000000    Distill Loss 0.008864                     LR 0.000125    Time 0.413317    
+2023-12-03 02:41:08,246 - Epoch: [21][  900/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.415136    
+2023-12-03 02:41:54,334 - Epoch: [21][ 1000/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.419703    
+2023-12-03 02:42:38,147 - Epoch: [21][ 1100/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.421372    
+2023-12-03 02:43:15,379 - Epoch: [21][ 1200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.417278    
+2023-12-03 02:43:52,495 - Epoch: [21][ 1300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.413725    
+2023-12-03 02:44:31,701 - Epoch: [21][ 1400/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.412171    
+2023-12-03 02:45:12,733 - Epoch: [21][ 1500/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.412043    
+2023-12-03 02:45:54,102 - Epoch: [21][ 1600/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.412142    
+2023-12-03 02:46:37,042 - Epoch: [21][ 1700/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.413152    
+2023-12-03 02:47:15,259 - Epoch: [21][ 1800/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.411427    
+2023-12-03 02:47:58,676 - Epoch: [21][ 1900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.412620    
+2023-12-03 02:48:46,703 - Epoch: [21][ 2000/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.415998    
+2023-12-03 02:49:22,771 - Epoch: [21][ 2100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.413361    
+2023-12-03 02:50:04,421 - Epoch: [21][ 2200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.413500    
+2023-12-03 02:50:41,174 - Epoch: [21][ 2300/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.411498    
+2023-12-03 02:51:28,309 - Epoch: [21][ 2400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.413989    
+2023-12-03 02:52:14,264 - Epoch: [21][ 2500/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.415809    
+2023-12-03 02:52:52,875 - Epoch: [21][ 2600/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.414663    
+2023-12-03 02:53:39,419 - Epoch: [21][ 2700/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.416541    
+2023-12-03 02:54:18,215 - Epoch: [21][ 2800/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.415518    
+2023-12-03 02:55:01,109 - Epoch: [21][ 2900/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.415978    
+2023-12-03 02:55:44,138 - Epoch: [21][ 3000/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.416453    
+2023-12-03 02:56:28,471 - Epoch: [21][ 3100/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.417317    
+2023-12-03 02:57:10,730 - Epoch: [21][ 3200/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.417480    
+2023-12-03 02:57:46,125 - Epoch: [21][ 3300/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.415552    
+2023-12-03 02:58:27,666 - Epoch: [21][ 3400/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.415546    
+2023-12-03 02:59:14,568 - Epoch: [21][ 3500/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.417071    
+2023-12-03 02:59:56,374 - Epoch: [21][ 3600/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.417097    
+2023-12-03 03:00:39,059 - Epoch: [21][ 3700/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.417358    
+2023-12-03 03:01:20,074 - Epoch: [21][ 3800/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.417167    
+2023-12-03 03:02:02,008 - Epoch: [21][ 3900/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.417221    
+2023-12-03 03:02:42,891 - Epoch: [21][ 4000/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.417009    
+2023-12-03 03:03:26,035 - Epoch: [21][ 4100/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.417359    
+2023-12-03 03:04:06,411 - Epoch: [21][ 4200/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.417033    
+2023-12-03 03:04:45,475 - Epoch: [21][ 4300/31148]    Overall Loss 0.008867    Objective Loss 0.000000    Distill Loss 0.008867                     LR 0.000125    Time 0.416418    
+2023-12-03 03:05:33,476 - Epoch: [21][ 4400/31148]    Overall Loss 0.008864    Objective Loss 0.000000    Distill Loss 0.008864                     LR 0.000125    Time 0.417861    
+2023-12-03 03:06:18,232 - Epoch: [21][ 4500/31148]    Overall Loss 0.008865    Objective Loss 0.000000    Distill Loss 0.008865                     LR 0.000125    Time 0.418519    
+2023-12-03 03:06:56,681 - Epoch: [21][ 4600/31148]    Overall Loss 0.008865    Objective Loss 0.000000    Distill Loss 0.008865                     LR 0.000125    Time 0.417778    
+2023-12-03 03:07:41,103 - Epoch: [21][ 4700/31148]    Overall Loss 0.008865    Objective Loss 0.000000    Distill Loss 0.008865                     LR 0.000125    Time 0.418339    
+2023-12-03 03:08:19,783 - Epoch: [21][ 4800/31148]    Overall Loss 0.008866    Objective Loss 0.000000    Distill Loss 0.008866                     LR 0.000125    Time 0.417681    
+2023-12-03 03:09:16,224 - Epoch: [21][ 4900/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.420673    
+2023-12-03 03:10:04,248 - Epoch: [21][ 5000/31148]    Overall Loss 0.008864    Objective Loss 0.000000    Distill Loss 0.008864                     LR 0.000125    Time 0.421863    
+2023-12-03 03:10:41,212 - Epoch: [21][ 5100/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.420838    
+2023-12-03 03:11:26,595 - Epoch: [21][ 5200/31148]    Overall Loss 0.008866    Objective Loss 0.000000    Distill Loss 0.008866                     LR 0.000125    Time 0.421471    
+2023-12-03 03:12:00,680 - Epoch: [21][ 5300/31148]    Overall Loss 0.008864    Objective Loss 0.000000    Distill Loss 0.008864                     LR 0.000125    Time 0.419948    
+2023-12-03 03:12:41,402 - Epoch: [21][ 5400/31148]    Overall Loss 0.008867    Objective Loss 0.000000    Distill Loss 0.008867                     LR 0.000125    Time 0.419711    
+2023-12-03 03:13:20,780 - Epoch: [21][ 5500/31148]    Overall Loss 0.008868    Objective Loss 0.000000    Distill Loss 0.008868                     LR 0.000125    Time 0.419239    
+2023-12-03 03:14:10,792 - Epoch: [21][ 5600/31148]    Overall Loss 0.008868    Objective Loss 0.000000    Distill Loss 0.008868                     LR 0.000125    Time 0.420682    
+2023-12-03 03:14:49,311 - Epoch: [21][ 5700/31148]    Overall Loss 0.008867    Objective Loss 0.000000    Distill Loss 0.008867                     LR 0.000125    Time 0.420058    
+2023-12-03 03:15:37,039 - Epoch: [21][ 5800/31148]    Overall Loss 0.008866    Objective Loss 0.000000    Distill Loss 0.008866                     LR 0.000125    Time 0.421043    
+2023-12-03 03:16:19,367 - Epoch: [21][ 5900/31148]    Overall Loss 0.008864    Objective Loss 0.000000    Distill Loss 0.008864                     LR 0.000125    Time 0.421080    
+2023-12-03 03:17:05,080 - Epoch: [21][ 6000/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.421679    
+2023-12-03 03:17:44,900 - Epoch: [21][ 6100/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.421293    
+2023-12-03 03:18:28,451 - Epoch: [21][ 6200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.421521    
+2023-12-03 03:19:11,845 - Epoch: [21][ 6300/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.421717    
+2023-12-03 03:19:59,156 - Epoch: [21][ 6400/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.422519    
+2023-12-03 03:20:48,907 - Epoch: [21][ 6500/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.423672    
+2023-12-03 03:21:35,441 - Epoch: [21][ 6600/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.424302    
+2023-12-03 03:22:20,080 - Epoch: [21][ 6700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.424630    
+2023-12-03 03:23:01,003 - Epoch: [21][ 6800/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.424403    
+2023-12-03 03:23:35,755 - Epoch: [21][ 6900/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.423288    
+2023-12-03 03:24:31,282 - Epoch: [21][ 7000/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.425172    
+2023-12-03 03:25:15,765 - Epoch: [21][ 7100/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.425448    
+2023-12-03 03:25:59,860 - Epoch: [21][ 7200/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.425662    
+2023-12-03 03:26:48,499 - Epoch: [21][ 7300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.426493    
+2023-12-03 03:27:37,319 - Epoch: [21][ 7400/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.427326    
+2023-12-03 03:28:09,905 - Epoch: [21][ 7500/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.425972    
+2023-12-03 03:28:57,555 - Epoch: [21][ 7600/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.426636    
+2023-12-03 03:29:43,247 - Epoch: [21][ 7700/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.427028    
+2023-12-03 03:30:33,777 - Epoch: [21][ 7800/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.428031    
+2023-12-03 03:31:09,737 - Epoch: [21][ 7900/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.427164    
+2023-12-03 03:32:03,250 - Epoch: [21][ 8000/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.428512    
+2023-12-03 03:32:47,325 - Epoch: [21][ 8100/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.428662    
+2023-12-03 03:33:30,722 - Epoch: [21][ 8200/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.428726    
+2023-12-03 03:34:16,736 - Epoch: [21][ 8300/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.429104    
+2023-12-03 03:35:03,544 - Epoch: [21][ 8400/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.429567    
+2023-12-03 03:35:46,337 - Epoch: [21][ 8500/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.429547    
+2023-12-03 03:36:22,028 - Epoch: [21][ 8600/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.428701    
+2023-12-03 03:37:09,485 - Epoch: [21][ 8700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429228    
+2023-12-03 03:37:51,828 - Epoch: [21][ 8800/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.429161    
+2023-12-03 03:38:33,664 - Epoch: [21][ 8900/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429039    
+2023-12-03 03:39:17,588 - Epoch: [21][ 9000/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.429151    
+2023-12-03 03:40:00,172 - Epoch: [21][ 9100/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.429114    
+2023-12-03 03:40:46,982 - Epoch: [21][ 9200/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429537    
+2023-12-03 03:41:30,437 - Epoch: [21][ 9300/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429590    
+2023-12-03 03:42:14,553 - Epoch: [21][ 9400/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429713    
+2023-12-03 03:42:57,179 - Epoch: [21][ 9500/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429675    
+2023-12-03 03:43:42,119 - Epoch: [21][ 9600/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.429880    
+2023-12-03 03:44:24,914 - Epoch: [21][ 9700/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.429859    
+2023-12-03 03:45:12,132 - Epoch: [21][ 9800/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.430291    
+2023-12-03 03:45:50,448 - Epoch: [21][ 9900/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.429814    
+2023-12-03 03:46:35,784 - Epoch: [21][10000/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.430048    
+2023-12-03 03:47:21,287 - Epoch: [21][10100/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.430295    
+2023-12-03 03:48:07,281 - Epoch: [21][10200/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.430585    
+2023-12-03 03:48:49,408 - Epoch: [21][10300/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.430494    
+2023-12-03 03:49:28,470 - Epoch: [21][10400/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.430110    
+2023-12-03 03:50:13,693 - Epoch: [21][10500/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.430320    
+2023-12-03 03:50:46,095 - Epoch: [21][10600/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.429316    
+2023-12-03 03:51:26,653 - Epoch: [21][10700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429094    
+2023-12-03 03:52:06,630 - Epoch: [21][10800/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428822    
+2023-12-03 03:52:43,520 - Epoch: [21][10900/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428271    
+2023-12-03 03:53:30,975 - Epoch: [21][11000/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428691    
+2023-12-03 03:54:18,982 - Epoch: [21][11100/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.429153    
+2023-12-03 03:55:00,706 - Epoch: [21][11200/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.429046    
+2023-12-03 03:55:34,839 - Epoch: [21][11300/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.428270    
+2023-12-03 03:56:15,219 - Epoch: [21][11400/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428053    
+2023-12-03 03:56:58,596 - Epoch: [21][11500/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.428103    
+2023-12-03 03:57:44,396 - Epoch: [21][11600/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.428360    
+2023-12-03 03:58:29,725 - Epoch: [21][11700/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.428572    
+2023-12-03 03:59:16,391 - Epoch: [21][11800/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.428894    
+2023-12-03 03:59:56,214 - Epoch: [21][11900/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428636    
+2023-12-03 04:00:41,938 - Epoch: [21][12000/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.428874    
+2023-12-03 04:01:23,158 - Epoch: [21][12100/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428735    
+2023-12-03 04:02:03,210 - Epoch: [21][12200/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.428504    
+2023-12-03 04:02:41,283 - Epoch: [21][12300/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428115    
+2023-12-03 04:03:17,920 - Epoch: [21][12400/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427616    
+2023-12-03 04:03:58,639 - Epoch: [21][12500/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427452    
+2023-12-03 04:04:42,833 - Epoch: [21][12600/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427566    
+2023-12-03 04:05:18,198 - Epoch: [21][12700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.426984    
+2023-12-03 04:05:55,720 - Epoch: [21][12800/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.426579    
+2023-12-03 04:06:35,747 - Epoch: [21][12900/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.426374    
+2023-12-03 04:07:30,233 - Epoch: [21][13000/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427285    
+2023-12-03 04:08:24,035 - Epoch: [21][13100/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.428130    
+2023-12-03 04:09:06,485 - Epoch: [21][13200/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.428102    
+2023-12-03 04:09:46,132 - Epoch: [21][13300/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427864    
+2023-12-03 04:10:35,877 - Epoch: [21][13400/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428382    
+2023-12-03 04:11:18,281 - Epoch: [21][13500/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428350    
+2023-12-03 04:11:56,350 - Epoch: [21][13600/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427999    
+2023-12-03 04:12:25,725 - Epoch: [21][13700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.427019    
+2023-12-03 04:12:55,423 - Epoch: [21][13800/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.426076    
+2023-12-03 04:13:22,852 - Epoch: [21][13900/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.424984    
+2023-12-03 04:13:50,946 - Epoch: [21][14000/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.423954    
+2023-12-03 04:14:19,390 - Epoch: [21][14100/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.422965    
+2023-12-03 04:14:47,022 - Epoch: [21][14200/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.421932    
+2023-12-03 04:15:14,815 - Epoch: [21][14300/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.420924    
+2023-12-03 04:15:43,395 - Epoch: [21][14400/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.419986    
+2023-12-03 04:16:13,768 - Epoch: [21][14500/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.419183    
+2023-12-03 04:16:40,220 - Epoch: [21][14600/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.418124    
+2023-12-03 04:17:07,485 - Epoch: [21][14700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.417134    
+2023-12-03 04:17:49,796 - Epoch: [21][14800/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.417174    
+2023-12-03 04:18:43,618 - Epoch: [21][14900/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.417986    
+2023-12-03 04:19:33,234 - Epoch: [21][15000/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.418507    
+2023-12-03 04:20:13,013 - Epoch: [21][15100/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.418369    
+2023-12-03 04:21:03,879 - Epoch: [21][15200/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.418962    
+2023-12-03 04:21:53,978 - Epoch: [21][15300/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.419498    
+2023-12-03 04:22:49,400 - Epoch: [21][15400/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.420372    
+2023-12-03 04:23:41,748 - Epoch: [21][15500/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.421037    
+2023-12-03 04:24:33,022 - Epoch: [21][15600/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.421624    
+2023-12-03 04:25:17,514 - Epoch: [21][15700/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.421772    
+2023-12-03 04:26:08,628 - Epoch: [21][15800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.422338    
+2023-12-03 04:26:49,780 - Epoch: [21][15900/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.422269    
+2023-12-03 04:27:48,971 - Epoch: [21][16000/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.423329    
+2023-12-03 04:28:36,713 - Epoch: [21][16100/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.423664    
+2023-12-03 04:29:15,904 - Epoch: [21][16200/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.423468    
+2023-12-03 04:30:06,568 - Epoch: [21][16300/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.423978    
+2023-12-03 04:30:44,485 - Epoch: [21][16400/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.423704    
+2023-12-03 04:31:29,412 - Epoch: [21][16500/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.423859    
+2023-12-03 04:32:22,038 - Epoch: [21][16600/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.424475    
+2023-12-03 04:33:17,885 - Epoch: [21][16700/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.425277    
+2023-12-03 04:34:08,272 - Epoch: [21][16800/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.425744    
+2023-12-03 04:34:55,693 - Epoch: [21][16900/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.426031    
+2023-12-03 04:35:36,535 - Epoch: [21][17000/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.425927    
+2023-12-03 04:36:23,142 - Epoch: [21][17100/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.426161    
+2023-12-03 04:37:11,330 - Epoch: [21][17200/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.426484    
+2023-12-03 04:37:52,115 - Epoch: [21][17300/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.426376    
+2023-12-03 04:38:49,303 - Epoch: [21][17400/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.427212    
+2023-12-03 04:39:39,303 - Epoch: [21][17500/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.427627    
+2023-12-03 04:40:30,117 - Epoch: [21][17600/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.428085    
+2023-12-03 04:41:20,750 - Epoch: [21][17700/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.428526    
+2023-12-03 04:42:15,788 - Epoch: [21][17800/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.429210    
+2023-12-03 04:43:03,526 - Epoch: [21][17900/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.429479    
+2023-12-03 04:43:53,098 - Epoch: [21][18000/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.429847    
+2023-12-03 04:44:42,754 - Epoch: [21][18100/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.430215    
+2023-12-03 04:45:26,729 - Epoch: [21][18200/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.430267    
+2023-12-03 04:46:20,765 - Epoch: [21][18300/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.430868    
+2023-12-03 04:47:08,715 - Epoch: [21][18400/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431132    
+2023-12-03 04:47:55,009 - Epoch: [21][18500/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.431303    
+2023-12-03 04:48:36,270 - Epoch: [21][18600/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.431202    
+2023-12-03 04:49:28,124 - Epoch: [21][18700/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431669    
+2023-12-03 04:50:14,761 - Epoch: [21][18800/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431853    
+2023-12-03 04:50:54,444 - Epoch: [21][18900/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431668    
+2023-12-03 04:51:41,506 - Epoch: [21][19000/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431872    
+2023-12-03 04:52:17,349 - Epoch: [21][19100/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431487    
+2023-12-03 04:53:14,513 - Epoch: [21][19200/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.432217    
+2023-12-03 04:53:53,323 - Epoch: [21][19300/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.431988    
+2023-12-03 04:54:31,980 - Epoch: [21][19400/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.431753    
+2023-12-03 04:55:27,630 - Epoch: [21][19500/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.432393    
+2023-12-03 04:56:11,069 - Epoch: [21][19600/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.432403    
+2023-12-03 04:56:56,591 - Epoch: [21][19700/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.432518    
+2023-12-03 04:57:35,236 - Epoch: [21][19800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.432285    
+2023-12-03 04:58:12,719 - Epoch: [21][19900/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.431996    
+2023-12-03 04:58:48,617 - Epoch: [21][20000/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.431630    
+2023-12-03 04:59:37,441 - Epoch: [21][20100/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.431912    
+2023-12-03 05:00:13,420 - Epoch: [21][20200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.431554    
+2023-12-03 05:01:00,702 - Epoch: [21][20300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.431757    
+2023-12-03 05:01:56,550 - Epoch: [21][20400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.432378    
+2023-12-03 05:03:02,162 - Epoch: [21][20500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.433469    
+2023-12-03 05:03:42,370 - Epoch: [21][20600/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.433316    
+2023-12-03 05:04:30,645 - Epoch: [21][20700/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.433555    
+2023-12-03 05:05:12,378 - Epoch: [21][20800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.433477    
+2023-12-03 05:06:05,500 - Epoch: [21][20900/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.433944    
+2023-12-03 05:06:56,596 - Epoch: [21][21000/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434310    
+2023-12-03 05:07:38,712 - Epoch: [21][21100/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434248    
+2023-12-03 05:08:24,642 - Epoch: [21][21200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434365    
+2023-12-03 05:09:12,009 - Epoch: [21][21300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434550    
+2023-12-03 05:09:57,123 - Epoch: [21][21400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434627    
+2023-12-03 05:10:42,208 - Epoch: [21][21500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434702    
+2023-12-03 05:11:22,976 - Epoch: [21][21600/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.434577    
+2023-12-03 05:12:10,177 - Epoch: [21][21700/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.434749    
+2023-12-03 05:12:56,550 - Epoch: [21][21800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.434881    
+2023-12-03 05:13:49,274 - Epoch: [21][21900/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.435303    
+2023-12-03 05:14:30,336 - Epoch: [21][22000/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.435190    
+2023-12-03 05:15:21,779 - Epoch: [21][22100/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.435548    
+2023-12-03 05:16:08,889 - Epoch: [21][22200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.435708    
+2023-12-03 05:16:52,664 - Epoch: [21][22300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.435717    
+2023-12-03 05:17:42,370 - Epoch: [21][22400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.435991    
+2023-12-03 05:18:25,506 - Epoch: [21][22500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.435970    
+2023-12-03 05:19:20,536 - Epoch: [21][22600/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.436475    
+2023-12-03 05:20:01,783 - Epoch: [21][22700/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.436369    
+2023-12-03 05:20:45,257 - Epoch: [21][22800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.436362    
+2023-12-03 05:21:42,787 - Epoch: [21][22900/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.436968    
+2023-12-03 05:22:23,798 - Epoch: [21][23000/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.436851    
+2023-12-03 05:23:08,859 - Epoch: [21][23100/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.436910    
+2023-12-03 05:23:54,022 - Epoch: [21][23200/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.436973    
+2023-12-03 05:24:40,724 - Epoch: [21][23300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.437102    
+2023-12-03 05:25:31,991 - Epoch: [21][23400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.437425    
+2023-12-03 05:26:13,611 - Epoch: [21][23500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.437334    
+2023-12-03 05:26:49,654 - Epoch: [21][23600/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.437008    
+2023-12-03 05:27:34,802 - Epoch: [21][23700/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.437069    
+2023-12-03 05:28:32,070 - Epoch: [21][23800/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.437638    
+2023-12-03 05:29:27,366 - Epoch: [21][23900/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.438120    
+2023-12-03 05:30:25,989 - Epoch: [21][24000/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.438737    
+2023-12-03 05:31:24,890 - Epoch: [21][24100/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.439360    
+2023-12-03 05:32:12,658 - Epoch: [21][24200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.439518    
+2023-12-03 05:32:52,794 - Epoch: [21][24300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.439361    
+2023-12-03 05:33:40,709 - Epoch: [21][24400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.439524    
+2023-12-03 05:34:30,255 - Epoch: [21][24500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.439752    
+2023-12-03 05:35:23,735 - Epoch: [21][24600/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440138    
+2023-12-03 05:36:05,500 - Epoch: [21][24700/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.440047    
+2023-12-03 05:36:45,886 - Epoch: [21][24800/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.439900    
+2023-12-03 05:37:30,511 - Epoch: [21][24900/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.439926    
+2023-12-03 05:38:16,093 - Epoch: [21][25000/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.439989    
+2023-12-03 05:39:10,664 - Epoch: [21][25100/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440410    
+2023-12-03 05:39:53,615 - Epoch: [21][25200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440366    
+2023-12-03 05:40:34,386 - Epoch: [21][25300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440237    
+2023-12-03 05:41:17,548 - Epoch: [21][25400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440203    
+2023-12-03 05:42:00,035 - Epoch: [21][25500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440142    
+2023-12-03 05:42:39,150 - Epoch: [21][25600/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.439950    
+2023-12-03 05:43:41,751 - Epoch: [21][25700/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440674    
+2023-12-03 05:44:23,791 - Epoch: [21][25800/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440595    
+2023-12-03 05:45:04,485 - Epoch: [21][25900/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440465    
+2023-12-03 05:45:52,820 - Epoch: [21][26000/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440630    
+2023-12-03 05:46:31,711 - Epoch: [21][26100/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440431    
+2023-12-03 05:47:21,430 - Epoch: [21][26200/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440648    
+2023-12-03 05:48:12,829 - Epoch: [21][26300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.440926    
+2023-12-03 05:49:00,811 - Epoch: [21][26400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.441073    
+2023-12-03 05:49:39,952 - Epoch: [21][26500/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.440886    
+2023-12-03 05:50:27,823 - Epoch: [21][26600/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.441028    
+2023-12-03 05:51:10,522 - Epoch: [21][26700/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.440975    
+2023-12-03 05:51:51,479 - Epoch: [21][26800/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.440857    
+2023-12-03 05:52:42,376 - Epoch: [21][26900/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.441110    
+2023-12-03 05:53:23,206 - Epoch: [21][27000/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.440988    
+2023-12-03 05:54:02,803 - Epoch: [21][27100/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.440822    
+2023-12-03 05:54:52,111 - Epoch: [21][27200/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.441014    
+2023-12-03 05:55:43,859 - Epoch: [21][27300/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.441294    
+2023-12-03 05:56:34,718 - Epoch: [21][27400/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.441539    
+2023-12-03 05:57:18,267 - Epoch: [21][27500/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.441517    
+2023-12-03 05:57:59,241 - Epoch: [21][27600/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.441401    
+2023-12-03 05:58:56,607 - Epoch: [21][27700/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.441879    
+2023-12-03 05:59:43,604 - Epoch: [21][27800/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.441979    
+2023-12-03 06:00:34,381 - Epoch: [21][27900/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.442215    
+2023-12-03 06:01:23,428 - Epoch: [21][28000/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.442387    
+2023-12-03 06:02:01,822 - Epoch: [21][28100/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.442179    
+2023-12-03 06:03:01,741 - Epoch: [21][28200/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.442735    
+2023-12-03 06:03:49,072 - Epoch: [21][28300/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.442843    
+2023-12-03 06:04:36,391 - Epoch: [21][28400/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.442950    
+2023-12-03 06:05:22,695 - Epoch: [21][28500/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.443020    
+2023-12-03 06:06:03,744 - Epoch: [21][28600/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.442906    
+2023-12-03 06:06:50,486 - Epoch: [21][28700/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.442991    
+2023-12-03 06:07:36,138 - Epoch: [21][28800/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.443038    
+2023-12-03 06:08:26,084 - Epoch: [21][28900/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443233    
+2023-12-03 06:09:09,424 - Epoch: [21][29000/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443199    
+2023-12-03 06:09:55,006 - Epoch: [21][29100/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443242    
+2023-12-03 06:10:39,241 - Epoch: [21][29200/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443238    
+2023-12-03 06:11:23,101 - Epoch: [21][29300/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443222    
+2023-12-03 06:12:15,440 - Epoch: [21][29400/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443495    
+2023-12-03 06:13:03,490 - Epoch: [21][29500/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443620    
+2023-12-03 06:13:51,735 - Epoch: [21][29600/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443751    
+2023-12-03 06:14:38,401 - Epoch: [21][29700/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.443828    
+2023-12-03 06:15:25,924 - Epoch: [21][29800/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.443933    
+2023-12-03 06:16:18,875 - Epoch: [21][29900/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444219    
+2023-12-03 06:17:01,417 - Epoch: [21][30000/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444156    
+2023-12-03 06:17:38,889 - Epoch: [21][30100/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.443925    
+2023-12-03 06:18:28,973 - Epoch: [21][30200/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444113    
+2023-12-03 06:19:16,260 - Epoch: [21][30300/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444208    
+2023-12-03 06:20:01,130 - Epoch: [21][30400/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444223    
+2023-12-03 06:20:54,119 - Epoch: [21][30500/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444503    
+2023-12-03 06:21:37,500 - Epoch: [21][30600/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444468    
+2023-12-03 06:22:19,549 - Epoch: [21][30700/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444390    
+2023-12-03 06:23:07,712 - Epoch: [21][30800/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444510    
+2023-12-03 06:23:50,071 - Epoch: [21][30900/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444442    
+2023-12-03 06:24:41,958 - Epoch: [21][31000/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444682    
+2023-12-03 06:25:24,199 - Epoch: [21][31100/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444610    
+2023-12-03 06:25:42,726 - Epoch: [21][31148/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.444520    
+2023-12-03 06:25:43,712 - --- validate (epoch=21)-----------
+2023-12-03 06:25:43,713 - 167951 samples (100 per mini-batch)
+2023-12-03 06:26:08,266 - Epoch: [21][  100/ 1680]    Loss 0.000000    Overall Loss 0.009529    
+2023-12-03 06:26:28,313 - Epoch: [21][  200/ 1680]    Loss 0.000000    Overall Loss 0.009505    
+2023-12-03 06:26:48,298 - Epoch: [21][  300/ 1680]    Loss 0.000000    Overall Loss 0.009467    
+2023-12-03 06:27:08,306 - Epoch: [21][  400/ 1680]    Loss 0.000000    Overall Loss 0.009478    
+2023-12-03 06:27:28,275 - Epoch: [21][  500/ 1680]    Loss 0.000000    Overall Loss 0.009495    
+2023-12-03 06:27:48,347 - Epoch: [21][  600/ 1680]    Loss 0.000000    Overall Loss 0.009494    
+2023-12-03 06:28:08,979 - Epoch: [21][  700/ 1680]    Loss 0.000000    Overall Loss 0.009493    
+2023-12-03 06:28:28,982 - Epoch: [21][  800/ 1680]    Loss 0.000000    Overall Loss 0.009496    
+2023-12-03 06:28:48,948 - Epoch: [21][  900/ 1680]    Loss 0.000000    Overall Loss 0.009499    
+2023-12-03 06:29:08,865 - Epoch: [21][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009498    
+2023-12-03 06:29:28,947 - Epoch: [21][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009495    
+2023-12-03 06:29:48,932 - Epoch: [21][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009493    
+2023-12-03 06:30:08,926 - Epoch: [21][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009489    
+2023-12-03 06:30:28,901 - Epoch: [21][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009489    
+2023-12-03 06:30:48,884 - Epoch: [21][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009485    
+2023-12-03 06:31:08,824 - Epoch: [21][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009489    
+2023-12-03 06:31:24,768 - Epoch: [21][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009488    
+2023-12-03 06:31:25,129 - ==> Overall Loss: 0.009
+
+2023-12-03 06:31:25,134 - ==> Best [Overall Loss: 0.009485 on epoch: 20]
+2023-12-03 06:31:25,135 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-03 06:31:25,168 - 
+
+2023-12-03 06:31:25,168 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-03 06:32:37,983 - Epoch: [22][  100/31148]    Overall Loss 0.008878    Objective Loss 0.000000    Distill Loss 0.008878                     LR 0.000125    Time 0.728063    
+2023-12-03 06:33:28,346 - Epoch: [22][  200/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.615808    
+2023-12-03 06:34:17,056 - Epoch: [22][  300/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.572882    
+2023-12-03 06:35:09,708 - Epoch: [22][  400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.561273    
+2023-12-03 06:35:50,666 - Epoch: [22][  500/31148]    Overall Loss 0.008821    Objective Loss 0.000000    Distill Loss 0.008821                     LR 0.000125    Time 0.530922    
+2023-12-03 06:36:44,744 - Epoch: [22][  600/31148]    Overall Loss 0.008825    Objective Loss 0.000000    Distill Loss 0.008825                     LR 0.000125    Time 0.532555    
+2023-12-03 06:37:25,328 - Epoch: [22][  700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.514441    
+2023-12-03 06:38:13,089 - Epoch: [22][  800/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.509828    
+2023-12-03 06:38:55,567 - Epoch: [22][  900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.500370    
+2023-12-03 06:39:54,572 - Epoch: [22][ 1000/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.509331    
+2023-12-03 06:40:42,536 - Epoch: [22][ 1100/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.506625    
+2023-12-03 06:41:25,124 - Epoch: [22][ 1200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.499890    
+2023-12-03 06:42:02,445 - Epoch: [22][ 1300/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.490140    
+2023-12-03 06:42:42,078 - Epoch: [22][ 1400/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.483434    
+2023-12-03 06:43:26,896 - Epoch: [22][ 1500/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.481079    
+2023-12-03 06:44:08,850 - Epoch: [22][ 1600/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.477228    
+2023-12-03 06:44:49,766 - Epoch: [22][ 1700/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.473220    
+2023-12-03 06:45:33,652 - Epoch: [22][ 1800/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.471307    
+2023-12-03 06:46:29,118 - Epoch: [22][ 1900/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.475690    
+2023-12-03 06:47:03,455 - Epoch: [22][ 2000/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.469070    
+2023-12-03 06:47:54,582 - Epoch: [22][ 2100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.471076    
+2023-12-03 06:48:48,361 - Epoch: [22][ 2200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.474105    
+2023-12-03 06:49:40,675 - Epoch: [22][ 2300/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.476234    
+2023-12-03 06:50:23,996 - Epoch: [22][ 2400/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.474438    
+2023-12-03 06:51:16,159 - Epoch: [22][ 2500/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.476323    
+2023-12-03 06:51:57,190 - Epoch: [22][ 2600/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.473781    
+2023-12-03 06:52:50,169 - Epoch: [22][ 2700/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.475852    
+2023-12-03 06:53:33,756 - Epoch: [22][ 2800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.474422    
+2023-12-03 06:54:07,986 - Epoch: [22][ 2900/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.469863    
+2023-12-03 06:54:44,091 - Epoch: [22][ 3000/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.466234    
+2023-12-03 06:55:35,522 - Epoch: [22][ 3100/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.467783    
+2023-12-03 06:56:22,167 - Epoch: [22][ 3200/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.467739    
+2023-12-03 06:57:01,952 - Epoch: [22][ 3300/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.465618    
+2023-12-03 06:57:45,459 - Epoch: [22][ 3400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.464718    
+2023-12-03 06:58:28,575 - Epoch: [22][ 3500/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.463757    
+2023-12-03 06:59:07,000 - Epoch: [22][ 3600/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.461546    
+2023-12-03 06:59:58,674 - Epoch: [22][ 3700/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.463036    
+2023-12-03 07:00:42,197 - Epoch: [22][ 3800/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.462302    
+2023-12-03 07:01:28,097 - Epoch: [22][ 3900/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.462216    
+2023-12-03 07:02:10,358 - Epoch: [22][ 4000/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.461224    
+2023-12-03 07:02:51,880 - Epoch: [22][ 4100/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.460100    
+2023-12-03 07:03:27,113 - Epoch: [22][ 4200/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.457532    
+2023-12-03 07:04:20,126 - Epoch: [22][ 4300/31148]    Overall Loss 0.008863    Objective Loss 0.000000    Distill Loss 0.008863                     LR 0.000125    Time 0.459219    
+2023-12-03 07:04:58,436 - Epoch: [22][ 4400/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.457487    
+2023-12-03 07:05:32,124 - Epoch: [22][ 4500/31148]    Overall Loss 0.008862    Objective Loss 0.000000    Distill Loss 0.008862                     LR 0.000125    Time 0.454806    
+2023-12-03 07:06:19,609 - Epoch: [22][ 4600/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.455240    
+2023-12-03 07:07:05,439 - Epoch: [22][ 4700/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.455303    
+2023-12-03 07:07:48,052 - Epoch: [22][ 4800/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.454694    
+2023-12-03 07:08:34,690 - Epoch: [22][ 4900/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.454931    
+2023-12-03 07:09:17,366 - Epoch: [22][ 5000/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.454366    
+2023-12-03 07:09:55,352 - Epoch: [22][ 5100/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.452904    
+2023-12-03 07:10:43,641 - Epoch: [22][ 5200/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.453479    
+2023-12-03 07:11:26,029 - Epoch: [22][ 5300/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.452919    
+2023-12-03 07:12:12,731 - Epoch: [22][ 5400/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.453179    
+2023-12-03 07:12:55,474 - Epoch: [22][ 5500/31148]    Overall Loss 0.008861    Objective Loss 0.000000    Distill Loss 0.008861                     LR 0.000125    Time 0.452709    
+2023-12-03 07:13:46,796 - Epoch: [22][ 5600/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.453789    
+2023-12-03 07:14:28,563 - Epoch: [22][ 5700/31148]    Overall Loss 0.008860    Objective Loss 0.000000    Distill Loss 0.008860                     LR 0.000125    Time 0.453154    
+2023-12-03 07:15:14,106 - Epoch: [22][ 5800/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.453192    
+2023-12-03 07:16:01,232 - Epoch: [22][ 5900/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.453497    
+2023-12-03 07:16:45,464 - Epoch: [22][ 6000/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.453309    
+2023-12-03 07:17:28,274 - Epoch: [22][ 6100/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.452895    
+2023-12-03 07:18:23,639 - Epoch: [22][ 6200/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.454519    
+2023-12-03 07:18:56,097 - Epoch: [22][ 6300/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.452455    
+2023-12-03 07:19:43,522 - Epoch: [22][ 6400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.452794    
+2023-12-03 07:20:30,031 - Epoch: [22][ 6500/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.452983    
+2023-12-03 07:21:08,421 - Epoch: [22][ 6600/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.451935    
+2023-12-03 07:21:47,247 - Epoch: [22][ 6700/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.450983    
+2023-12-03 07:22:25,052 - Epoch: [22][ 6800/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.449909    
+2023-12-03 07:23:07,401 - Epoch: [22][ 6900/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.449526    
+2023-12-03 07:23:48,724 - Epoch: [22][ 7000/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.449006    
+2023-12-03 07:24:32,669 - Epoch: [22][ 7100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.448870    
+2023-12-03 07:25:07,016 - Epoch: [22][ 7200/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.447405    
+2023-12-03 07:25:51,723 - Epoch: [22][ 7300/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447400    
+2023-12-03 07:26:37,180 - Epoch: [22][ 7400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447496    
+2023-12-03 07:27:12,169 - Epoch: [22][ 7500/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.446193    
+2023-12-03 07:27:59,263 - Epoch: [22][ 7600/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446518    
+2023-12-03 07:28:40,204 - Epoch: [22][ 7700/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446035    
+2023-12-03 07:29:25,883 - Epoch: [22][ 7800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.446172    
+2023-12-03 07:30:06,714 - Epoch: [22][ 7900/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445692    
+2023-12-03 07:30:45,370 - Epoch: [22][ 8000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444952    
+2023-12-03 07:31:38,078 - Epoch: [22][ 8100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445965    
+2023-12-03 07:32:16,975 - Epoch: [22][ 8200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.445269    
+2023-12-03 07:33:01,008 - Epoch: [22][ 8300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.445209    
+2023-12-03 07:33:46,006 - Epoch: [22][ 8400/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.445265    
+2023-12-03 07:34:27,725 - Epoch: [22][ 8500/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444933    
+2023-12-03 07:35:11,342 - Epoch: [22][ 8600/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.444831    
+2023-12-03 07:35:56,532 - Epoch: [22][ 8700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444911    
+2023-12-03 07:36:37,197 - Epoch: [22][ 8800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444476    
+2023-12-03 07:37:31,331 - Epoch: [22][ 8900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.445563    
+2023-12-03 07:38:16,737 - Epoch: [22][ 9000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.445657    
+2023-12-03 07:38:54,894 - Epoch: [22][ 9100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444952    
+2023-12-03 07:39:34,091 - Epoch: [22][ 9200/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.444375    
+2023-12-03 07:40:05,856 - Epoch: [22][ 9300/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.443012    
+2023-12-03 07:40:33,534 - Epoch: [22][ 9400/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.441243    
+2023-12-03 07:41:01,416 - Epoch: [22][ 9500/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.439533    
+2023-12-03 07:41:27,956 - Epoch: [22][ 9600/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.437718    
+2023-12-03 07:41:55,832 - Epoch: [22][ 9700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.436079    
+2023-12-03 07:42:22,376 - Epoch: [22][ 9800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.434338    
+2023-12-03 07:42:50,368 - Epoch: [22][ 9900/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.432777    
+2023-12-03 07:43:18,230 - Epoch: [22][10000/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.431235    
+2023-12-03 07:43:47,548 - Epoch: [22][10100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.429868    
+2023-12-03 07:44:14,849 - Epoch: [22][10200/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.428330    
+2023-12-03 07:44:43,095 - Epoch: [22][10300/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.426913    
+2023-12-03 07:45:09,375 - Epoch: [22][10400/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.425335    
+2023-12-03 07:45:47,552 - Epoch: [22][10500/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.424919    
+2023-12-03 07:46:30,808 - Epoch: [22][10600/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.424991    
+2023-12-03 07:47:25,582 - Epoch: [22][10700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.426137    
+2023-12-03 07:48:03,062 - Epoch: [22][10800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.425661    
+2023-12-03 07:48:45,658 - Epoch: [22][10900/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.425663    
+2023-12-03 07:49:32,910 - Epoch: [22][11000/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.426088    
+2023-12-03 07:50:11,747 - Epoch: [22][11100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.425748    
+2023-12-03 07:50:53,707 - Epoch: [22][11200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.425692    
+2023-12-03 07:51:41,893 - Epoch: [22][11300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.426189    
+2023-12-03 07:52:33,080 - Epoch: [22][11400/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.426940    
+2023-12-03 07:53:20,847 - Epoch: [22][11500/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.427380    
+2023-12-03 07:54:02,388 - Epoch: [22][11600/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.427276    
+2023-12-03 07:54:52,876 - Epoch: [22][11700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.427939    
+2023-12-03 07:55:43,063 - Epoch: [22][11800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.428565    
+2023-12-03 07:56:40,116 - Epoch: [22][11900/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.429757    
+2023-12-03 07:57:27,609 - Epoch: [22][12000/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.430133    
+2023-12-03 07:58:17,561 - Epoch: [22][12100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.430706    
+2023-12-03 07:58:59,512 - Epoch: [22][12200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.430613    
+2023-12-03 08:00:01,449 - Epoch: [22][12300/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.432147    
+2023-12-03 08:00:51,499 - Epoch: [22][12400/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.432698    
+2023-12-03 08:01:45,799 - Epoch: [22][12500/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.433580    
+2023-12-03 08:02:41,871 - Epoch: [22][12600/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.434588    
+2023-12-03 08:03:32,250 - Epoch: [22][12700/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.435132    
+2023-12-03 08:04:17,432 - Epoch: [22][12800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.435262    
+2023-12-03 08:05:06,174 - Epoch: [22][12900/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.435666    
+2023-12-03 08:05:46,336 - Epoch: [22][13000/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.435403    
+2023-12-03 08:06:41,914 - Epoch: [22][13100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.436322    
+2023-12-03 08:07:35,853 - Epoch: [22][13200/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.437102    
+2023-12-03 08:08:20,229 - Epoch: [22][13300/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.437151    
+2023-12-03 08:09:29,878 - Epoch: [22][13400/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.439085    
+2023-12-03 08:10:10,777 - Epoch: [22][13500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.438862    
+2023-12-03 08:10:50,598 - Epoch: [22][13600/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.438562    
+2023-12-03 08:11:32,484 - Epoch: [22][13700/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.438418    
+2023-12-03 08:12:13,136 - Epoch: [22][13800/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.438186    
+2023-12-03 08:13:07,468 - Epoch: [22][13900/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.438942    
+2023-12-03 08:13:53,436 - Epoch: [22][14000/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.439090    
+2023-12-03 08:14:42,076 - Epoch: [22][14100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.439424    
+2023-12-03 08:15:29,141 - Epoch: [22][14200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.439644    
+2023-12-03 08:16:08,356 - Epoch: [22][14300/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.439311    
+2023-12-03 08:16:47,723 - Epoch: [22][14400/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.438994    
+2023-12-03 08:17:31,784 - Epoch: [22][14500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.439004    
+2023-12-03 08:18:12,512 - Epoch: [22][14600/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.438787    
+2023-12-03 08:18:59,232 - Epoch: [22][14700/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.438979    
+2023-12-03 08:19:41,293 - Epoch: [22][14800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.438855    
+2023-12-03 08:20:24,060 - Epoch: [22][14900/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.438779    
+2023-12-03 08:21:05,143 - Epoch: [22][15000/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.438593    
+2023-12-03 08:21:53,049 - Epoch: [22][15100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.438860    
+2023-12-03 08:22:46,835 - Epoch: [22][15200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.439511    
+2023-12-03 08:23:31,328 - Epoch: [22][15300/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.439546    
+2023-12-03 08:24:18,178 - Epoch: [22][15400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.439733    
+2023-12-03 08:25:09,418 - Epoch: [22][15500/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.440202    
+2023-12-03 08:25:49,177 - Epoch: [22][15600/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.439928    
+2023-12-03 08:26:40,440 - Epoch: [22][15700/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.440390    
+2023-12-03 08:27:34,969 - Epoch: [22][15800/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.441054    
+2023-12-03 08:28:24,278 - Epoch: [22][15900/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.441381    
+2023-12-03 08:29:16,192 - Epoch: [22][16000/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.441866    
+2023-12-03 08:29:58,820 - Epoch: [22][16100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.441769    
+2023-12-03 08:30:38,557 - Epoch: [22][16200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.441495    
+2023-12-03 08:31:30,948 - Epoch: [22][16300/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.442000    
+2023-12-03 08:32:22,049 - Epoch: [22][16400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.442420    
+2023-12-03 08:33:12,498 - Epoch: [22][16500/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.442796    
+2023-12-03 08:34:02,005 - Epoch: [22][16600/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443110    
+2023-12-03 08:34:52,396 - Epoch: [22][16700/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443474    
+2023-12-03 08:35:47,119 - Epoch: [22][16800/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.444091    
+2023-12-03 08:36:30,983 - Epoch: [22][16900/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.444058    
+2023-12-03 08:37:08,431 - Epoch: [22][17000/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443649    
+2023-12-03 08:37:53,873 - Epoch: [22][17100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443711    
+2023-12-03 08:38:35,240 - Epoch: [22][17200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443536    
+2023-12-03 08:39:24,789 - Epoch: [22][17300/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443836    
+2023-12-03 08:40:11,211 - Epoch: [22][17400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.443953    
+2023-12-03 08:41:02,158 - Epoch: [22][17500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444327    
+2023-12-03 08:41:47,480 - Epoch: [22][17600/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444377    
+2023-12-03 08:42:36,629 - Epoch: [22][17700/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444643    
+2023-12-03 08:43:21,733 - Epoch: [22][17800/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444678    
+2023-12-03 08:44:04,550 - Epoch: [22][17900/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444585    
+2023-12-03 08:44:46,287 - Epoch: [22][18000/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444434    
+2023-12-03 08:45:33,148 - Epoch: [22][18100/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.444567    
+2023-12-03 08:46:12,945 - Epoch: [22][18200/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.444311    
+2023-12-03 08:46:58,233 - Epoch: [22][18300/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.444357    
+2023-12-03 08:47:46,357 - Epoch: [22][18400/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.444557    
+2023-12-03 08:48:31,411 - Epoch: [22][18500/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.444589    
+2023-12-03 08:49:26,068 - Epoch: [22][18600/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445137    
+2023-12-03 08:50:13,058 - Epoch: [22][18700/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445269    
+2023-12-03 08:50:57,729 - Epoch: [22][18800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445276    
+2023-12-03 08:51:36,097 - Epoch: [22][18900/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.444950    
+2023-12-03 08:52:26,424 - Epoch: [22][19000/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445256    
+2023-12-03 08:53:07,052 - Epoch: [22][19100/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445052    
+2023-12-03 08:54:05,695 - Epoch: [22][19200/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445788    
+2023-12-03 08:54:45,122 - Epoch: [22][19300/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.445521    
+2023-12-03 08:55:34,381 - Epoch: [22][19400/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.445763    
+2023-12-03 08:56:20,414 - Epoch: [22][19500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.445837    
+2023-12-03 08:57:00,326 - Epoch: [22][19600/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.445599    
+2023-12-03 08:57:45,493 - Epoch: [22][19700/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.445629    
+2023-12-03 08:58:44,236 - Epoch: [22][19800/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446345    
+2023-12-03 08:59:33,207 - Epoch: [22][19900/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446562    
+2023-12-03 09:00:17,559 - Epoch: [22][20000/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446547    
+2023-12-03 09:01:03,931 - Epoch: [22][20100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446632    
+2023-12-03 09:01:51,603 - Epoch: [22][20200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446780    
+2023-12-03 09:02:31,307 - Epoch: [22][20300/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446535    
+2023-12-03 09:03:13,286 - Epoch: [22][20400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446404    
+2023-12-03 09:03:54,114 - Epoch: [22][20500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446217    
+2023-12-03 09:04:39,808 - Epoch: [22][20600/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446269    
+2023-12-03 09:05:21,508 - Epoch: [22][20700/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446127    
+2023-12-03 09:06:05,927 - Epoch: [22][20800/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446118    
+2023-12-03 09:06:54,561 - Epoch: [22][20900/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446310    
+2023-12-03 09:07:38,870 - Epoch: [22][21000/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.446294    
+2023-12-03 09:08:21,282 - Epoch: [22][21100/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.446189    
+2023-12-03 09:08:57,954 - Epoch: [22][21200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445813    
+2023-12-03 09:09:46,380 - Epoch: [22][21300/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445993    
+2023-12-03 09:10:22,002 - Epoch: [22][21400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445574    
+2023-12-03 09:11:14,297 - Epoch: [22][21500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.445933    
+2023-12-03 09:11:55,064 - Epoch: [22][21600/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.445756    
+2023-12-03 09:12:31,818 - Epoch: [22][21700/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445395    
+2023-12-03 09:13:17,902 - Epoch: [22][21800/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445466    
+2023-12-03 09:14:05,897 - Epoch: [22][21900/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445623    
+2023-12-03 09:14:46,665 - Epoch: [22][22000/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.445450    
+2023-12-03 09:15:34,146 - Epoch: [22][22100/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.445582    
+2023-12-03 09:16:24,799 - Epoch: [22][22200/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.445857    
+2023-12-03 09:17:25,167 - Epoch: [22][22300/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446564    
+2023-12-03 09:18:08,763 - Epoch: [22][22400/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446516    
+2023-12-03 09:18:49,356 - Epoch: [22][22500/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446336    
+2023-12-03 09:19:34,343 - Epoch: [22][22600/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446351    
+2023-12-03 09:20:21,718 - Epoch: [22][22700/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446471    
+2023-12-03 09:21:00,316 - Epoch: [22][22800/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446206    
+2023-12-03 09:21:48,014 - Epoch: [22][22900/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446340    
+2023-12-03 09:22:40,866 - Epoch: [22][23000/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446697    
+2023-12-03 09:23:30,103 - Epoch: [22][23100/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.446894    
+2023-12-03 09:24:19,584 - Epoch: [22][23200/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.447100    
+2023-12-03 09:25:04,057 - Epoch: [22][23300/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447090    
+2023-12-03 09:25:42,509 - Epoch: [22][23400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.446822    
+2023-12-03 09:26:31,293 - Epoch: [22][23500/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.446996    
+2023-12-03 09:27:22,420 - Epoch: [22][23600/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447268    
+2023-12-03 09:28:11,753 - Epoch: [22][23700/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447462    
+2023-12-03 09:29:04,717 - Epoch: [22][23800/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447807    
+2023-12-03 09:29:49,516 - Epoch: [22][23900/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447808    
+2023-12-03 09:30:33,924 - Epoch: [22][24000/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447792    
+2023-12-03 09:31:21,852 - Epoch: [22][24100/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447922    
+2023-12-03 09:32:05,721 - Epoch: [22][24200/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447884    
+2023-12-03 09:32:51,425 - Epoch: [22][24300/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447921    
+2023-12-03 09:33:37,041 - Epoch: [22][24400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447955    
+2023-12-03 09:34:17,142 - Epoch: [22][24500/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447763    
+2023-12-03 09:34:55,552 - Epoch: [22][24600/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447504    
+2023-12-03 09:35:33,803 - Epoch: [22][24700/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.447240    
+2023-12-03 09:36:30,575 - Epoch: [22][24800/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.447726    
+2023-12-03 09:37:29,051 - Epoch: [22][24900/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448276    
+2023-12-03 09:38:06,280 - Epoch: [22][25000/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.447972    
+2023-12-03 09:38:47,252 - Epoch: [22][25100/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447819    
+2023-12-03 09:39:26,873 - Epoch: [22][25200/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.447614    
+2023-12-03 09:40:23,618 - Epoch: [22][25300/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.448087    
+2023-12-03 09:41:06,722 - Epoch: [22][25400/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.448020    
+2023-12-03 09:41:49,648 - Epoch: [22][25500/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.447945    
+2023-12-03 09:42:47,836 - Epoch: [22][25600/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448468    
+2023-12-03 09:43:32,850 - Epoch: [22][25700/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448475    
+2023-12-03 09:44:16,978 - Epoch: [22][25800/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448446    
+2023-12-03 09:44:56,898 - Epoch: [22][25900/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448256    
+2023-12-03 09:45:42,662 - Epoch: [22][26000/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448292    
+2023-12-03 09:46:30,937 - Epoch: [22][26100/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448424    
+2023-12-03 09:47:32,725 - Epoch: [22][26200/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.449070    
+2023-12-03 09:48:16,133 - Epoch: [22][26300/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.449013    
+2023-12-03 09:49:09,486 - Epoch: [22][26400/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.449333    
+2023-12-03 09:49:52,384 - Epoch: [22][26500/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.449256    
+2023-12-03 09:50:37,838 - Epoch: [22][26600/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.449275    
+2023-12-03 09:51:28,677 - Epoch: [22][26700/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.449496    
+2023-12-03 09:52:07,535 - Epoch: [22][26800/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.449269    
+2023-12-03 09:52:49,387 - Epoch: [22][26900/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.449154    
+2023-12-03 09:53:35,547 - Epoch: [22][27000/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.449200    
+2023-12-03 09:54:11,258 - Epoch: [22][27100/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448860    
+2023-12-03 09:54:55,020 - Epoch: [22][27200/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448818    
+2023-12-03 09:55:40,996 - Epoch: [22][27300/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448858    
+2023-12-03 09:56:32,652 - Epoch: [22][27400/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.449105    
+2023-12-03 09:57:07,523 - Epoch: [22][27500/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448740    
+2023-12-03 09:57:55,400 - Epoch: [22][27600/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448848    
+2023-12-03 09:58:47,422 - Epoch: [22][27700/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.449106    
+2023-12-03 09:59:29,526 - Epoch: [22][27800/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.449004    
+2023-12-03 10:00:08,426 - Epoch: [22][27900/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448789    
+2023-12-03 10:00:55,992 - Epoch: [22][28000/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448885    
+2023-12-03 10:01:37,635 - Epoch: [22][28100/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448769    
+2023-12-03 10:02:19,217 - Epoch: [22][28200/31148]    Overall Loss 0.008852    Objective Loss 0.000000    Distill Loss 0.008852                     LR 0.000125    Time 0.448652    
+2023-12-03 10:03:10,093 - Epoch: [22][28300/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448864    
+2023-12-03 10:03:50,847 - Epoch: [22][28400/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448718    
+2023-12-03 10:04:31,293 - Epoch: [22][28500/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448563    
+2023-12-03 10:05:17,312 - Epoch: [22][28600/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448603    
+2023-12-03 10:06:04,966 - Epoch: [22][28700/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448700    
+2023-12-03 10:06:50,284 - Epoch: [22][28800/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448716    
+2023-12-03 10:07:34,273 - Epoch: [22][28900/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448685    
+2023-12-03 10:08:16,756 - Epoch: [22][29000/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448602    
+2023-12-03 10:09:05,546 - Epoch: [22][29100/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448737    
+2023-12-03 10:10:00,727 - Epoch: [22][29200/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.449090    
+2023-12-03 10:10:44,894 - Epoch: [22][29300/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.449064    
+2023-12-03 10:11:29,944 - Epoch: [22][29400/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.449069    
+2023-12-03 10:12:07,148 - Epoch: [22][29500/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448808    
+2023-12-03 10:12:50,580 - Epoch: [22][29600/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.448758    
+2023-12-03 10:13:33,445 - Epoch: [22][29700/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448690    
+2023-12-03 10:14:15,106 - Epoch: [22][29800/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448582    
+2023-12-03 10:14:55,955 - Epoch: [22][29900/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448448    
+2023-12-03 10:15:34,766 - Epoch: [22][30000/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448247    
+2023-12-03 10:16:27,067 - Epoch: [22][30100/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448495    
+2023-12-03 10:17:17,131 - Epoch: [22][30200/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448667    
+2023-12-03 10:18:14,777 - Epoch: [22][30300/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.449089    
+2023-12-03 10:18:58,587 - Epoch: [22][30400/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.449052    
+2023-12-03 10:19:37,701 - Epoch: [22][30500/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448862    
+2023-12-03 10:20:27,901 - Epoch: [22][30600/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.449036    
+2023-12-03 10:21:02,025 - Epoch: [22][30700/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448684    
+2023-12-03 10:21:44,296 - Epoch: [22][30800/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.448600    
+2023-12-03 10:22:31,012 - Epoch: [22][30900/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.448660    
+2023-12-03 10:23:19,807 - Epoch: [22][31000/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.448786    
+2023-12-03 10:24:01,614 - Epoch: [22][31100/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.448687    
+2023-12-03 10:24:30,323 - Epoch: [22][31148/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.448917    
+2023-12-03 10:24:31,362 - --- validate (epoch=22)-----------
+2023-12-03 10:24:31,363 - 167951 samples (100 per mini-batch)
+2023-12-03 10:24:55,207 - Epoch: [22][  100/ 1680]    Loss 0.000000    Overall Loss 0.009485    
+2023-12-03 10:25:15,144 - Epoch: [22][  200/ 1680]    Loss 0.000000    Overall Loss 0.009479    
+2023-12-03 10:25:35,157 - Epoch: [22][  300/ 1680]    Loss 0.000000    Overall Loss 0.009474    
+2023-12-03 10:25:55,134 - Epoch: [22][  400/ 1680]    Loss 0.000000    Overall Loss 0.009471    
+2023-12-03 10:26:15,071 - Epoch: [22][  500/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 10:26:35,103 - Epoch: [22][  600/ 1680]    Loss 0.000000    Overall Loss 0.009469    
+2023-12-03 10:26:55,113 - Epoch: [22][  700/ 1680]    Loss 0.000000    Overall Loss 0.009472    
+2023-12-03 10:27:15,129 - Epoch: [22][  800/ 1680]    Loss 0.000000    Overall Loss 0.009474    
+2023-12-03 10:27:35,131 - Epoch: [22][  900/ 1680]    Loss 0.000000    Overall Loss 0.009475    
+2023-12-03 10:27:55,088 - Epoch: [22][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009474    
+2023-12-03 10:28:15,035 - Epoch: [22][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 10:28:34,986 - Epoch: [22][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 10:28:54,982 - Epoch: [22][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 10:29:14,894 - Epoch: [22][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009479    
+2023-12-03 10:29:34,834 - Epoch: [22][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 10:29:54,804 - Epoch: [22][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009474    
+2023-12-03 10:30:10,777 - Epoch: [22][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009474    
+2023-12-03 10:30:11,237 - ==> Overall Loss: 0.009
+
+2023-12-03 10:30:11,246 - ==> Best [Overall Loss: 0.009474 on epoch: 22]
+2023-12-03 10:30:11,246 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-03 10:30:11,304 - 
+
+2023-12-03 10:30:11,305 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-03 10:31:12,797 - Epoch: [23][  100/31148]    Overall Loss 0.008904    Objective Loss 0.000000    Distill Loss 0.008904                     LR 0.000125    Time 0.614835    
+2023-12-03 10:31:59,627 - Epoch: [23][  200/31148]    Overall Loss 0.008866    Objective Loss 0.000000    Distill Loss 0.008866                     LR 0.000125    Time 0.541535    
+2023-12-03 10:32:35,865 - Epoch: [23][  300/31148]    Overall Loss 0.008870    Objective Loss 0.000000    Distill Loss 0.008870                     LR 0.000125    Time 0.481790    
+2023-12-03 10:33:08,662 - Epoch: [23][  400/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.443317    
+2023-12-03 10:33:47,668 - Epoch: [23][  500/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.432650    
+2023-12-03 10:34:40,777 - Epoch: [23][  600/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.449045    
+2023-12-03 10:35:20,287 - Epoch: [23][  700/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.441330    
+2023-12-03 10:36:00,770 - Epoch: [23][  800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.436758    
+2023-12-03 10:36:40,409 - Epoch: [23][  900/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.432264    
+2023-12-03 10:37:23,295 - Epoch: [23][ 1000/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.431917    
+2023-12-03 10:38:02,315 - Epoch: [23][ 1100/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.428117    
+2023-12-03 10:38:42,801 - Epoch: [23][ 1200/31148]    Overall Loss 0.008823    Objective Loss 0.000000    Distill Loss 0.008823                     LR 0.000125    Time 0.426173    
+2023-12-03 10:39:28,848 - Epoch: [23][ 1300/31148]    Overall Loss 0.008822    Objective Loss 0.000000    Distill Loss 0.008822                     LR 0.000125    Time 0.428805    
+2023-12-03 10:40:20,084 - Epoch: [23][ 1400/31148]    Overall Loss 0.008823    Objective Loss 0.000000    Distill Loss 0.008823                     LR 0.000125    Time 0.434768    
+2023-12-03 10:41:08,803 - Epoch: [23][ 1500/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.438258    
+2023-12-03 10:41:53,915 - Epoch: [23][ 1600/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.439057    
+2023-12-03 10:42:43,211 - Epoch: [23][ 1700/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.442223    
+2023-12-03 10:43:27,530 - Epoch: [23][ 1800/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.442273    
+2023-12-03 10:44:11,691 - Epoch: [23][ 1900/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.442234    
+2023-12-03 10:44:47,147 - Epoch: [23][ 2000/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.437847    
+2023-12-03 10:45:30,661 - Epoch: [23][ 2100/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.437714    
+2023-12-03 10:46:13,174 - Epoch: [23][ 2200/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.437139    
+2023-12-03 10:46:51,742 - Epoch: [23][ 2300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.434898    
+2023-12-03 10:47:35,270 - Epoch: [23][ 2400/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.434911    
+2023-12-03 10:48:17,391 - Epoch: [23][ 2500/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.434360    
+2023-12-03 10:48:59,935 - Epoch: [23][ 2600/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.434014    
+2023-12-03 10:49:44,254 - Epoch: [23][ 2700/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.434351    
+2023-12-03 10:50:23,186 - Epoch: [23][ 2800/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.432740    
+2023-12-03 10:51:02,878 - Epoch: [23][ 2900/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.431503    
+2023-12-03 10:51:39,337 - Epoch: [23][ 3000/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.429270    
+2023-12-03 10:52:33,204 - Epoch: [23][ 3100/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.432796    
+2023-12-03 10:53:25,906 - Epoch: [23][ 3200/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.435738    
+2023-12-03 10:54:02,109 - Epoch: [23][ 3300/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.433503    
+2023-12-03 10:54:40,747 - Epoch: [23][ 3400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.432114    
+2023-12-03 10:55:14,529 - Epoch: [23][ 3500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.429418    
+2023-12-03 10:55:54,637 - Epoch: [23][ 3600/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.428629    
+2023-12-03 10:56:42,190 - Epoch: [23][ 3700/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.429895    
+2023-12-03 10:57:24,856 - Epoch: [23][ 3800/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.429807    
+2023-12-03 10:58:04,315 - Epoch: [23][ 3900/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.428902    
+2023-12-03 10:58:52,142 - Epoch: [23][ 4000/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.430135    
+2023-12-03 10:59:26,615 - Epoch: [23][ 4100/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.428050    
+2023-12-03 11:00:07,486 - Epoch: [23][ 4200/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.427587    
+2023-12-03 11:00:42,908 - Epoch: [23][ 4300/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.425880    
+2023-12-03 11:01:25,232 - Epoch: [23][ 4400/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.425818    
+2023-12-03 11:02:02,424 - Epoch: [23][ 4500/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.424618    
+2023-12-03 11:02:42,420 - Epoch: [23][ 4600/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.424081    
+2023-12-03 11:03:20,869 - Epoch: [23][ 4700/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.423237    
+2023-12-03 11:03:58,038 - Epoch: [23][ 4800/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.422162    
+2023-12-03 11:04:42,113 - Epoch: [23][ 4900/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.422540    
+2023-12-03 11:05:26,828 - Epoch: [23][ 5000/31148]    Overall Loss 0.008854    Objective Loss 0.000000    Distill Loss 0.008854                     LR 0.000125    Time 0.423030    
+2023-12-03 11:06:02,780 - Epoch: [23][ 5100/31148]    Overall Loss 0.008853    Objective Loss 0.000000    Distill Loss 0.008853                     LR 0.000125    Time 0.421784    
+2023-12-03 11:06:44,224 - Epoch: [23][ 5200/31148]    Overall Loss 0.008857    Objective Loss 0.000000    Distill Loss 0.008857                     LR 0.000125    Time 0.421641    
+2023-12-03 11:07:23,935 - Epoch: [23][ 5300/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.421177    
+2023-12-03 11:07:59,699 - Epoch: [23][ 5400/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.419999    
+2023-12-03 11:08:35,374 - Epoch: [23][ 5500/31148]    Overall Loss 0.008859    Objective Loss 0.000000    Distill Loss 0.008859                     LR 0.000125    Time 0.418847    
+2023-12-03 11:09:15,227 - Epoch: [23][ 5600/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.418483    
+2023-12-03 11:09:59,830 - Epoch: [23][ 5700/31148]    Overall Loss 0.008858    Objective Loss 0.000000    Distill Loss 0.008858                     LR 0.000125    Time 0.418965    
+2023-12-03 11:10:42,489 - Epoch: [23][ 5800/31148]    Overall Loss 0.008856    Objective Loss 0.000000    Distill Loss 0.008856                     LR 0.000125    Time 0.419095    
+2023-12-03 11:11:27,658 - Epoch: [23][ 5900/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.419646    
+2023-12-03 11:11:58,024 - Epoch: [23][ 6000/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.417712    
+2023-12-03 11:12:27,715 - Epoch: [23][ 6100/31148]    Overall Loss 0.008855    Objective Loss 0.000000    Distill Loss 0.008855                     LR 0.000125    Time 0.415731    
+2023-12-03 11:12:57,220 - Epoch: [23][ 6200/31148]    Overall Loss 0.008851    Objective Loss 0.000000    Distill Loss 0.008851                     LR 0.000125    Time 0.413784    
+2023-12-03 11:13:24,862 - Epoch: [23][ 6300/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.411603    
+2023-12-03 11:13:52,887 - Epoch: [23][ 6400/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.409550    
+2023-12-03 11:14:20,080 - Epoch: [23][ 6500/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.407432    
+2023-12-03 11:14:47,275 - Epoch: [23][ 6600/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.405379    
+2023-12-03 11:15:14,933 - Epoch: [23][ 6700/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.403456    
+2023-12-03 11:15:43,030 - Epoch: [23][ 6800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.401654    
+2023-12-03 11:16:10,678 - Epoch: [23][ 6900/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.399839    
+2023-12-03 11:16:37,969 - Epoch: [23][ 7000/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.398025    
+2023-12-03 11:17:05,263 - Epoch: [23][ 7100/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.396263    
+2023-12-03 11:17:34,297 - Epoch: [23][ 7200/31148]    Overall Loss 0.008848    Objective Loss 0.000000    Distill Loss 0.008848                     LR 0.000125    Time 0.394791    
+2023-12-03 11:18:15,395 - Epoch: [23][ 7300/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.395012    
+2023-12-03 11:18:58,431 - Epoch: [23][ 7400/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.395488    
+2023-12-03 11:19:41,959 - Epoch: [23][ 7500/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.396018    
+2023-12-03 11:20:25,096 - Epoch: [23][ 7600/31148]    Overall Loss 0.008850    Objective Loss 0.000000    Distill Loss 0.008850                     LR 0.000125    Time 0.396482    
+2023-12-03 11:21:10,525 - Epoch: [23][ 7700/31148]    Overall Loss 0.008849    Objective Loss 0.000000    Distill Loss 0.008849                     LR 0.000125    Time 0.397232    
+2023-12-03 11:21:57,983 - Epoch: [23][ 7800/31148]    Overall Loss 0.008847    Objective Loss 0.000000    Distill Loss 0.008847                     LR 0.000125    Time 0.398223    
+2023-12-03 11:23:00,695 - Epoch: [23][ 7900/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.401119    
+2023-12-03 11:23:36,327 - Epoch: [23][ 8000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.400558    
+2023-12-03 11:24:36,228 - Epoch: [23][ 8100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.403007    
+2023-12-03 11:25:29,022 - Epoch: [23][ 8200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.404530    
+2023-12-03 11:26:19,944 - Epoch: [23][ 8300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.405790    
+2023-12-03 11:27:02,908 - Epoch: [23][ 8400/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.406073    
+2023-12-03 11:27:40,466 - Epoch: [23][ 8500/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.405714    
+2023-12-03 11:28:24,656 - Epoch: [23][ 8600/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.406134    
+2023-12-03 11:29:15,027 - Epoch: [23][ 8700/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.407254    
+2023-12-03 11:30:03,930 - Epoch: [23][ 8800/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.408183    
+2023-12-03 11:30:50,119 - Epoch: [23][ 8900/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.408785    
+2023-12-03 11:31:38,721 - Epoch: [23][ 9000/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.409643    
+2023-12-03 11:32:30,293 - Epoch: [23][ 9100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.410808    
+2023-12-03 11:33:09,451 - Epoch: [23][ 9200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.410598    
+2023-12-03 11:33:55,197 - Epoch: [23][ 9300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.411101    
+2023-12-03 11:34:43,573 - Epoch: [23][ 9400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.411873    
+2023-12-03 11:35:33,315 - Epoch: [23][ 9500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.412773    
+2023-12-03 11:36:32,025 - Epoch: [23][ 9600/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.414588    
+2023-12-03 11:37:22,803 - Epoch: [23][ 9700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.415548    
+2023-12-03 11:38:19,123 - Epoch: [23][ 9800/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.417054    
+2023-12-03 11:39:08,928 - Epoch: [23][ 9900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.417871    
+2023-12-03 11:39:55,305 - Epoch: [23][10000/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.418329    
+2023-12-03 11:40:51,648 - Epoch: [23][10100/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.419765    
+2023-12-03 11:41:34,271 - Epoch: [23][10200/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.419828    
+2023-12-03 11:42:18,556 - Epoch: [23][10300/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.420050    
+2023-12-03 11:43:01,121 - Epoch: [23][10400/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.420104    
+2023-12-03 11:43:45,591 - Epoch: [23][10500/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.420337    
+2023-12-03 11:44:40,425 - Epoch: [23][10600/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.421544    
+2023-12-03 11:45:19,441 - Epoch: [23][10700/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.421250    
+2023-12-03 11:46:16,295 - Epoch: [23][10800/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.422613    
+2023-12-03 11:47:04,261 - Epoch: [23][10900/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.423136    
+2023-12-03 11:47:55,741 - Epoch: [23][11000/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.423968    
+2023-12-03 11:48:42,273 - Epoch: [23][11100/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.424340    
+2023-12-03 11:49:31,469 - Epoch: [23][11200/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.424943    
+2023-12-03 11:50:19,904 - Epoch: [23][11300/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.425468    
+2023-12-03 11:51:08,715 - Epoch: [23][11400/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.426017    
+2023-12-03 11:51:56,261 - Epoch: [23][11500/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.426446    
+2023-12-03 11:53:04,441 - Epoch: [23][11600/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.428647    
+2023-12-03 11:53:46,775 - Epoch: [23][11700/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.428601    
+2023-12-03 11:54:32,008 - Epoch: [23][11800/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.428802    
+2023-12-03 11:55:15,599 - Epoch: [23][11900/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.428861    
+2023-12-03 11:55:54,399 - Epoch: [23][12000/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.428519    
+2023-12-03 11:56:35,197 - Epoch: [23][12100/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.428349    
+2023-12-03 11:57:31,887 - Epoch: [23][12200/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.429484    
+2023-12-03 11:58:25,397 - Epoch: [23][12300/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.430342    
+2023-12-03 11:59:21,008 - Epoch: [23][12400/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.431356    
+2023-12-03 12:00:02,234 - Epoch: [23][12500/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.431203    
+2023-12-03 12:00:45,079 - Epoch: [23][12600/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.431180    
+2023-12-03 12:01:27,707 - Epoch: [23][12700/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.431141    
+2023-12-03 12:02:08,351 - Epoch: [23][12800/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.430947    
+2023-12-03 12:02:46,593 - Epoch: [23][12900/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.430571    
+2023-12-03 12:03:38,768 - Epoch: [23][13000/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.431271    
+2023-12-03 12:04:26,907 - Epoch: [23][13100/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.431653    
+2023-12-03 12:05:13,761 - Epoch: [23][13200/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.431932    
+2023-12-03 12:05:51,807 - Epoch: [23][13300/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.431545    
+2023-12-03 12:06:30,771 - Epoch: [23][13400/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.431231    
+2023-12-03 12:07:23,243 - Epoch: [23][13500/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.431923    
+2023-12-03 12:08:08,193 - Epoch: [23][13600/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.432052    
+2023-12-03 12:09:00,897 - Epoch: [23][13700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.432745    
+2023-12-03 12:09:36,269 - Epoch: [23][13800/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.432172    
+2023-12-03 12:10:20,596 - Epoch: [23][13900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.432251    
+2023-12-03 12:11:03,297 - Epoch: [23][14000/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.432213    
+2023-12-03 12:11:49,702 - Epoch: [23][14100/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.432439    
+2023-12-03 12:12:46,402 - Epoch: [23][14200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.433386    
+2023-12-03 12:13:41,720 - Epoch: [23][14300/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434223    
+2023-12-03 12:14:25,485 - Epoch: [23][14400/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.434246    
+2023-12-03 12:15:05,011 - Epoch: [23][14500/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.433977    
+2023-12-03 12:15:44,701 - Epoch: [23][14600/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.433722    
+2023-12-03 12:16:36,408 - Epoch: [23][14700/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.434289    
+2023-12-03 12:17:18,839 - Epoch: [23][14800/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.434221    
+2023-12-03 12:18:01,127 - Epoch: [23][14900/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.434144    
+2023-12-03 12:18:49,327 - Epoch: [23][15000/31148]    Overall Loss 0.008841    Objective Loss 0.000000    Distill Loss 0.008841                     LR 0.000125    Time 0.434463    
+2023-12-03 12:19:33,177 - Epoch: [23][15100/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434489    
+2023-12-03 12:20:16,219 - Epoch: [23][15200/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434462    
+2023-12-03 12:21:05,786 - Epoch: [23][15300/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.434862    
+2023-12-03 12:21:45,013 - Epoch: [23][15400/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434585    
+2023-12-03 12:22:27,470 - Epoch: [23][15500/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.434519    
+2023-12-03 12:23:04,137 - Epoch: [23][15600/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434084    
+2023-12-03 12:23:51,681 - Epoch: [23][15700/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434347    
+2023-12-03 12:24:43,930 - Epoch: [23][15800/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.434904    
+2023-12-03 12:25:31,647 - Epoch: [23][15900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.435170    
+2023-12-03 12:26:13,799 - Epoch: [23][16000/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.435084    
+2023-12-03 12:27:01,419 - Epoch: [23][16100/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.435339    
+2023-12-03 12:27:41,678 - Epoch: [23][16200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.435136    
+2023-12-03 12:28:29,404 - Epoch: [23][16300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.435394    
+2023-12-03 12:29:20,987 - Epoch: [23][16400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.435884    
+2023-12-03 12:30:01,970 - Epoch: [23][16500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.435726    
+2023-12-03 12:30:47,102 - Epoch: [23][16600/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.435820    
+2023-12-03 12:31:34,631 - Epoch: [23][16700/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436056    
+2023-12-03 12:32:17,598 - Epoch: [23][16800/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436017    
+2023-12-03 12:33:08,601 - Epoch: [23][16900/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436455    
+2023-12-03 12:33:49,929 - Epoch: [23][17000/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436318    
+2023-12-03 12:34:36,511 - Epoch: [23][17100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436490    
+2023-12-03 12:35:17,978 - Epoch: [23][17200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436363    
+2023-12-03 12:36:11,357 - Epoch: [23][17300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.436926    
+2023-12-03 12:36:59,157 - Epoch: [23][17400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.437161    
+2023-12-03 12:37:48,116 - Epoch: [23][17500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.437460    
+2023-12-03 12:38:32,760 - Epoch: [23][17600/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.437511    
+2023-12-03 12:39:24,326 - Epoch: [23][17700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.437952    
+2023-12-03 12:40:06,264 - Epoch: [23][17800/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.437847    
+2023-12-03 12:40:47,052 - Epoch: [23][17900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.437680    
+2023-12-03 12:41:32,847 - Epoch: [23][18000/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.437792    
+2023-12-03 12:42:15,562 - Epoch: [23][18100/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.437733    
+2023-12-03 12:43:13,139 - Epoch: [23][18200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.438491    
+2023-12-03 12:44:01,445 - Epoch: [23][18300/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.438734    
+2023-12-03 12:44:44,229 - Epoch: [23][18400/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.438674    
+2023-12-03 12:45:29,824 - Epoch: [23][18500/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.438767    
+2023-12-03 12:46:19,328 - Epoch: [23][18600/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.439069    
+2023-12-03 12:47:13,648 - Epoch: [23][18700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.439626    
+2023-12-03 12:48:11,424 - Epoch: [23][18800/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.440360    
+2023-12-03 12:49:04,239 - Epoch: [23][18900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.440824    
+2023-12-03 12:49:47,490 - Epoch: [23][19000/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.440780    
+2023-12-03 12:50:28,788 - Epoch: [23][19100/31148]    Overall Loss 0.008842    Objective Loss 0.000000    Distill Loss 0.008842                     LR 0.000125    Time 0.440634    
+2023-12-03 12:51:17,141 - Epoch: [23][19200/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.440857    
+2023-12-03 12:52:09,681 - Epoch: [23][19300/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.441295    
+2023-12-03 12:52:48,324 - Epoch: [23][19400/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.441012    
+2023-12-03 12:53:31,820 - Epoch: [23][19500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.440980    
+2023-12-03 12:54:13,551 - Epoch: [23][19600/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.440859    
+2023-12-03 12:55:04,135 - Epoch: [23][19700/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441189    
+2023-12-03 12:55:44,547 - Epoch: [23][19800/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441001    
+2023-12-03 12:56:30,604 - Epoch: [23][19900/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441099    
+2023-12-03 12:57:21,889 - Epoch: [23][20000/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441457    
+2023-12-03 12:57:58,547 - Epoch: [23][20100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441085    
+2023-12-03 12:58:54,580 - Epoch: [23][20200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441675    
+2023-12-03 12:59:37,571 - Epoch: [23][20300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.441616    
+2023-12-03 13:00:32,233 - Epoch: [23][20400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442131    
+2023-12-03 13:01:18,350 - Epoch: [23][20500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442223    
+2023-12-03 13:01:54,837 - Epoch: [23][20600/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.441847    
+2023-12-03 13:02:38,124 - Epoch: [23][20700/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441804    
+2023-12-03 13:03:22,575 - Epoch: [23][20800/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441816    
+2023-12-03 13:04:10,505 - Epoch: [23][20900/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441995    
+2023-12-03 13:04:46,096 - Epoch: [23][21000/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441585    
+2023-12-03 13:05:40,007 - Epoch: [23][21100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442047    
+2023-12-03 13:06:31,952 - Epoch: [23][21200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442412    
+2023-12-03 13:07:20,429 - Epoch: [23][21300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442610    
+2023-12-03 13:08:04,378 - Epoch: [23][21400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442595    
+2023-12-03 13:08:56,048 - Epoch: [23][21500/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442940    
+2023-12-03 13:09:37,639 - Epoch: [23][21600/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442814    
+2023-12-03 13:10:20,849 - Epoch: [23][21700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442764    
+2023-12-03 13:11:00,422 - Epoch: [23][21800/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442548    
+2023-12-03 13:11:42,577 - Epoch: [23][21900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442452    
+2023-12-03 13:12:28,067 - Epoch: [23][22000/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442508    
+2023-12-03 13:13:06,761 - Epoch: [23][22100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442257    
+2023-12-03 13:13:48,183 - Epoch: [23][22200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442130    
+2023-12-03 13:14:27,813 - Epoch: [23][22300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441924    
+2023-12-03 13:15:12,510 - Epoch: [23][22400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441946    
+2023-12-03 13:15:54,218 - Epoch: [23][22500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441836    
+2023-12-03 13:16:38,289 - Epoch: [23][22600/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.441830    
+2023-12-03 13:17:30,604 - Epoch: [23][22700/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442188    
+2023-12-03 13:18:14,659 - Epoch: [23][22800/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442181    
+2023-12-03 13:19:06,843 - Epoch: [23][22900/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.442528    
+2023-12-03 13:20:03,161 - Epoch: [23][23000/31148]    Overall Loss 0.008843    Objective Loss 0.000000    Distill Loss 0.008843                     LR 0.000125    Time 0.443052    
+2023-12-03 13:20:46,592 - Epoch: [23][23100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443014    
+2023-12-03 13:21:30,398 - Epoch: [23][23200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442993    
+2023-12-03 13:22:17,689 - Epoch: [23][23300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443121    
+2023-12-03 13:22:54,632 - Epoch: [23][23400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442806    
+2023-12-03 13:23:42,145 - Epoch: [23][23500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442943    
+2023-12-03 13:24:20,238 - Epoch: [23][23600/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442680    
+2023-12-03 13:25:06,082 - Epoch: [23][23700/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.442746    
+2023-12-03 13:25:53,004 - Epoch: [23][23800/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.442857    
+2023-12-03 13:26:34,773 - Epoch: [23][23900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.442751    
+2023-12-03 13:27:19,762 - Epoch: [23][24000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.442781    
+2023-12-03 13:28:03,323 - Epoch: [23][24100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.442751    
+2023-12-03 13:28:51,974 - Epoch: [23][24200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.442931    
+2023-12-03 13:29:39,319 - Epoch: [23][24300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443056    
+2023-12-03 13:30:28,186 - Epoch: [23][24400/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443243    
+2023-12-03 13:31:11,484 - Epoch: [23][24500/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443201    
+2023-12-03 13:32:03,718 - Epoch: [23][24600/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443522    
+2023-12-03 13:32:49,568 - Epoch: [23][24700/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443583    
+2023-12-03 13:33:33,472 - Epoch: [23][24800/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443564    
+2023-12-03 13:34:07,002 - Epoch: [23][24900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443129    
+2023-12-03 13:35:04,096 - Epoch: [23][25000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443640    
+2023-12-03 13:35:45,832 - Epoch: [23][25100/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443535    
+2023-12-03 13:36:32,714 - Epoch: [23][25200/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443635    
+2023-12-03 13:37:15,241 - Epoch: [23][25300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443562    
+2023-12-03 13:37:55,290 - Epoch: [23][25400/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443392    
+2023-12-03 13:38:46,647 - Epoch: [23][25500/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443667    
+2023-12-03 13:39:29,609 - Epoch: [23][25600/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443612    
+2023-12-03 13:40:13,337 - Epoch: [23][25700/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443587    
+2023-12-03 13:40:52,056 - Epoch: [23][25800/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443368    
+2023-12-03 13:41:45,278 - Epoch: [23][25900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443711    
+2023-12-03 13:42:26,292 - Epoch: [23][26000/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443582    
+2023-12-03 13:43:05,439 - Epoch: [23][26100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443382    
+2023-12-03 13:43:54,754 - Epoch: [23][26200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443571    
+2023-12-03 13:44:36,317 - Epoch: [23][26300/31148]    Overall Loss 0.008844    Objective Loss 0.000000    Distill Loss 0.008844                     LR 0.000125    Time 0.443465    
+2023-12-03 13:45:17,897 - Epoch: [23][26400/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443360    
+2023-12-03 13:46:05,824 - Epoch: [23][26500/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443495    
+2023-12-03 13:46:52,726 - Epoch: [23][26600/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443591    
+2023-12-03 13:47:41,645 - Epoch: [23][26700/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443761    
+2023-12-03 13:48:28,723 - Epoch: [23][26800/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443862    
+2023-12-03 13:49:11,297 - Epoch: [23][26900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443794    
+2023-12-03 13:49:53,345 - Epoch: [23][27000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443708    
+2023-12-03 13:50:47,308 - Epoch: [23][27100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444061    
+2023-12-03 13:51:29,605 - Epoch: [23][27200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443983    
+2023-12-03 13:52:14,080 - Epoch: [23][27300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.443986    
+2023-12-03 13:53:02,127 - Epoch: [23][27400/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444119    
+2023-12-03 13:53:49,575 - Epoch: [23][27500/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444229    
+2023-12-03 13:54:40,426 - Epoch: [23][27600/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444462    
+2023-12-03 13:55:20,630 - Epoch: [23][27700/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444308    
+2023-12-03 13:56:13,789 - Epoch: [23][27800/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444622    
+2023-12-03 13:56:54,864 - Epoch: [23][27900/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444500    
+2023-12-03 13:57:44,853 - Epoch: [23][28000/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444698    
+2023-12-03 13:58:32,420 - Epoch: [23][28100/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444808    
+2023-12-03 13:59:20,244 - Epoch: [23][28200/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444926    
+2023-12-03 14:00:02,490 - Epoch: [23][28300/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444847    
+2023-12-03 14:00:43,251 - Epoch: [23][28400/31148]    Overall Loss 0.008845    Objective Loss 0.000000    Distill Loss 0.008845                     LR 0.000125    Time 0.444715    
+2023-12-03 14:01:29,048 - Epoch: [23][28500/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444762    
+2023-12-03 14:02:13,428 - Epoch: [23][28600/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444758    
+2023-12-03 14:02:54,397 - Epoch: [23][28700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444636    
+2023-12-03 14:03:43,840 - Epoch: [23][28800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444808    
+2023-12-03 14:04:33,553 - Epoch: [23][28900/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444989    
+2023-12-03 14:05:09,893 - Epoch: [23][29000/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444707    
+2023-12-03 14:06:00,950 - Epoch: [23][29100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444933    
+2023-12-03 14:06:40,317 - Epoch: [23][29200/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444758    
+2023-12-03 14:07:21,968 - Epoch: [23][29300/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444661    
+2023-12-03 14:08:12,521 - Epoch: [23][29400/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444868    
+2023-12-03 14:08:51,436 - Epoch: [23][29500/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444679    
+2023-12-03 14:09:39,870 - Epoch: [23][29600/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444812    
+2023-12-03 14:10:27,843 - Epoch: [23][29700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444930    
+2023-12-03 14:11:03,218 - Epoch: [23][29800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444624    
+2023-12-03 14:11:58,031 - Epoch: [23][29900/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.444969    
+2023-12-03 14:12:46,955 - Epoch: [23][30000/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445117    
+2023-12-03 14:13:33,407 - Epoch: [23][30100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445181    
+2023-12-03 14:14:18,682 - Epoch: [23][30200/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445206    
+2023-12-03 14:15:05,085 - Epoch: [23][30300/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445268    
+2023-12-03 14:15:53,577 - Epoch: [23][30400/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445398    
+2023-12-03 14:16:40,183 - Epoch: [23][30500/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445465    
+2023-12-03 14:17:27,520 - Epoch: [23][30600/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445556    
+2023-12-03 14:18:11,365 - Epoch: [23][30700/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445533    
+2023-12-03 14:18:46,931 - Epoch: [23][30800/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445241    
+2023-12-03 14:19:48,781 - Epoch: [23][30900/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445802    
+2023-12-03 14:20:34,694 - Epoch: [23][31000/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445844    
+2023-12-03 14:21:20,128 - Epoch: [23][31100/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445871    
+2023-12-03 14:21:40,073 - Epoch: [23][31148/31148]    Overall Loss 0.008846    Objective Loss 0.000000    Distill Loss 0.008846                     LR 0.000125    Time 0.445825    
+2023-12-03 14:21:40,964 - --- validate (epoch=23)-----------
+2023-12-03 14:21:40,964 - 167951 samples (100 per mini-batch)
+2023-12-03 14:22:04,464 - Epoch: [23][  100/ 1680]    Loss 0.000000    Overall Loss 0.009412    
+2023-12-03 14:22:24,364 - Epoch: [23][  200/ 1680]    Loss 0.000000    Overall Loss 0.009437    
+2023-12-03 14:22:44,339 - Epoch: [23][  300/ 1680]    Loss 0.000000    Overall Loss 0.009452    
+2023-12-03 14:23:04,349 - Epoch: [23][  400/ 1680]    Loss 0.000000    Overall Loss 0.009470    
+2023-12-03 14:23:24,312 - Epoch: [23][  500/ 1680]    Loss 0.000000    Overall Loss 0.009480    
+2023-12-03 14:23:44,349 - Epoch: [23][  600/ 1680]    Loss 0.000000    Overall Loss 0.009472    
+2023-12-03 14:24:04,344 - Epoch: [23][  700/ 1680]    Loss 0.000000    Overall Loss 0.009474    
+2023-12-03 14:24:24,290 - Epoch: [23][  800/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 14:24:44,279 - Epoch: [23][  900/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 14:25:04,282 - Epoch: [23][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 14:25:24,229 - Epoch: [23][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009479    
+2023-12-03 14:25:44,162 - Epoch: [23][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 14:26:04,049 - Epoch: [23][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 14:26:24,065 - Epoch: [23][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 14:26:44,036 - Epoch: [23][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 14:27:04,029 - Epoch: [23][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009477    
+2023-12-03 14:27:19,960 - Epoch: [23][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009475    
+2023-12-03 14:27:20,512 - ==> Overall Loss: 0.009
+
+2023-12-03 14:27:20,519 - ==> Best [Overall Loss: 0.009474 on epoch: 22]
+2023-12-03 14:27:20,519 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-03 14:27:20,563 - 
+
+2023-12-03 14:27:20,563 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-03 14:28:21,316 - Epoch: [24][  100/31148]    Overall Loss 0.008766    Objective Loss 0.000000    Distill Loss 0.008766                     LR 0.000125    Time 0.607432    
+2023-12-03 14:29:12,951 - Epoch: [24][  200/31148]    Overall Loss 0.008736    Objective Loss 0.000000    Distill Loss 0.008736                     LR 0.000125    Time 0.561854    
+2023-12-03 14:29:56,934 - Epoch: [24][  300/31148]    Overall Loss 0.008808    Objective Loss 0.000000    Distill Loss 0.008808                     LR 0.000125    Time 0.521155    
+2023-12-03 14:30:37,971 - Epoch: [24][  400/31148]    Overall Loss 0.008800    Objective Loss 0.000000    Distill Loss 0.008800                     LR 0.000125    Time 0.493437    
+2023-12-03 14:31:25,028 - Epoch: [24][  500/31148]    Overall Loss 0.008807    Objective Loss 0.000000    Distill Loss 0.008807                     LR 0.000125    Time 0.488849    
+2023-12-03 14:32:09,682 - Epoch: [24][  600/31148]    Overall Loss 0.008807    Objective Loss 0.000000    Distill Loss 0.008807                     LR 0.000125    Time 0.481786    
+2023-12-03 14:32:51,733 - Epoch: [24][  700/31148]    Overall Loss 0.008819    Objective Loss 0.000000    Distill Loss 0.008819                     LR 0.000125    Time 0.473021    
+2023-12-03 14:33:31,525 - Epoch: [24][  800/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.463624    
+2023-12-03 14:34:15,444 - Epoch: [24][  900/31148]    Overall Loss 0.008823    Objective Loss 0.000000    Distill Loss 0.008823                     LR 0.000125    Time 0.460901    
+2023-12-03 14:34:55,956 - Epoch: [24][ 1000/31148]    Overall Loss 0.008817    Objective Loss 0.000000    Distill Loss 0.008817                     LR 0.000125    Time 0.455316    
+2023-12-03 14:35:32,587 - Epoch: [24][ 1100/31148]    Overall Loss 0.008818    Objective Loss 0.000000    Distill Loss 0.008818                     LR 0.000125    Time 0.447218    
+2023-12-03 14:36:12,216 - Epoch: [24][ 1200/31148]    Overall Loss 0.008813    Objective Loss 0.000000    Distill Loss 0.008813                     LR 0.000125    Time 0.442968    
+2023-12-03 14:36:56,625 - Epoch: [24][ 1300/31148]    Overall Loss 0.008810    Objective Loss 0.000000    Distill Loss 0.008810                     LR 0.000125    Time 0.443048    
+2023-12-03 14:37:43,867 - Epoch: [24][ 1400/31148]    Overall Loss 0.008818    Objective Loss 0.000000    Distill Loss 0.008818                     LR 0.000125    Time 0.445141    
+2023-12-03 14:38:27,702 - Epoch: [24][ 1500/31148]    Overall Loss 0.008816    Objective Loss 0.000000    Distill Loss 0.008816                     LR 0.000125    Time 0.444682    
+2023-12-03 14:39:10,511 - Epoch: [24][ 1600/31148]    Overall Loss 0.008815    Objective Loss 0.000000    Distill Loss 0.008815                     LR 0.000125    Time 0.443640    
+2023-12-03 14:39:50,662 - Epoch: [24][ 1700/31148]    Overall Loss 0.008816    Objective Loss 0.000000    Distill Loss 0.008816                     LR 0.000125    Time 0.441156    
+2023-12-03 14:40:18,915 - Epoch: [24][ 1800/31148]    Overall Loss 0.008819    Objective Loss 0.000000    Distill Loss 0.008819                     LR 0.000125    Time 0.432341    
+2023-12-03 14:40:46,282 - Epoch: [24][ 1900/31148]    Overall Loss 0.008817    Objective Loss 0.000000    Distill Loss 0.008817                     LR 0.000125    Time 0.423987    
+2023-12-03 14:41:13,871 - Epoch: [24][ 2000/31148]    Overall Loss 0.008816    Objective Loss 0.000000    Distill Loss 0.008816                     LR 0.000125    Time 0.416580    
+2023-12-03 14:41:41,161 - Epoch: [24][ 2100/31148]    Overall Loss 0.008818    Objective Loss 0.000000    Distill Loss 0.008818                     LR 0.000125    Time 0.409736    
+2023-12-03 14:42:08,774 - Epoch: [24][ 2200/31148]    Overall Loss 0.008821    Objective Loss 0.000000    Distill Loss 0.008821                     LR 0.000125    Time 0.403661    
+2023-12-03 14:42:36,134 - Epoch: [24][ 2300/31148]    Overall Loss 0.008826    Objective Loss 0.000000    Distill Loss 0.008826                     LR 0.000125    Time 0.398004    
+2023-12-03 14:43:03,878 - Epoch: [24][ 2400/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.392979    
+2023-12-03 14:43:31,104 - Epoch: [24][ 2500/31148]    Overall Loss 0.008825    Objective Loss 0.000000    Distill Loss 0.008825                     LR 0.000125    Time 0.388148    
+2023-12-03 14:43:58,225 - Epoch: [24][ 2600/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.383649    
+2023-12-03 14:44:25,166 - Epoch: [24][ 2700/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.379416    
+2023-12-03 14:44:52,434 - Epoch: [24][ 2800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.375603    
+2023-12-03 14:45:18,981 - Epoch: [24][ 2900/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.371804    
+2023-12-03 14:45:53,205 - Epoch: [24][ 3000/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.370816    
+2023-12-03 14:46:39,155 - Epoch: [24][ 3100/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.373674    
+2023-12-03 14:47:23,204 - Epoch: [24][ 3200/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.375760    
+2023-12-03 14:47:58,730 - Epoch: [24][ 3300/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.375136    
+2023-12-03 14:48:52,129 - Epoch: [24][ 3400/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.379807    
+2023-12-03 14:49:40,887 - Epoch: [24][ 3500/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.382883    
+2023-12-03 14:50:34,066 - Epoch: [24][ 3600/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.387018    
+2023-12-03 14:51:13,016 - Epoch: [24][ 3700/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.387083    
+2023-12-03 14:51:59,853 - Epoch: [24][ 3800/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.389220    
+2023-12-03 14:52:38,972 - Epoch: [24][ 3900/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.389269    
+2023-12-03 14:53:27,994 - Epoch: [24][ 4000/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.391790    
+2023-12-03 14:54:16,604 - Epoch: [24][ 4100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.394089    
+2023-12-03 14:54:55,291 - Epoch: [24][ 4200/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.393915    
+2023-12-03 14:55:44,607 - Epoch: [24][ 4300/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.396221    
+2023-12-03 14:56:21,691 - Epoch: [24][ 4400/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.395643    
+2023-12-03 14:57:21,071 - Epoch: [24][ 4500/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.400045    
+2023-12-03 14:58:10,644 - Epoch: [24][ 4600/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.402123    
+2023-12-03 14:58:56,537 - Epoch: [24][ 4700/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.403330    
+2023-12-03 14:59:41,464 - Epoch: [24][ 4800/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.404286    
+2023-12-03 15:00:23,248 - Epoch: [24][ 4900/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.404561    
+2023-12-03 15:01:05,426 - Epoch: [24][ 5000/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.404904    
+2023-12-03 15:01:46,347 - Epoch: [24][ 5100/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.404987    
+2023-12-03 15:02:37,988 - Epoch: [24][ 5200/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.407128    
+2023-12-03 15:03:23,727 - Epoch: [24][ 5300/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.408075    
+2023-12-03 15:04:09,273 - Epoch: [24][ 5400/31148]    Overall Loss 0.008839    Objective Loss 0.000000    Distill Loss 0.008839                     LR 0.000125    Time 0.408951    
+2023-12-03 15:05:00,720 - Epoch: [24][ 5500/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.410868    
+2023-12-03 15:05:46,680 - Epoch: [24][ 5600/31148]    Overall Loss 0.008840    Objective Loss 0.000000    Distill Loss 0.008840                     LR 0.000125    Time 0.411737    
+2023-12-03 15:06:43,897 - Epoch: [24][ 5700/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.414550    
+2023-12-03 15:07:36,338 - Epoch: [24][ 5800/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.416443    
+2023-12-03 15:08:25,619 - Epoch: [24][ 5900/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.417736    
+2023-12-03 15:09:11,528 - Epoch: [24][ 6000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.418424    
+2023-12-03 15:09:59,356 - Epoch: [24][ 6100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.419404    
+2023-12-03 15:10:47,466 - Epoch: [24][ 6200/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.420398    
+2023-12-03 15:11:30,111 - Epoch: [24][ 6300/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.420493    
+2023-12-03 15:12:19,007 - Epoch: [24][ 6400/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.421562    
+2023-12-03 15:13:13,142 - Epoch: [24][ 6500/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.423403    
+2023-12-03 15:13:59,689 - Epoch: [24][ 6600/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.424040    
+2023-12-03 15:14:47,011 - Epoch: [24][ 6700/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.424772    
+2023-12-03 15:15:29,851 - Epoch: [24][ 6800/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.424825    
+2023-12-03 15:16:10,288 - Epoch: [24][ 6900/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.424527    
+2023-12-03 15:16:52,686 - Epoch: [24][ 7000/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.424518    
+2023-12-03 15:17:33,610 - Epoch: [24][ 7100/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.424302    
+2023-12-03 15:18:24,174 - Epoch: [24][ 7200/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.425431    
+2023-12-03 15:19:10,472 - Epoch: [24][ 7300/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.425944    
+2023-12-03 15:19:57,286 - Epoch: [24][ 7400/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.426513    
+2023-12-03 15:20:48,317 - Epoch: [24][ 7500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.427629    
+2023-12-03 15:21:38,630 - Epoch: [24][ 7600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.428622    
+2023-12-03 15:22:34,994 - Epoch: [24][ 7700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.430374    
+2023-12-03 15:23:19,967 - Epoch: [24][ 7800/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.430621    
+2023-12-03 15:23:55,632 - Epoch: [24][ 7900/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.429684    
+2023-12-03 15:24:47,891 - Epoch: [24][ 8000/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.430844    
+2023-12-03 15:25:30,129 - Epoch: [24][ 8100/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.430739    
+2023-12-03 15:26:21,849 - Epoch: [24][ 8200/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.431792    
+2023-12-03 15:27:10,979 - Epoch: [24][ 8300/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.432509    
+2023-12-03 15:28:03,225 - Epoch: [24][ 8400/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.433578    
+2023-12-03 15:28:45,921 - Epoch: [24][ 8500/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.433500    
+2023-12-03 15:29:30,653 - Epoch: [24][ 8600/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.433660    
+2023-12-03 15:30:33,512 - Epoch: [24][ 8700/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.435899    
+2023-12-03 15:31:17,060 - Epoch: [24][ 8800/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.435894    
+2023-12-03 15:32:07,687 - Epoch: [24][ 8900/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.436683    
+2023-12-03 15:33:04,675 - Epoch: [24][ 9000/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.438163    
+2023-12-03 15:33:46,020 - Epoch: [24][ 9100/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.437890    
+2023-12-03 15:34:36,478 - Epoch: [24][ 9200/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.438614    
+2023-12-03 15:35:17,023 - Epoch: [24][ 9300/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.438257    
+2023-12-03 15:36:04,827 - Epoch: [24][ 9400/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.438679    
+2023-12-03 15:36:42,393 - Epoch: [24][ 9500/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.438015    
+2023-12-03 15:37:23,771 - Epoch: [24][ 9600/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.437762    
+2023-12-03 15:38:10,853 - Epoch: [24][ 9700/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.438102    
+2023-12-03 15:38:55,866 - Epoch: [24][ 9800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.438224    
+2023-12-03 15:39:47,999 - Epoch: [24][ 9900/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.439063    
+2023-12-03 15:40:42,771 - Epoch: [24][10000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.440148    
+2023-12-03 15:41:25,304 - Epoch: [24][10100/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.440001    
+2023-12-03 15:42:06,470 - Epoch: [24][10200/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.439722    
+2023-12-03 15:42:58,031 - Epoch: [24][10300/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.440458    
+2023-12-03 15:43:43,882 - Epoch: [24][10400/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.440631    
+2023-12-03 15:44:34,953 - Epoch: [24][10500/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.441298    
+2023-12-03 15:45:18,831 - Epoch: [24][10600/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.441274    
+2023-12-03 15:46:03,665 - Epoch: [24][10700/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.441339    
+2023-12-03 15:46:50,371 - Epoch: [24][10800/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.441576    
+2023-12-03 15:47:37,297 - Epoch: [24][10900/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.441830    
+2023-12-03 15:48:26,223 - Epoch: [24][11000/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.442260    
+2023-12-03 15:49:08,744 - Epoch: [24][11100/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.442106    
+2023-12-03 15:49:57,828 - Epoch: [24][11200/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.442540    
+2023-12-03 15:50:42,295 - Epoch: [24][11300/31148]    Overall Loss 0.008828    Objective Loss 0.000000    Distill Loss 0.008828                     LR 0.000125    Time 0.442558    
+2023-12-03 15:51:30,205 - Epoch: [24][11400/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.442878    
+2023-12-03 15:52:15,294 - Epoch: [24][11500/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.442947    
+2023-12-03 15:53:07,516 - Epoch: [24][11600/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.443630    
+2023-12-03 15:53:59,887 - Epoch: [24][11700/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.444314    
+2023-12-03 15:54:38,061 - Epoch: [24][11800/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.443783    
+2023-12-03 15:55:23,680 - Epoch: [24][11900/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.443887    
+2023-12-03 15:56:21,472 - Epoch: [24][12000/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.445003    
+2023-12-03 15:57:12,275 - Epoch: [24][12100/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.445523    
+2023-12-03 15:57:57,370 - Epoch: [24][12200/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.445567    
+2023-12-03 15:58:32,890 - Epoch: [24][12300/31148]    Overall Loss 0.008829    Objective Loss 0.000000    Distill Loss 0.008829                     LR 0.000125    Time 0.444832    
+2023-12-03 15:59:08,124 - Epoch: [24][12400/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.444085    
+2023-12-03 15:59:50,291 - Epoch: [24][12500/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.443905    
+2023-12-03 16:00:34,235 - Epoch: [24][12600/31148]    Overall Loss 0.008830    Objective Loss 0.000000    Distill Loss 0.008830                     LR 0.000125    Time 0.443870    
+2023-12-03 16:01:19,514 - Epoch: [24][12700/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.443939    
+2023-12-03 16:02:09,827 - Epoch: [24][12800/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.444401    
+2023-12-03 16:02:59,684 - Epoch: [24][12900/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.444820    
+2023-12-03 16:03:39,389 - Epoch: [24][13000/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.444452    
+2023-12-03 16:04:37,652 - Epoch: [24][13100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.445507    
+2023-12-03 16:05:27,653 - Epoch: [24][13200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.445919    
+2023-12-03 16:06:11,645 - Epoch: [24][13300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.445873    
+2023-12-03 16:07:02,581 - Epoch: [24][13400/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.446347    
+2023-12-03 16:07:46,868 - Epoch: [24][13500/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.446320    
+2023-12-03 16:08:34,525 - Epoch: [24][13600/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.446542    
+2023-12-03 16:09:18,024 - Epoch: [24][13700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.446457    
+2023-12-03 16:10:03,822 - Epoch: [24][13800/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.446540    
+2023-12-03 16:11:00,133 - Epoch: [24][13900/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447378    
+2023-12-03 16:11:49,773 - Epoch: [24][14000/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447728    
+2023-12-03 16:12:28,262 - Epoch: [24][14100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447282    
+2023-12-03 16:13:15,157 - Epoch: [24][14200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447434    
+2023-12-03 16:13:48,205 - Epoch: [24][14300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.446616    
+2023-12-03 16:14:23,754 - Epoch: [24][14400/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.445982    
+2023-12-03 16:15:12,469 - Epoch: [24][14500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.446266    
+2023-12-03 16:16:01,736 - Epoch: [24][14600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.446583    
+2023-12-03 16:16:37,541 - Epoch: [24][14700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.445980    
+2023-12-03 16:17:27,631 - Epoch: [24][14800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.446351    
+2023-12-03 16:18:13,860 - Epoch: [24][14900/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.446457    
+2023-12-03 16:18:59,547 - Epoch: [24][15000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.446526    
+2023-12-03 16:19:50,851 - Epoch: [24][15100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.446966    
+2023-12-03 16:20:38,197 - Epoch: [24][15200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447140    
+2023-12-03 16:21:23,455 - Epoch: [24][15300/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447175    
+2023-12-03 16:22:15,164 - Epoch: [24][15400/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447629    
+2023-12-03 16:23:01,307 - Epoch: [24][15500/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447717    
+2023-12-03 16:23:41,616 - Epoch: [24][15600/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447431    
+2023-12-03 16:24:30,368 - Epoch: [24][15700/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447686    
+2023-12-03 16:25:19,636 - Epoch: [24][15800/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447970    
+2023-12-03 16:25:59,810 - Epoch: [24][15900/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447679    
+2023-12-03 16:26:39,127 - Epoch: [24][16000/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447338    
+2023-12-03 16:27:26,862 - Epoch: [24][16100/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447523    
+2023-12-03 16:28:15,003 - Epoch: [24][16200/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447732    
+2023-12-03 16:28:57,243 - Epoch: [24][16300/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447576    
+2023-12-03 16:29:41,685 - Epoch: [24][16400/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447557    
+2023-12-03 16:30:37,682 - Epoch: [24][16500/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.448237    
+2023-12-03 16:31:26,005 - Epoch: [24][16600/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.448448    
+2023-12-03 16:32:01,712 - Epoch: [24][16700/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.447900    
+2023-12-03 16:32:55,997 - Epoch: [24][16800/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.448465    
+2023-12-03 16:33:47,250 - Epoch: [24][16900/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448844    
+2023-12-03 16:34:29,862 - Epoch: [24][17000/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448710    
+2023-12-03 16:35:12,706 - Epoch: [24][17100/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.448591    
+2023-12-03 16:35:54,566 - Epoch: [24][17200/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.448416    
+2023-12-03 16:36:42,670 - Epoch: [24][17300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448604    
+2023-12-03 16:37:34,305 - Epoch: [24][17400/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448993    
+2023-12-03 16:38:12,400 - Epoch: [24][17500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448604    
+2023-12-03 16:38:56,507 - Epoch: [24][17600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448560    
+2023-12-03 16:39:33,490 - Epoch: [24][17700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448115    
+2023-12-03 16:40:16,902 - Epoch: [24][17800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448036    
+2023-12-03 16:40:54,938 - Epoch: [24][17900/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447658    
+2023-12-03 16:41:37,172 - Epoch: [24][18000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447517    
+2023-12-03 16:42:15,441 - Epoch: [24][18100/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447158    
+2023-12-03 16:43:03,296 - Epoch: [24][18200/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447330    
+2023-12-03 16:43:52,621 - Epoch: [24][18300/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447581    
+2023-12-03 16:44:37,410 - Epoch: [24][18400/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447582    
+2023-12-03 16:45:20,270 - Epoch: [24][18500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447479    
+2023-12-03 16:45:59,694 - Epoch: [24][18600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447192    
+2023-12-03 16:46:50,967 - Epoch: [24][18700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447543    
+2023-12-03 16:47:30,726 - Epoch: [24][18800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447276    
+2023-12-03 16:48:24,578 - Epoch: [24][18900/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447759    
+2023-12-03 16:49:06,731 - Epoch: [24][19000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447620    
+2023-12-03 16:49:51,712 - Epoch: [24][19100/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.447632    
+2023-12-03 16:50:38,009 - Epoch: [24][19200/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.447711    
+2023-12-03 16:51:32,355 - Epoch: [24][19300/31148]    Overall Loss 0.008831    Objective Loss 0.000000    Distill Loss 0.008831                     LR 0.000125    Time 0.448207    
+2023-12-03 16:52:15,000 - Epoch: [24][19400/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448094    
+2023-12-03 16:52:56,837 - Epoch: [24][19500/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447941    
+2023-12-03 16:53:32,549 - Epoch: [24][19600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447478    
+2023-12-03 16:54:26,360 - Epoch: [24][19700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447937    
+2023-12-03 16:55:07,520 - Epoch: [24][19800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.447753    
+2023-12-03 16:56:03,115 - Epoch: [24][19900/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448297    
+2023-12-03 16:56:48,688 - Epoch: [24][20000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448334    
+2023-12-03 16:57:31,988 - Epoch: [24][20100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448257    
+2023-12-03 16:58:15,305 - Epoch: [24][20200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448182    
+2023-12-03 16:59:02,972 - Epoch: [24][20300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448322    
+2023-12-03 16:59:41,172 - Epoch: [24][20400/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.447996    
+2023-12-03 17:00:31,458 - Epoch: [24][20500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448264    
+2023-12-03 17:01:18,327 - Epoch: [24][20600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448362    
+2023-12-03 17:02:04,339 - Epoch: [24][20700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.448419    
+2023-12-03 17:02:47,447 - Epoch: [24][20800/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448335    
+2023-12-03 17:03:31,858 - Epoch: [24][20900/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448315    
+2023-12-03 17:04:19,227 - Epoch: [24][21000/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448435    
+2023-12-03 17:04:56,662 - Epoch: [24][21100/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448084    
+2023-12-03 17:05:46,536 - Epoch: [24][21200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448322    
+2023-12-03 17:06:37,528 - Epoch: [24][21300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448611    
+2023-12-03 17:07:24,319 - Epoch: [24][21400/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.448701    
+2023-12-03 17:08:19,075 - Epoch: [24][21500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449161    
+2023-12-03 17:09:11,655 - Epoch: [24][21600/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449515    
+2023-12-03 17:09:51,877 - Epoch: [24][21700/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449297    
+2023-12-03 17:10:36,781 - Epoch: [24][21800/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449295    
+2023-12-03 17:11:21,415 - Epoch: [24][21900/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449281    
+2023-12-03 17:12:09,129 - Epoch: [24][22000/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.449408    
+2023-12-03 17:12:57,974 - Epoch: [24][22100/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.449584    
+2023-12-03 17:13:37,729 - Epoch: [24][22200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449349    
+2023-12-03 17:14:27,533 - Epoch: [24][22300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449567    
+2023-12-03 17:15:08,816 - Epoch: [24][22400/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449403    
+2023-12-03 17:15:51,297 - Epoch: [24][22500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449293    
+2023-12-03 17:16:39,951 - Epoch: [24][22600/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449458    
+2023-12-03 17:17:15,349 - Epoch: [24][22700/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449037    
+2023-12-03 17:18:01,530 - Epoch: [24][22800/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449093    
+2023-12-03 17:18:51,216 - Epoch: [24][22900/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449301    
+2023-12-03 17:19:35,820 - Epoch: [24][23000/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449286    
+2023-12-03 17:20:15,838 - Epoch: [24][23100/31148]    Overall Loss 0.008832    Objective Loss 0.000000    Distill Loss 0.008832                     LR 0.000125    Time 0.449074    
+2023-12-03 17:21:13,746 - Epoch: [24][23200/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449634    
+2023-12-03 17:22:00,622 - Epoch: [24][23300/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449715    
+2023-12-03 17:22:48,727 - Epoch: [24][23400/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449849    
+2023-12-03 17:23:37,906 - Epoch: [24][23500/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.450027    
+2023-12-03 17:24:19,869 - Epoch: [24][23600/31148]    Overall Loss 0.008833    Objective Loss 0.000000    Distill Loss 0.008833                     LR 0.000125    Time 0.449898    
+2023-12-03 17:25:08,873 - Epoch: [24][23700/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.450067    
+2023-12-03 17:25:54,891 - Epoch: [24][23800/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.450109    
+2023-12-03 17:26:40,188 - Epoch: [24][23900/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.450121    
+2023-12-03 17:27:24,631 - Epoch: [24][24000/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450097    
+2023-12-03 17:28:05,120 - Epoch: [24][24100/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449909    
+2023-12-03 17:28:52,241 - Epoch: [24][24200/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449997    
+2023-12-03 17:29:40,232 - Epoch: [24][24300/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450120    
+2023-12-03 17:30:27,249 - Epoch: [24][24400/31148]    Overall Loss 0.008834    Objective Loss 0.000000    Distill Loss 0.008834                     LR 0.000125    Time 0.450201    
+2023-12-03 17:31:13,118 - Epoch: [24][24500/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450236    
+2023-12-03 17:31:59,337 - Epoch: [24][24600/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450284    
+2023-12-03 17:32:42,411 - Epoch: [24][24700/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450205    
+2023-12-03 17:33:29,443 - Epoch: [24][24800/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450286    
+2023-12-03 17:34:15,554 - Epoch: [24][24900/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450329    
+2023-12-03 17:34:54,125 - Epoch: [24][25000/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450070    
+2023-12-03 17:35:52,215 - Epoch: [24][25100/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450591    
+2023-12-03 17:36:39,642 - Epoch: [24][25200/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450685    
+2023-12-03 17:37:22,492 - Epoch: [24][25300/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450597    
+2023-12-03 17:38:10,738 - Epoch: [24][25400/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450722    
+2023-12-03 17:38:54,373 - Epoch: [24][25500/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450665    
+2023-12-03 17:39:36,497 - Epoch: [24][25600/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450550    
+2023-12-03 17:40:21,211 - Epoch: [24][25700/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450536    
+2023-12-03 17:41:12,316 - Epoch: [24][25800/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450771    
+2023-12-03 17:41:56,180 - Epoch: [24][25900/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450724    
+2023-12-03 17:42:51,880 - Epoch: [24][26000/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.451132    
+2023-12-03 17:43:28,906 - Epoch: [24][26100/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450822    
+2023-12-03 17:44:09,214 - Epoch: [24][26200/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450639    
+2023-12-03 17:44:46,717 - Epoch: [24][26300/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450352    
+2023-12-03 17:45:20,385 - Epoch: [24][26400/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449921    
+2023-12-03 17:46:05,153 - Epoch: [24][26500/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449912    
+2023-12-03 17:46:40,191 - Epoch: [24][26600/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449537    
+2023-12-03 17:47:25,188 - Epoch: [24][26700/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449539    
+2023-12-03 17:48:11,224 - Epoch: [24][26800/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.449579    
+2023-12-03 17:48:48,667 - Epoch: [24][26900/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.449299    
+2023-12-03 17:49:34,038 - Epoch: [24][27000/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449315    
+2023-12-03 17:50:25,485 - Epoch: [24][27100/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449556    
+2023-12-03 17:51:09,626 - Epoch: [24][27200/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449525    
+2023-12-03 17:52:00,493 - Epoch: [24][27300/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.449742    
+2023-12-03 17:52:55,463 - Epoch: [24][27400/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450106    
+2023-12-03 17:53:51,239 - Epoch: [24][27500/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450497    
+2023-12-03 17:54:39,713 - Epoch: [24][27600/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450621    
+2023-12-03 17:55:24,374 - Epoch: [24][27700/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450606    
+2023-12-03 17:56:08,701 - Epoch: [24][27800/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450580    
+2023-12-03 17:56:53,648 - Epoch: [24][27900/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450576    
+2023-12-03 17:57:40,535 - Epoch: [24][28000/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450641    
+2023-12-03 17:58:29,672 - Epoch: [24][28100/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450785    
+2023-12-03 17:59:14,624 - Epoch: [24][28200/31148]    Overall Loss 0.008835    Objective Loss 0.000000    Distill Loss 0.008835                     LR 0.000125    Time 0.450781    
+2023-12-03 17:59:58,754 - Epoch: [24][28300/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450747    
+2023-12-03 18:00:48,033 - Epoch: [24][28400/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450895    
+2023-12-03 18:01:32,037 - Epoch: [24][28500/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.450856    
+2023-12-03 18:02:22,837 - Epoch: [24][28600/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451056    
+2023-12-03 18:03:10,296 - Epoch: [24][28700/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451138    
+2023-12-03 18:03:55,806 - Epoch: [24][28800/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451151    
+2023-12-03 18:04:47,801 - Epoch: [24][28900/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451389    
+2023-12-03 18:05:30,274 - Epoch: [24][29000/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451297    
+2023-12-03 18:06:22,015 - Epoch: [24][29100/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451524    
+2023-12-03 18:07:00,582 - Epoch: [24][29200/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451298    
+2023-12-03 18:07:38,170 - Epoch: [24][29300/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451040    
+2023-12-03 18:08:22,273 - Epoch: [24][29400/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451006    
+2023-12-03 18:09:09,718 - Epoch: [24][29500/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.451085    
+2023-12-03 18:09:50,852 - Epoch: [24][29600/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450951    
+2023-12-03 18:10:35,636 - Epoch: [24][29700/31148]    Overall Loss 0.008836    Objective Loss 0.000000    Distill Loss 0.008836                     LR 0.000125    Time 0.450940    
+2023-12-03 18:11:10,157 - Epoch: [24][29800/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.450585    
+2023-12-03 18:11:40,972 - Epoch: [24][29900/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.450109    
+2023-12-03 18:12:08,991 - Epoch: [24][30000/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.449542    
+2023-12-03 18:12:37,468 - Epoch: [24][30100/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.448994    
+2023-12-03 18:13:07,342 - Epoch: [24][30200/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.448497    
+2023-12-03 18:13:35,656 - Epoch: [24][30300/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.447951    
+2023-12-03 18:14:04,084 - Epoch: [24][30400/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.447412    
+2023-12-03 18:14:31,371 - Epoch: [24][30500/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.446840    
+2023-12-03 18:14:59,196 - Epoch: [24][30600/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.446289    
+2023-12-03 18:15:28,945 - Epoch: [24][30700/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.445804    
+2023-12-03 18:15:56,935 - Epoch: [24][30800/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.445265    
+2023-12-03 18:16:24,206 - Epoch: [24][30900/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.444707    
+2023-12-03 18:16:58,839 - Epoch: [24][31000/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.444389    
+2023-12-03 18:17:46,394 - Epoch: [24][31100/31148]    Overall Loss 0.008837    Objective Loss 0.000000    Distill Loss 0.008837                     LR 0.000125    Time 0.444489    
+2023-12-03 18:18:03,317 - Epoch: [24][31148/31148]    Overall Loss 0.008838    Objective Loss 0.000000    Distill Loss 0.008838                     LR 0.000125    Time 0.444347    
+2023-12-03 18:18:04,264 - --- validate (epoch=24)-----------
+2023-12-03 18:18:04,264 - 167951 samples (100 per mini-batch)
+2023-12-03 18:18:27,485 - Epoch: [24][  100/ 1680]    Loss 0.000000    Overall Loss 0.009441    
+2023-12-03 18:18:47,527 - Epoch: [24][  200/ 1680]    Loss 0.000000    Overall Loss 0.009449    
+2023-12-03 18:19:07,515 - Epoch: [24][  300/ 1680]    Loss 0.000000    Overall Loss 0.009470    
+2023-12-03 18:19:27,450 - Epoch: [24][  400/ 1680]    Loss 0.000000    Overall Loss 0.009463    
+2023-12-03 18:19:47,357 - Epoch: [24][  500/ 1680]    Loss 0.000000    Overall Loss 0.009485    
+2023-12-03 18:20:07,338 - Epoch: [24][  600/ 1680]    Loss 0.000000    Overall Loss 0.009487    
+2023-12-03 18:20:27,325 - Epoch: [24][  700/ 1680]    Loss 0.000000    Overall Loss 0.009492    
+2023-12-03 18:20:47,318 - Epoch: [24][  800/ 1680]    Loss 0.000000    Overall Loss 0.009488    
+2023-12-03 18:21:07,327 - Epoch: [24][  900/ 1680]    Loss 0.000000    Overall Loss 0.009486    
+2023-12-03 18:21:27,311 - Epoch: [24][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.009482    
+2023-12-03 18:21:47,296 - Epoch: [24][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.009479    
+2023-12-03 18:22:07,317 - Epoch: [24][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.009480    
+2023-12-03 18:22:27,255 - Epoch: [24][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.009480    
+2023-12-03 18:22:47,222 - Epoch: [24][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.009483    
+2023-12-03 18:23:07,251 - Epoch: [24][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.009480    
+2023-12-03 18:23:27,295 - Epoch: [24][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.009478    
+2023-12-03 18:23:43,329 - Epoch: [24][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.009476    
+2023-12-03 18:23:43,893 - ==> Overall Loss: 0.009
+
+2023-12-03 18:23:43,902 - ==> Best [Overall Loss: 0.009474 on epoch: 22]
+2023-12-03 18:23:43,902 - Saving checkpoint to: logs/2023.11.30-015335/checkpoint.pth.tar
+2023-12-03 18:23:43,951 - 
+
+2023-12-03 18:23:43,952 - Initiating quantization aware training (QAT)...
+2023-12-03 18:23:44,037 - 
+
+2023-12-03 18:23:44,037 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-03 18:24:52,304 - Epoch: [25][  100/31148]    Overall Loss 0.013104    Objective Loss 0.000000    Distill Loss 0.013104                     LR 0.000063    Time 0.682575    
+2023-12-03 18:25:46,614 - Epoch: [25][  200/31148]    Overall Loss 0.012094    Objective Loss 0.000000    Distill Loss 0.012094                     LR 0.000063    Time 0.612797    
+2023-12-03 18:26:25,631 - Epoch: [25][  300/31148]    Overall Loss 0.011723    Objective Loss 0.000000    Distill Loss 0.011723                     LR 0.000063    Time 0.538565    
+2023-12-03 18:27:10,028 - Epoch: [25][  400/31148]    Overall Loss 0.011451    Objective Loss 0.000000    Distill Loss 0.011451                     LR 0.000063    Time 0.514897    
+2023-12-03 18:27:56,321 - Epoch: [25][  500/31148]    Overall Loss 0.011286    Objective Loss 0.000000    Distill Loss 0.011286                     LR 0.000063    Time 0.504487    
+2023-12-03 18:28:31,934 - Epoch: [25][  600/31148]    Overall Loss 0.011156    Objective Loss 0.000000    Distill Loss 0.011156                     LR 0.000063    Time 0.479749    
+2023-12-03 18:29:20,831 - Epoch: [25][  700/31148]    Overall Loss 0.011069    Objective Loss 0.000000    Distill Loss 0.011069                     LR 0.000063    Time 0.481055    
+2023-12-03 18:29:55,916 - Epoch: [25][  800/31148]    Overall Loss 0.011001    Objective Loss 0.000000    Distill Loss 0.011001                     LR 0.000063    Time 0.464771    
+2023-12-03 18:30:36,705 - Epoch: [25][  900/31148]    Overall Loss 0.010922    Objective Loss 0.000000    Distill Loss 0.010922                     LR 0.000063    Time 0.458442    
+2023-12-03 18:31:15,565 - Epoch: [25][ 1000/31148]    Overall Loss 0.010850    Objective Loss 0.000000    Distill Loss 0.010850                     LR 0.000063    Time 0.451450    
+2023-12-03 18:31:58,406 - Epoch: [25][ 1100/31148]    Overall Loss 0.010810    Objective Loss 0.000000    Distill Loss 0.010810                     LR 0.000063    Time 0.449349    
+2023-12-03 18:32:40,061 - Epoch: [25][ 1200/31148]    Overall Loss 0.010764    Objective Loss 0.000000    Distill Loss 0.010764                     LR 0.000063    Time 0.446609    
+2023-12-03 18:33:27,187 - Epoch: [25][ 1300/31148]    Overall Loss 0.010735    Objective Loss 0.000000    Distill Loss 0.010735                     LR 0.000063    Time 0.448499    
+2023-12-03 18:34:13,296 - Epoch: [25][ 1400/31148]    Overall Loss 0.010715    Objective Loss 0.000000    Distill Loss 0.010715                     LR 0.000063    Time 0.449393    
+2023-12-03 18:35:00,852 - Epoch: [25][ 1500/31148]    Overall Loss 0.010693    Objective Loss 0.000000    Distill Loss 0.010693                     LR 0.000063    Time 0.451133    
+2023-12-03 18:35:42,520 - Epoch: [25][ 1600/31148]    Overall Loss 0.010675    Objective Loss 0.000000    Distill Loss 0.010675                     LR 0.000063    Time 0.448975    
+2023-12-03 18:36:18,899 - Epoch: [25][ 1700/31148]    Overall Loss 0.010651    Objective Loss 0.000000    Distill Loss 0.010651                     LR 0.000063    Time 0.443959    
+2023-12-03 18:37:03,096 - Epoch: [25][ 1800/31148]    Overall Loss 0.010633    Objective Loss 0.000000    Distill Loss 0.010633                     LR 0.000063    Time 0.443844    
+2023-12-03 18:37:47,929 - Epoch: [25][ 1900/31148]    Overall Loss 0.010621    Objective Loss 0.000000    Distill Loss 0.010621                     LR 0.000063    Time 0.444076    
+2023-12-03 18:38:44,933 - Epoch: [25][ 2000/31148]    Overall Loss 0.010604    Objective Loss 0.000000    Distill Loss 0.010604                     LR 0.000063    Time 0.450371    
+2023-12-03 18:39:32,051 - Epoch: [25][ 2100/31148]    Overall Loss 0.010595    Objective Loss 0.000000    Distill Loss 0.010595                     LR 0.000063    Time 0.451358    
+2023-12-03 18:40:21,480 - Epoch: [25][ 2200/31148]    Overall Loss 0.010580    Objective Loss 0.000000    Distill Loss 0.010580                     LR 0.000063    Time 0.453306    
+2023-12-03 18:41:09,286 - Epoch: [25][ 2300/31148]    Overall Loss 0.010573    Objective Loss 0.000000    Distill Loss 0.010573                     LR 0.000063    Time 0.454379    
+2023-12-03 18:41:54,702 - Epoch: [25][ 2400/31148]    Overall Loss 0.010566    Objective Loss 0.000000    Distill Loss 0.010566                     LR 0.000063    Time 0.454365    
+2023-12-03 18:42:34,638 - Epoch: [25][ 2500/31148]    Overall Loss 0.010559    Objective Loss 0.000000    Distill Loss 0.010559                     LR 0.000063    Time 0.452162    
+2023-12-03 18:43:25,446 - Epoch: [25][ 2600/31148]    Overall Loss 0.010552    Objective Loss 0.000000    Distill Loss 0.010552                     LR 0.000063    Time 0.454310    
+2023-12-03 18:43:59,607 - Epoch: [25][ 2700/31148]    Overall Loss 0.010545    Objective Loss 0.000000    Distill Loss 0.010545                     LR 0.000063    Time 0.450133    
+2023-12-03 18:44:58,629 - Epoch: [25][ 2800/31148]    Overall Loss 0.010533    Objective Loss 0.000000    Distill Loss 0.010533                     LR 0.000063    Time 0.455134    
+2023-12-03 18:45:48,476 - Epoch: [25][ 2900/31148]    Overall Loss 0.010524    Objective Loss 0.000000    Distill Loss 0.010524                     LR 0.000063    Time 0.456625    
+2023-12-03 18:46:32,906 - Epoch: [25][ 3000/31148]    Overall Loss 0.010517    Objective Loss 0.000000    Distill Loss 0.010517                     LR 0.000063    Time 0.456212    
+2023-12-03 18:47:17,506 - Epoch: [25][ 3100/31148]    Overall Loss 0.010507    Objective Loss 0.000000    Distill Loss 0.010507                     LR 0.000063    Time 0.455880    
+2023-12-03 18:48:01,412 - Epoch: [25][ 3200/31148]    Overall Loss 0.010505    Objective Loss 0.000000    Distill Loss 0.010505                     LR 0.000063    Time 0.455352    
+2023-12-03 18:48:46,269 - Epoch: [25][ 3300/31148]    Overall Loss 0.010497    Objective Loss 0.000000    Distill Loss 0.010497                     LR 0.000063    Time 0.455144    
+2023-12-03 18:49:33,393 - Epoch: [25][ 3400/31148]    Overall Loss 0.010494    Objective Loss 0.000000    Distill Loss 0.010494                     LR 0.000063    Time 0.455615    
+2023-12-03 18:50:19,488 - Epoch: [25][ 3500/31148]    Overall Loss 0.010489    Objective Loss 0.000000    Distill Loss 0.010489                     LR 0.000063    Time 0.455764    
+2023-12-03 18:51:04,213 - Epoch: [25][ 3600/31148]    Overall Loss 0.010488    Objective Loss 0.000000    Distill Loss 0.010488                     LR 0.000063    Time 0.455526    
+2023-12-03 18:51:57,411 - Epoch: [25][ 3700/31148]    Overall Loss 0.010482    Objective Loss 0.000000    Distill Loss 0.010482                     LR 0.000063    Time 0.457590    
+2023-12-03 18:52:37,470 - Epoch: [25][ 3800/31148]    Overall Loss 0.010478    Objective Loss 0.000000    Distill Loss 0.010478                     LR 0.000063    Time 0.456088    
+2023-12-03 18:53:20,722 - Epoch: [25][ 3900/31148]    Overall Loss 0.010473    Objective Loss 0.000000    Distill Loss 0.010473                     LR 0.000063    Time 0.455482    
+2023-12-03 18:54:05,119 - Epoch: [25][ 4000/31148]    Overall Loss 0.010468    Objective Loss 0.000000    Distill Loss 0.010468                     LR 0.000063    Time 0.455192    
+2023-12-03 18:55:01,655 - Epoch: [25][ 4100/31148]    Overall Loss 0.010462    Objective Loss 0.000000    Distill Loss 0.010462                     LR 0.000063    Time 0.457877    
+2023-12-03 18:55:48,973 - Epoch: [25][ 4200/31148]    Overall Loss 0.010459    Objective Loss 0.000000    Distill Loss 0.010459                     LR 0.000063    Time 0.458240    
+2023-12-03 18:56:35,526 - Epoch: [25][ 4300/31148]    Overall Loss 0.010458    Objective Loss 0.000000    Distill Loss 0.010458                     LR 0.000063    Time 0.458407    
+2023-12-03 18:57:23,073 - Epoch: [25][ 4400/31148]    Overall Loss 0.010454    Objective Loss 0.000000    Distill Loss 0.010454                     LR 0.000063    Time 0.458794    
+2023-12-03 18:58:08,635 - Epoch: [25][ 4500/31148]    Overall Loss 0.010449    Objective Loss 0.000000    Distill Loss 0.010449                     LR 0.000063    Time 0.458721    
+2023-12-03 18:58:52,998 - Epoch: [25][ 4600/31148]    Overall Loss 0.010445    Objective Loss 0.000000    Distill Loss 0.010445                     LR 0.000063    Time 0.458392    
+2023-12-03 18:59:35,983 - Epoch: [25][ 4700/31148]    Overall Loss 0.010440    Objective Loss 0.000000    Distill Loss 0.010440                     LR 0.000063    Time 0.457783    
+2023-12-03 19:00:23,647 - Epoch: [25][ 4800/31148]    Overall Loss 0.010437    Objective Loss 0.000000    Distill Loss 0.010437                     LR 0.000063    Time 0.458174    
+2023-12-03 19:01:11,329 - Epoch: [25][ 4900/31148]    Overall Loss 0.010432    Objective Loss 0.000000    Distill Loss 0.010432                     LR 0.000063    Time 0.458553    
+2023-12-03 19:01:57,375 - Epoch: [25][ 5000/31148]    Overall Loss 0.010431    Objective Loss 0.000000    Distill Loss 0.010431                     LR 0.000063    Time 0.458590    
+2023-12-03 19:02:48,260 - Epoch: [25][ 5100/31148]    Overall Loss 0.010429    Objective Loss 0.000000    Distill Loss 0.010429                     LR 0.000063    Time 0.459574    
+2023-12-03 19:03:35,906 - Epoch: [25][ 5200/31148]    Overall Loss 0.010429    Objective Loss 0.000000    Distill Loss 0.010429                     LR 0.000063    Time 0.459897    
+2023-12-03 19:04:19,643 - Epoch: [25][ 5300/31148]    Overall Loss 0.010426    Objective Loss 0.000000    Distill Loss 0.010426                     LR 0.000063    Time 0.459471    
+2023-12-03 19:05:08,217 - Epoch: [25][ 5400/31148]    Overall Loss 0.010426    Objective Loss 0.000000    Distill Loss 0.010426                     LR 0.000063    Time 0.459956    
+2023-12-03 19:05:53,604 - Epoch: [25][ 5500/31148]    Overall Loss 0.010424    Objective Loss 0.000000    Distill Loss 0.010424                     LR 0.000063    Time 0.459844    
+2023-12-03 19:06:35,883 - Epoch: [25][ 5600/31148]    Overall Loss 0.010420    Objective Loss 0.000000    Distill Loss 0.010420                     LR 0.000063    Time 0.459181    
+2023-12-03 19:07:17,131 - Epoch: [25][ 5700/31148]    Overall Loss 0.010418    Objective Loss 0.000000    Distill Loss 0.010418                     LR 0.000063    Time 0.458360    
+2023-12-03 19:08:00,249 - Epoch: [25][ 5800/31148]    Overall Loss 0.010413    Objective Loss 0.000000    Distill Loss 0.010413                     LR 0.000063    Time 0.457890    
+2023-12-03 19:08:45,895 - Epoch: [25][ 5900/31148]    Overall Loss 0.010411    Objective Loss 0.000000    Distill Loss 0.010411                     LR 0.000063    Time 0.457865    
+2023-12-03 19:09:30,655 - Epoch: [25][ 6000/31148]    Overall Loss 0.010407    Objective Loss 0.000000    Distill Loss 0.010407                     LR 0.000063    Time 0.457692    
+2023-12-03 19:10:19,417 - Epoch: [25][ 6100/31148]    Overall Loss 0.010406    Objective Loss 0.000000    Distill Loss 0.010406                     LR 0.000063    Time 0.458182    
+2023-12-03 19:11:11,586 - Epoch: [25][ 6200/31148]    Overall Loss 0.010402    Objective Loss 0.000000    Distill Loss 0.010402                     LR 0.000063    Time 0.459205    
+2023-12-03 19:12:00,598 - Epoch: [25][ 6300/31148]    Overall Loss 0.010400    Objective Loss 0.000000    Distill Loss 0.010400                     LR 0.000063    Time 0.459694    
+2023-12-03 19:12:51,430 - Epoch: [25][ 6400/31148]    Overall Loss 0.010398    Objective Loss 0.000000    Distill Loss 0.010398                     LR 0.000063    Time 0.460453    
+2023-12-03 19:13:45,898 - Epoch: [25][ 6500/31148]    Overall Loss 0.010395    Objective Loss 0.000000    Distill Loss 0.010395                     LR 0.000063    Time 0.461747    
+2023-12-03 19:14:26,528 - Epoch: [25][ 6600/31148]    Overall Loss 0.010391    Objective Loss 0.000000    Distill Loss 0.010391                     LR 0.000063    Time 0.460906    
+2023-12-03 19:15:10,515 - Epoch: [25][ 6700/31148]    Overall Loss 0.010390    Objective Loss 0.000000    Distill Loss 0.010390                     LR 0.000063    Time 0.460591    
+2023-12-03 19:15:52,538 - Epoch: [25][ 6800/31148]    Overall Loss 0.010389    Objective Loss 0.000000    Distill Loss 0.010389                     LR 0.000063    Time 0.459996    
+2023-12-03 19:16:41,923 - Epoch: [25][ 6900/31148]    Overall Loss 0.010390    Objective Loss 0.000000    Distill Loss 0.010390                     LR 0.000063    Time 0.460486    
+2023-12-03 19:17:38,509 - Epoch: [25][ 7000/31148]    Overall Loss 0.010390    Objective Loss 0.000000    Distill Loss 0.010390                     LR 0.000063    Time 0.461990    
+2023-12-03 19:18:28,359 - Epoch: [25][ 7100/31148]    Overall Loss 0.010389    Objective Loss 0.000000    Distill Loss 0.010389                     LR 0.000063    Time 0.462504    
+2023-12-03 19:19:15,058 - Epoch: [25][ 7200/31148]    Overall Loss 0.010388    Objective Loss 0.000000    Distill Loss 0.010388                     LR 0.000063    Time 0.462565    
+2023-12-03 19:20:04,997 - Epoch: [25][ 7300/31148]    Overall Loss 0.010387    Objective Loss 0.000000    Distill Loss 0.010387                     LR 0.000063    Time 0.463068    
+2023-12-03 19:20:53,133 - Epoch: [25][ 7400/31148]    Overall Loss 0.010386    Objective Loss 0.000000    Distill Loss 0.010386                     LR 0.000063    Time 0.463314    
+2023-12-03 19:21:32,339 - Epoch: [25][ 7500/31148]    Overall Loss 0.010384    Objective Loss 0.000000    Distill Loss 0.010384                     LR 0.000063    Time 0.462363    
+2023-12-03 19:22:22,101 - Epoch: [25][ 7600/31148]    Overall Loss 0.010383    Objective Loss 0.000000    Distill Loss 0.010383                     LR 0.000063    Time 0.462826    
+2023-12-03 19:23:07,083 - Epoch: [25][ 7700/31148]    Overall Loss 0.010381    Objective Loss 0.000000    Distill Loss 0.010381                     LR 0.000063    Time 0.462656    
+2023-12-03 19:24:06,206 - Epoch: [25][ 7800/31148]    Overall Loss 0.010378    Objective Loss 0.000000    Distill Loss 0.010378                     LR 0.000063    Time 0.464304    
+2023-12-03 19:24:47,427 - Epoch: [25][ 7900/31148]    Overall Loss 0.010376    Objective Loss 0.000000    Distill Loss 0.010376                     LR 0.000063    Time 0.463643    
+2023-12-03 19:25:31,306 - Epoch: [25][ 8000/31148]    Overall Loss 0.010375    Objective Loss 0.000000    Distill Loss 0.010375                     LR 0.000063    Time 0.463332    
+2023-12-03 19:26:19,194 - Epoch: [25][ 8100/31148]    Overall Loss 0.010374    Objective Loss 0.000000    Distill Loss 0.010374                     LR 0.000063    Time 0.463523    
+2023-12-03 19:27:07,669 - Epoch: [25][ 8200/31148]    Overall Loss 0.010372    Objective Loss 0.000000    Distill Loss 0.010372                     LR 0.000063    Time 0.463781    
+2023-12-03 19:27:51,224 - Epoch: [25][ 8300/31148]    Overall Loss 0.010372    Objective Loss 0.000000    Distill Loss 0.010372                     LR 0.000063    Time 0.463440    
+2023-12-03 19:28:36,695 - Epoch: [25][ 8400/31148]    Overall Loss 0.010372    Objective Loss 0.000000    Distill Loss 0.010372                     LR 0.000063    Time 0.463335    
+2023-12-03 19:29:21,776 - Epoch: [25][ 8500/31148]    Overall Loss 0.010372    Objective Loss 0.000000    Distill Loss 0.010372                     LR 0.000063    Time 0.463187    
+2023-12-03 19:30:14,818 - Epoch: [25][ 8600/31148]    Overall Loss 0.010372    Objective Loss 0.000000    Distill Loss 0.010372                     LR 0.000063    Time 0.463967    
+2023-12-03 19:30:54,981 - Epoch: [25][ 8700/31148]    Overall Loss 0.010373    Objective Loss 0.000000    Distill Loss 0.010373                     LR 0.000063    Time 0.463249    
+2023-12-03 19:31:33,664 - Epoch: [25][ 8800/31148]    Overall Loss 0.010372    Objective Loss 0.000000    Distill Loss 0.010372                     LR 0.000063    Time 0.462380    
+2023-12-03 19:32:21,092 - Epoch: [25][ 8900/31148]    Overall Loss 0.010370    Objective Loss 0.000000    Distill Loss 0.010370                     LR 0.000063    Time 0.462513    
+2023-12-03 19:33:10,492 - Epoch: [25][ 9000/31148]    Overall Loss 0.010370    Objective Loss 0.000000    Distill Loss 0.010370                     LR 0.000063    Time 0.462862    
+2023-12-03 19:34:04,552 - Epoch: [25][ 9100/31148]    Overall Loss 0.010369    Objective Loss 0.000000    Distill Loss 0.010369                     LR 0.000063    Time 0.463715    
+2023-12-03 19:34:50,222 - Epoch: [25][ 9200/31148]    Overall Loss 0.010368    Objective Loss 0.000000    Distill Loss 0.010368                     LR 0.000063    Time 0.463638    
+2023-12-03 19:35:37,567 - Epoch: [25][ 9300/31148]    Overall Loss 0.010368    Objective Loss 0.000000    Distill Loss 0.010368                     LR 0.000063    Time 0.463743    
+2023-12-03 19:36:25,100 - Epoch: [25][ 9400/31148]    Overall Loss 0.010369    Objective Loss 0.000000    Distill Loss 0.010369                     LR 0.000063    Time 0.463865    
+2023-12-03 19:37:15,402 - Epoch: [25][ 9500/31148]    Overall Loss 0.010367    Objective Loss 0.000000    Distill Loss 0.010367                     LR 0.000063    Time 0.464277    
+2023-12-03 19:38:00,511 - Epoch: [25][ 9600/31148]    Overall Loss 0.010368    Objective Loss 0.000000    Distill Loss 0.010368                     LR 0.000063    Time 0.464138    
+2023-12-03 19:38:44,032 - Epoch: [25][ 9700/31148]    Overall Loss 0.010368    Objective Loss 0.000000    Distill Loss 0.010368                     LR 0.000063    Time 0.463839    
+2023-12-03 19:39:26,438 - Epoch: [25][ 9800/31148]    Overall Loss 0.010368    Objective Loss 0.000000    Distill Loss 0.010368                     LR 0.000063    Time 0.463433    
+2023-12-03 19:40:10,396 - Epoch: [25][ 9900/31148]    Overall Loss 0.010367    Objective Loss 0.000000    Distill Loss 0.010367                     LR 0.000063    Time 0.463191    
+2023-12-03 19:40:47,422 - Epoch: [25][10000/31148]    Overall Loss 0.010366    Objective Loss 0.000000    Distill Loss 0.010366                     LR 0.000063    Time 0.462261    
+2023-12-03 19:41:26,853 - Epoch: [25][10100/31148]    Overall Loss 0.010364    Objective Loss 0.000000    Distill Loss 0.010364                     LR 0.000063    Time 0.461588    
+2023-12-03 19:42:22,362 - Epoch: [25][10200/31148]    Overall Loss 0.010363    Objective Loss 0.000000    Distill Loss 0.010363                     LR 0.000063    Time 0.462504    
+2023-12-03 19:43:08,072 - Epoch: [25][10300/31148]    Overall Loss 0.010364    Objective Loss 0.000000    Distill Loss 0.010364                     LR 0.000063    Time 0.462451    
+2023-12-03 19:43:50,284 - Epoch: [25][10400/31148]    Overall Loss 0.010363    Objective Loss 0.000000    Distill Loss 0.010363                     LR 0.000063    Time 0.462062    
+2023-12-03 19:44:35,701 - Epoch: [25][10500/31148]    Overall Loss 0.010363    Objective Loss 0.000000    Distill Loss 0.010363                     LR 0.000063    Time 0.461986    
+2023-12-03 19:45:31,593 - Epoch: [25][10600/31148]    Overall Loss 0.010364    Objective Loss 0.000000    Distill Loss 0.010364                     LR 0.000063    Time 0.462900    
+2023-12-03 19:46:23,003 - Epoch: [25][10700/31148]    Overall Loss 0.010362    Objective Loss 0.000000    Distill Loss 0.010362                     LR 0.000063    Time 0.463378    
+2023-12-03 19:47:08,622 - Epoch: [25][10800/31148]    Overall Loss 0.010363    Objective Loss 0.000000    Distill Loss 0.010363                     LR 0.000063    Time 0.463310    
+2023-12-03 19:47:55,398 - Epoch: [25][10900/31148]    Overall Loss 0.010363    Objective Loss 0.000000    Distill Loss 0.010363                     LR 0.000063    Time 0.463350    
+2023-12-03 19:48:52,045 - Epoch: [25][11000/31148]    Overall Loss 0.010362    Objective Loss 0.000000    Distill Loss 0.010362                     LR 0.000063    Time 0.464287    
+2023-12-03 19:49:31,572 - Epoch: [25][11100/31148]    Overall Loss 0.010362    Objective Loss 0.000000    Distill Loss 0.010362                     LR 0.000063    Time 0.463665    
+2023-12-03 19:50:17,786 - Epoch: [25][11200/31148]    Overall Loss 0.010361    Objective Loss 0.000000    Distill Loss 0.010361                     LR 0.000063    Time 0.463650    
+2023-12-03 19:51:04,206 - Epoch: [25][11300/31148]    Overall Loss 0.010360    Objective Loss 0.000000    Distill Loss 0.010360                     LR 0.000063    Time 0.463655    
+2023-12-03 19:51:44,307 - Epoch: [25][11400/31148]    Overall Loss 0.010359    Objective Loss 0.000000    Distill Loss 0.010359                     LR 0.000063    Time 0.463104    
+2023-12-03 19:52:27,155 - Epoch: [25][11500/31148]    Overall Loss 0.010359    Objective Loss 0.000000    Distill Loss 0.010359                     LR 0.000063    Time 0.462803    
+2023-12-03 19:53:07,589 - Epoch: [25][11600/31148]    Overall Loss 0.010358    Objective Loss 0.000000    Distill Loss 0.010358                     LR 0.000063    Time 0.462298    
+2023-12-03 19:53:53,880 - Epoch: [25][11700/31148]    Overall Loss 0.010357    Objective Loss 0.000000    Distill Loss 0.010357                     LR 0.000063    Time 0.462303    
+2023-12-03 19:54:39,770 - Epoch: [25][11800/31148]    Overall Loss 0.010358    Objective Loss 0.000000    Distill Loss 0.010358                     LR 0.000063    Time 0.462273    
+2023-12-03 19:55:24,460 - Epoch: [25][11900/31148]    Overall Loss 0.010357    Objective Loss 0.000000    Distill Loss 0.010357                     LR 0.000063    Time 0.462143    
+2023-12-03 19:56:07,668 - Epoch: [25][12000/31148]    Overall Loss 0.010357    Objective Loss 0.000000    Distill Loss 0.010357                     LR 0.000063    Time 0.461892    
+2023-12-03 19:57:03,353 - Epoch: [25][12100/31148]    Overall Loss 0.010357    Objective Loss 0.000000    Distill Loss 0.010357                     LR 0.000063    Time 0.462676    
+2023-12-03 19:57:48,437 - Epoch: [25][12200/31148]    Overall Loss 0.010356    Objective Loss 0.000000    Distill Loss 0.010356                     LR 0.000063    Time 0.462579    
+2023-12-03 19:58:37,581 - Epoch: [25][12300/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.462813    
+2023-12-03 19:59:19,900 - Epoch: [25][12400/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.462493    
+2023-12-03 20:00:02,585 - Epoch: [25][12500/31148]    Overall Loss 0.010356    Objective Loss 0.000000    Distill Loss 0.010356                     LR 0.000063    Time 0.462207    
+2023-12-03 20:00:36,231 - Epoch: [25][12600/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.461208    
+2023-12-03 20:01:14,979 - Epoch: [25][12700/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460627    
+2023-12-03 20:02:00,118 - Epoch: [25][12800/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460555    
+2023-12-03 20:02:39,822 - Epoch: [25][12900/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460062    
+2023-12-03 20:03:34,369 - Epoch: [25][13000/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460718    
+2023-12-03 20:04:28,830 - Epoch: [25][13100/31148]    Overall Loss 0.010356    Objective Loss 0.000000    Distill Loss 0.010356                     LR 0.000063    Time 0.461358    
+2023-12-03 20:05:16,493 - Epoch: [25][13200/31148]    Overall Loss 0.010356    Objective Loss 0.000000    Distill Loss 0.010356                     LR 0.000063    Time 0.461473    
+2023-12-03 20:05:50,526 - Epoch: [25][13300/31148]    Overall Loss 0.010356    Objective Loss 0.000000    Distill Loss 0.010356                     LR 0.000063    Time 0.460562    
+2023-12-03 20:06:40,660 - Epoch: [25][13400/31148]    Overall Loss 0.010356    Objective Loss 0.000000    Distill Loss 0.010356                     LR 0.000063    Time 0.460865    
+2023-12-03 20:07:19,880 - Epoch: [25][13500/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460356    
+2023-12-03 20:08:04,182 - Epoch: [25][13600/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460228    
+2023-12-03 20:08:53,007 - Epoch: [25][13700/31148]    Overall Loss 0.010355    Objective Loss 0.000000    Distill Loss 0.010355                     LR 0.000063    Time 0.460432    
+2023-12-03 20:09:31,375 - Epoch: [25][13800/31148]    Overall Loss 0.010354    Objective Loss 0.000000    Distill Loss 0.010354                     LR 0.000063    Time 0.459875    
+2023-12-03 20:10:20,742 - Epoch: [25][13900/31148]    Overall Loss 0.010353    Objective Loss 0.000000    Distill Loss 0.010353                     LR 0.000063    Time 0.460118    
+2023-12-03 20:11:09,962 - Epoch: [25][14000/31148]    Overall Loss 0.010353    Objective Loss 0.000000    Distill Loss 0.010353                     LR 0.000063    Time 0.460347    
+2023-12-03 20:11:55,215 - Epoch: [25][14100/31148]    Overall Loss 0.010354    Objective Loss 0.000000    Distill Loss 0.010354                     LR 0.000063    Time 0.460291    
+2023-12-03 20:12:47,298 - Epoch: [25][14200/31148]    Overall Loss 0.010353    Objective Loss 0.000000    Distill Loss 0.010353                     LR 0.000063    Time 0.460717    
+2023-12-03 20:13:33,751 - Epoch: [25][14300/31148]    Overall Loss 0.010352    Objective Loss 0.000000    Distill Loss 0.010352                     LR 0.000063    Time 0.460743    
+2023-12-03 20:14:12,360 - Epoch: [25][14400/31148]    Overall Loss 0.010351    Objective Loss 0.000000    Distill Loss 0.010351                     LR 0.000063    Time 0.460224    
+2023-12-03 20:14:59,109 - Epoch: [25][14500/31148]    Overall Loss 0.010351    Objective Loss 0.000000    Distill Loss 0.010351                     LR 0.000063    Time 0.460274    
+2023-12-03 20:15:39,343 - Epoch: [25][14600/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.459876    
+2023-12-03 20:16:25,832 - Epoch: [25][14700/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.459910    
+2023-12-03 20:17:19,090 - Epoch: [25][14800/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.460400    
+2023-12-03 20:17:58,518 - Epoch: [25][14900/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.459956    
+2023-12-03 20:18:33,450 - Epoch: [25][15000/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.459218    
+2023-12-03 20:19:13,984 - Epoch: [25][15100/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.458861    
+2023-12-03 20:20:09,063 - Epoch: [25][15200/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.459465    
+2023-12-03 20:20:52,829 - Epoch: [25][15300/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.459322    
+2023-12-03 20:21:45,983 - Epoch: [25][15400/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.459791    
+2023-12-03 20:22:38,970 - Epoch: [25][15500/31148]    Overall Loss 0.010350    Objective Loss 0.000000    Distill Loss 0.010350                     LR 0.000063    Time 0.460242    
+2023-12-03 20:23:22,021 - Epoch: [25][15600/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.460051    
+2023-12-03 20:24:07,115 - Epoch: [25][15700/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.459993    
+2023-12-03 20:24:48,057 - Epoch: [25][15800/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.459672    
+2023-12-03 20:25:23,854 - Epoch: [25][15900/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.459032    
+2023-12-03 20:26:03,335 - Epoch: [25][16000/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458630    
+2023-12-03 20:26:54,992 - Epoch: [25][16100/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458990    
+2023-12-03 20:27:39,904 - Epoch: [25][16200/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458928    
+2023-12-03 20:28:19,065 - Epoch: [25][16300/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458515    
+2023-12-03 20:29:09,989 - Epoch: [25][16400/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458824    
+2023-12-03 20:29:48,572 - Epoch: [25][16500/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458381    
+2023-12-03 20:30:40,971 - Epoch: [25][16600/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458776    
+2023-12-03 20:31:25,923 - Epoch: [25][16700/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458720    
+2023-12-03 20:32:03,275 - Epoch: [25][16800/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458212    
+2023-12-03 20:32:57,138 - Epoch: [25][16900/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458688    
+2023-12-03 20:33:44,300 - Epoch: [25][17000/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458763    
+2023-12-03 20:34:30,910 - Epoch: [25][17100/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458806    
+2023-12-03 20:35:14,106 - Epoch: [25][17200/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458649    
+2023-12-03 20:36:05,357 - Epoch: [25][17300/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458960    
+2023-12-03 20:36:45,437 - Epoch: [25][17400/31148]    Overall Loss 0.010349    Objective Loss 0.000000    Distill Loss 0.010349                     LR 0.000063    Time 0.458625    
+2023-12-03 20:37:28,994 - Epoch: [25][17500/31148]    Overall Loss 0.010348    Objective Loss 0.000000    Distill Loss 0.010348                     LR 0.000063    Time 0.458493    
+2023-12-03 20:38:22,079 - Epoch: [25][17600/31148]    Overall Loss 0.010347    Objective Loss 0.000000    Distill Loss 0.010347                     LR 0.000063    Time 0.458904    
+2023-12-03 20:39:06,131 - Epoch: [25][17700/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458800    
+2023-12-03 20:39:55,238 - Epoch: [25][17800/31148]    Overall Loss 0.010347    Objective Loss 0.000000    Distill Loss 0.010347                     LR 0.000063    Time 0.458981    
+2023-12-03 20:40:45,948 - Epoch: [25][17900/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.459249    
+2023-12-03 20:41:38,913 - Epoch: [25][18000/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.459640    
+2023-12-03 20:42:17,281 - Epoch: [25][18100/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.459220    
+2023-12-03 20:42:56,598 - Epoch: [25][18200/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458856    
+2023-12-03 20:43:40,991 - Epoch: [25][18300/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458774    
+2023-12-03 20:44:22,431 - Epoch: [25][18400/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458533    
+2023-12-03 20:45:04,216 - Epoch: [25][18500/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458313    
+2023-12-03 20:45:46,431 - Epoch: [25][18600/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458118    
+2023-12-03 20:46:35,632 - Epoch: [25][18700/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458299    
+2023-12-03 20:47:22,351 - Epoch: [25][18800/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458346    
+2023-12-03 20:48:02,013 - Epoch: [25][18900/31148]    Overall Loss 0.010346    Objective Loss 0.000000    Distill Loss 0.010346                     LR 0.000063    Time 0.458019    
+2023-12-03 20:48:39,137 - Epoch: [25][19000/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.457561    
+2023-12-03 20:49:20,982 - Epoch: [25][19100/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.457356    
+2023-12-03 20:50:10,313 - Epoch: [25][19200/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.457543    
+2023-12-03 20:50:53,834 - Epoch: [25][19300/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.457427    
+2023-12-03 20:51:34,971 - Epoch: [25][19400/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.457189    
+2023-12-03 20:52:18,582 - Epoch: [25][19500/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.457081    
+2023-12-03 20:53:00,926 - Epoch: [25][19600/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.456909    
+2023-12-03 20:53:46,752 - Epoch: [25][19700/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.456915    
+2023-12-03 20:54:32,481 - Epoch: [25][19800/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.456916    
+2023-12-03 20:55:18,135 - Epoch: [25][19900/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.456914    
+2023-12-03 20:56:04,613 - Epoch: [25][20000/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.456953    
+2023-12-03 20:56:41,433 - Epoch: [25][20100/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.456511    
+2023-12-03 20:57:33,636 - Epoch: [25][20200/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.456835    
+2023-12-03 20:58:17,708 - Epoch: [25][20300/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.456755    
+2023-12-03 20:59:02,155 - Epoch: [25][20400/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.456695    
+2023-12-03 20:59:53,377 - Epoch: [25][20500/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456965    
+2023-12-03 21:00:42,902 - Epoch: [25][20600/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.457151    
+2023-12-03 21:01:31,649 - Epoch: [25][20700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.457297    
+2023-12-03 21:02:19,637 - Epoch: [25][20800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.457405    
+2023-12-03 21:03:01,369 - Epoch: [25][20900/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.457213    
+2023-12-03 21:03:46,952 - Epoch: [25][21000/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.457206    
+2023-12-03 21:04:28,586 - Epoch: [25][21100/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.457012    
+2023-12-03 21:05:07,539 - Epoch: [25][21200/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456693    
+2023-12-03 21:05:52,104 - Epoch: [25][21300/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456641    
+2023-12-03 21:06:35,396 - Epoch: [25][21400/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456530    
+2023-12-03 21:07:16,334 - Epoch: [25][21500/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456310    
+2023-12-03 21:08:07,601 - Epoch: [25][21600/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456571    
+2023-12-03 21:08:49,297 - Epoch: [25][21700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456388    
+2023-12-03 21:09:31,929 - Epoch: [25][21800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456250    
+2023-12-03 21:10:19,124 - Epoch: [25][21900/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456321    
+2023-12-03 21:11:02,529 - Epoch: [25][22000/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456220    
+2023-12-03 21:11:42,318 - Epoch: [25][22100/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455955    
+2023-12-03 21:12:28,185 - Epoch: [25][22200/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455967    
+2023-12-03 21:13:17,736 - Epoch: [25][22300/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456144    
+2023-12-03 21:13:59,423 - Epoch: [25][22400/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455969    
+2023-12-03 21:14:44,486 - Epoch: [25][22500/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455945    
+2023-12-03 21:15:32,568 - Epoch: [25][22600/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456054    
+2023-12-03 21:16:13,141 - Epoch: [25][22700/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455832    
+2023-12-03 21:16:53,492 - Epoch: [25][22800/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455603    
+2023-12-03 21:17:37,981 - Epoch: [25][22900/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455555    
+2023-12-03 21:18:17,998 - Epoch: [25][23000/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455314    
+2023-12-03 21:19:12,466 - Epoch: [25][23100/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455701    
+2023-12-03 21:20:04,232 - Epoch: [25][23200/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455968    
+2023-12-03 21:20:44,841 - Epoch: [25][23300/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455753    
+2023-12-03 21:21:33,722 - Epoch: [25][23400/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455894    
+2023-12-03 21:22:13,488 - Epoch: [25][23500/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455646    
+2023-12-03 21:22:59,505 - Epoch: [25][23600/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455665    
+2023-12-03 21:23:40,948 - Epoch: [25][23700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455491    
+2023-12-03 21:24:19,013 - Epoch: [25][23800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455176    
+2023-12-03 21:25:06,202 - Epoch: [25][23900/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455246    
+2023-12-03 21:26:01,451 - Epoch: [25][24000/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455650    
+2023-12-03 21:26:50,458 - Epoch: [25][24100/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455793    
+2023-12-03 21:27:35,401 - Epoch: [25][24200/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455766    
+2023-12-03 21:28:14,617 - Epoch: [25][24300/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455504    
+2023-12-03 21:29:04,625 - Epoch: [25][24400/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455687    
+2023-12-03 21:29:56,444 - Epoch: [25][24500/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455942    
+2023-12-03 21:30:44,615 - Epoch: [25][24600/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456046    
+2023-12-03 21:31:28,259 - Epoch: [25][24700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.455966    
+2023-12-03 21:32:19,414 - Epoch: [25][24800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456190    
+2023-12-03 21:33:00,531 - Epoch: [25][24900/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.456009    
+2023-12-03 21:33:46,362 - Epoch: [25][25000/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456018    
+2023-12-03 21:34:35,874 - Epoch: [25][25100/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.000063    Time 0.456173    
+2023-12-03 21:35:20,965 - Epoch: [25][25200/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.000063    Time 0.456152    
+2023-12-03 21:36:05,476 - Epoch: [25][25300/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.456108    
+2023-12-03 21:36:46,769 - Epoch: [25][25400/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.000063    Time 0.455938    
+2023-12-03 21:37:32,702 - Epoch: [25][25500/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.000063    Time 0.455951    
+2023-12-03 21:38:20,417 - Epoch: [25][25600/31148]    Overall Loss 0.010341    Objective Loss 0.000000    Distill Loss 0.010341                     LR 0.000063    Time 0.456034    
+2023-12-03 21:39:02,350 - Epoch: [25][25700/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455891    
+2023-12-03 21:39:44,437 - Epoch: [25][25800/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455755    
+2023-12-03 21:40:28,865 - Epoch: [25][25900/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455710    
+2023-12-03 21:41:11,960 - Epoch: [25][26000/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455614    
+2023-12-03 21:41:52,163 - Epoch: [25][26100/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.455409    
+2023-12-03 21:42:21,776 - Epoch: [25][26200/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.454801    
+2023-12-03 21:42:49,775 - Epoch: [25][26300/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.454136    
+2023-12-03 21:43:17,654 - Epoch: [25][26400/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.453472    
+2023-12-03 21:43:46,576 - Epoch: [25][26500/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.452852    
+2023-12-03 21:44:14,702 - Epoch: [25][26600/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.452206    
+2023-12-03 21:44:42,711 - Epoch: [25][26700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.451562    
+2023-12-03 21:45:10,918 - Epoch: [25][26800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.450929    
+2023-12-03 21:45:38,934 - Epoch: [25][26900/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.450294    
+2023-12-03 21:46:06,836 - Epoch: [25][27000/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449660    
+2023-12-03 21:46:34,738 - Epoch: [25][27100/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449030    
+2023-12-03 21:47:02,515 - Epoch: [25][27200/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.448400    
+2023-12-03 21:47:39,807 - Epoch: [25][27300/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.448123    
+2023-12-03 21:48:31,495 - Epoch: [25][27400/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.448374    
+2023-12-03 21:49:22,420 - Epoch: [25][27500/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.448595    
+2023-12-03 21:50:12,924 - Epoch: [25][27600/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.448799    
+2023-12-03 21:51:05,396 - Epoch: [25][27700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449073    
+2023-12-03 21:52:08,281 - Epoch: [25][27800/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449720    
+2023-12-03 21:52:50,742 - Epoch: [25][27900/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449629    
+2023-12-03 21:53:35,425 - Epoch: [25][28000/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449619    
+2023-12-03 21:54:16,046 - Epoch: [25][28100/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449464    
+2023-12-03 21:55:00,053 - Epoch: [25][28200/31148]    Overall Loss 0.010342    Objective Loss 0.000000    Distill Loss 0.010342                     LR 0.000063    Time 0.449431    
+2023-12-03 21:55:39,408 - Epoch: [25][28300/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449233    
+2023-12-03 21:56:31,475 - Epoch: [25][28400/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449484    
+2023-12-03 21:57:16,574 - Epoch: [25][28500/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.449489    
+2023-12-03 21:58:00,837 - Epoch: [25][28600/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449465    
+2023-12-03 21:58:36,842 - Epoch: [25][28700/31148]    Overall Loss 0.010343    Objective Loss 0.000000    Distill Loss 0.010343                     LR 0.000063    Time 0.449153    
+2023-12-03 21:59:29,249 - Epoch: [25][28800/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.449413    
+2023-12-03 22:00:26,506 - Epoch: [25][28900/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.449839    
+2023-12-03 22:01:19,534 - Epoch: [25][29000/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450116    
+2023-12-03 22:02:07,099 - Epoch: [25][29100/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450204    
+2023-12-03 22:02:49,641 - Epoch: [25][29200/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450119    
+2023-12-03 22:03:40,876 - Epoch: [25][29300/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450331    
+2023-12-03 22:04:21,211 - Epoch: [25][29400/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450171    
+2023-12-03 22:05:15,675 - Epoch: [25][29500/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450491    
+2023-12-03 22:05:59,160 - Epoch: [25][29600/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450438    
+2023-12-03 22:06:44,490 - Epoch: [25][29700/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450447    
+2023-12-03 22:07:26,689 - Epoch: [25][29800/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.450351    
+2023-12-03 22:08:16,849 - Epoch: [25][29900/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.450522    
+2023-12-03 22:09:10,127 - Epoch: [25][30000/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.450796    
+2023-12-03 22:10:03,286 - Epoch: [25][30100/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.451065    
+2023-12-03 22:10:46,654 - Epoch: [25][30200/31148]    Overall Loss 0.010345    Objective Loss 0.000000    Distill Loss 0.010345                     LR 0.000063    Time 0.451007    
+2023-12-03 22:11:35,309 - Epoch: [25][30300/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451124    
+2023-12-03 22:12:28,489 - Epoch: [25][30400/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451389    
+2023-12-03 22:13:16,961 - Epoch: [25][30500/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451498    
+2023-12-03 22:14:08,002 - Epoch: [25][30600/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451690    
+2023-12-03 22:14:57,131 - Epoch: [25][30700/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451819    
+2023-12-03 22:15:43,925 - Epoch: [25][30800/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451871    
+2023-12-03 22:16:34,315 - Epoch: [25][30900/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.452039    
+2023-12-03 22:17:18,961 - Epoch: [25][31000/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.452021    
+2023-12-03 22:18:00,538 - Epoch: [25][31100/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.451904    
+2023-12-03 22:18:29,763 - Epoch: [25][31148/31148]    Overall Loss 0.010344    Objective Loss 0.000000    Distill Loss 0.010344                     LR 0.000063    Time 0.452146    
+2023-12-03 22:18:30,887 - --- validate (epoch=25)-----------
+2023-12-03 22:18:30,887 - 167951 samples (100 per mini-batch)
+2023-12-03 22:18:58,075 - Epoch: [25][  100/ 1680]    Loss 0.000000    Overall Loss 0.010970    
+2023-12-03 22:19:22,111 - Epoch: [25][  200/ 1680]    Loss 0.000000    Overall Loss 0.011016    
+2023-12-03 22:19:46,329 - Epoch: [25][  300/ 1680]    Loss 0.000000    Overall Loss 0.011009    
+2023-12-03 22:20:09,684 - Epoch: [25][  400/ 1680]    Loss 0.000000    Overall Loss 0.011019    
+2023-12-03 22:20:32,448 - Epoch: [25][  500/ 1680]    Loss 0.000000    Overall Loss 0.011011    
+2023-12-03 22:20:55,441 - Epoch: [25][  600/ 1680]    Loss 0.000000    Overall Loss 0.011021    
+2023-12-03 22:21:19,458 - Epoch: [25][  700/ 1680]    Loss 0.000000    Overall Loss 0.011009    
+2023-12-03 22:21:42,872 - Epoch: [25][  800/ 1680]    Loss 0.000000    Overall Loss 0.011014    
+2023-12-03 22:22:05,755 - Epoch: [25][  900/ 1680]    Loss 0.000000    Overall Loss 0.011011    
+2023-12-03 22:22:29,355 - Epoch: [25][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.011013    
+2023-12-03 22:22:53,475 - Epoch: [25][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.011015    
+2023-12-03 22:23:16,844 - Epoch: [25][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.011017    
+2023-12-03 22:23:40,976 - Epoch: [25][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.011017    
+2023-12-03 22:24:05,349 - Epoch: [25][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.011014    
+2023-12-03 22:24:29,307 - Epoch: [25][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.011012    
+2023-12-03 22:24:52,308 - Epoch: [25][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.011014    
+2023-12-03 22:25:11,054 - Epoch: [25][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.011013    
+2023-12-03 22:25:11,571 - ==> Overall Loss: 0.011
+
+2023-12-03 22:25:11,580 - ==> Best [Overall Loss: 0.011013 on epoch: 25]
+2023-12-03 22:25:11,580 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-03 22:25:11,645 - 
+
+2023-12-03 22:25:11,645 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-03 22:26:04,139 - Epoch: [26][  100/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.000031    Time 0.524836    
+2023-12-03 22:26:52,868 - Epoch: [26][  200/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.000031    Time 0.506026    
+2023-12-03 22:27:37,232 - Epoch: [26][  300/31148]    Overall Loss 0.010004    Objective Loss 0.000000    Distill Loss 0.010004                     LR 0.000031    Time 0.485208    
+2023-12-03 22:28:25,373 - Epoch: [26][  400/31148]    Overall Loss 0.009981    Objective Loss 0.000000    Distill Loss 0.009981                     LR 0.000031    Time 0.484238    
+2023-12-03 22:29:08,925 - Epoch: [26][  500/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.000031    Time 0.474480    
+2023-12-03 22:29:58,154 - Epoch: [26][  600/31148]    Overall Loss 0.009977    Objective Loss 0.000000    Distill Loss 0.009977                     LR 0.000031    Time 0.477436    
+2023-12-03 22:30:52,342 - Epoch: [26][  700/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.000031    Time 0.486631    
+2023-12-03 22:31:34,579 - Epoch: [26][  800/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.000031    Time 0.478588    
+2023-12-03 22:32:25,026 - Epoch: [26][  900/31148]    Overall Loss 0.009992    Objective Loss 0.000000    Distill Loss 0.009992                     LR 0.000031    Time 0.481456    
+2023-12-03 22:33:01,480 - Epoch: [26][ 1000/31148]    Overall Loss 0.009988    Objective Loss 0.000000    Distill Loss 0.009988                     LR 0.000031    Time 0.469756    
+2023-12-03 22:33:53,678 - Epoch: [26][ 1100/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.000031    Time 0.474498    
+2023-12-03 22:34:52,643 - Epoch: [26][ 1200/31148]    Overall Loss 0.009996    Objective Loss 0.000000    Distill Loss 0.009996                     LR 0.000031    Time 0.484086    
+2023-12-03 22:35:32,380 - Epoch: [26][ 1300/31148]    Overall Loss 0.009995    Objective Loss 0.000000    Distill Loss 0.009995                     LR 0.000031    Time 0.477410    
+2023-12-03 22:36:16,445 - Epoch: [26][ 1400/31148]    Overall Loss 0.009997    Objective Loss 0.000000    Distill Loss 0.009997                     LR 0.000031    Time 0.474779    
+2023-12-03 22:37:00,940 - Epoch: [26][ 1500/31148]    Overall Loss 0.009998    Objective Loss 0.000000    Distill Loss 0.009998                     LR 0.000031    Time 0.472786    
+2023-12-03 22:37:39,746 - Epoch: [26][ 1600/31148]    Overall Loss 0.010002    Objective Loss 0.000000    Distill Loss 0.010002                     LR 0.000031    Time 0.467486    
+2023-12-03 22:38:25,372 - Epoch: [26][ 1700/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.000031    Time 0.466821    
+2023-12-03 22:39:08,129 - Epoch: [26][ 1800/31148]    Overall Loss 0.010002    Objective Loss 0.000000    Distill Loss 0.010002                     LR 0.000031    Time 0.464637    
+2023-12-03 22:39:46,239 - Epoch: [26][ 1900/31148]    Overall Loss 0.010003    Objective Loss 0.000000    Distill Loss 0.010003                     LR 0.000031    Time 0.460236    
+2023-12-03 22:40:24,063 - Epoch: [26][ 2000/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.000031    Time 0.456132    
+2023-12-03 22:41:10,442 - Epoch: [26][ 2100/31148]    Overall Loss 0.010001    Objective Loss 0.000000    Distill Loss 0.010001                     LR 0.000031    Time 0.456493    
+2023-12-03 22:41:57,307 - Epoch: [26][ 2200/31148]    Overall Loss 0.010006    Objective Loss 0.000000    Distill Loss 0.010006                     LR 0.000031    Time 0.457042    
+2023-12-03 22:42:44,066 - Epoch: [26][ 2300/31148]    Overall Loss 0.010014    Objective Loss 0.000000    Distill Loss 0.010014                     LR 0.000031    Time 0.457497    
+2023-12-03 22:43:25,933 - Epoch: [26][ 2400/31148]    Overall Loss 0.010021    Objective Loss 0.000000    Distill Loss 0.010021                     LR 0.000031    Time 0.455876    
+2023-12-03 22:44:05,808 - Epoch: [26][ 2500/31148]    Overall Loss 0.010021    Objective Loss 0.000000    Distill Loss 0.010021                     LR 0.000031    Time 0.453589    
+2023-12-03 22:44:50,306 - Epoch: [26][ 2600/31148]    Overall Loss 0.010025    Objective Loss 0.000000    Distill Loss 0.010025                     LR 0.000031    Time 0.453254    
+2023-12-03 22:45:40,186 - Epoch: [26][ 2700/31148]    Overall Loss 0.010028    Objective Loss 0.000000    Distill Loss 0.010028                     LR 0.000031    Time 0.454939    
+2023-12-03 22:46:33,985 - Epoch: [26][ 2800/31148]    Overall Loss 0.010028    Objective Loss 0.000000    Distill Loss 0.010028                     LR 0.000031    Time 0.457902    
+2023-12-03 22:47:18,766 - Epoch: [26][ 2900/31148]    Overall Loss 0.010027    Objective Loss 0.000000    Distill Loss 0.010027                     LR 0.000031    Time 0.457551    
+2023-12-03 22:48:02,273 - Epoch: [26][ 3000/31148]    Overall Loss 0.010026    Objective Loss 0.000000    Distill Loss 0.010026                     LR 0.000031    Time 0.456799    
+2023-12-03 22:48:53,280 - Epoch: [26][ 3100/31148]    Overall Loss 0.010025    Objective Loss 0.000000    Distill Loss 0.010025                     LR 0.000031    Time 0.458515    
+2023-12-03 22:49:36,613 - Epoch: [26][ 3200/31148]    Overall Loss 0.010030    Objective Loss 0.000000    Distill Loss 0.010030                     LR 0.000031    Time 0.457726    
+2023-12-03 22:50:22,870 - Epoch: [26][ 3300/31148]    Overall Loss 0.010031    Objective Loss 0.000000    Distill Loss 0.010031                     LR 0.000031    Time 0.457870    
+2023-12-03 22:51:11,078 - Epoch: [26][ 3400/31148]    Overall Loss 0.010030    Objective Loss 0.000000    Distill Loss 0.010030                     LR 0.000031    Time 0.458580    
+2023-12-03 22:51:45,107 - Epoch: [26][ 3500/31148]    Overall Loss 0.010030    Objective Loss 0.000000    Distill Loss 0.010030                     LR 0.000031    Time 0.455198    
+2023-12-03 22:52:27,803 - Epoch: [26][ 3600/31148]    Overall Loss 0.010035    Objective Loss 0.000000    Distill Loss 0.010035                     LR 0.000031    Time 0.454412    
+2023-12-03 22:53:15,220 - Epoch: [26][ 3700/31148]    Overall Loss 0.010036    Objective Loss 0.000000    Distill Loss 0.010036                     LR 0.000031    Time 0.454944    
+2023-12-03 22:54:00,474 - Epoch: [26][ 3800/31148]    Overall Loss 0.010037    Objective Loss 0.000000    Distill Loss 0.010037                     LR 0.000031    Time 0.454878    
+2023-12-03 22:54:39,963 - Epoch: [26][ 3900/31148]    Overall Loss 0.010037    Objective Loss 0.000000    Distill Loss 0.010037                     LR 0.000031    Time 0.453338    
+2023-12-03 22:55:25,606 - Epoch: [26][ 4000/31148]    Overall Loss 0.010039    Objective Loss 0.000000    Distill Loss 0.010039                     LR 0.000031    Time 0.453414    
+2023-12-03 22:56:14,345 - Epoch: [26][ 4100/31148]    Overall Loss 0.010038    Objective Loss 0.000000    Distill Loss 0.010038                     LR 0.000031    Time 0.454240    
+2023-12-03 22:56:54,383 - Epoch: [26][ 4200/31148]    Overall Loss 0.010038    Objective Loss 0.000000    Distill Loss 0.010038                     LR 0.000031    Time 0.452956    
+2023-12-03 22:57:34,649 - Epoch: [26][ 4300/31148]    Overall Loss 0.010045    Objective Loss 0.000000    Distill Loss 0.010045                     LR 0.000031    Time 0.451785    
+2023-12-03 22:58:12,785 - Epoch: [26][ 4400/31148]    Overall Loss 0.010045    Objective Loss 0.000000    Distill Loss 0.010045                     LR 0.000031    Time 0.450182    
+2023-12-03 22:59:07,291 - Epoch: [26][ 4500/31148]    Overall Loss 0.010047    Objective Loss 0.000000    Distill Loss 0.010047                     LR 0.000031    Time 0.452289    
+2023-12-03 22:59:49,226 - Epoch: [26][ 4600/31148]    Overall Loss 0.010048    Objective Loss 0.000000    Distill Loss 0.010048                     LR 0.000031    Time 0.451571    
+2023-12-03 23:00:30,460 - Epoch: [26][ 4700/31148]    Overall Loss 0.010048    Objective Loss 0.000000    Distill Loss 0.010048                     LR 0.000031    Time 0.450735    
+2023-12-03 23:01:20,199 - Epoch: [26][ 4800/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.451705    
+2023-12-03 23:02:02,169 - Epoch: [26][ 4900/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.451051    
+2023-12-03 23:02:41,728 - Epoch: [26][ 5000/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.449940    
+2023-12-03 23:03:20,014 - Epoch: [26][ 5100/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.448623    
+2023-12-03 23:04:07,803 - Epoch: [26][ 5200/31148]    Overall Loss 0.010053    Objective Loss 0.000000    Distill Loss 0.010053                     LR 0.000031    Time 0.449185    
+2023-12-03 23:04:45,158 - Epoch: [26][ 5300/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.447756    
+2023-12-03 23:05:24,122 - Epoch: [26][ 5400/31148]    Overall Loss 0.010054    Objective Loss 0.000000    Distill Loss 0.010054                     LR 0.000031    Time 0.446678    
+2023-12-03 23:06:08,889 - Epoch: [26][ 5500/31148]    Overall Loss 0.010056    Objective Loss 0.000000    Distill Loss 0.010056                     LR 0.000031    Time 0.446695    
+2023-12-03 23:06:55,274 - Epoch: [26][ 5600/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.447000    
+2023-12-03 23:07:48,944 - Epoch: [26][ 5700/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.448572    
+2023-12-03 23:08:29,571 - Epoch: [26][ 5800/31148]    Overall Loss 0.010055    Objective Loss 0.000000    Distill Loss 0.010055                     LR 0.000031    Time 0.447842    
+2023-12-03 23:09:17,042 - Epoch: [26][ 5900/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.448296    
+2023-12-03 23:10:11,058 - Epoch: [26][ 6000/31148]    Overall Loss 0.010053    Objective Loss 0.000000    Distill Loss 0.010053                     LR 0.000031    Time 0.449826    
+2023-12-03 23:10:51,629 - Epoch: [26][ 6100/31148]    Overall Loss 0.010053    Objective Loss 0.000000    Distill Loss 0.010053                     LR 0.000031    Time 0.449102    
+2023-12-03 23:11:39,822 - Epoch: [26][ 6200/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.449630    
+2023-12-03 23:12:21,315 - Epoch: [26][ 6300/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.449078    
+2023-12-03 23:13:02,932 - Epoch: [26][ 6400/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.448562    
+2023-12-03 23:13:49,688 - Epoch: [26][ 6500/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.448854    
+2023-12-03 23:14:34,657 - Epoch: [26][ 6600/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.448865    
+2023-12-03 23:15:11,872 - Epoch: [26][ 6700/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.447719    
+2023-12-03 23:15:56,246 - Epoch: [26][ 6800/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.447659    
+2023-12-03 23:16:47,528 - Epoch: [26][ 6900/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.448603    
+2023-12-03 23:17:39,808 - Epoch: [26][ 7000/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.449662    
+2023-12-03 23:18:20,732 - Epoch: [26][ 7100/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.449091    
+2023-12-03 23:18:59,961 - Epoch: [26][ 7200/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.448302    
+2023-12-03 23:19:48,847 - Epoch: [26][ 7300/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.448856    
+2023-12-03 23:20:27,851 - Epoch: [26][ 7400/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.448060    
+2023-12-03 23:21:15,000 - Epoch: [26][ 7500/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.448372    
+2023-12-03 23:21:57,087 - Epoch: [26][ 7600/31148]    Overall Loss 0.010053    Objective Loss 0.000000    Distill Loss 0.010053                     LR 0.000031    Time 0.448009    
+2023-12-03 23:22:33,834 - Epoch: [26][ 7700/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.446962    
+2023-12-03 23:23:19,038 - Epoch: [26][ 7800/31148]    Overall Loss 0.010049    Objective Loss 0.000000    Distill Loss 0.010049                     LR 0.000031    Time 0.447026    
+2023-12-03 23:24:00,011 - Epoch: [26][ 7900/31148]    Overall Loss 0.010049    Objective Loss 0.000000    Distill Loss 0.010049                     LR 0.000031    Time 0.446553    
+2023-12-03 23:24:41,061 - Epoch: [26][ 8000/31148]    Overall Loss 0.010048    Objective Loss 0.000000    Distill Loss 0.010048                     LR 0.000031    Time 0.446101    
+2023-12-03 23:25:21,234 - Epoch: [26][ 8100/31148]    Overall Loss 0.010048    Objective Loss 0.000000    Distill Loss 0.010048                     LR 0.000031    Time 0.445553    
+2023-12-03 23:26:04,393 - Epoch: [26][ 8200/31148]    Overall Loss 0.010047    Objective Loss 0.000000    Distill Loss 0.010047                     LR 0.000031    Time 0.445382    
+2023-12-03 23:26:47,521 - Epoch: [26][ 8300/31148]    Overall Loss 0.010049    Objective Loss 0.000000    Distill Loss 0.010049                     LR 0.000031    Time 0.445211    
+2023-12-03 23:27:30,199 - Epoch: [26][ 8400/31148]    Overall Loss 0.010049    Objective Loss 0.000000    Distill Loss 0.010049                     LR 0.000031    Time 0.444990    
+2023-12-03 23:28:14,528 - Epoch: [26][ 8500/31148]    Overall Loss 0.010049    Objective Loss 0.000000    Distill Loss 0.010049                     LR 0.000031    Time 0.444970    
+2023-12-03 23:28:56,743 - Epoch: [26][ 8600/31148]    Overall Loss 0.010048    Objective Loss 0.000000    Distill Loss 0.010048                     LR 0.000031    Time 0.444703    
+2023-12-03 23:29:43,057 - Epoch: [26][ 8700/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.444915    
+2023-12-03 23:30:29,460 - Epoch: [26][ 8800/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.445131    
+2023-12-03 23:31:11,667 - Epoch: [26][ 8900/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.444871    
+2023-12-03 23:32:00,787 - Epoch: [26][ 9000/31148]    Overall Loss 0.010050    Objective Loss 0.000000    Distill Loss 0.010050                     LR 0.000031    Time 0.445385    
+2023-12-03 23:32:45,393 - Epoch: [26][ 9100/31148]    Overall Loss 0.010051    Objective Loss 0.000000    Distill Loss 0.010051                     LR 0.000031    Time 0.445392    
+2023-12-03 23:33:33,404 - Epoch: [26][ 9200/31148]    Overall Loss 0.010052    Objective Loss 0.000000    Distill Loss 0.010052                     LR 0.000031    Time 0.445768    
+2023-12-03 23:34:32,641 - Epoch: [26][ 9300/31148]    Overall Loss 0.010054    Objective Loss 0.000000    Distill Loss 0.010054                     LR 0.000031    Time 0.447344    
+2023-12-03 23:35:09,669 - Epoch: [26][ 9400/31148]    Overall Loss 0.010055    Objective Loss 0.000000    Distill Loss 0.010055                     LR 0.000031    Time 0.446523    
+2023-12-03 23:35:56,394 - Epoch: [26][ 9500/31148]    Overall Loss 0.010055    Objective Loss 0.000000    Distill Loss 0.010055                     LR 0.000031    Time 0.446741    
+2023-12-03 23:36:39,068 - Epoch: [26][ 9600/31148]    Overall Loss 0.010056    Objective Loss 0.000000    Distill Loss 0.010056                     LR 0.000031    Time 0.446532    
+2023-12-03 23:37:23,471 - Epoch: [26][ 9700/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446505    
+2023-12-03 23:38:11,228 - Epoch: [26][ 9800/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.446821    
+2023-12-03 23:38:53,794 - Epoch: [26][ 9900/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446607    
+2023-12-03 23:39:35,122 - Epoch: [26][10000/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446273    
+2023-12-03 23:40:27,667 - Epoch: [26][10100/31148]    Overall Loss 0.010055    Objective Loss 0.000000    Distill Loss 0.010055                     LR 0.000031    Time 0.447056    
+2023-12-03 23:41:10,038 - Epoch: [26][10200/31148]    Overall Loss 0.010056    Objective Loss 0.000000    Distill Loss 0.010056                     LR 0.000031    Time 0.446826    
+2023-12-03 23:41:54,622 - Epoch: [26][10300/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446816    
+2023-12-03 23:42:37,348 - Epoch: [26][10400/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446628    
+2023-12-03 23:43:22,107 - Epoch: [26][10500/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446636    
+2023-12-03 23:44:11,761 - Epoch: [26][10600/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.447106    
+2023-12-03 23:44:50,250 - Epoch: [26][10700/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446524    
+2023-12-03 23:45:39,729 - Epoch: [26][10800/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.446970    
+2023-12-03 23:46:22,364 - Epoch: [26][10900/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446780    
+2023-12-03 23:47:08,959 - Epoch: [26][11000/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446954    
+2023-12-03 23:47:53,768 - Epoch: [26][11100/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.446963    
+2023-12-03 23:48:42,850 - Epoch: [26][11200/31148]    Overall Loss 0.010056    Objective Loss 0.000000    Distill Loss 0.010056                     LR 0.000031    Time 0.447354    
+2023-12-03 23:49:24,725 - Epoch: [26][11300/31148]    Overall Loss 0.010056    Objective Loss 0.000000    Distill Loss 0.010056                     LR 0.000031    Time 0.447100    
+2023-12-03 23:50:14,633 - Epoch: [26][11400/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.447556    
+2023-12-03 23:51:00,352 - Epoch: [26][11500/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.447639    
+2023-12-03 23:51:45,393 - Epoch: [26][11600/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.447662    
+2023-12-03 23:52:26,532 - Epoch: [26][11700/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.447351    
+2023-12-03 23:53:12,177 - Epoch: [26][11800/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.447428    
+2023-12-03 23:54:02,497 - Epoch: [26][11900/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.447896    
+2023-12-03 23:54:50,002 - Epoch: [26][12000/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.448122    
+2023-12-03 23:55:32,187 - Epoch: [26][12100/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.447904    
+2023-12-03 23:56:26,303 - Epoch: [26][12200/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.448668    
+2023-12-03 23:57:10,087 - Epoch: [26][12300/31148]    Overall Loss 0.010057    Objective Loss 0.000000    Distill Loss 0.010057                     LR 0.000031    Time 0.448579    
+2023-12-03 23:57:55,868 - Epoch: [26][12400/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.448653    
+2023-12-03 23:58:40,070 - Epoch: [26][12500/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.448599    
+2023-12-03 23:59:20,179 - Epoch: [26][12600/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.448222    
+2023-12-04 00:00:06,407 - Epoch: [26][12700/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.448332    
+2023-12-04 00:00:57,840 - Epoch: [26][12800/31148]    Overall Loss 0.010059    Objective Loss 0.000000    Distill Loss 0.010059                     LR 0.000031    Time 0.448847    
+2023-12-04 00:01:50,280 - Epoch: [26][12900/31148]    Overall Loss 0.010058    Objective Loss 0.000000    Distill Loss 0.010058                     LR 0.000031    Time 0.449432    
+2023-12-04 00:02:41,798 - Epoch: [26][13000/31148]    Overall Loss 0.010059    Objective Loss 0.000000    Distill Loss 0.010059                     LR 0.000031    Time 0.449937    
+2023-12-04 00:03:24,509 - Epoch: [26][13100/31148]    Overall Loss 0.010060    Objective Loss 0.000000    Distill Loss 0.010060                     LR 0.000031    Time 0.449762    
+2023-12-04 00:04:14,092 - Epoch: [26][13200/31148]    Overall Loss 0.010060    Objective Loss 0.000000    Distill Loss 0.010060                     LR 0.000031    Time 0.450111    
+2023-12-04 00:04:59,612 - Epoch: [26][13300/31148]    Overall Loss 0.010061    Objective Loss 0.000000    Distill Loss 0.010061                     LR 0.000031    Time 0.450149    
+2023-12-04 00:05:36,390 - Epoch: [26][13400/31148]    Overall Loss 0.010061    Objective Loss 0.000000    Distill Loss 0.010061                     LR 0.000031    Time 0.449533    
+2023-12-04 00:06:11,426 - Epoch: [26][13500/31148]    Overall Loss 0.010061    Objective Loss 0.000000    Distill Loss 0.010061                     LR 0.000031    Time 0.448798    
+2023-12-04 00:06:56,334 - Epoch: [26][13600/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.448800    
+2023-12-04 00:07:37,716 - Epoch: [26][13700/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.448544    
+2023-12-04 00:08:16,623 - Epoch: [26][13800/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.448112    
+2023-12-04 00:08:57,800 - Epoch: [26][13900/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.447850    
+2023-12-04 00:09:44,225 - Epoch: [26][14000/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.447967    
+2023-12-04 00:10:27,005 - Epoch: [26][14100/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.447823    
+2023-12-04 00:11:11,738 - Epoch: [26][14200/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.447819    
+2023-12-04 00:11:54,776 - Epoch: [26][14300/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.447697    
+2023-12-04 00:12:41,400 - Epoch: [26][14400/31148]    Overall Loss 0.010062    Objective Loss 0.000000    Distill Loss 0.010062                     LR 0.000031    Time 0.447825    
+2023-12-04 00:13:28,933 - Epoch: [26][14500/31148]    Overall Loss 0.010063    Objective Loss 0.000000    Distill Loss 0.010063                     LR 0.000031    Time 0.448014    
+2023-12-04 00:14:11,416 - Epoch: [26][14600/31148]    Overall Loss 0.010063    Objective Loss 0.000000    Distill Loss 0.010063                     LR 0.000031    Time 0.447855    
+2023-12-04 00:14:53,214 - Epoch: [26][14700/31148]    Overall Loss 0.010063    Objective Loss 0.000000    Distill Loss 0.010063                     LR 0.000031    Time 0.447651    
+2023-12-04 00:15:35,336 - Epoch: [26][14800/31148]    Overall Loss 0.010063    Objective Loss 0.000000    Distill Loss 0.010063                     LR 0.000031    Time 0.447472    
+2023-12-04 00:16:22,516 - Epoch: [26][14900/31148]    Overall Loss 0.010063    Objective Loss 0.000000    Distill Loss 0.010063                     LR 0.000031    Time 0.447635    
+2023-12-04 00:17:04,338 - Epoch: [26][15000/31148]    Overall Loss 0.010063    Objective Loss 0.000000    Distill Loss 0.010063                     LR 0.000031    Time 0.447438    
+2023-12-04 00:17:39,874 - Epoch: [26][15100/31148]    Overall Loss 0.010065    Objective Loss 0.000000    Distill Loss 0.010065                     LR 0.000031    Time 0.446828    
+2023-12-04 00:18:26,467 - Epoch: [26][15200/31148]    Overall Loss 0.010065    Objective Loss 0.000000    Distill Loss 0.010065                     LR 0.000031    Time 0.446953    
+2023-12-04 00:19:09,924 - Epoch: [26][15300/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.446872    
+2023-12-04 00:19:56,985 - Epoch: [26][15400/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.447025    
+2023-12-04 00:20:35,845 - Epoch: [26][15500/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.446648    
+2023-12-04 00:21:20,713 - Epoch: [26][15600/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.446660    
+2023-12-04 00:22:06,208 - Epoch: [26][15700/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.446713    
+2023-12-04 00:23:00,353 - Epoch: [26][15800/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.447312    
+2023-12-04 00:23:35,098 - Epoch: [26][15900/31148]    Overall Loss 0.010066    Objective Loss 0.000000    Distill Loss 0.010066                     LR 0.000031    Time 0.446683    
+2023-12-04 00:24:28,719 - Epoch: [26][16000/31148]    Overall Loss 0.010067    Objective Loss 0.000000    Distill Loss 0.010067                     LR 0.000031    Time 0.447242    
+2023-12-04 00:25:05,819 - Epoch: [26][16100/31148]    Overall Loss 0.010067    Objective Loss 0.000000    Distill Loss 0.010067                     LR 0.000031    Time 0.446768    
+2023-12-04 00:25:55,104 - Epoch: [26][16200/31148]    Overall Loss 0.010067    Objective Loss 0.000000    Distill Loss 0.010067                     LR 0.000031    Time 0.447052    
+2023-12-04 00:26:42,832 - Epoch: [26][16300/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.447237    
+2023-12-04 00:27:26,268 - Epoch: [26][16400/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447158    
+2023-12-04 00:28:12,415 - Epoch: [26][16500/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447245    
+2023-12-04 00:28:47,348 - Epoch: [26][16600/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.446654    
+2023-12-04 00:29:40,772 - Epoch: [26][16700/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447179    
+2023-12-04 00:30:20,596 - Epoch: [26][16800/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.446887    
+2023-12-04 00:31:02,280 - Epoch: [26][16900/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.446709    
+2023-12-04 00:31:53,156 - Epoch: [26][17000/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.447073    
+2023-12-04 00:32:34,186 - Epoch: [26][17100/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.446858    
+2023-12-04 00:33:20,680 - Epoch: [26][17200/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.446962    
+2023-12-04 00:34:07,565 - Epoch: [26][17300/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447088    
+2023-12-04 00:35:00,859 - Epoch: [26][17400/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447581    
+2023-12-04 00:35:47,102 - Epoch: [26][17500/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447666    
+2023-12-04 00:36:26,136 - Epoch: [26][17600/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447340    
+2023-12-04 00:37:04,043 - Epoch: [26][17700/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.446954    
+2023-12-04 00:37:49,348 - Epoch: [26][17800/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.446988    
+2023-12-04 00:38:38,745 - Epoch: [26][17900/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447250    
+2023-12-04 00:39:23,484 - Epoch: [26][18000/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447250    
+2023-12-04 00:40:14,014 - Epoch: [26][18100/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.447570    
+2023-12-04 00:40:58,854 - Epoch: [26][18200/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.447575    
+2023-12-04 00:41:44,365 - Epoch: [26][18300/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.447615    
+2023-12-04 00:42:28,232 - Epoch: [26][18400/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447566    
+2023-12-04 00:43:16,488 - Epoch: [26][18500/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447755    
+2023-12-04 00:43:53,740 - Epoch: [26][18600/31148]    Overall Loss 0.010068    Objective Loss 0.000000    Distill Loss 0.010068                     LR 0.000031    Time 0.447350    
+2023-12-04 00:44:35,331 - Epoch: [26][18700/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447182    
+2023-12-04 00:45:23,656 - Epoch: [26][18800/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447373    
+2023-12-04 00:46:05,514 - Epoch: [26][18900/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447221    
+2023-12-04 00:46:49,619 - Epoch: [26][19000/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447188    
+2023-12-04 00:47:34,706 - Epoch: [26][19100/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.447207    
+2023-12-04 00:48:22,839 - Epoch: [26][19200/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447384    
+2023-12-04 00:48:59,578 - Epoch: [26][19300/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446969    
+2023-12-04 00:49:40,601 - Epoch: [26][19400/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446779    
+2023-12-04 00:50:24,745 - Epoch: [26][19500/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446752    
+2023-12-04 00:51:12,868 - Epoch: [26][19600/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446927    
+2023-12-04 00:51:53,236 - Epoch: [26][19700/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446707    
+2023-12-04 00:52:41,716 - Epoch: [26][19800/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446899    
+2023-12-04 00:53:30,542 - Epoch: [26][19900/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447107    
+2023-12-04 00:54:11,240 - Epoch: [26][20000/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446906    
+2023-12-04 00:54:54,041 - Epoch: [26][20100/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446811    
+2023-12-04 00:55:32,237 - Epoch: [26][20200/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446490    
+2023-12-04 00:56:21,519 - Epoch: [26][20300/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446718    
+2023-12-04 00:56:57,125 - Epoch: [26][20400/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446273    
+2023-12-04 00:57:43,126 - Epoch: [26][20500/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446340    
+2023-12-04 00:58:30,166 - Epoch: [26][20600/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446456    
+2023-12-04 00:59:19,935 - Epoch: [26][20700/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446703    
+2023-12-04 01:00:00,187 - Epoch: [26][20800/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446491    
+2023-12-04 01:00:54,525 - Epoch: [26][20900/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.446954    
+2023-12-04 01:01:42,239 - Epoch: [26][21000/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447097    
+2023-12-04 01:02:26,162 - Epoch: [26][21100/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447060    
+2023-12-04 01:03:19,262 - Epoch: [26][21200/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.447455    
+2023-12-04 01:04:05,155 - Epoch: [26][21300/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447509    
+2023-12-04 01:04:48,700 - Epoch: [26][21400/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447452    
+2023-12-04 01:05:25,117 - Epoch: [26][21500/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447064    
+2023-12-04 01:06:09,265 - Epoch: [26][21600/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447038    
+2023-12-04 01:06:56,835 - Epoch: [26][21700/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.447170    
+2023-12-04 01:07:38,824 - Epoch: [26][21800/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.447044    
+2023-12-04 01:08:23,153 - Epoch: [26][21900/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.447027    
+2023-12-04 01:09:05,939 - Epoch: [26][22000/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446939    
+2023-12-04 01:09:51,068 - Epoch: [26][22100/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446959    
+2023-12-04 01:10:32,782 - Epoch: [26][22200/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446824    
+2023-12-04 01:11:18,328 - Epoch: [26][22300/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446863    
+2023-12-04 01:11:49,921 - Epoch: [26][22400/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.446277    
+2023-12-04 01:12:18,775 - Epoch: [26][22500/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.445576    
+2023-12-04 01:12:46,779 - Epoch: [26][22600/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.444844    
+2023-12-04 01:13:15,228 - Epoch: [26][22700/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.444137    
+2023-12-04 01:13:43,227 - Epoch: [26][22800/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.443417    
+2023-12-04 01:14:11,229 - Epoch: [26][22900/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.442703    
+2023-12-04 01:14:39,152 - Epoch: [26][23000/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.441992    
+2023-12-04 01:15:07,242 - Epoch: [26][23100/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.441295    
+2023-12-04 01:15:35,182 - Epoch: [26][23200/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.440597    
+2023-12-04 01:16:03,362 - Epoch: [26][23300/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.439915    
+2023-12-04 01:16:31,137 - Epoch: [26][23400/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.439222    
+2023-12-04 01:16:58,991 - Epoch: [26][23500/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.438538    
+2023-12-04 01:17:40,588 - Epoch: [26][23600/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.438442    
+2023-12-04 01:18:26,532 - Epoch: [26][23700/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.438530    
+2023-12-04 01:19:05,688 - Epoch: [26][23800/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.438333    
+2023-12-04 01:19:49,001 - Epoch: [26][23900/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.438311    
+2023-12-04 01:20:32,293 - Epoch: [26][24000/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.438288    
+2023-12-04 01:21:16,681 - Epoch: [26][24100/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.438311    
+2023-12-04 01:22:08,208 - Epoch: [26][24200/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.438628    
+2023-12-04 01:23:07,159 - Epoch: [26][24300/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.439249    
+2023-12-04 01:24:06,907 - Epoch: [26][24400/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.439897    
+2023-12-04 01:24:55,963 - Epoch: [26][24500/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440104    
+2023-12-04 01:25:36,610 - Epoch: [26][24600/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.439967    
+2023-12-04 01:26:24,668 - Epoch: [26][24700/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.440131    
+2023-12-04 01:27:07,174 - Epoch: [26][24800/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.440070    
+2023-12-04 01:27:56,664 - Epoch: [26][24900/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.440290    
+2023-12-04 01:28:47,523 - Epoch: [26][25000/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440563    
+2023-12-04 01:29:22,263 - Epoch: [26][25100/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440191    
+2023-12-04 01:30:07,585 - Epoch: [26][25200/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440243    
+2023-12-04 01:30:57,976 - Epoch: [26][25300/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440494    
+2023-12-04 01:31:39,047 - Epoch: [26][25400/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440376    
+2023-12-04 01:32:25,498 - Epoch: [26][25500/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440471    
+2023-12-04 01:33:19,501 - Epoch: [26][25600/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.440859    
+2023-12-04 01:34:13,160 - Epoch: [26][25700/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.441232    
+2023-12-04 01:35:12,008 - Epoch: [26][25800/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.441802    
+2023-12-04 01:36:03,343 - Epoch: [26][25900/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.442078    
+2023-12-04 01:36:56,188 - Epoch: [26][26000/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.442410    
+2023-12-04 01:37:39,036 - Epoch: [26][26100/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.442356    
+2023-12-04 01:38:35,622 - Epoch: [26][26200/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.442827    
+2023-12-04 01:39:23,816 - Epoch: [26][26300/31148]    Overall Loss 0.010073    Objective Loss 0.000000    Distill Loss 0.010073                     LR 0.000031    Time 0.442976    
+2023-12-04 01:40:14,162 - Epoch: [26][26400/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.443205    
+2023-12-04 01:40:55,340 - Epoch: [26][26500/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.443086    
+2023-12-04 01:41:45,455 - Epoch: [26][26600/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.443304    
+2023-12-04 01:42:34,982 - Epoch: [26][26700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.443498    
+2023-12-04 01:43:24,712 - Epoch: [26][26800/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.443699    
+2023-12-04 01:44:16,609 - Epoch: [26][26900/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.443978    
+2023-12-04 01:45:04,047 - Epoch: [26][27000/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.444090    
+2023-12-04 01:45:41,674 - Epoch: [26][27100/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.443840    
+2023-12-04 01:46:34,417 - Epoch: [26][27200/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444147    
+2023-12-04 01:47:20,460 - Epoch: [26][27300/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444206    
+2023-12-04 01:48:04,748 - Epoch: [26][27400/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444201    
+2023-12-04 01:48:49,957 - Epoch: [26][27500/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444230    
+2023-12-04 01:49:44,733 - Epoch: [26][27600/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444605    
+2023-12-04 01:50:32,604 - Epoch: [26][27700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444727    
+2023-12-04 01:51:17,737 - Epoch: [26][27800/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.444751    
+2023-12-04 01:52:07,566 - Epoch: [26][27900/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.444942    
+2023-12-04 01:52:58,114 - Epoch: [26][28000/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445158    
+2023-12-04 01:53:49,396 - Epoch: [26][28100/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445399    
+2023-12-04 01:54:35,546 - Epoch: [26][28200/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445456    
+2023-12-04 01:55:14,680 - Epoch: [26][28300/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445264    
+2023-12-04 01:56:02,474 - Epoch: [26][28400/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445379    
+2023-12-04 01:56:48,284 - Epoch: [26][28500/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445424    
+2023-12-04 01:57:34,120 - Epoch: [26][28600/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.445469    
+2023-12-04 01:58:21,623 - Epoch: [26][28700/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.445571    
+2023-12-04 01:59:11,213 - Epoch: [26][28800/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.445746    
+2023-12-04 01:59:57,623 - Epoch: [26][28900/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.445809    
+2023-12-04 02:00:58,698 - Epoch: [26][29000/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446378    
+2023-12-04 02:01:48,756 - Epoch: [26][29100/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446564    
+2023-12-04 02:02:34,930 - Epoch: [26][29200/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446615    
+2023-12-04 02:03:22,630 - Epoch: [26][29300/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446719    
+2023-12-04 02:04:02,803 - Epoch: [26][29400/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446565    
+2023-12-04 02:04:46,438 - Epoch: [26][29500/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446531    
+2023-12-04 02:05:47,443 - Epoch: [26][29600/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.447083    
+2023-12-04 02:06:32,035 - Epoch: [26][29700/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.447079    
+2023-12-04 02:07:17,243 - Epoch: [26][29800/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.447095    
+2023-12-04 02:07:58,544 - Epoch: [26][29900/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.446981    
+2023-12-04 02:08:51,151 - Epoch: [26][30000/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.447244    
+2023-12-04 02:09:40,952 - Epoch: [26][30100/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.447413    
+2023-12-04 02:10:28,384 - Epoch: [26][30200/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.447502    
+2023-12-04 02:11:18,777 - Epoch: [26][30300/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.447688    
+2023-12-04 02:12:09,964 - Epoch: [26][30400/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.447899    
+2023-12-04 02:13:01,848 - Epoch: [26][30500/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.448131    
+2023-12-04 02:13:49,517 - Epoch: [26][30600/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.448224    
+2023-12-04 02:14:40,217 - Epoch: [26][30700/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.448415    
+2023-12-04 02:15:21,102 - Epoch: [26][30800/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.448287    
+2023-12-04 02:16:09,087 - Epoch: [26][30900/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.448388    
+2023-12-04 02:16:58,991 - Epoch: [26][31000/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.448552    
+2023-12-04 02:17:43,334 - Epoch: [26][31100/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.448535    
+2023-12-04 02:18:04,932 - Epoch: [26][31148/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.448537    
+2023-12-04 02:18:05,982 - --- validate (epoch=26)-----------
+2023-12-04 02:18:05,982 - 167951 samples (100 per mini-batch)
+2023-12-04 02:18:33,403 - Epoch: [26][  100/ 1680]    Loss 0.000000    Overall Loss 0.010724    
+2023-12-04 02:18:56,588 - Epoch: [26][  200/ 1680]    Loss 0.000000    Overall Loss 0.010706    
+2023-12-04 02:19:20,016 - Epoch: [26][  300/ 1680]    Loss 0.000000    Overall Loss 0.010722    
+2023-12-04 02:19:43,254 - Epoch: [26][  400/ 1680]    Loss 0.000000    Overall Loss 0.010715    
+2023-12-04 02:20:06,295 - Epoch: [26][  500/ 1680]    Loss 0.000000    Overall Loss 0.010718    
+2023-12-04 02:20:29,725 - Epoch: [26][  600/ 1680]    Loss 0.000000    Overall Loss 0.010728    
+2023-12-04 02:20:53,999 - Epoch: [26][  700/ 1680]    Loss 0.000000    Overall Loss 0.010725    
+2023-12-04 02:21:17,433 - Epoch: [26][  800/ 1680]    Loss 0.000000    Overall Loss 0.010719    
+2023-12-04 02:21:41,631 - Epoch: [26][  900/ 1680]    Loss 0.000000    Overall Loss 0.010712    
+2023-12-04 02:22:05,222 - Epoch: [26][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010710    
+2023-12-04 02:22:28,353 - Epoch: [26][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010708    
+2023-12-04 02:22:51,431 - Epoch: [26][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010713    
+2023-12-04 02:23:14,147 - Epoch: [26][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010715    
+2023-12-04 02:23:36,975 - Epoch: [26][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010717    
+2023-12-04 02:24:00,636 - Epoch: [26][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010717    
+2023-12-04 02:24:23,223 - Epoch: [26][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010719    
+2023-12-04 02:24:41,475 - Epoch: [26][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010714    
+2023-12-04 02:24:41,965 - ==> Overall Loss: 0.011
+
+2023-12-04 02:24:41,972 - ==> Best [Overall Loss: 0.010714 on epoch: 26]
+2023-12-04 02:24:41,972 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-04 02:24:42,023 - 
+
+2023-12-04 02:24:42,024 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-04 02:25:53,128 - Epoch: [27][  100/31148]    Overall Loss 0.010108    Objective Loss 0.000000    Distill Loss 0.010108                     LR 0.000031    Time 0.710954    
+2023-12-04 02:26:43,490 - Epoch: [27][  200/31148]    Overall Loss 0.010072    Objective Loss 0.000000    Distill Loss 0.010072                     LR 0.000031    Time 0.607250    
+2023-12-04 02:27:29,886 - Epoch: [27][  300/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.559459    
+2023-12-04 02:28:23,209 - Epoch: [27][  400/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.552885    
+2023-12-04 02:29:06,950 - Epoch: [27][  500/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.529776    
+2023-12-04 02:29:55,722 - Epoch: [27][  600/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.522753    
+2023-12-04 02:30:36,567 - Epoch: [27][  700/31148]    Overall Loss 0.010102    Objective Loss 0.000000    Distill Loss 0.010102                     LR 0.000031    Time 0.506412    
+2023-12-04 02:31:17,470 - Epoch: [27][  800/31148]    Overall Loss 0.010112    Objective Loss 0.000000    Distill Loss 0.010112                     LR 0.000031    Time 0.494230    
+2023-12-04 02:32:03,981 - Epoch: [27][  900/31148]    Overall Loss 0.010090    Objective Loss 0.000000    Distill Loss 0.010090                     LR 0.000031    Time 0.490987    
+2023-12-04 02:32:47,964 - Epoch: [27][ 1000/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.485863    
+2023-12-04 02:33:39,719 - Epoch: [27][ 1100/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.488737    
+2023-12-04 02:34:17,045 - Epoch: [27][ 1200/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.479107    
+2023-12-04 02:35:25,921 - Epoch: [27][ 1300/31148]    Overall Loss 0.010069    Objective Loss 0.000000    Distill Loss 0.010069                     LR 0.000031    Time 0.495229    
+2023-12-04 02:36:01,605 - Epoch: [27][ 1400/31148]    Overall Loss 0.010071    Objective Loss 0.000000    Distill Loss 0.010071                     LR 0.000031    Time 0.485339    
+2023-12-04 02:36:53,221 - Epoch: [27][ 1500/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.487388    
+2023-12-04 02:37:38,193 - Epoch: [27][ 1600/31148]    Overall Loss 0.010070    Objective Loss 0.000000    Distill Loss 0.010070                     LR 0.000031    Time 0.485029    
+2023-12-04 02:38:24,827 - Epoch: [27][ 1700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.483926    
+2023-12-04 02:39:15,210 - Epoch: [27][ 1800/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.485028    
+2023-12-04 02:39:56,287 - Epoch: [27][ 1900/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.481115    
+2023-12-04 02:40:41,440 - Epoch: [27][ 2000/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.479632    
+2023-12-04 02:41:28,295 - Epoch: [27][ 2100/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.479101    
+2023-12-04 02:42:16,588 - Epoch: [27][ 2200/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.479271    
+2023-12-04 02:42:57,329 - Epoch: [27][ 2300/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.476144    
+2023-12-04 02:43:48,637 - Epoch: [27][ 2400/31148]    Overall Loss 0.010093    Objective Loss 0.000000    Distill Loss 0.010093                     LR 0.000031    Time 0.477680    
+2023-12-04 02:44:37,343 - Epoch: [27][ 2500/31148]    Overall Loss 0.010094    Objective Loss 0.000000    Distill Loss 0.010094                     LR 0.000031    Time 0.478052    
+2023-12-04 02:45:19,950 - Epoch: [27][ 2600/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.476050    
+2023-12-04 02:46:02,217 - Epoch: [27][ 2700/31148]    Overall Loss 0.010101    Objective Loss 0.000000    Distill Loss 0.010101                     LR 0.000031    Time 0.474070    
+2023-12-04 02:46:44,761 - Epoch: [27][ 2800/31148]    Overall Loss 0.010100    Objective Loss 0.000000    Distill Loss 0.010100                     LR 0.000031    Time 0.472331    
+2023-12-04 02:47:38,461 - Epoch: [27][ 2900/31148]    Overall Loss 0.010099    Objective Loss 0.000000    Distill Loss 0.010099                     LR 0.000031    Time 0.474558    
+2023-12-04 02:48:30,316 - Epoch: [27][ 3000/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.476022    
+2023-12-04 02:49:16,021 - Epoch: [27][ 3100/31148]    Overall Loss 0.010095    Objective Loss 0.000000    Distill Loss 0.010095                     LR 0.000031    Time 0.475408    
+2023-12-04 02:50:03,051 - Epoch: [27][ 3200/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.475246    
+2023-12-04 02:50:46,981 - Epoch: [27][ 3300/31148]    Overall Loss 0.010095    Objective Loss 0.000000    Distill Loss 0.010095                     LR 0.000031    Time 0.474154    
+2023-12-04 02:51:22,490 - Epoch: [27][ 3400/31148]    Overall Loss 0.010095    Objective Loss 0.000000    Distill Loss 0.010095                     LR 0.000031    Time 0.470650    
+2023-12-04 02:52:05,969 - Epoch: [27][ 3500/31148]    Overall Loss 0.010092    Objective Loss 0.000000    Distill Loss 0.010092                     LR 0.000031    Time 0.469623    
+2023-12-04 02:52:50,012 - Epoch: [27][ 3600/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.468810    
+2023-12-04 02:53:29,754 - Epoch: [27][ 3700/31148]    Overall Loss 0.010096    Objective Loss 0.000000    Distill Loss 0.010096                     LR 0.000031    Time 0.466879    
+2023-12-04 02:54:10,801 - Epoch: [27][ 3800/31148]    Overall Loss 0.010093    Objective Loss 0.000000    Distill Loss 0.010093                     LR 0.000031    Time 0.465392    
+2023-12-04 02:54:57,161 - Epoch: [27][ 3900/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.465344    
+2023-12-04 02:55:47,667 - Epoch: [27][ 4000/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.466335    
+2023-12-04 02:56:27,242 - Epoch: [27][ 4100/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.464612    
+2023-12-04 02:57:01,075 - Epoch: [27][ 4200/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.461604    
+2023-12-04 02:57:44,479 - Epoch: [27][ 4300/31148]    Overall Loss 0.010100    Objective Loss 0.000000    Distill Loss 0.010100                     LR 0.000031    Time 0.460961    
+2023-12-04 02:58:23,570 - Epoch: [27][ 4400/31148]    Overall Loss 0.010099    Objective Loss 0.000000    Distill Loss 0.010099                     LR 0.000031    Time 0.459367    
+2023-12-04 02:59:08,220 - Epoch: [27][ 4500/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.459079    
+2023-12-04 02:59:47,943 - Epoch: [27][ 4600/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.457733    
+2023-12-04 03:00:25,000 - Epoch: [27][ 4700/31148]    Overall Loss 0.010096    Objective Loss 0.000000    Distill Loss 0.010096                     LR 0.000031    Time 0.455877    
+2023-12-04 03:01:06,966 - Epoch: [27][ 4800/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.455121    
+2023-12-04 03:01:49,254 - Epoch: [27][ 4900/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.454462    
+2023-12-04 03:02:37,091 - Epoch: [27][ 5000/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.454938    
+2023-12-04 03:03:17,709 - Epoch: [27][ 5100/31148]    Overall Loss 0.010097    Objective Loss 0.000000    Distill Loss 0.010097                     LR 0.000031    Time 0.453981    
+2023-12-04 03:04:03,030 - Epoch: [27][ 5200/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.453965    
+2023-12-04 03:04:51,270 - Epoch: [27][ 5300/31148]    Overall Loss 0.010096    Objective Loss 0.000000    Distill Loss 0.010096                     LR 0.000031    Time 0.454499    
+2023-12-04 03:05:29,299 - Epoch: [27][ 5400/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.453124    
+2023-12-04 03:06:13,766 - Epoch: [27][ 5500/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.452969    
+2023-12-04 03:06:52,366 - Epoch: [27][ 5600/31148]    Overall Loss 0.010098    Objective Loss 0.000000    Distill Loss 0.010098                     LR 0.000031    Time 0.451772    
+2023-12-04 03:07:32,915 - Epoch: [27][ 5700/31148]    Overall Loss 0.010099    Objective Loss 0.000000    Distill Loss 0.010099                     LR 0.000031    Time 0.450958    
+2023-12-04 03:08:13,562 - Epoch: [27][ 5800/31148]    Overall Loss 0.010095    Objective Loss 0.000000    Distill Loss 0.010095                     LR 0.000031    Time 0.450190    
+2023-12-04 03:08:55,931 - Epoch: [27][ 5900/31148]    Overall Loss 0.010094    Objective Loss 0.000000    Distill Loss 0.010094                     LR 0.000031    Time 0.449740    
+2023-12-04 03:09:41,946 - Epoch: [27][ 6000/31148]    Overall Loss 0.010094    Objective Loss 0.000000    Distill Loss 0.010094                     LR 0.000031    Time 0.449912    
+2023-12-04 03:10:20,780 - Epoch: [27][ 6100/31148]    Overall Loss 0.010095    Objective Loss 0.000000    Distill Loss 0.010095                     LR 0.000031    Time 0.448902    
+2023-12-04 03:11:09,796 - Epoch: [27][ 6200/31148]    Overall Loss 0.010092    Objective Loss 0.000000    Distill Loss 0.010092                     LR 0.000031    Time 0.449566    
+2023-12-04 03:11:55,614 - Epoch: [27][ 6300/31148]    Overall Loss 0.010092    Objective Loss 0.000000    Distill Loss 0.010092                     LR 0.000031    Time 0.449702    
+2023-12-04 03:12:49,715 - Epoch: [27][ 6400/31148]    Overall Loss 0.010092    Objective Loss 0.000000    Distill Loss 0.010092                     LR 0.000031    Time 0.451127    
+2023-12-04 03:13:28,276 - Epoch: [27][ 6500/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.450118    
+2023-12-04 03:14:25,421 - Epoch: [27][ 6600/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.451955    
+2023-12-04 03:15:03,821 - Epoch: [27][ 6700/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.450940    
+2023-12-04 03:15:50,619 - Epoch: [27][ 6800/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.451189    
+2023-12-04 03:16:32,957 - Epoch: [27][ 6900/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.450785    
+2023-12-04 03:17:12,136 - Epoch: [27][ 7000/31148]    Overall Loss 0.010090    Objective Loss 0.000000    Distill Loss 0.010090                     LR 0.000031    Time 0.449942    
+2023-12-04 03:17:52,051 - Epoch: [27][ 7100/31148]    Overall Loss 0.010089    Objective Loss 0.000000    Distill Loss 0.010089                     LR 0.000031    Time 0.449225    
+2023-12-04 03:18:38,819 - Epoch: [27][ 7200/31148]    Overall Loss 0.010090    Objective Loss 0.000000    Distill Loss 0.010090                     LR 0.000031    Time 0.449480    
+2023-12-04 03:19:18,789 - Epoch: [27][ 7300/31148]    Overall Loss 0.010091    Objective Loss 0.000000    Distill Loss 0.010091                     LR 0.000031    Time 0.448797    
+2023-12-04 03:20:00,644 - Epoch: [27][ 7400/31148]    Overall Loss 0.010089    Objective Loss 0.000000    Distill Loss 0.010089                     LR 0.000031    Time 0.448388    
+2023-12-04 03:20:44,059 - Epoch: [27][ 7500/31148]    Overall Loss 0.010090    Objective Loss 0.000000    Distill Loss 0.010090                     LR 0.000031    Time 0.448197    
+2023-12-04 03:21:28,881 - Epoch: [27][ 7600/31148]    Overall Loss 0.010090    Objective Loss 0.000000    Distill Loss 0.010090                     LR 0.000031    Time 0.448196    
+2023-12-04 03:22:13,575 - Epoch: [27][ 7700/31148]    Overall Loss 0.010090    Objective Loss 0.000000    Distill Loss 0.010090                     LR 0.000031    Time 0.448179    
+2023-12-04 03:23:00,257 - Epoch: [27][ 7800/31148]    Overall Loss 0.010087    Objective Loss 0.000000    Distill Loss 0.010087                     LR 0.000031    Time 0.448417    
+2023-12-04 03:23:53,509 - Epoch: [27][ 7900/31148]    Overall Loss 0.010086    Objective Loss 0.000000    Distill Loss 0.010086                     LR 0.000031    Time 0.449481    
+2023-12-04 03:24:43,304 - Epoch: [27][ 8000/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.450085    
+2023-12-04 03:25:19,054 - Epoch: [27][ 8100/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.448941    
+2023-12-04 03:26:05,297 - Epoch: [27][ 8200/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.449105    
+2023-12-04 03:26:43,942 - Epoch: [27][ 8300/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.448349    
+2023-12-04 03:27:29,829 - Epoch: [27][ 8400/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.448474    
+2023-12-04 03:28:08,668 - Epoch: [27][ 8500/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.447766    
+2023-12-04 03:28:51,609 - Epoch: [27][ 8600/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.447552    
+2023-12-04 03:29:31,980 - Epoch: [27][ 8700/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.447047    
+2023-12-04 03:30:20,796 - Epoch: [27][ 8800/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.447513    
+2023-12-04 03:31:08,261 - Epoch: [27][ 8900/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.447817    
+2023-12-04 03:31:48,890 - Epoch: [27][ 9000/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.447355    
+2023-12-04 03:32:31,694 - Epoch: [27][ 9100/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.447142    
+2023-12-04 03:33:19,815 - Epoch: [27][ 9200/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.447512    
+2023-12-04 03:34:01,239 - Epoch: [27][ 9300/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.447153    
+2023-12-04 03:34:40,242 - Epoch: [27][ 9400/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.446545    
+2023-12-04 03:35:18,358 - Epoch: [27][ 9500/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.445856    
+2023-12-04 03:35:59,195 - Epoch: [27][ 9600/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.445464    
+2023-12-04 03:36:39,309 - Epoch: [27][ 9700/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.445007    
+2023-12-04 03:37:36,608 - Epoch: [27][ 9800/31148]    Overall Loss 0.010085    Objective Loss 0.000000    Distill Loss 0.010085                     LR 0.000031    Time 0.446312    
+2023-12-04 03:38:12,789 - Epoch: [27][ 9900/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.445458    
+2023-12-04 03:38:54,513 - Epoch: [27][10000/31148]    Overall Loss 0.010084    Objective Loss 0.000000    Distill Loss 0.010084                     LR 0.000031    Time 0.445175    
+2023-12-04 03:39:43,050 - Epoch: [27][10100/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.445572    
+2023-12-04 03:40:26,247 - Epoch: [27][10200/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.445438    
+2023-12-04 03:41:11,622 - Epoch: [27][10300/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.445518    
+2023-12-04 03:41:52,374 - Epoch: [27][10400/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.445152    
+2023-12-04 03:42:39,268 - Epoch: [27][10500/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.445378    
+2023-12-04 03:43:23,389 - Epoch: [27][10600/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.445338    
+2023-12-04 03:44:08,574 - Epoch: [27][10700/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.445398    
+2023-12-04 03:44:48,975 - Epoch: [27][10800/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.445014    
+2023-12-04 03:45:30,608 - Epoch: [27][10900/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.444750    
+2023-12-04 03:46:13,877 - Epoch: [27][11000/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.444640    
+2023-12-04 03:47:00,595 - Epoch: [27][11100/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.444842    
+2023-12-04 03:47:45,670 - Epoch: [27][11200/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.444894    
+2023-12-04 03:48:31,234 - Epoch: [27][11300/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.444989    
+2023-12-04 03:49:12,739 - Epoch: [27][11400/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.444726    
+2023-12-04 03:49:56,943 - Epoch: [27][11500/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.444702    
+2023-12-04 03:50:35,460 - Epoch: [27][11600/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.444188    
+2023-12-04 03:51:19,972 - Epoch: [27][11700/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.444195    
+2023-12-04 03:52:04,621 - Epoch: [27][11800/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.444214    
+2023-12-04 03:52:47,272 - Epoch: [27][11900/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.444064    
+2023-12-04 03:53:28,987 - Epoch: [27][12000/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443840    
+2023-12-04 03:54:11,511 - Epoch: [27][12100/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443685    
+2023-12-04 03:55:00,232 - Epoch: [27][12200/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.444041    
+2023-12-04 03:55:38,606 - Epoch: [27][12300/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.443551    
+2023-12-04 03:56:19,699 - Epoch: [27][12400/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443287    
+2023-12-04 03:57:00,289 - Epoch: [27][12500/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442987    
+2023-12-04 03:57:46,156 - Epoch: [27][12600/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443111    
+2023-12-04 03:58:29,696 - Epoch: [27][12700/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443050    
+2023-12-04 03:59:11,488 - Epoch: [27][12800/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.442853    
+2023-12-04 04:00:00,189 - Epoch: [27][12900/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443195    
+2023-12-04 04:00:41,938 - Epoch: [27][13000/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.442997    
+2023-12-04 04:01:21,166 - Epoch: [27][13100/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442609    
+2023-12-04 04:02:10,558 - Epoch: [27][13200/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.442997    
+2023-12-04 04:02:51,228 - Epoch: [27][13300/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.442724    
+2023-12-04 04:03:41,530 - Epoch: [27][13400/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.443173    
+2023-12-04 04:04:22,642 - Epoch: [27][13500/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442935    
+2023-12-04 04:05:04,835 - Epoch: [27][13600/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442780    
+2023-12-04 04:05:52,342 - Epoch: [27][13700/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.443015    
+2023-12-04 04:06:39,219 - Epoch: [27][13800/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.443201    
+2023-12-04 04:07:27,873 - Epoch: [27][13900/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.443513    
+2023-12-04 04:08:07,700 - Epoch: [27][14000/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.443189    
+2023-12-04 04:08:48,190 - Epoch: [27][14100/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.442917    
+2023-12-04 04:09:27,368 - Epoch: [27][14200/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.442556    
+2023-12-04 04:10:23,812 - Epoch: [27][14300/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443408    
+2023-12-04 04:11:15,974 - Epoch: [27][14400/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.443951    
+2023-12-04 04:11:52,927 - Epoch: [27][14500/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.443437    
+2023-12-04 04:12:38,088 - Epoch: [27][14600/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.443492    
+2023-12-04 04:13:24,804 - Epoch: [27][14700/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.443653    
+2023-12-04 04:14:01,957 - Epoch: [27][14800/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.443165    
+2023-12-04 04:14:44,673 - Epoch: [27][14900/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.443057    
+2023-12-04 04:15:33,457 - Epoch: [27][15000/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.443355    
+2023-12-04 04:16:18,164 - Epoch: [27][15100/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.443379    
+2023-12-04 04:16:56,751 - Epoch: [27][15200/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.443000    
+2023-12-04 04:17:37,937 - Epoch: [27][15300/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.442796    
+2023-12-04 04:18:30,816 - Epoch: [27][15400/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.443354    
+2023-12-04 04:19:06,061 - Epoch: [27][15500/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.442768    
+2023-12-04 04:19:48,548 - Epoch: [27][15600/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442652    
+2023-12-04 04:20:29,068 - Epoch: [27][15700/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442413    
+2023-12-04 04:21:14,037 - Epoch: [27][15800/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442459    
+2023-12-04 04:22:03,493 - Epoch: [27][15900/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442786    
+2023-12-04 04:22:42,029 - Epoch: [27][16000/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442427    
+2023-12-04 04:23:24,711 - Epoch: [27][16100/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442329    
+2023-12-04 04:24:16,255 - Epoch: [27][16200/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442780    
+2023-12-04 04:25:02,759 - Epoch: [27][16300/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442916    
+2023-12-04 04:25:43,208 - Epoch: [27][16400/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.442682    
+2023-12-04 04:26:27,890 - Epoch: [27][16500/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442706    
+2023-12-04 04:27:08,605 - Epoch: [27][16600/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442492    
+2023-12-04 04:27:51,121 - Epoch: [27][16700/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442387    
+2023-12-04 04:28:38,286 - Epoch: [27][16800/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.442561    
+2023-12-04 04:29:20,500 - Epoch: [27][16900/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.442440    
+2023-12-04 04:30:00,370 - Epoch: [27][17000/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.442182    
+2023-12-04 04:30:37,892 - Epoch: [27][17100/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.441790    
+2023-12-04 04:31:20,062 - Epoch: [27][17200/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.441673    
+2023-12-04 04:32:08,933 - Epoch: [27][17300/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.441944    
+2023-12-04 04:32:41,727 - Epoch: [27][17400/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.441289    
+2023-12-04 04:33:20,045 - Epoch: [27][17500/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.440956    
+2023-12-04 04:34:05,023 - Epoch: [27][17600/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.441006    
+2023-12-04 04:34:47,033 - Epoch: [27][17700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.440888    
+2023-12-04 04:35:28,426 - Epoch: [27][17800/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.440736    
+2023-12-04 04:36:17,820 - Epoch: [27][17900/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.441033    
+2023-12-04 04:36:56,660 - Epoch: [27][18000/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.440740    
+2023-12-04 04:37:34,211 - Epoch: [27][18100/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.440379    
+2023-12-04 04:38:09,627 - Epoch: [27][18200/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.439905    
+2023-12-04 04:38:43,709 - Epoch: [27][18300/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.439363    
+2023-12-04 04:39:29,093 - Epoch: [27][18400/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.439441    
+2023-12-04 04:40:14,580 - Epoch: [27][18500/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.439524    
+2023-12-04 04:40:49,776 - Epoch: [27][18600/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.439053    
+2023-12-04 04:41:24,184 - Epoch: [27][18700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.438545    
+2023-12-04 04:41:53,983 - Epoch: [27][18800/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.437797    
+2023-12-04 04:42:22,365 - Epoch: [27][18900/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.436982    
+2023-12-04 04:42:50,497 - Epoch: [27][19000/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.436163    
+2023-12-04 04:43:18,762 - Epoch: [27][19100/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.435359    
+2023-12-04 04:43:46,801 - Epoch: [27][19200/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.434552    
+2023-12-04 04:44:15,325 - Epoch: [27][19300/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.433778    
+2023-12-04 04:44:43,364 - Epoch: [27][19400/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.432987    
+2023-12-04 04:45:11,471 - Epoch: [27][19500/31148]    Overall Loss 0.010074    Objective Loss 0.000000    Distill Loss 0.010074                     LR 0.000031    Time 0.432208    
+2023-12-04 04:45:40,158 - Epoch: [27][19600/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.431466    
+2023-12-04 04:46:08,386 - Epoch: [27][19700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.430708    
+2023-12-04 04:46:35,960 - Epoch: [27][19800/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429926    
+2023-12-04 04:47:12,978 - Epoch: [27][19900/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429625    
+2023-12-04 04:47:51,155 - Epoch: [27][20000/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429385    
+2023-12-04 04:48:28,997 - Epoch: [27][20100/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429131    
+2023-12-04 04:49:08,993 - Epoch: [27][20200/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.428987    
+2023-12-04 04:49:51,090 - Epoch: [27][20300/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.428947    
+2023-12-04 04:50:39,963 - Epoch: [27][20400/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429239    
+2023-12-04 04:51:21,531 - Epoch: [27][20500/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429173    
+2023-12-04 04:51:58,679 - Epoch: [27][20600/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.428892    
+2023-12-04 04:52:47,824 - Epoch: [27][20700/31148]    Overall Loss 0.010075    Objective Loss 0.000000    Distill Loss 0.010075                     LR 0.000031    Time 0.429194    
+2023-12-04 04:53:34,913 - Epoch: [27][20800/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.429394    
+2023-12-04 04:54:20,311 - Epoch: [27][20900/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.429512    
+2023-12-04 04:54:59,938 - Epoch: [27][21000/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.429353    
+2023-12-04 04:55:41,720 - Epoch: [27][21100/31148]    Overall Loss 0.010076    Objective Loss 0.000000    Distill Loss 0.010076                     LR 0.000031    Time 0.429298    
+2023-12-04 04:56:26,513 - Epoch: [27][21200/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.429386    
+2023-12-04 04:57:13,852 - Epoch: [27][21300/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.429592    
+2023-12-04 04:57:54,095 - Epoch: [27][21400/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.429465    
+2023-12-04 04:58:29,954 - Epoch: [27][21500/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.429135    
+2023-12-04 04:59:23,445 - Epoch: [27][21600/31148]    Overall Loss 0.010077    Objective Loss 0.000000    Distill Loss 0.010077                     LR 0.000031    Time 0.429624    
+2023-12-04 05:00:08,675 - Epoch: [27][21700/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.429728    
+2023-12-04 05:00:48,918 - Epoch: [27][21800/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.429603    
+2023-12-04 05:01:35,913 - Epoch: [27][21900/31148]    Overall Loss 0.010078    Objective Loss 0.000000    Distill Loss 0.010078                     LR 0.000031    Time 0.429787    
+2023-12-04 05:02:15,121 - Epoch: [27][22000/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429615    
+2023-12-04 05:02:54,217 - Epoch: [27][22100/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429440    
+2023-12-04 05:03:40,921 - Epoch: [27][22200/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429609    
+2023-12-04 05:04:29,662 - Epoch: [27][22300/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429867    
+2023-12-04 05:05:07,651 - Epoch: [27][22400/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429644    
+2023-12-04 05:05:56,840 - Epoch: [27][22500/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429920    
+2023-12-04 05:06:39,610 - Epoch: [27][22600/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.429910    
+2023-12-04 05:07:37,280 - Epoch: [27][22700/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.430556    
+2023-12-04 05:08:37,651 - Epoch: [27][22800/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.431316    
+2023-12-04 05:09:23,594 - Epoch: [27][22900/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.431438    
+2023-12-04 05:10:14,746 - Epoch: [27][23000/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.431786    
+2023-12-04 05:11:11,432 - Epoch: [27][23100/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.432370    
+2023-12-04 05:11:59,723 - Epoch: [27][23200/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.432588    
+2023-12-04 05:12:58,229 - Epoch: [27][23300/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.433242    
+2023-12-04 05:14:02,452 - Epoch: [27][23400/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.434135    
+2023-12-04 05:14:52,989 - Epoch: [27][23500/31148]    Overall Loss 0.010079    Objective Loss 0.000000    Distill Loss 0.010079                     LR 0.000031    Time 0.434438    
+2023-12-04 05:15:33,483 - Epoch: [27][23600/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.434312    
+2023-12-04 05:16:21,154 - Epoch: [27][23700/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.434491    
+2023-12-04 05:17:03,453 - Epoch: [27][23800/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.434442    
+2023-12-04 05:17:50,878 - Epoch: [27][23900/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.434608    
+2023-12-04 05:18:41,700 - Epoch: [27][24000/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.434915    
+2023-12-04 05:19:27,001 - Epoch: [27][24100/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.434990    
+2023-12-04 05:20:24,433 - Epoch: [27][24200/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.435565    
+2023-12-04 05:21:12,836 - Epoch: [27][24300/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.435764    
+2023-12-04 05:21:55,200 - Epoch: [27][24400/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.435714    
+2023-12-04 05:22:40,084 - Epoch: [27][24500/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.435767    
+2023-12-04 05:23:31,232 - Epoch: [27][24600/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.436075    
+2023-12-04 05:24:20,935 - Epoch: [27][24700/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.436321    
+2023-12-04 05:25:14,485 - Epoch: [27][24800/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.436721    
+2023-12-04 05:26:03,457 - Epoch: [27][24900/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.436934    
+2023-12-04 05:26:55,470 - Epoch: [27][25000/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.437266    
+2023-12-04 05:27:44,167 - Epoch: [27][25100/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.437464    
+2023-12-04 05:28:35,350 - Epoch: [27][25200/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.437759    
+2023-12-04 05:29:22,774 - Epoch: [27][25300/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.437902    
+2023-12-04 05:30:16,268 - Epoch: [27][25400/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.438284    
+2023-12-04 05:31:00,366 - Epoch: [27][25500/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.438294    
+2023-12-04 05:31:49,298 - Epoch: [27][25600/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.438494    
+2023-12-04 05:32:47,453 - Epoch: [27][25700/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.439050    
+2023-12-04 05:33:41,969 - Epoch: [27][25800/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.439461    
+2023-12-04 05:34:24,267 - Epoch: [27][25900/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.439397    
+2023-12-04 05:35:23,870 - Epoch: [27][26000/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.439999    
+2023-12-04 05:36:09,595 - Epoch: [27][26100/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.440065    
+2023-12-04 05:36:52,177 - Epoch: [27][26200/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440010    
+2023-12-04 05:37:38,464 - Epoch: [27][26300/31148]    Overall Loss 0.010080    Objective Loss 0.000000    Distill Loss 0.010080                     LR 0.000031    Time 0.440097    
+2023-12-04 05:38:25,832 - Epoch: [27][26400/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440224    
+2023-12-04 05:39:03,530 - Epoch: [27][26500/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.439985    
+2023-12-04 05:39:45,238 - Epoch: [27][26600/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.439898    
+2023-12-04 05:40:41,839 - Epoch: [27][26700/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440371    
+2023-12-04 05:41:25,958 - Epoch: [27][26800/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440373    
+2023-12-04 05:42:13,581 - Epoch: [27][26900/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440506    
+2023-12-04 05:42:50,103 - Epoch: [27][27000/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440227    
+2023-12-04 05:43:45,785 - Epoch: [27][27100/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440657    
+2023-12-04 05:44:45,753 - Epoch: [27][27200/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441242    
+2023-12-04 05:45:24,379 - Epoch: [27][27300/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441040    
+2023-12-04 05:46:06,420 - Epoch: [27][27400/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.440964    
+2023-12-04 05:46:59,399 - Epoch: [27][27500/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441287    
+2023-12-04 05:47:48,419 - Epoch: [27][27600/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441464    
+2023-12-04 05:48:39,796 - Epoch: [27][27700/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.441725    
+2023-12-04 05:49:30,544 - Epoch: [27][27800/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441961    
+2023-12-04 05:50:18,806 - Epoch: [27][27900/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442107    
+2023-12-04 05:51:09,158 - Epoch: [27][28000/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442326    
+2023-12-04 05:51:46,976 - Epoch: [27][28100/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442097    
+2023-12-04 05:52:25,377 - Epoch: [27][28200/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441891    
+2023-12-04 05:53:03,832 - Epoch: [27][28300/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441688    
+2023-12-04 05:53:50,280 - Epoch: [27][28400/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441768    
+2023-12-04 05:54:37,186 - Epoch: [27][28500/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441864    
+2023-12-04 05:55:28,896 - Epoch: [27][28600/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.442126    
+2023-12-04 05:56:05,440 - Epoch: [27][28700/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441859    
+2023-12-04 05:56:48,806 - Epoch: [27][28800/31148]    Overall Loss 0.010081    Objective Loss 0.000000    Distill Loss 0.010081                     LR 0.000031    Time 0.441830    
+2023-12-04 05:57:39,428 - Epoch: [27][28900/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442053    
+2023-12-04 05:58:25,589 - Epoch: [27][29000/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442120    
+2023-12-04 05:59:12,272 - Epoch: [27][29100/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442205    
+2023-12-04 05:59:51,586 - Epoch: [27][29200/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442036    
+2023-12-04 06:00:39,402 - Epoch: [27][29300/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442159    
+2023-12-04 06:01:25,163 - Epoch: [27][29400/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442212    
+2023-12-04 06:02:12,196 - Epoch: [27][29500/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442307    
+2023-12-04 06:02:51,346 - Epoch: [27][29600/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442135    
+2023-12-04 06:03:36,184 - Epoch: [27][29700/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442156    
+2023-12-04 06:04:18,526 - Epoch: [27][29800/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442093    
+2023-12-04 06:05:16,122 - Epoch: [27][29900/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442540    
+2023-12-04 06:05:58,803 - Epoch: [27][30000/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442487    
+2023-12-04 06:06:40,652 - Epoch: [27][30100/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.442407    
+2023-12-04 06:07:27,635 - Epoch: [27][30200/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.442498    
+2023-12-04 06:08:18,014 - Epoch: [27][30300/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.442700    
+2023-12-04 06:09:03,015 - Epoch: [27][30400/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442724    
+2023-12-04 06:09:40,985 - Epoch: [27][30500/31148]    Overall Loss 0.010083    Objective Loss 0.000000    Distill Loss 0.010083                     LR 0.000031    Time 0.442517    
+2023-12-04 06:10:28,251 - Epoch: [27][30600/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442615    
+2023-12-04 06:11:13,965 - Epoch: [27][30700/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442662    
+2023-12-04 06:11:53,602 - Epoch: [27][30800/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442512    
+2023-12-04 06:12:39,853 - Epoch: [27][30900/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442576    
+2023-12-04 06:13:19,411 - Epoch: [27][31000/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442425    
+2023-12-04 06:14:07,222 - Epoch: [27][31100/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442539    
+2023-12-04 06:14:24,565 - Epoch: [27][31148/31148]    Overall Loss 0.010082    Objective Loss 0.000000    Distill Loss 0.010082                     LR 0.000031    Time 0.442413    
+2023-12-04 06:14:25,489 - --- validate (epoch=27)-----------
+2023-12-04 06:14:25,490 - 167951 samples (100 per mini-batch)
+2023-12-04 06:14:51,821 - Epoch: [27][  100/ 1680]    Loss 0.000000    Overall Loss 0.010761    
+2023-12-04 06:15:15,246 - Epoch: [27][  200/ 1680]    Loss 0.000000    Overall Loss 0.010750    
+2023-12-04 06:15:38,793 - Epoch: [27][  300/ 1680]    Loss 0.000000    Overall Loss 0.010746    
+2023-12-04 06:16:01,647 - Epoch: [27][  400/ 1680]    Loss 0.000000    Overall Loss 0.010764    
+2023-12-04 06:16:24,606 - Epoch: [27][  500/ 1680]    Loss 0.000000    Overall Loss 0.010757    
+2023-12-04 06:16:48,242 - Epoch: [27][  600/ 1680]    Loss 0.000000    Overall Loss 0.010757    
+2023-12-04 06:17:11,686 - Epoch: [27][  700/ 1680]    Loss 0.000000    Overall Loss 0.010762    
+2023-12-04 06:17:34,892 - Epoch: [27][  800/ 1680]    Loss 0.000000    Overall Loss 0.010756    
+2023-12-04 06:17:58,996 - Epoch: [27][  900/ 1680]    Loss 0.000000    Overall Loss 0.010751    
+2023-12-04 06:18:23,175 - Epoch: [27][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010747    
+2023-12-04 06:18:46,011 - Epoch: [27][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010746    
+2023-12-04 06:19:09,991 - Epoch: [27][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010747    
+2023-12-04 06:19:33,331 - Epoch: [27][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010746    
+2023-12-04 06:19:56,279 - Epoch: [27][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010749    
+2023-12-04 06:20:19,513 - Epoch: [27][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010748    
+2023-12-04 06:20:42,651 - Epoch: [27][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010747    
+2023-12-04 06:21:00,836 - Epoch: [27][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010747    
+2023-12-04 06:21:01,355 - ==> Overall Loss: 0.011
+
+2023-12-04 06:21:01,362 - ==> Best [Overall Loss: 0.010714 on epoch: 26]
+2023-12-04 06:21:01,363 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-04 06:21:01,401 - 
+
+2023-12-04 06:21:01,401 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-04 06:22:00,713 - Epoch: [28][  100/31148]    Overall Loss 0.009880    Objective Loss 0.000000    Distill Loss 0.009880                     LR 0.000016    Time 0.593016    
+2023-12-04 06:22:41,987 - Epoch: [28][  200/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000016    Time 0.502840    
+2023-12-04 06:23:20,847 - Epoch: [28][  300/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000016    Time 0.464736    
+2023-12-04 06:24:01,336 - Epoch: [28][  400/31148]    Overall Loss 0.009792    Objective Loss 0.000000    Distill Loss 0.009792                     LR 0.000016    Time 0.449755    
+2023-12-04 06:24:47,821 - Epoch: [28][  500/31148]    Overall Loss 0.009801    Objective Loss 0.000000    Distill Loss 0.009801                     LR 0.000016    Time 0.452760    
+2023-12-04 06:25:27,393 - Epoch: [28][  600/31148]    Overall Loss 0.009796    Objective Loss 0.000000    Distill Loss 0.009796                     LR 0.000016    Time 0.443241    
+2023-12-04 06:26:02,336 - Epoch: [28][  700/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000016    Time 0.429829    
+2023-12-04 06:26:50,276 - Epoch: [28][  800/31148]    Overall Loss 0.009831    Objective Loss 0.000000    Distill Loss 0.009831                     LR 0.000016    Time 0.436016    
+2023-12-04 06:27:30,078 - Epoch: [28][  900/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000016    Time 0.431787    
+2023-12-04 06:28:16,736 - Epoch: [28][ 1000/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000016    Time 0.435259    
+2023-12-04 06:28:54,525 - Epoch: [28][ 1100/31148]    Overall Loss 0.009837    Objective Loss 0.000000    Distill Loss 0.009837                     LR 0.000016    Time 0.430037    
+2023-12-04 06:29:41,615 - Epoch: [28][ 1200/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000016    Time 0.433435    
+2023-12-04 06:30:24,601 - Epoch: [28][ 1300/31148]    Overall Loss 0.009831    Objective Loss 0.000000    Distill Loss 0.009831                     LR 0.000016    Time 0.433155    
+2023-12-04 06:31:05,019 - Epoch: [28][ 1400/31148]    Overall Loss 0.009837    Objective Loss 0.000000    Distill Loss 0.009837                     LR 0.000016    Time 0.431080    
+2023-12-04 06:31:45,072 - Epoch: [28][ 1500/31148]    Overall Loss 0.009836    Objective Loss 0.000000    Distill Loss 0.009836                     LR 0.000016    Time 0.429039    
+2023-12-04 06:32:37,155 - Epoch: [28][ 1600/31148]    Overall Loss 0.009836    Objective Loss 0.000000    Distill Loss 0.009836                     LR 0.000016    Time 0.434771    
+2023-12-04 06:33:29,910 - Epoch: [28][ 1700/31148]    Overall Loss 0.009835    Objective Loss 0.000000    Distill Loss 0.009835                     LR 0.000016    Time 0.440224    
+2023-12-04 06:34:17,210 - Epoch: [28][ 1800/31148]    Overall Loss 0.009834    Objective Loss 0.000000    Distill Loss 0.009834                     LR 0.000016    Time 0.442041    
+2023-12-04 06:34:59,269 - Epoch: [28][ 1900/31148]    Overall Loss 0.009836    Objective Loss 0.000000    Distill Loss 0.009836                     LR 0.000016    Time 0.440908    
+2023-12-04 06:35:42,080 - Epoch: [28][ 2000/31148]    Overall Loss 0.009835    Objective Loss 0.000000    Distill Loss 0.009835                     LR 0.000016    Time 0.440265    
+2023-12-04 06:36:26,594 - Epoch: [28][ 2100/31148]    Overall Loss 0.009838    Objective Loss 0.000000    Distill Loss 0.009838                     LR 0.000016    Time 0.440494    
+2023-12-04 06:37:05,995 - Epoch: [28][ 2200/31148]    Overall Loss 0.009837    Objective Loss 0.000000    Distill Loss 0.009837                     LR 0.000016    Time 0.438377    
+2023-12-04 06:37:59,235 - Epoch: [28][ 2300/31148]    Overall Loss 0.009843    Objective Loss 0.000000    Distill Loss 0.009843                     LR 0.000016    Time 0.442462    
+2023-12-04 06:38:44,351 - Epoch: [28][ 2400/31148]    Overall Loss 0.009849    Objective Loss 0.000000    Distill Loss 0.009849                     LR 0.000016    Time 0.442821    
+2023-12-04 06:39:21,488 - Epoch: [28][ 2500/31148]    Overall Loss 0.009852    Objective Loss 0.000000    Distill Loss 0.009852                     LR 0.000016    Time 0.439961    
+2023-12-04 06:40:07,136 - Epoch: [28][ 2600/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.000016    Time 0.440593    
+2023-12-04 06:40:50,043 - Epoch: [28][ 2700/31148]    Overall Loss 0.009860    Objective Loss 0.000000    Distill Loss 0.009860                     LR 0.000016    Time 0.440164    
+2023-12-04 06:41:37,475 - Epoch: [28][ 2800/31148]    Overall Loss 0.009860    Objective Loss 0.000000    Distill Loss 0.009860                     LR 0.000016    Time 0.441381    
+2023-12-04 06:42:18,049 - Epoch: [28][ 2900/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.000016    Time 0.440150    
+2023-12-04 06:42:54,425 - Epoch: [28][ 3000/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.000016    Time 0.437601    
+2023-12-04 06:43:36,483 - Epoch: [28][ 3100/31148]    Overall Loss 0.009859    Objective Loss 0.000000    Distill Loss 0.009859                     LR 0.000016    Time 0.437050    
+2023-12-04 06:44:19,137 - Epoch: [28][ 3200/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.000016    Time 0.436719    
+2023-12-04 06:45:03,359 - Epoch: [28][ 3300/31148]    Overall Loss 0.009857    Objective Loss 0.000000    Distill Loss 0.009857                     LR 0.000016    Time 0.436884    
+2023-12-04 06:45:50,977 - Epoch: [28][ 3400/31148]    Overall Loss 0.009858    Objective Loss 0.000000    Distill Loss 0.009858                     LR 0.000016    Time 0.438037    
+2023-12-04 06:46:39,161 - Epoch: [28][ 3500/31148]    Overall Loss 0.009856    Objective Loss 0.000000    Distill Loss 0.009856                     LR 0.000016    Time 0.439286    
+2023-12-04 06:47:26,379 - Epoch: [28][ 3600/31148]    Overall Loss 0.009861    Objective Loss 0.000000    Distill Loss 0.009861                     LR 0.000016    Time 0.440198    
+2023-12-04 06:48:07,796 - Epoch: [28][ 3700/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.439493    
+2023-12-04 06:48:54,230 - Epoch: [28][ 3800/31148]    Overall Loss 0.009863    Objective Loss 0.000000    Distill Loss 0.009863                     LR 0.000016    Time 0.440145    
+2023-12-04 06:49:38,035 - Epoch: [28][ 3900/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.440090    
+2023-12-04 06:50:17,409 - Epoch: [28][ 4000/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.438929    
+2023-12-04 06:51:05,586 - Epoch: [28][ 4100/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.439972    
+2023-12-04 06:51:54,604 - Epoch: [28][ 4200/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.441166    
+2023-12-04 06:52:43,996 - Epoch: [28][ 4300/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.442391    
+2023-12-04 06:53:23,876 - Epoch: [28][ 4400/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.441398    
+2023-12-04 06:54:01,134 - Epoch: [28][ 4500/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.439868    
+2023-12-04 06:54:39,555 - Epoch: [28][ 4600/31148]    Overall Loss 0.009864    Objective Loss 0.000000    Distill Loss 0.009864                     LR 0.000016    Time 0.438656    
+2023-12-04 06:55:20,035 - Epoch: [28][ 4700/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.437934    
+2023-12-04 06:55:56,000 - Epoch: [28][ 4800/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.436302    
+2023-12-04 06:56:34,858 - Epoch: [28][ 4900/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.435326    
+2023-12-04 06:57:11,053 - Epoch: [28][ 5000/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.433857    
+2023-12-04 06:57:53,172 - Epoch: [28][ 5100/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.433607    
+2023-12-04 06:58:31,205 - Epoch: [28][ 5200/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.000016    Time 0.432582    
+2023-12-04 06:59:18,534 - Epoch: [28][ 5300/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.000016    Time 0.433348    
+2023-12-04 07:00:01,769 - Epoch: [28][ 5400/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.433328    
+2023-12-04 07:00:57,906 - Epoch: [28][ 5500/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.435655    
+2023-12-04 07:01:48,597 - Epoch: [28][ 5600/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.436926    
+2023-12-04 07:02:42,480 - Epoch: [28][ 5700/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.438713    
+2023-12-04 07:03:29,200 - Epoch: [28][ 5800/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.000016    Time 0.439203    
+2023-12-04 07:04:19,697 - Epoch: [28][ 5900/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.440316    
+2023-12-04 07:04:56,507 - Epoch: [28][ 6000/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.439111    
+2023-12-04 07:05:42,537 - Epoch: [28][ 6100/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.439457    
+2023-12-04 07:06:20,096 - Epoch: [28][ 6200/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.438426    
+2023-12-04 07:07:04,429 - Epoch: [28][ 6300/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.438503    
+2023-12-04 07:07:47,187 - Epoch: [28][ 6400/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.438331    
+2023-12-04 07:08:32,673 - Epoch: [28][ 6500/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.438584    
+2023-12-04 07:09:26,670 - Epoch: [28][ 6600/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.440119    
+2023-12-04 07:10:01,414 - Epoch: [28][ 6700/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.438735    
+2023-12-04 07:10:41,955 - Epoch: [28][ 6800/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.438244    
+2023-12-04 07:11:22,181 - Epoch: [28][ 6900/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.000016    Time 0.437721    
+2023-12-04 07:12:03,961 - Epoch: [28][ 7000/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.000016    Time 0.437436    
+2023-12-04 07:12:51,995 - Epoch: [28][ 7100/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.000016    Time 0.438039    
+2023-12-04 07:13:40,280 - Epoch: [28][ 7200/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.000016    Time 0.438660    
+2023-12-04 07:14:25,676 - Epoch: [28][ 7300/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.438869    
+2023-12-04 07:15:04,174 - Epoch: [28][ 7400/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.438140    
+2023-12-04 07:15:56,801 - Epoch: [28][ 7500/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.439314    
+2023-12-04 07:16:39,173 - Epoch: [28][ 7600/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.439107    
+2023-12-04 07:17:22,342 - Epoch: [28][ 7700/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.000016    Time 0.439010    
+2023-12-04 07:18:04,239 - Epoch: [28][ 7800/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.438752    
+2023-12-04 07:18:49,378 - Epoch: [28][ 7900/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.438911    
+2023-12-04 07:19:31,620 - Epoch: [28][ 8000/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.438704    
+2023-12-04 07:20:13,696 - Epoch: [28][ 8100/31148]    Overall Loss 0.009866    Objective Loss 0.000000    Distill Loss 0.009866                     LR 0.000016    Time 0.438482    
+2023-12-04 07:20:55,942 - Epoch: [28][ 8200/31148]    Overall Loss 0.009865    Objective Loss 0.000000    Distill Loss 0.009865                     LR 0.000016    Time 0.438286    
+2023-12-04 07:21:45,446 - Epoch: [28][ 8300/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.438968    
+2023-12-04 07:22:33,419 - Epoch: [28][ 8400/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.439453    
+2023-12-04 07:23:15,974 - Epoch: [28][ 8500/31148]    Overall Loss 0.009868    Objective Loss 0.000000    Distill Loss 0.009868                     LR 0.000016    Time 0.439289    
+2023-12-04 07:23:55,739 - Epoch: [28][ 8600/31148]    Overall Loss 0.009867    Objective Loss 0.000000    Distill Loss 0.009867                     LR 0.000016    Time 0.438804    
+2023-12-04 07:24:33,758 - Epoch: [28][ 8700/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.000016    Time 0.438129    
+2023-12-04 07:25:16,576 - Epoch: [28][ 8800/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.438015    
+2023-12-04 07:26:02,301 - Epoch: [28][ 8900/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.438231    
+2023-12-04 07:26:50,743 - Epoch: [28][ 9000/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.438743    
+2023-12-04 07:27:33,629 - Epoch: [28][ 9100/31148]    Overall Loss 0.009870    Objective Loss 0.000000    Distill Loss 0.009870                     LR 0.000016    Time 0.438634    
+2023-12-04 07:28:20,039 - Epoch: [28][ 9200/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.438910    
+2023-12-04 07:29:00,082 - Epoch: [28][ 9300/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.438495    
+2023-12-04 07:29:49,144 - Epoch: [28][ 9400/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.000016    Time 0.439049    
+2023-12-04 07:30:32,191 - Epoch: [28][ 9500/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.000016    Time 0.438958    
+2023-12-04 07:31:13,815 - Epoch: [28][ 9600/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.000016    Time 0.438720    
+2023-12-04 07:31:56,031 - Epoch: [28][ 9700/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.000016    Time 0.438549    
+2023-12-04 07:32:49,247 - Epoch: [28][ 9800/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.000016    Time 0.439503    
+2023-12-04 07:33:35,055 - Epoch: [28][ 9900/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.000016    Time 0.439690    
+2023-12-04 07:34:20,168 - Epoch: [28][10000/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.000016    Time 0.439804    
+2023-12-04 07:34:56,404 - Epoch: [28][10100/31148]    Overall Loss 0.009872    Objective Loss 0.000000    Distill Loss 0.009872                     LR 0.000016    Time 0.439036    
+2023-12-04 07:35:39,177 - Epoch: [28][10200/31148]    Overall Loss 0.009871    Objective Loss 0.000000    Distill Loss 0.009871                     LR 0.000016    Time 0.438925    
+2023-12-04 07:36:30,696 - Epoch: [28][10300/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.000016    Time 0.439665    
+2023-12-04 07:37:14,364 - Epoch: [28][10400/31148]    Overall Loss 0.009873    Objective Loss 0.000000    Distill Loss 0.009873                     LR 0.000016    Time 0.439635    
+2023-12-04 07:37:55,675 - Epoch: [28][10500/31148]    Overall Loss 0.009874    Objective Loss 0.000000    Distill Loss 0.009874                     LR 0.000016    Time 0.439382    
+2023-12-04 07:38:36,243 - Epoch: [28][10600/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.000016    Time 0.439063    
+2023-12-04 07:39:19,920 - Epoch: [28][10700/31148]    Overall Loss 0.009875    Objective Loss 0.000000    Distill Loss 0.009875                     LR 0.000016    Time 0.439041    
+2023-12-04 07:40:01,512 - Epoch: [28][10800/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.000016    Time 0.438827    
+2023-12-04 07:40:51,049 - Epoch: [28][10900/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.000016    Time 0.439345    
+2023-12-04 07:41:39,221 - Epoch: [28][11000/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.000016    Time 0.439729    
+2023-12-04 07:42:22,883 - Epoch: [28][11100/31148]    Overall Loss 0.009877    Objective Loss 0.000000    Distill Loss 0.009877                     LR 0.000016    Time 0.439700    
+2023-12-04 07:43:10,520 - Epoch: [28][11200/31148]    Overall Loss 0.009875    Objective Loss 0.000000    Distill Loss 0.009875                     LR 0.000016    Time 0.440027    
+2023-12-04 07:43:52,713 - Epoch: [28][11300/31148]    Overall Loss 0.009876    Objective Loss 0.000000    Distill Loss 0.009876                     LR 0.000016    Time 0.439867    
+2023-12-04 07:44:33,195 - Epoch: [28][11400/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.000016    Time 0.439558    
+2023-12-04 07:45:12,188 - Epoch: [28][11500/31148]    Overall Loss 0.009878    Objective Loss 0.000000    Distill Loss 0.009878                     LR 0.000016    Time 0.439126    
+2023-12-04 07:45:56,256 - Epoch: [28][11600/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.000016    Time 0.439139    
+2023-12-04 07:46:36,341 - Epoch: [28][11700/31148]    Overall Loss 0.009879    Objective Loss 0.000000    Distill Loss 0.009879                     LR 0.000016    Time 0.438811    
+2023-12-04 07:47:21,188 - Epoch: [28][11800/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.438893    
+2023-12-04 07:48:04,390 - Epoch: [28][11900/31148]    Overall Loss 0.009880    Objective Loss 0.000000    Distill Loss 0.009880                     LR 0.000016    Time 0.438834    
+2023-12-04 07:48:44,020 - Epoch: [28][12000/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.438479    
+2023-12-04 07:49:26,418 - Epoch: [28][12100/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.438359    
+2023-12-04 07:50:07,682 - Epoch: [28][12200/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.438147    
+2023-12-04 07:50:49,714 - Epoch: [28][12300/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.438002    
+2023-12-04 07:51:35,005 - Epoch: [28][12400/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.438122    
+2023-12-04 07:52:14,831 - Epoch: [28][12500/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.437802    
+2023-12-04 07:52:52,988 - Epoch: [28][12600/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.437355    
+2023-12-04 07:53:27,819 - Epoch: [28][12700/31148]    Overall Loss 0.009881    Objective Loss 0.000000    Distill Loss 0.009881                     LR 0.000016    Time 0.436654    
+2023-12-04 07:54:11,108 - Epoch: [28][12800/31148]    Overall Loss 0.009882    Objective Loss 0.000000    Distill Loss 0.009882                     LR 0.000016    Time 0.436624    
+2023-12-04 07:54:52,638 - Epoch: [28][12900/31148]    Overall Loss 0.009882    Objective Loss 0.000000    Distill Loss 0.009882                     LR 0.000016    Time 0.436458    
+2023-12-04 07:55:30,039 - Epoch: [28][13000/31148]    Overall Loss 0.009883    Objective Loss 0.000000    Distill Loss 0.009883                     LR 0.000016    Time 0.435977    
+2023-12-04 07:56:11,789 - Epoch: [28][13100/31148]    Overall Loss 0.009883    Objective Loss 0.000000    Distill Loss 0.009883                     LR 0.000016    Time 0.435835    
+2023-12-04 07:56:54,063 - Epoch: [28][13200/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.435735    
+2023-12-04 07:57:40,411 - Epoch: [28][13300/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.435944    
+2023-12-04 07:58:34,337 - Epoch: [28][13400/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.436714    
+2023-12-04 07:59:15,027 - Epoch: [28][13500/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.436493    
+2023-12-04 07:59:56,640 - Epoch: [28][13600/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.436342    
+2023-12-04 08:00:36,802 - Epoch: [28][13700/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.436088    
+2023-12-04 08:01:18,777 - Epoch: [28][13800/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.435970    
+2023-12-04 08:01:55,788 - Epoch: [28][13900/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.435495    
+2023-12-04 08:02:37,849 - Epoch: [28][14000/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.435388    
+2023-12-04 08:03:13,269 - Epoch: [28][14100/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.000016    Time 0.434812    
+2023-12-04 08:03:53,868 - Epoch: [28][14200/31148]    Overall Loss 0.009886    Objective Loss 0.000000    Distill Loss 0.009886                     LR 0.000016    Time 0.434609    
+2023-12-04 08:04:38,084 - Epoch: [28][14300/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.434661    
+2023-12-04 08:05:22,004 - Epoch: [28][14400/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.434692    
+2023-12-04 08:06:11,981 - Epoch: [28][14500/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.435140    
+2023-12-04 08:06:45,951 - Epoch: [28][14600/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.434486    
+2023-12-04 08:07:31,335 - Epoch: [28][14700/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.434617    
+2023-12-04 08:08:19,657 - Epoch: [28][14800/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.434945    
+2023-12-04 08:09:05,013 - Epoch: [28][14900/31148]    Overall Loss 0.009884    Objective Loss 0.000000    Distill Loss 0.009884                     LR 0.000016    Time 0.435070    
+2023-12-04 08:09:47,192 - Epoch: [28][15000/31148]    Overall Loss 0.009885    Objective Loss 0.000000    Distill Loss 0.009885                     LR 0.000016    Time 0.434981    
+2023-12-04 08:10:39,774 - Epoch: [28][15100/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.435582    
+2023-12-04 08:11:19,364 - Epoch: [28][15200/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.435320    
+2023-12-04 08:11:58,503 - Epoch: [28][15300/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.435033    
+2023-12-04 08:12:37,962 - Epoch: [28][15400/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.434770    
+2023-12-04 08:13:10,726 - Epoch: [28][15500/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.434078    
+2023-12-04 08:13:38,658 - Epoch: [28][15600/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.433086    
+2023-12-04 08:14:06,764 - Epoch: [28][15700/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.432117    
+2023-12-04 08:14:35,188 - Epoch: [28][15800/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.431181    
+2023-12-04 08:15:03,605 - Epoch: [28][15900/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.430256    
+2023-12-04 08:15:31,436 - Epoch: [28][16000/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.429306    
+2023-12-04 08:15:59,555 - Epoch: [28][16100/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.428386    
+2023-12-04 08:16:27,665 - Epoch: [28][16200/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.427477    
+2023-12-04 08:16:55,974 - Epoch: [28][16300/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.426591    
+2023-12-04 08:17:24,356 - Epoch: [28][16400/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.425720    
+2023-12-04 08:17:52,382 - Epoch: [28][16500/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.424838    
+2023-12-04 08:18:26,332 - Epoch: [28][16600/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.424324    
+2023-12-04 08:19:16,374 - Epoch: [28][16700/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.424779    
+2023-12-04 08:20:01,367 - Epoch: [28][16800/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.424928    
+2023-12-04 08:20:47,917 - Epoch: [28][16900/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.000016    Time 0.425168    
+2023-12-04 08:21:34,058 - Epoch: [28][17000/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.425381    
+2023-12-04 08:22:32,411 - Epoch: [28][17100/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.000016    Time 0.426305    
+2023-12-04 08:23:14,502 - Epoch: [28][17200/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.426273    
+2023-12-04 08:24:14,804 - Epoch: [28][17300/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.427294    
+2023-12-04 08:25:11,312 - Epoch: [28][17400/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.428086    
+2023-12-04 08:25:57,943 - Epoch: [28][17500/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.428304    
+2023-12-04 08:26:46,951 - Epoch: [28][17600/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.428654    
+2023-12-04 08:27:30,474 - Epoch: [28][17700/31148]    Overall Loss 0.009887    Objective Loss 0.000000    Distill Loss 0.009887                     LR 0.000016    Time 0.428691    
+2023-12-04 08:28:13,811 - Epoch: [28][17800/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.428717    
+2023-12-04 08:29:03,748 - Epoch: [28][17900/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.429111    
+2023-12-04 08:29:45,555 - Epoch: [28][18000/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.429050    
+2023-12-04 08:30:47,228 - Epoch: [28][18100/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.430086    
+2023-12-04 08:31:33,448 - Epoch: [28][18200/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.430262    
+2023-12-04 08:32:15,778 - Epoch: [28][18300/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.430224    
+2023-12-04 08:33:11,661 - Epoch: [28][18400/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.430922    
+2023-12-04 08:33:58,688 - Epoch: [28][18500/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.431135    
+2023-12-04 08:34:50,181 - Epoch: [28][18600/31148]    Overall Loss 0.009888    Objective Loss 0.000000    Distill Loss 0.009888                     LR 0.000016    Time 0.431585    
+2023-12-04 08:35:40,311 - Epoch: [28][18700/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.431957    
+2023-12-04 08:36:29,146 - Epoch: [28][18800/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.432257    
+2023-12-04 08:37:17,573 - Epoch: [28][18900/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.432531    
+2023-12-04 08:38:04,877 - Epoch: [28][19000/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.432744    
+2023-12-04 08:38:40,430 - Epoch: [28][19100/31148]    Overall Loss 0.009889    Objective Loss 0.000000    Distill Loss 0.009889                     LR 0.000016    Time 0.432340    
+2023-12-04 08:39:46,635 - Epoch: [28][19200/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.433536    
+2023-12-04 08:40:43,918 - Epoch: [28][19300/31148]    Overall Loss 0.009890    Objective Loss 0.000000    Distill Loss 0.009890                     LR 0.000016    Time 0.434257    
+2023-12-04 08:41:27,440 - Epoch: [28][19400/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.000016    Time 0.434262    
+2023-12-04 08:42:13,101 - Epoch: [28][19500/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.000016    Time 0.434376    
+2023-12-04 08:43:04,757 - Epoch: [28][19600/31148]    Overall Loss 0.009891    Objective Loss 0.000000    Distill Loss 0.009891                     LR 0.000016    Time 0.434795    
+2023-12-04 08:43:49,193 - Epoch: [28][19700/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.434843    
+2023-12-04 08:44:41,537 - Epoch: [28][19800/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.435290    
+2023-12-04 08:45:23,445 - Epoch: [28][19900/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.435208    
+2023-12-04 08:46:11,084 - Epoch: [28][20000/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.435414    
+2023-12-04 08:46:57,061 - Epoch: [28][20100/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.435535    
+2023-12-04 08:47:47,657 - Epoch: [28][20200/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.435883    
+2023-12-04 08:48:40,772 - Epoch: [28][20300/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.436352    
+2023-12-04 08:49:30,953 - Epoch: [28][20400/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.436672    
+2023-12-04 08:50:07,656 - Epoch: [28][20500/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.436332    
+2023-12-04 08:50:46,002 - Epoch: [28][20600/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.436075    
+2023-12-04 08:51:44,000 - Epoch: [28][20700/31148]    Overall Loss 0.009892    Objective Loss 0.000000    Distill Loss 0.009892                     LR 0.000016    Time 0.436770    
+2023-12-04 08:52:41,856 - Epoch: [28][20800/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.437451    
+2023-12-04 08:53:35,545 - Epoch: [28][20900/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.437927    
+2023-12-04 08:54:18,118 - Epoch: [28][21000/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.437868    
+2023-12-04 08:55:07,224 - Epoch: [28][21100/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.438120    
+2023-12-04 08:55:54,182 - Epoch: [28][21200/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.438268    
+2023-12-04 08:56:36,977 - Epoch: [28][21300/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.438219    
+2023-12-04 08:57:16,634 - Epoch: [28][21400/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.438024    
+2023-12-04 08:58:01,268 - Epoch: [28][21500/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.438063    
+2023-12-04 08:58:52,235 - Epoch: [28][21600/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.438394    
+2023-12-04 08:59:39,097 - Epoch: [28][21700/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.438533    
+2023-12-04 09:00:34,293 - Epoch: [28][21800/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439053    
+2023-12-04 09:01:21,236 - Epoch: [28][21900/31148]    Overall Loss 0.009893    Objective Loss 0.000000    Distill Loss 0.009893                     LR 0.000016    Time 0.439191    
+2023-12-04 09:02:13,704 - Epoch: [28][22000/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439579    
+2023-12-04 09:02:59,936 - Epoch: [28][22100/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439682    
+2023-12-04 09:03:46,984 - Epoch: [28][22200/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439820    
+2023-12-04 09:04:29,184 - Epoch: [28][22300/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439740    
+2023-12-04 09:05:10,895 - Epoch: [28][22400/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439639    
+2023-12-04 09:06:02,533 - Epoch: [28][22500/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439980    
+2023-12-04 09:06:45,813 - Epoch: [28][22600/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.439947    
+2023-12-04 09:07:50,471 - Epoch: [28][22700/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.440857    
+2023-12-04 09:08:40,284 - Epoch: [28][22800/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.441108    
+2023-12-04 09:09:24,294 - Epoch: [28][22900/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.441104    
+2023-12-04 09:10:14,563 - Epoch: [28][23000/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.441371    
+2023-12-04 09:11:03,759 - Epoch: [28][23100/31148]    Overall Loss 0.009894    Objective Loss 0.000000    Distill Loss 0.009894                     LR 0.000016    Time 0.441590    
+2023-12-04 09:11:55,707 - Epoch: [28][23200/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.441925    
+2023-12-04 09:12:37,519 - Epoch: [28][23300/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.441823    
+2023-12-04 09:13:23,724 - Epoch: [28][23400/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.441909    
+2023-12-04 09:14:15,076 - Epoch: [28][23500/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.442213    
+2023-12-04 09:14:54,827 - Epoch: [28][23600/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.442023    
+2023-12-04 09:15:40,230 - Epoch: [28][23700/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.442074    
+2023-12-04 09:16:27,993 - Epoch: [28][23800/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.442223    
+2023-12-04 09:17:23,773 - Epoch: [28][23900/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.442706    
+2023-12-04 09:18:21,485 - Epoch: [28][24000/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443266    
+2023-12-04 09:19:02,742 - Epoch: [28][24100/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443138    
+2023-12-04 09:19:49,704 - Epoch: [28][24200/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443247    
+2023-12-04 09:20:31,436 - Epoch: [28][24300/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443140    
+2023-12-04 09:21:21,240 - Epoch: [28][24400/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.443365    
+2023-12-04 09:22:08,970 - Epoch: [28][24500/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443503    
+2023-12-04 09:22:59,073 - Epoch: [28][24600/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443737    
+2023-12-04 09:23:47,121 - Epoch: [28][24700/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443885    
+2023-12-04 09:24:33,326 - Epoch: [28][24800/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443958    
+2023-12-04 09:25:17,636 - Epoch: [28][24900/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443955    
+2023-12-04 09:26:02,439 - Epoch: [28][25000/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443971    
+2023-12-04 09:26:48,583 - Epoch: [28][25100/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.444040    
+2023-12-04 09:27:35,252 - Epoch: [28][25200/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.444130    
+2023-12-04 09:28:15,479 - Epoch: [28][25300/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.443964    
+2023-12-04 09:28:59,423 - Epoch: [28][25400/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443946    
+2023-12-04 09:29:47,745 - Epoch: [28][25500/31148]    Overall Loss 0.009896    Objective Loss 0.000000    Distill Loss 0.009896                     LR 0.000016    Time 0.444099    
+2023-12-04 09:30:32,337 - Epoch: [28][25600/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.444106    
+2023-12-04 09:31:14,594 - Epoch: [28][25700/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.444022    
+2023-12-04 09:31:53,535 - Epoch: [28][25800/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443810    
+2023-12-04 09:32:37,110 - Epoch: [28][25900/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443779    
+2023-12-04 09:33:22,751 - Epoch: [28][26000/31148]    Overall Loss 0.009897    Objective Loss 0.000000    Distill Loss 0.009897                     LR 0.000016    Time 0.443827    
+2023-12-04 09:34:18,406 - Epoch: [28][26100/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.000016    Time 0.444258    
+2023-12-04 09:35:05,209 - Epoch: [28][26200/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.000016    Time 0.444349    
+2023-12-04 09:35:57,461 - Epoch: [28][26300/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.000016    Time 0.444646    
+2023-12-04 09:36:38,161 - Epoch: [28][26400/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.000016    Time 0.444503    
+2023-12-04 09:37:19,809 - Epoch: [28][26500/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444397    
+2023-12-04 09:38:04,976 - Epoch: [28][26600/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444424    
+2023-12-04 09:38:52,935 - Epoch: [28][26700/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444555    
+2023-12-04 09:39:36,261 - Epoch: [28][26800/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444513    
+2023-12-04 09:40:14,863 - Epoch: [28][26900/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444295    
+2023-12-04 09:40:54,293 - Epoch: [28][27000/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444110    
+2023-12-04 09:41:41,240 - Epoch: [28][27100/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444203    
+2023-12-04 09:42:24,119 - Epoch: [28][27200/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444146    
+2023-12-04 09:43:02,278 - Epoch: [28][27300/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.443917    
+2023-12-04 09:43:51,574 - Epoch: [28][27400/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444096    
+2023-12-04 09:44:39,496 - Epoch: [28][27500/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444223    
+2023-12-04 09:45:30,366 - Epoch: [28][27600/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444456    
+2023-12-04 09:46:12,934 - Epoch: [28][27700/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444388    
+2023-12-04 09:46:55,677 - Epoch: [28][27800/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444327    
+2023-12-04 09:47:38,857 - Epoch: [28][27900/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444282    
+2023-12-04 09:48:18,841 - Epoch: [28][28000/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444123    
+2023-12-04 09:49:01,857 - Epoch: [28][28100/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444073    
+2023-12-04 09:49:46,558 - Epoch: [28][28200/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.000016    Time 0.444083    
+2023-12-04 09:50:31,629 - Epoch: [28][28300/31148]    Overall Loss 0.009898    Objective Loss 0.000000    Distill Loss 0.009898                     LR 0.000016    Time 0.444106    
+2023-12-04 09:51:14,550 - Epoch: [28][28400/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444054    
+2023-12-04 09:52:01,099 - Epoch: [28][28500/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444129    
+2023-12-04 09:52:43,831 - Epoch: [28][28600/31148]    Overall Loss 0.009899    Objective Loss 0.000000    Distill Loss 0.009899                     LR 0.000016    Time 0.444070    
+2023-12-04 09:53:27,773 - Epoch: [28][28700/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444053    
+2023-12-04 09:54:20,237 - Epoch: [28][28800/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444333    
+2023-12-04 09:55:03,871 - Epoch: [28][28900/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444305    
+2023-12-04 09:55:40,424 - Epoch: [28][29000/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444033    
+2023-12-04 09:56:24,492 - Epoch: [28][29100/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444021    
+2023-12-04 09:57:10,782 - Epoch: [28][29200/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444086    
+2023-12-04 09:57:56,375 - Epoch: [28][29300/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444126    
+2023-12-04 09:58:35,564 - Epoch: [28][29400/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.443948    
+2023-12-04 09:59:25,353 - Epoch: [28][29500/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444130    
+2023-12-04 10:00:09,572 - Epoch: [28][29600/31148]    Overall Loss 0.009900    Objective Loss 0.000000    Distill Loss 0.009900                     LR 0.000016    Time 0.444124    
+2023-12-04 10:00:53,151 - Epoch: [28][29700/31148]    Overall Loss 0.009901    Objective Loss 0.000000    Distill Loss 0.009901                     LR 0.000016    Time 0.444095    
+2023-12-04 10:01:35,608 - Epoch: [28][29800/31148]    Overall Loss 0.009901    Objective Loss 0.000000    Distill Loss 0.009901                     LR 0.000016    Time 0.444030    
+2023-12-04 10:02:30,052 - Epoch: [28][29900/31148]    Overall Loss 0.009901    Objective Loss 0.000000    Distill Loss 0.009901                     LR 0.000016    Time 0.444365    
+2023-12-04 10:03:14,284 - Epoch: [28][30000/31148]    Overall Loss 0.009901    Objective Loss 0.000000    Distill Loss 0.009901                     LR 0.000016    Time 0.444358    
+2023-12-04 10:03:59,717 - Epoch: [28][30100/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444391    
+2023-12-04 10:04:43,605 - Epoch: [28][30200/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444372    
+2023-12-04 10:05:21,384 - Epoch: [28][30300/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444152    
+2023-12-04 10:06:03,549 - Epoch: [28][30400/31148]    Overall Loss 0.009901    Objective Loss 0.000000    Distill Loss 0.009901                     LR 0.000016    Time 0.444078    
+2023-12-04 10:06:53,666 - Epoch: [28][30500/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444265    
+2023-12-04 10:07:43,980 - Epoch: [28][30600/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444457    
+2023-12-04 10:08:24,767 - Epoch: [28][30700/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444338    
+2023-12-04 10:09:06,646 - Epoch: [28][30800/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444255    
+2023-12-04 10:09:46,206 - Epoch: [28][30900/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444097    
+2023-12-04 10:10:36,179 - Epoch: [28][31000/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444276    
+2023-12-04 10:11:22,564 - Epoch: [28][31100/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.444339    
+2023-12-04 10:11:41,869 - Epoch: [28][31148/31148]    Overall Loss 0.009903    Objective Loss 0.000000    Distill Loss 0.009903                     LR 0.000016    Time 0.444274    
+2023-12-04 10:11:42,885 - --- validate (epoch=28)-----------
+2023-12-04 10:11:42,885 - 167951 samples (100 per mini-batch)
+2023-12-04 10:12:10,103 - Epoch: [28][  100/ 1680]    Loss 0.000000    Overall Loss 0.010548    
+2023-12-04 10:12:32,856 - Epoch: [28][  200/ 1680]    Loss 0.000000    Overall Loss 0.010567    
+2023-12-04 10:12:55,975 - Epoch: [28][  300/ 1680]    Loss 0.000000    Overall Loss 0.010592    
+2023-12-04 10:13:18,725 - Epoch: [28][  400/ 1680]    Loss 0.000000    Overall Loss 0.010607    
+2023-12-04 10:13:42,102 - Epoch: [28][  500/ 1680]    Loss 0.000000    Overall Loss 0.010594    
+2023-12-04 10:14:04,801 - Epoch: [28][  600/ 1680]    Loss 0.000000    Overall Loss 0.010586    
+2023-12-04 10:14:28,025 - Epoch: [28][  700/ 1680]    Loss 0.000000    Overall Loss 0.010584    
+2023-12-04 10:14:51,663 - Epoch: [28][  800/ 1680]    Loss 0.000000    Overall Loss 0.010584    
+2023-12-04 10:15:16,196 - Epoch: [28][  900/ 1680]    Loss 0.000000    Overall Loss 0.010582    
+2023-12-04 10:15:40,730 - Epoch: [28][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010581    
+2023-12-04 10:16:05,123 - Epoch: [28][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010582    
+2023-12-04 10:16:29,055 - Epoch: [28][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010579    
+2023-12-04 10:16:53,652 - Epoch: [28][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010577    
+2023-12-04 10:17:18,751 - Epoch: [28][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010574    
+2023-12-04 10:17:42,588 - Epoch: [28][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010575    
+2023-12-04 10:18:06,696 - Epoch: [28][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010574    
+2023-12-04 10:18:25,511 - Epoch: [28][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010576    
+2023-12-04 10:18:25,956 - ==> Overall Loss: 0.011
+
+2023-12-04 10:18:25,965 - ==> Best [Overall Loss: 0.010576 on epoch: 28]
+2023-12-04 10:18:25,965 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-04 10:18:26,030 - 
+
+2023-12-04 10:18:26,031 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-04 10:19:29,147 - Epoch: [29][  100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.631067    
+2023-12-04 10:20:12,260 - Epoch: [29][  200/31148]    Overall Loss 0.009869    Objective Loss 0.000000    Distill Loss 0.009869                     LR 0.000016    Time 0.531058    
+2023-12-04 10:21:03,096 - Epoch: [29][  300/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.523467    
+2023-12-04 10:21:48,729 - Epoch: [29][  400/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.506665    
+2023-12-04 10:22:27,928 - Epoch: [29][  500/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.483716    
+2023-12-04 10:23:15,031 - Epoch: [29][  600/31148]    Overall Loss 0.009895    Objective Loss 0.000000    Distill Loss 0.009895                     LR 0.000016    Time 0.481588    
+2023-12-04 10:23:53,173 - Epoch: [29][  700/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.467269    
+2023-12-04 10:24:35,555 - Epoch: [29][  800/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.461829    
+2023-12-04 10:25:22,773 - Epoch: [29][  900/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.462971    
+2023-12-04 10:25:58,098 - Epoch: [29][ 1000/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.451991    
+2023-12-04 10:26:46,615 - Epoch: [29][ 1100/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.455001    
+2023-12-04 10:27:34,164 - Epoch: [29][ 1200/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.456702    
+2023-12-04 10:28:16,207 - Epoch: [29][ 1300/31148]    Overall Loss 0.009906    Objective Loss 0.000000    Distill Loss 0.009906                     LR 0.000016    Time 0.453906    
+2023-12-04 10:28:59,052 - Epoch: [29][ 1400/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.452083    
+2023-12-04 10:29:43,090 - Epoch: [29][ 1500/31148]    Overall Loss 0.009901    Objective Loss 0.000000    Distill Loss 0.009901                     LR 0.000016    Time 0.451298    
+2023-12-04 10:30:20,256 - Epoch: [29][ 1600/31148]    Overall Loss 0.009904    Objective Loss 0.000000    Distill Loss 0.009904                     LR 0.000016    Time 0.446315    
+2023-12-04 10:30:59,904 - Epoch: [29][ 1700/31148]    Overall Loss 0.009902    Objective Loss 0.000000    Distill Loss 0.009902                     LR 0.000016    Time 0.443380    
+2023-12-04 10:31:49,128 - Epoch: [29][ 1800/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.446090    
+2023-12-04 10:32:30,497 - Epoch: [29][ 1900/31148]    Overall Loss 0.009908    Objective Loss 0.000000    Distill Loss 0.009908                     LR 0.000016    Time 0.444381    
+2023-12-04 10:33:11,779 - Epoch: [29][ 2000/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.442799    
+2023-12-04 10:33:51,638 - Epoch: [29][ 2100/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.440691    
+2023-12-04 10:34:38,184 - Epoch: [29][ 2200/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.441813    
+2023-12-04 10:35:13,218 - Epoch: [29][ 2300/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.437833    
+2023-12-04 10:35:52,505 - Epoch: [29][ 2400/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.435956    
+2023-12-04 10:36:37,896 - Epoch: [29][ 2500/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.436671    
+2023-12-04 10:37:26,622 - Epoch: [29][ 2600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.438614    
+2023-12-04 10:38:07,431 - Epoch: [29][ 2700/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.437481    
+2023-12-04 10:38:41,148 - Epoch: [29][ 2800/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.433896    
+2023-12-04 10:39:24,305 - Epoch: [29][ 2900/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.433813    
+2023-12-04 10:40:19,678 - Epoch: [29][ 3000/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.437808    
+2023-12-04 10:40:55,761 - Epoch: [29][ 3100/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.435322    
+2023-12-04 10:41:47,044 - Epoch: [29][ 3200/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.437742    
+2023-12-04 10:42:23,486 - Epoch: [29][ 3300/31148]    Overall Loss 0.009908    Objective Loss 0.000000    Distill Loss 0.009908                     LR 0.000016    Time 0.435518    
+2023-12-04 10:43:02,977 - Epoch: [29][ 3400/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.434321    
+2023-12-04 10:43:40,174 - Epoch: [29][ 3500/31148]    Overall Loss 0.009906    Objective Loss 0.000000    Distill Loss 0.009906                     LR 0.000016    Time 0.432538    
+2023-12-04 10:44:26,705 - Epoch: [29][ 3600/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.433446    
+2023-12-04 10:45:03,683 - Epoch: [29][ 3700/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.431723    
+2023-12-04 10:45:42,341 - Epoch: [29][ 3800/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430533    
+2023-12-04 10:46:30,300 - Epoch: [29][ 3900/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.431789    
+2023-12-04 10:47:17,683 - Epoch: [29][ 4000/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.432838    
+2023-12-04 10:48:07,714 - Epoch: [29][ 4100/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.434482    
+2023-12-04 10:48:54,213 - Epoch: [29][ 4200/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.435206    
+2023-12-04 10:49:34,420 - Epoch: [29][ 4300/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.434434    
+2023-12-04 10:50:11,775 - Epoch: [29][ 4400/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.433049    
+2023-12-04 10:50:59,976 - Epoch: [29][ 4500/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.434135    
+2023-12-04 10:51:46,949 - Epoch: [29][ 4600/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.434907    
+2023-12-04 10:52:25,200 - Epoch: [29][ 4700/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.433791    
+2023-12-04 10:53:04,189 - Epoch: [29][ 4800/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.432875    
+2023-12-04 10:53:39,629 - Epoch: [29][ 4900/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.431272    
+2023-12-04 10:54:24,522 - Epoch: [29][ 5000/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.431624    
+2023-12-04 10:55:04,233 - Epoch: [29][ 5100/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.430946    
+2023-12-04 10:55:43,386 - Epoch: [29][ 5200/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.430186    
+2023-12-04 10:56:25,135 - Epoch: [29][ 5300/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.429945    
+2023-12-04 10:57:14,051 - Epoch: [29][ 5400/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.431040    
+2023-12-04 10:57:55,186 - Epoch: [29][ 5500/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.430681    
+2023-12-04 10:58:43,798 - Epoch: [29][ 5600/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.431670    
+2023-12-04 10:59:25,256 - Epoch: [29][ 5700/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.431368    
+2023-12-04 10:59:57,599 - Epoch: [29][ 5800/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.429506    
+2023-12-04 11:00:41,426 - Epoch: [29][ 5900/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.429654    
+2023-12-04 11:01:24,378 - Epoch: [29][ 6000/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.429650    
+2023-12-04 11:02:12,195 - Epoch: [29][ 6100/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.430444    
+2023-12-04 11:02:56,050 - Epoch: [29][ 6200/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430574    
+2023-12-04 11:03:38,197 - Epoch: [29][ 6300/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430428    
+2023-12-04 11:04:18,943 - Epoch: [29][ 6400/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.430068    
+2023-12-04 11:05:00,668 - Epoch: [29][ 6500/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.429870    
+2023-12-04 11:05:46,777 - Epoch: [29][ 6600/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.430342    
+2023-12-04 11:06:26,831 - Epoch: [29][ 6700/31148]    Overall Loss 0.009906    Objective Loss 0.000000    Distill Loss 0.009906                     LR 0.000016    Time 0.429896    
+2023-12-04 11:07:16,437 - Epoch: [29][ 6800/31148]    Overall Loss 0.009906    Objective Loss 0.000000    Distill Loss 0.009906                     LR 0.000016    Time 0.430868    
+2023-12-04 11:08:05,537 - Epoch: [29][ 6900/31148]    Overall Loss 0.009908    Objective Loss 0.000000    Distill Loss 0.009908                     LR 0.000016    Time 0.431738    
+2023-12-04 11:08:43,533 - Epoch: [29][ 7000/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.430998    
+2023-12-04 11:09:32,323 - Epoch: [29][ 7100/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.431798    
+2023-12-04 11:10:12,148 - Epoch: [29][ 7200/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.431331    
+2023-12-04 11:10:49,621 - Epoch: [29][ 7300/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430555    
+2023-12-04 11:11:31,749 - Epoch: [29][ 7400/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430428    
+2023-12-04 11:12:16,339 - Epoch: [29][ 7500/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430634    
+2023-12-04 11:12:57,188 - Epoch: [29][ 7600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430341    
+2023-12-04 11:13:43,155 - Epoch: [29][ 7700/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430721    
+2023-12-04 11:14:17,835 - Epoch: [29][ 7800/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.429645    
+2023-12-04 11:15:04,148 - Epoch: [29][ 7900/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.430068    
+2023-12-04 11:15:43,781 - Epoch: [29][ 8000/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.429645    
+2023-12-04 11:16:29,333 - Epoch: [29][ 8100/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.429963    
+2023-12-04 11:17:13,597 - Epoch: [29][ 8200/31148]    Overall Loss 0.009906    Objective Loss 0.000000    Distill Loss 0.009906                     LR 0.000016    Time 0.430117    
+2023-12-04 11:17:52,880 - Epoch: [29][ 8300/31148]    Overall Loss 0.009908    Objective Loss 0.000000    Distill Loss 0.009908                     LR 0.000016    Time 0.429667    
+2023-12-04 11:18:37,871 - Epoch: [29][ 8400/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.429907    
+2023-12-04 11:19:21,886 - Epoch: [29][ 8500/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.430027    
+2023-12-04 11:20:10,020 - Epoch: [29][ 8600/31148]    Overall Loss 0.009907    Objective Loss 0.000000    Distill Loss 0.009907                     LR 0.000016    Time 0.430622    
+2023-12-04 11:20:51,726 - Epoch: [29][ 8700/31148]    Overall Loss 0.009908    Objective Loss 0.000000    Distill Loss 0.009908                     LR 0.000016    Time 0.430466    
+2023-12-04 11:21:33,645 - Epoch: [29][ 8800/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.430337    
+2023-12-04 11:22:23,063 - Epoch: [29][ 8900/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.431053    
+2023-12-04 11:23:08,665 - Epoch: [29][ 9000/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.431330    
+2023-12-04 11:23:52,019 - Epoch: [29][ 9100/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.431353    
+2023-12-04 11:24:30,475 - Epoch: [29][ 9200/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430844    
+2023-12-04 11:25:12,544 - Epoch: [29][ 9300/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430734    
+2023-12-04 11:25:57,426 - Epoch: [29][ 9400/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.430926    
+2023-12-04 11:26:36,524 - Epoch: [29][ 9500/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430504    
+2023-12-04 11:27:20,165 - Epoch: [29][ 9600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430565    
+2023-12-04 11:27:58,938 - Epoch: [29][ 9700/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430123    
+2023-12-04 11:28:48,252 - Epoch: [29][ 9800/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.430765    
+2023-12-04 11:29:32,319 - Epoch: [29][ 9900/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.430864    
+2023-12-04 11:30:07,798 - Epoch: [29][10000/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430103    
+2023-12-04 11:30:51,515 - Epoch: [29][10100/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.430172    
+2023-12-04 11:31:27,017 - Epoch: [29][10200/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.429434    
+2023-12-04 11:32:03,153 - Epoch: [29][10300/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.428773    
+2023-12-04 11:32:39,652 - Epoch: [29][10400/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.428159    
+2023-12-04 11:33:19,028 - Epoch: [29][10500/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.427831    
+2023-12-04 11:34:05,167 - Epoch: [29][10600/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.428146    
+2023-12-04 11:34:55,563 - Epoch: [29][10700/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.428854    
+2023-12-04 11:35:42,035 - Epoch: [29][10800/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.429186    
+2023-12-04 11:36:20,750 - Epoch: [29][10900/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.428799    
+2023-12-04 11:37:14,056 - Epoch: [29][11000/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.429747    
+2023-12-04 11:37:58,219 - Epoch: [29][11100/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.429853    
+2023-12-04 11:38:42,945 - Epoch: [29][11200/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.430008    
+2023-12-04 11:39:28,792 - Epoch: [29][11300/31148]    Overall Loss 0.009909    Objective Loss 0.000000    Distill Loss 0.009909                     LR 0.000016    Time 0.430259    
+2023-12-04 11:40:08,563 - Epoch: [29][11400/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.429973    
+2023-12-04 11:40:48,763 - Epoch: [29][11500/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.429729    
+2023-12-04 11:41:29,895 - Epoch: [29][11600/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.429569    
+2023-12-04 11:42:08,216 - Epoch: [29][11700/31148]    Overall Loss 0.009910    Objective Loss 0.000000    Distill Loss 0.009910                     LR 0.000016    Time 0.429173    
+2023-12-04 11:42:50,766 - Epoch: [29][11800/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.429141    
+2023-12-04 11:43:29,581 - Epoch: [29][11900/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.428796    
+2023-12-04 11:44:03,026 - Epoch: [29][12000/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.428009    
+2023-12-04 11:44:31,771 - Epoch: [29][12100/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.426847    
+2023-12-04 11:44:59,700 - Epoch: [29][12200/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.425637    
+2023-12-04 11:45:28,430 - Epoch: [29][12300/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.424512    
+2023-12-04 11:45:56,603 - Epoch: [29][12400/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.423361    
+2023-12-04 11:46:24,712 - Epoch: [29][12500/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.422222    
+2023-12-04 11:46:53,052 - Epoch: [29][12600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.421120    
+2023-12-04 11:47:21,165 - Epoch: [29][12700/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.420017    
+2023-12-04 11:47:49,349 - Epoch: [29][12800/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.418938    
+2023-12-04 11:48:17,458 - Epoch: [29][12900/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.417869    
+2023-12-04 11:48:46,000 - Epoch: [29][13000/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.416850    
+2023-12-04 11:49:14,800 - Epoch: [29][13100/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.415866    
+2023-12-04 11:50:11,523 - Epoch: [29][13200/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.417012    
+2023-12-04 11:50:57,006 - Epoch: [29][13300/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.417296    
+2023-12-04 11:51:42,500 - Epoch: [29][13400/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.417576    
+2023-12-04 11:52:28,780 - Epoch: [29][13500/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.417910    
+2023-12-04 11:53:16,680 - Epoch: [29][13600/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.418359    
+2023-12-04 11:54:13,830 - Epoch: [29][13700/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.419476    
+2023-12-04 11:55:04,625 - Epoch: [29][13800/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.420117    
+2023-12-04 11:55:47,243 - Epoch: [29][13900/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.420160    
+2023-12-04 11:56:26,658 - Epoch: [29][14000/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.419974    
+2023-12-04 11:57:11,471 - Epoch: [29][14100/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.420173    
+2023-12-04 11:57:49,277 - Epoch: [29][14200/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.419876    
+2023-12-04 11:58:31,471 - Epoch: [29][14300/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.419890    
+2023-12-04 11:59:26,190 - Epoch: [29][14400/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.420773    
+2023-12-04 12:00:21,908 - Epoch: [29][14500/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.421714    
+2023-12-04 12:00:59,396 - Epoch: [29][14600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.421393    
+2023-12-04 12:01:42,101 - Epoch: [29][14700/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.421430    
+2023-12-04 12:02:33,200 - Epoch: [29][14800/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.422035    
+2023-12-04 12:03:15,423 - Epoch: [29][14900/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.422036    
+2023-12-04 12:03:55,044 - Epoch: [29][15000/31148]    Overall Loss 0.009911    Objective Loss 0.000000    Distill Loss 0.009911                     LR 0.000016    Time 0.421863    
+2023-12-04 12:04:39,759 - Epoch: [29][15100/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.422030    
+2023-12-04 12:05:24,973 - Epoch: [29][15200/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.422227    
+2023-12-04 12:06:12,009 - Epoch: [29][15300/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.422541    
+2023-12-04 12:07:03,014 - Epoch: [29][15400/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.423109    
+2023-12-04 12:07:50,472 - Epoch: [29][15500/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.423441    
+2023-12-04 12:08:40,913 - Epoch: [29][15600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.423959    
+2023-12-04 12:09:33,896 - Epoch: [29][15700/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.424633    
+2023-12-04 12:10:18,368 - Epoch: [29][15800/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.424760    
+2023-12-04 12:11:13,144 - Epoch: [29][15900/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.425533    
+2023-12-04 12:12:04,695 - Epoch: [29][16000/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.426095    
+2023-12-04 12:12:50,486 - Epoch: [29][16100/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.426292    
+2023-12-04 12:13:31,940 - Epoch: [29][16200/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.426219    
+2023-12-04 12:14:19,415 - Epoch: [29][16300/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.426517    
+2023-12-04 12:14:59,974 - Epoch: [29][16400/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.426388    
+2023-12-04 12:15:53,325 - Epoch: [29][16500/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.427037    
+2023-12-04 12:16:38,179 - Epoch: [29][16600/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.427166    
+2023-12-04 12:17:23,794 - Epoch: [29][16700/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.427339    
+2023-12-04 12:18:10,132 - Epoch: [29][16800/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.427554    
+2023-12-04 12:18:56,603 - Epoch: [29][16900/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.427773    
+2023-12-04 12:19:32,461 - Epoch: [29][17000/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.427366    
+2023-12-04 12:20:06,386 - Epoch: [29][17100/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.426850    
+2023-12-04 12:21:07,303 - Epoch: [29][17200/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.427909    
+2023-12-04 12:21:51,263 - Epoch: [29][17300/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.427977    
+2023-12-04 12:22:40,882 - Epoch: [29][17400/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.428368    
+2023-12-04 12:23:26,503 - Epoch: [29][17500/31148]    Overall Loss 0.009912    Objective Loss 0.000000    Distill Loss 0.009912                     LR 0.000016    Time 0.428527    
+2023-12-04 12:24:22,893 - Epoch: [29][17600/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.429296    
+2023-12-04 12:25:13,244 - Epoch: [29][17700/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.429715    
+2023-12-04 12:25:54,335 - Epoch: [29][17800/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.429608    
+2023-12-04 12:26:41,639 - Epoch: [29][17900/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.429851    
+2023-12-04 12:27:37,070 - Epoch: [29][18000/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.430542    
+2023-12-04 12:28:24,824 - Epoch: [29][18100/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.430801    
+2023-12-04 12:29:14,108 - Epoch: [29][18200/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.431142    
+2023-12-04 12:29:55,246 - Epoch: [29][18300/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.431033    
+2023-12-04 12:30:49,611 - Epoch: [29][18400/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.431645    
+2023-12-04 12:31:42,288 - Epoch: [29][18500/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.432159    
+2023-12-04 12:32:27,186 - Epoch: [29][18600/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.432249    
+2023-12-04 12:33:21,179 - Epoch: [29][18700/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.432824    
+2023-12-04 12:34:11,016 - Epoch: [29][18800/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.433172    
+2023-12-04 12:34:57,346 - Epoch: [29][18900/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.433331    
+2023-12-04 12:35:46,008 - Epoch: [29][19000/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.433611    
+2023-12-04 12:36:33,471 - Epoch: [29][19100/31148]    Overall Loss 0.009913    Objective Loss 0.000000    Distill Loss 0.009913                     LR 0.000016    Time 0.433826    
+2023-12-04 12:37:17,936 - Epoch: [29][19200/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.433882    
+2023-12-04 12:38:20,808 - Epoch: [29][19300/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.434891    
+2023-12-04 12:39:00,282 - Epoch: [29][19400/31148]    Overall Loss 0.009914    Objective Loss 0.000000    Distill Loss 0.009914                     LR 0.000016    Time 0.434684    
+2023-12-04 12:39:41,647 - Epoch: [29][19500/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.434575    
+2023-12-04 12:40:31,101 - Epoch: [29][19600/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.434881    
+2023-12-04 12:41:16,926 - Epoch: [29][19700/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.434999    
+2023-12-04 12:41:59,627 - Epoch: [29][19800/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.434959    
+2023-12-04 12:42:47,035 - Epoch: [29][19900/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.435155    
+2023-12-04 12:43:36,565 - Epoch: [29][20000/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.435455    
+2023-12-04 12:44:24,088 - Epoch: [29][20100/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.435653    
+2023-12-04 12:45:16,217 - Epoch: [29][20200/31148]    Overall Loss 0.009915    Objective Loss 0.000000    Distill Loss 0.009915                     LR 0.000016    Time 0.436076    
+2023-12-04 12:46:03,488 - Epoch: [29][20300/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.436256    
+2023-12-04 12:46:50,372 - Epoch: [29][20400/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.436416    
+2023-12-04 12:47:43,657 - Epoch: [29][20500/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.436886    
+2023-12-04 12:48:28,891 - Epoch: [29][20600/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.436960    
+2023-12-04 12:49:15,450 - Epoch: [29][20700/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.437098    
+2023-12-04 12:50:10,364 - Epoch: [29][20800/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.437637    
+2023-12-04 12:50:50,055 - Epoch: [29][20900/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.437442    
+2023-12-04 12:51:44,499 - Epoch: [29][21000/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.437951    
+2023-12-04 12:52:21,331 - Epoch: [29][21100/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.437620    
+2023-12-04 12:53:15,072 - Epoch: [29][21200/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438091    
+2023-12-04 12:53:58,447 - Epoch: [29][21300/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438070    
+2023-12-04 12:54:54,090 - Epoch: [29][21400/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438623    
+2023-12-04 12:55:41,697 - Epoch: [29][21500/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438797    
+2023-12-04 12:56:19,072 - Epoch: [29][21600/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438495    
+2023-12-04 12:57:05,827 - Epoch: [29][21700/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.438629    
+2023-12-04 12:57:44,611 - Epoch: [29][21800/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438395    
+2023-12-04 12:58:33,010 - Epoch: [29][21900/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438603    
+2023-12-04 12:59:09,838 - Epoch: [29][22000/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438283    
+2023-12-04 12:59:55,939 - Epoch: [29][22100/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.438386    
+2023-12-04 13:00:37,607 - Epoch: [29][22200/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.438288    
+2023-12-04 13:01:20,693 - Epoch: [29][22300/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.438254    
+2023-12-04 13:02:09,648 - Epoch: [29][22400/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.438483    
+2023-12-04 13:02:45,979 - Epoch: [29][22500/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438148    
+2023-12-04 13:03:33,967 - Epoch: [29][22600/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438333    
+2023-12-04 13:04:20,269 - Epoch: [29][22700/31148]    Overall Loss 0.009916    Objective Loss 0.000000    Distill Loss 0.009916                     LR 0.000016    Time 0.438441    
+2023-12-04 13:05:07,600 - Epoch: [29][22800/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.438594    
+2023-12-04 13:06:00,824 - Epoch: [29][22900/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.439002    
+2023-12-04 13:06:51,282 - Epoch: [29][23000/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.439287    
+2023-12-04 13:07:34,116 - Epoch: [29][23100/31148]    Overall Loss 0.009917    Objective Loss 0.000000    Distill Loss 0.009917                     LR 0.000016    Time 0.439240    
+2023-12-04 13:08:21,348 - Epoch: [29][23200/31148]    Overall Loss 0.009918    Objective Loss 0.000000    Distill Loss 0.009918                     LR 0.000016    Time 0.439382    
+2023-12-04 13:09:09,193 - Epoch: [29][23300/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.439549    
+2023-12-04 13:09:52,607 - Epoch: [29][23400/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.439526    
+2023-12-04 13:10:37,451 - Epoch: [29][23500/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.439563    
+2023-12-04 13:11:21,165 - Epoch: [29][23600/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439553    
+2023-12-04 13:12:08,583 - Epoch: [29][23700/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439699    
+2023-12-04 13:12:53,840 - Epoch: [29][23800/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.439752    
+2023-12-04 13:13:36,338 - Epoch: [29][23900/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439690    
+2023-12-04 13:14:18,976 - Epoch: [29][24000/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.439634    
+2023-12-04 13:14:54,515 - Epoch: [29][24100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439285    
+2023-12-04 13:15:36,966 - Epoch: [29][24200/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439223    
+2023-12-04 13:16:16,431 - Epoch: [29][24300/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439040    
+2023-12-04 13:17:14,488 - Epoch: [29][24400/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.439619    
+2023-12-04 13:18:07,241 - Epoch: [29][24500/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.439978    
+2023-12-04 13:18:53,761 - Epoch: [29][24600/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.440080    
+2023-12-04 13:19:37,532 - Epoch: [29][24700/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.440070    
+2023-12-04 13:20:29,792 - Epoch: [29][24800/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.440403    
+2023-12-04 13:21:21,901 - Epoch: [29][24900/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.440726    
+2023-12-04 13:22:04,969 - Epoch: [29][25000/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.440686    
+2023-12-04 13:22:54,620 - Epoch: [29][25100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.440908    
+2023-12-04 13:23:35,585 - Epoch: [29][25200/31148]    Overall Loss 0.009919    Objective Loss 0.000000    Distill Loss 0.009919                     LR 0.000016    Time 0.440784    
+2023-12-04 13:24:23,381 - Epoch: [29][25300/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.440930    
+2023-12-04 13:25:15,571 - Epoch: [29][25400/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441249    
+2023-12-04 13:26:04,325 - Epoch: [29][25500/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441430    
+2023-12-04 13:26:47,034 - Epoch: [29][25600/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441374    
+2023-12-04 13:27:37,140 - Epoch: [29][25700/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441606    
+2023-12-04 13:28:18,208 - Epoch: [29][25800/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.441486    
+2023-12-04 13:29:11,287 - Epoch: [29][25900/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.441830    
+2023-12-04 13:29:51,286 - Epoch: [29][26000/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441669    
+2023-12-04 13:30:31,287 - Epoch: [29][26100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441509    
+2023-12-04 13:31:19,075 - Epoch: [29][26200/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441648    
+2023-12-04 13:31:57,998 - Epoch: [29][26300/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441448    
+2023-12-04 13:32:42,937 - Epoch: [29][26400/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441478    
+2023-12-04 13:33:23,464 - Epoch: [29][26500/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441341    
+2023-12-04 13:34:03,496 - Epoch: [29][26600/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.441187    
+2023-12-04 13:34:46,352 - Epoch: [29][26700/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441139    
+2023-12-04 13:35:33,259 - Epoch: [29][26800/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.441243    
+2023-12-04 13:36:26,903 - Epoch: [29][26900/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441597    
+2023-12-04 13:37:15,240 - Epoch: [29][27000/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441751    
+2023-12-04 13:37:58,351 - Epoch: [29][27100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441711    
+2023-12-04 13:38:45,124 - Epoch: [29][27200/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.441807    
+2023-12-04 13:39:32,364 - Epoch: [29][27300/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.441919    
+2023-12-04 13:40:32,725 - Epoch: [29][27400/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.442509    
+2023-12-04 13:41:24,092 - Epoch: [29][27500/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.442767    
+2023-12-04 13:42:14,197 - Epoch: [29][27600/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.442978    
+2023-12-04 13:43:01,350 - Epoch: [29][27700/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443081    
+2023-12-04 13:43:51,984 - Epoch: [29][27800/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443308    
+2023-12-04 13:44:34,179 - Epoch: [29][27900/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443231    
+2023-12-04 13:45:17,553 - Epoch: [29][28000/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443197    
+2023-12-04 13:46:04,543 - Epoch: [29][28100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443292    
+2023-12-04 13:46:46,060 - Epoch: [29][28200/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443192    
+2023-12-04 13:47:27,843 - Epoch: [29][28300/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443102    
+2023-12-04 13:48:17,476 - Epoch: [29][28400/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443289    
+2023-12-04 13:48:55,805 - Epoch: [29][28500/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443078    
+2023-12-04 13:49:40,245 - Epoch: [29][28600/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443083    
+2023-12-04 13:50:28,101 - Epoch: [29][28700/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443206    
+2023-12-04 13:51:23,667 - Epoch: [29][28800/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443596    
+2023-12-04 13:52:10,569 - Epoch: [29][28900/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443684    
+2023-12-04 13:52:51,444 - Epoch: [29][29000/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443563    
+2023-12-04 13:53:39,763 - Epoch: [29][29100/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443699    
+2023-12-04 13:54:22,675 - Epoch: [29][29200/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443649    
+2023-12-04 13:55:07,845 - Epoch: [29][29300/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443676    
+2023-12-04 13:55:52,634 - Epoch: [29][29400/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443690    
+2023-12-04 13:56:41,929 - Epoch: [29][29500/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443857    
+2023-12-04 13:57:28,822 - Epoch: [29][29600/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443942    
+2023-12-04 13:58:08,702 - Epoch: [29][29700/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.443789    
+2023-12-04 13:58:46,248 - Epoch: [29][29800/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443560    
+2023-12-04 13:59:34,862 - Epoch: [29][29900/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.443702    
+2023-12-04 14:00:32,401 - Epoch: [29][30000/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444141    
+2023-12-04 14:01:17,832 - Epoch: [29][30100/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444174    
+2023-12-04 14:02:07,948 - Epoch: [29][30200/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444363    
+2023-12-04 14:02:47,290 - Epoch: [29][30300/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444194    
+2023-12-04 14:03:30,107 - Epoch: [29][30400/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444142    
+2023-12-04 14:04:22,197 - Epoch: [29][30500/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444393    
+2023-12-04 14:05:07,512 - Epoch: [29][30600/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.444421    
+2023-12-04 14:05:53,092 - Epoch: [29][30700/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.444458    
+2023-12-04 14:06:30,227 - Epoch: [29][30800/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.444221    
+2023-12-04 14:07:13,931 - Epoch: [29][30900/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.444197    
+2023-12-04 14:07:53,550 - Epoch: [29][31000/31148]    Overall Loss 0.009921    Objective Loss 0.000000    Distill Loss 0.009921                     LR 0.000016    Time 0.444042    
+2023-12-04 14:08:49,596 - Epoch: [29][31100/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.444416    
+2023-12-04 14:09:13,161 - Epoch: [29][31148/31148]    Overall Loss 0.009920    Objective Loss 0.000000    Distill Loss 0.009920                     LR 0.000016    Time 0.444488    
+2023-12-04 14:09:13,987 - --- validate (epoch=29)-----------
+2023-12-04 14:09:13,987 - 167951 samples (100 per mini-batch)
+2023-12-04 14:09:42,987 - Epoch: [29][  100/ 1680]    Loss 0.000000    Overall Loss 0.010522    
+2023-12-04 14:10:07,217 - Epoch: [29][  200/ 1680]    Loss 0.000000    Overall Loss 0.010523    
+2023-12-04 14:10:29,843 - Epoch: [29][  300/ 1680]    Loss 0.000000    Overall Loss 0.010526    
+2023-12-04 14:10:53,909 - Epoch: [29][  400/ 1680]    Loss 0.000000    Overall Loss 0.010531    
+2023-12-04 14:11:16,599 - Epoch: [29][  500/ 1680]    Loss 0.000000    Overall Loss 0.010530    
+2023-12-04 14:11:40,417 - Epoch: [29][  600/ 1680]    Loss 0.000000    Overall Loss 0.010523    
+2023-12-04 14:12:03,730 - Epoch: [29][  700/ 1680]    Loss 0.000000    Overall Loss 0.010529    
+2023-12-04 14:12:27,656 - Epoch: [29][  800/ 1680]    Loss 0.000000    Overall Loss 0.010534    
+2023-12-04 14:12:50,707 - Epoch: [29][  900/ 1680]    Loss 0.000000    Overall Loss 0.010539    
+2023-12-04 14:13:13,790 - Epoch: [29][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010545    
+2023-12-04 14:13:36,918 - Epoch: [29][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010541    
+2023-12-04 14:13:59,957 - Epoch: [29][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010539    
+2023-12-04 14:14:23,518 - Epoch: [29][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010542    
+2023-12-04 14:14:46,616 - Epoch: [29][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010539    
+2023-12-04 14:15:09,446 - Epoch: [29][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010538    
+2023-12-04 14:15:32,709 - Epoch: [29][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010541    
+2023-12-04 14:15:50,949 - Epoch: [29][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010541    
+2023-12-04 14:15:51,436 - ==> Overall Loss: 0.011
+
+2023-12-04 14:15:51,443 - ==> Best [Overall Loss: 0.010541 on epoch: 29]
+2023-12-04 14:15:51,443 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-04 14:15:51,505 - 
+
+2023-12-04 14:15:51,505 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-04 14:16:46,746 - Epoch: [30][  100/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000008    Time 0.552308    
+2023-12-04 14:17:25,063 - Epoch: [30][  200/31148]    Overall Loss 0.009637    Objective Loss 0.000000    Distill Loss 0.009637                     LR 0.000008    Time 0.467703    
+2023-12-04 14:18:18,636 - Epoch: [30][  300/31148]    Overall Loss 0.009660    Objective Loss 0.000000    Distill Loss 0.009660                     LR 0.000008    Time 0.490353    
+2023-12-04 14:19:04,770 - Epoch: [30][  400/31148]    Overall Loss 0.009644    Objective Loss 0.000000    Distill Loss 0.009644                     LR 0.000008    Time 0.483083    
+2023-12-04 14:19:42,651 - Epoch: [30][  500/31148]    Overall Loss 0.009659    Objective Loss 0.000000    Distill Loss 0.009659                     LR 0.000008    Time 0.462214    
+2023-12-04 14:20:28,569 - Epoch: [30][  600/31148]    Overall Loss 0.009677    Objective Loss 0.000000    Distill Loss 0.009677                     LR 0.000008    Time 0.461696    
+2023-12-04 14:21:13,159 - Epoch: [30][  700/31148]    Overall Loss 0.009699    Objective Loss 0.000000    Distill Loss 0.009699                     LR 0.000008    Time 0.459429    
+2023-12-04 14:21:57,298 - Epoch: [30][  800/31148]    Overall Loss 0.009717    Objective Loss 0.000000    Distill Loss 0.009717                     LR 0.000008    Time 0.457164    
+2023-12-04 14:22:33,240 - Epoch: [30][  900/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000008    Time 0.446295    
+2023-12-04 14:23:09,829 - Epoch: [30][ 1000/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000008    Time 0.438248    
+2023-12-04 14:23:43,184 - Epoch: [30][ 1100/31148]    Overall Loss 0.009713    Objective Loss 0.000000    Distill Loss 0.009713                     LR 0.000008    Time 0.428725    
+2023-12-04 14:24:27,239 - Epoch: [30][ 1200/31148]    Overall Loss 0.009717    Objective Loss 0.000000    Distill Loss 0.009717                     LR 0.000008    Time 0.429704    
+2023-12-04 14:25:20,291 - Epoch: [30][ 1300/31148]    Overall Loss 0.009720    Objective Loss 0.000000    Distill Loss 0.009720                     LR 0.000008    Time 0.437453    
+2023-12-04 14:26:00,355 - Epoch: [30][ 1400/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000008    Time 0.434819    
+2023-12-04 14:26:46,572 - Epoch: [30][ 1500/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000008    Time 0.436637    
+2023-12-04 14:27:24,707 - Epoch: [30][ 1600/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000008    Time 0.433177    
+2023-12-04 14:28:19,942 - Epoch: [30][ 1700/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000008    Time 0.440183    
+2023-12-04 14:29:00,237 - Epoch: [30][ 1800/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000008    Time 0.438111    
+2023-12-04 14:29:49,135 - Epoch: [30][ 1900/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000008    Time 0.440784    
+2023-12-04 14:30:31,836 - Epoch: [30][ 2000/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000008    Time 0.440091    
+2023-12-04 14:31:17,443 - Epoch: [30][ 2100/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000008    Time 0.440849    
+2023-12-04 14:31:55,788 - Epoch: [30][ 2200/31148]    Overall Loss 0.009737    Objective Loss 0.000000    Distill Loss 0.009737                     LR 0.000008    Time 0.438236    
+2023-12-04 14:32:36,247 - Epoch: [30][ 2300/31148]    Overall Loss 0.009745    Objective Loss 0.000000    Distill Loss 0.009745                     LR 0.000008    Time 0.436770    
+2023-12-04 14:33:11,329 - Epoch: [30][ 2400/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000008    Time 0.433186    
+2023-12-04 14:33:57,028 - Epoch: [30][ 2500/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000008    Time 0.434135    
+2023-12-04 14:34:40,406 - Epoch: [30][ 2600/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000008    Time 0.434119    
+2023-12-04 14:35:21,554 - Epoch: [30][ 2700/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000008    Time 0.433277    
+2023-12-04 14:36:02,064 - Epoch: [30][ 2800/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000008    Time 0.432269    
+2023-12-04 14:36:44,039 - Epoch: [30][ 2900/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000008    Time 0.431835    
+2023-12-04 14:37:23,222 - Epoch: [30][ 3000/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000008    Time 0.430499    
+2023-12-04 14:38:02,093 - Epoch: [30][ 3100/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000008    Time 0.429148    
+2023-12-04 14:38:35,997 - Epoch: [30][ 3200/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000008    Time 0.426330    
+2023-12-04 14:39:14,468 - Epoch: [30][ 3300/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000008    Time 0.425067    
+2023-12-04 14:39:50,739 - Epoch: [30][ 3400/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000008    Time 0.423231    
+2023-12-04 14:40:31,117 - Epoch: [30][ 3500/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000008    Time 0.422673    
+2023-12-04 14:41:11,823 - Epoch: [30][ 3600/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000008    Time 0.422237    
+2023-12-04 14:41:55,641 - Epoch: [30][ 3700/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000008    Time 0.422666    
+2023-12-04 14:42:38,040 - Epoch: [30][ 3800/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000008    Time 0.422699    
+2023-12-04 14:43:21,121 - Epoch: [30][ 3900/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000008    Time 0.422905    
+2023-12-04 14:43:59,375 - Epoch: [30][ 4000/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000008    Time 0.421894    
+2023-12-04 14:44:46,312 - Epoch: [30][ 4100/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000008    Time 0.423050    
+2023-12-04 14:45:27,646 - Epoch: [30][ 4200/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000008    Time 0.422817    
+2023-12-04 14:46:11,082 - Epoch: [30][ 4300/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.423084    
+2023-12-04 14:46:49,950 - Epoch: [30][ 4400/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000008    Time 0.422301    
+2023-12-04 14:47:25,188 - Epoch: [30][ 4500/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.420745    
+2023-12-04 14:48:08,370 - Epoch: [30][ 4600/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.420985    
+2023-12-04 14:48:57,959 - Epoch: [30][ 4700/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.422577    
+2023-12-04 14:49:34,474 - Epoch: [30][ 4800/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.421379    
+2023-12-04 14:50:13,237 - Epoch: [30][ 4900/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.420689    
+2023-12-04 14:50:54,254 - Epoch: [30][ 5000/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.420477    
+2023-12-04 14:51:31,127 - Epoch: [30][ 5100/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.419461    
+2023-12-04 14:52:09,021 - Epoch: [30][ 5200/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.418680    
+2023-12-04 14:52:52,403 - Epoch: [30][ 5300/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.418964    
+2023-12-04 14:53:39,435 - Epoch: [30][ 5400/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.419914    
+2023-12-04 14:54:21,301 - Epoch: [30][ 5500/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.419890    
+2023-12-04 14:55:08,502 - Epoch: [30][ 5600/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.420820    
+2023-12-04 14:55:56,746 - Epoch: [30][ 5700/31148]    Overall Loss 0.009771    Objective Loss 0.000000    Distill Loss 0.009771                     LR 0.000008    Time 0.421899    
+2023-12-04 14:56:37,100 - Epoch: [30][ 5800/31148]    Overall Loss 0.009770    Objective Loss 0.000000    Distill Loss 0.009770                     LR 0.000008    Time 0.421581    
+2023-12-04 14:57:15,244 - Epoch: [30][ 5900/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.420900    
+2023-12-04 14:57:51,694 - Epoch: [30][ 6000/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.419959    
+2023-12-04 14:58:42,046 - Epoch: [30][ 6100/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.421327    
+2023-12-04 14:59:22,936 - Epoch: [30][ 6200/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.421126    
+2023-12-04 15:00:04,076 - Epoch: [30][ 6300/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.420970    
+2023-12-04 15:00:47,821 - Epoch: [30][ 6400/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.421227    
+2023-12-04 15:01:32,843 - Epoch: [30][ 6500/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000008    Time 0.421671    
+2023-12-04 15:02:20,524 - Epoch: [30][ 6600/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000008    Time 0.422506    
+2023-12-04 15:03:00,021 - Epoch: [30][ 6700/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000008    Time 0.422094    
+2023-12-04 15:03:44,471 - Epoch: [30][ 6800/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000008    Time 0.422422    
+2023-12-04 15:04:23,548 - Epoch: [30][ 6900/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.421963    
+2023-12-04 15:04:59,294 - Epoch: [30][ 7000/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000008    Time 0.421040    
+2023-12-04 15:05:43,216 - Epoch: [30][ 7100/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.421295    
+2023-12-04 15:06:27,137 - Epoch: [30][ 7200/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.421543    
+2023-12-04 15:07:05,786 - Epoch: [30][ 7300/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.421062    
+2023-12-04 15:07:41,022 - Epoch: [30][ 7400/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.420132    
+2023-12-04 15:08:21,617 - Epoch: [30][ 7500/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.419942    
+2023-12-04 15:09:03,780 - Epoch: [30][ 7600/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.419964    
+2023-12-04 15:09:39,841 - Epoch: [30][ 7700/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.419192    
+2023-12-04 15:10:10,068 - Epoch: [30][ 7800/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.417692    
+2023-12-04 15:10:38,067 - Epoch: [30][ 7900/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.415949    
+2023-12-04 15:11:05,735 - Epoch: [30][ 8000/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.414208    
+2023-12-04 15:11:33,606 - Epoch: [30][ 8100/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.412534    
+2023-12-04 15:12:01,354 - Epoch: [30][ 8200/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.410887    
+2023-12-04 15:12:29,361 - Epoch: [30][ 8300/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.409310    
+2023-12-04 15:12:57,179 - Epoch: [30][ 8400/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.407749    
+2023-12-04 15:13:25,215 - Epoch: [30][ 8500/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.406250    
+2023-12-04 15:13:53,280 - Epoch: [30][ 8600/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.404789    
+2023-12-04 15:14:21,139 - Epoch: [30][ 8700/31148]    Overall Loss 0.009765    Objective Loss 0.000000    Distill Loss 0.009765                     LR 0.000008    Time 0.403338    
+2023-12-04 15:14:49,137 - Epoch: [30][ 8800/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.401936    
+2023-12-04 15:15:16,740 - Epoch: [30][ 8900/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.400521    
+2023-12-04 15:15:53,887 - Epoch: [30][ 9000/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.400197    
+2023-12-04 15:16:38,582 - Epoch: [30][ 9100/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.400710    
+2023-12-04 15:17:14,687 - Epoch: [30][ 9200/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.400278    
+2023-12-04 15:18:07,088 - Epoch: [30][ 9300/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.401608    
+2023-12-04 15:18:49,125 - Epoch: [30][ 9400/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.401807    
+2023-12-04 15:19:41,878 - Epoch: [30][ 9500/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.403129    
+2023-12-04 15:20:31,854 - Epoch: [30][ 9600/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.404135    
+2023-12-04 15:21:09,317 - Epoch: [30][ 9700/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.403830    
+2023-12-04 15:21:57,997 - Epoch: [30][ 9800/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.404676    
+2023-12-04 15:22:36,118 - Epoch: [30][ 9900/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.404439    
+2023-12-04 15:23:14,680 - Epoch: [30][10000/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.404250    
+2023-12-04 15:23:59,230 - Epoch: [30][10100/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.404657    
+2023-12-04 15:24:37,776 - Epoch: [30][10200/31148]    Overall Loss 0.009766    Objective Loss 0.000000    Distill Loss 0.009766                     LR 0.000008    Time 0.404468    
+2023-12-04 15:25:25,510 - Epoch: [30][10300/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.405175    
+2023-12-04 15:26:08,318 - Epoch: [30][10400/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.405395    
+2023-12-04 15:26:47,649 - Epoch: [30][10500/31148]    Overall Loss 0.009767    Objective Loss 0.000000    Distill Loss 0.009767                     LR 0.000008    Time 0.405279    
+2023-12-04 15:27:35,019 - Epoch: [30][10600/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.405924    
+2023-12-04 15:28:21,992 - Epoch: [30][10700/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.406519    
+2023-12-04 15:29:09,983 - Epoch: [30][10800/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.407198    
+2023-12-04 15:29:58,180 - Epoch: [30][10900/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.407883    
+2023-12-04 15:30:49,807 - Epoch: [30][11000/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.408868    
+2023-12-04 15:31:46,113 - Epoch: [30][11100/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.410257    
+2023-12-04 15:32:31,029 - Epoch: [30][11200/31148]    Overall Loss 0.009768    Objective Loss 0.000000    Distill Loss 0.009768                     LR 0.000008    Time 0.410603    
+2023-12-04 15:33:17,918 - Epoch: [30][11300/31148]    Overall Loss 0.009769    Objective Loss 0.000000    Distill Loss 0.009769                     LR 0.000008    Time 0.411118    
+2023-12-04 15:33:59,688 - Epoch: [30][11400/31148]    Overall Loss 0.009771    Objective Loss 0.000000    Distill Loss 0.009771                     LR 0.000008    Time 0.411175    
+2023-12-04 15:34:43,939 - Epoch: [30][11500/31148]    Overall Loss 0.009771    Objective Loss 0.000000    Distill Loss 0.009771                     LR 0.000008    Time 0.411447    
+2023-12-04 15:35:21,216 - Epoch: [30][11600/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.411113    
+2023-12-04 15:36:08,518 - Epoch: [30][11700/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.411642    
+2023-12-04 15:36:59,506 - Epoch: [30][11800/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.412474    
+2023-12-04 15:37:46,924 - Epoch: [30][11900/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.412992    
+2023-12-04 15:38:26,671 - Epoch: [30][12000/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.412862    
+2023-12-04 15:39:10,234 - Epoch: [30][12100/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.413049    
+2023-12-04 15:39:55,804 - Epoch: [30][12200/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.413398    
+2023-12-04 15:40:37,553 - Epoch: [30][12300/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.413431    
+2023-12-04 15:41:18,356 - Epoch: [30][12400/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.413387    
+2023-12-04 15:41:57,896 - Epoch: [30][12500/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.413242    
+2023-12-04 15:42:44,276 - Epoch: [30][12600/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.413643    
+2023-12-04 15:43:35,148 - Epoch: [30][12700/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.414391    
+2023-12-04 15:44:29,039 - Epoch: [30][12800/31148]    Overall Loss 0.009772    Objective Loss 0.000000    Distill Loss 0.009772                     LR 0.000008    Time 0.415363    
+2023-12-04 15:45:28,079 - Epoch: [30][12900/31148]    Overall Loss 0.009773    Objective Loss 0.000000    Distill Loss 0.009773                     LR 0.000008    Time 0.416720    
+2023-12-04 15:46:11,792 - Epoch: [30][13000/31148]    Overall Loss 0.009774    Objective Loss 0.000000    Distill Loss 0.009774                     LR 0.000008    Time 0.416876    
+2023-12-04 15:46:52,893 - Epoch: [30][13100/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.416831    
+2023-12-04 15:47:33,221 - Epoch: [30][13200/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.416728    
+2023-12-04 15:48:15,301 - Epoch: [30][13300/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.416758    
+2023-12-04 15:48:55,652 - Epoch: [30][13400/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.416658    
+2023-12-04 15:49:43,915 - Epoch: [30][13500/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.417146    
+2023-12-04 15:50:25,784 - Epoch: [30][13600/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.417157    
+2023-12-04 15:51:10,237 - Epoch: [30][13700/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.417357    
+2023-12-04 15:51:58,765 - Epoch: [30][13800/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.417848    
+2023-12-04 15:52:43,871 - Epoch: [30][13900/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.418087    
+2023-12-04 15:53:29,106 - Epoch: [30][14000/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.418331    
+2023-12-04 15:54:07,585 - Epoch: [30][14100/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.418092    
+2023-12-04 15:54:51,000 - Epoch: [30][14200/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.418205    
+2023-12-04 15:55:38,111 - Epoch: [30][14300/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.418574    
+2023-12-04 15:56:24,126 - Epoch: [30][14400/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.418863    
+2023-12-04 15:57:17,814 - Epoch: [30][14500/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.419676    
+2023-12-04 15:58:10,644 - Epoch: [30][14600/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.420420    
+2023-12-04 15:59:05,624 - Epoch: [30][14700/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.421299    
+2023-12-04 16:00:00,483 - Epoch: [30][14800/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.422159    
+2023-12-04 16:00:52,248 - Epoch: [30][14900/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.422799    
+2023-12-04 16:01:42,728 - Epoch: [30][15000/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.423345    
+2023-12-04 16:02:25,629 - Epoch: [30][15100/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.423382    
+2023-12-04 16:03:13,574 - Epoch: [30][15200/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.423751    
+2023-12-04 16:03:54,716 - Epoch: [30][15300/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.423670    
+2023-12-04 16:04:44,523 - Epoch: [30][15400/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.424152    
+2023-12-04 16:05:25,159 - Epoch: [30][15500/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.424037    
+2023-12-04 16:06:12,256 - Epoch: [30][15600/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.424338    
+2023-12-04 16:06:52,951 - Epoch: [30][15700/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.424226    
+2023-12-04 16:07:42,438 - Epoch: [30][15800/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.424673    
+2023-12-04 16:08:24,017 - Epoch: [30][15900/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.424617    
+2023-12-04 16:09:08,373 - Epoch: [30][16000/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.424735    
+2023-12-04 16:09:59,485 - Epoch: [30][16100/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.425271    
+2023-12-04 16:10:38,235 - Epoch: [30][16200/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.425037    
+2023-12-04 16:11:30,658 - Epoch: [30][16300/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.425645    
+2023-12-04 16:12:24,532 - Epoch: [30][16400/31148]    Overall Loss 0.009779    Objective Loss 0.000000    Distill Loss 0.009779                     LR 0.000008    Time 0.426334    
+2023-12-04 16:13:14,569 - Epoch: [30][16500/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.426783    
+2023-12-04 16:14:04,934 - Epoch: [30][16600/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.427245    
+2023-12-04 16:14:52,608 - Epoch: [30][16700/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.427541    
+2023-12-04 16:15:33,730 - Epoch: [30][16800/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.427444    
+2023-12-04 16:16:17,208 - Epoch: [30][16900/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.427487    
+2023-12-04 16:17:06,737 - Epoch: [30][17000/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.427885    
+2023-12-04 16:17:49,912 - Epoch: [30][17100/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.427907    
+2023-12-04 16:18:38,171 - Epoch: [30][17200/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.428225    
+2023-12-04 16:19:19,457 - Epoch: [30][17300/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.428136    
+2023-12-04 16:20:11,987 - Epoch: [30][17400/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.428694    
+2023-12-04 16:20:58,637 - Epoch: [30][17500/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.428909    
+2023-12-04 16:21:40,444 - Epoch: [30][17600/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.428847    
+2023-12-04 16:22:26,351 - Epoch: [30][17700/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.429018    
+2023-12-04 16:23:11,877 - Epoch: [30][17800/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429165    
+2023-12-04 16:23:58,275 - Epoch: [30][17900/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429359    
+2023-12-04 16:24:39,194 - Epoch: [30][18000/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429246    
+2023-12-04 16:25:22,899 - Epoch: [30][18100/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429289    
+2023-12-04 16:26:07,823 - Epoch: [30][18200/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429398    
+2023-12-04 16:26:52,895 - Epoch: [30][18300/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429514    
+2023-12-04 16:27:41,744 - Epoch: [30][18400/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.429835    
+2023-12-04 16:28:22,579 - Epoch: [30][18500/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.429718    
+2023-12-04 16:29:02,295 - Epoch: [30][18600/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.429543    
+2023-12-04 16:29:51,208 - Epoch: [30][18700/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.429861    
+2023-12-04 16:30:36,593 - Epoch: [30][18800/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.429988    
+2023-12-04 16:31:26,707 - Epoch: [30][18900/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.430364    
+2023-12-04 16:32:11,166 - Epoch: [30][19000/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.430439    
+2023-12-04 16:32:55,011 - Epoch: [30][19100/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.430480    
+2023-12-04 16:33:36,450 - Epoch: [30][19200/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.430396    
+2023-12-04 16:34:23,732 - Epoch: [30][19300/31148]    Overall Loss 0.009778    Objective Loss 0.000000    Distill Loss 0.009778                     LR 0.000008    Time 0.430616    
+2023-12-04 16:35:07,267 - Epoch: [30][19400/31148]    Overall Loss 0.009779    Objective Loss 0.000000    Distill Loss 0.009779                     LR 0.000008    Time 0.430640    
+2023-12-04 16:35:49,350 - Epoch: [30][19500/31148]    Overall Loss 0.009779    Objective Loss 0.000000    Distill Loss 0.009779                     LR 0.000008    Time 0.430589    
+2023-12-04 16:36:31,482 - Epoch: [30][19600/31148]    Overall Loss 0.009780    Objective Loss 0.000000    Distill Loss 0.009780                     LR 0.000008    Time 0.430541    
+2023-12-04 16:37:19,738 - Epoch: [30][19700/31148]    Overall Loss 0.009780    Objective Loss 0.000000    Distill Loss 0.009780                     LR 0.000008    Time 0.430805    
+2023-12-04 16:37:57,927 - Epoch: [30][19800/31148]    Overall Loss 0.009781    Objective Loss 0.000000    Distill Loss 0.009781                     LR 0.000008    Time 0.430558    
+2023-12-04 16:38:43,955 - Epoch: [30][19900/31148]    Overall Loss 0.009781    Objective Loss 0.000000    Distill Loss 0.009781                     LR 0.000008    Time 0.430707    
+2023-12-04 16:39:24,474 - Epoch: [30][20000/31148]    Overall Loss 0.009781    Objective Loss 0.000000    Distill Loss 0.009781                     LR 0.000008    Time 0.430579    
+2023-12-04 16:40:08,453 - Epoch: [30][20100/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.430624    
+2023-12-04 16:40:52,789 - Epoch: [30][20200/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.430687    
+2023-12-04 16:41:48,707 - Epoch: [30][20300/31148]    Overall Loss 0.009783    Objective Loss 0.000000    Distill Loss 0.009783                     LR 0.000008    Time 0.431320    
+2023-12-04 16:42:43,652 - Epoch: [30][20400/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.431898    
+2023-12-04 16:43:36,187 - Epoch: [30][20500/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.432354    
+2023-12-04 16:44:20,035 - Epoch: [30][20600/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.432383    
+2023-12-04 16:45:06,131 - Epoch: [30][20700/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.432521    
+2023-12-04 16:45:49,568 - Epoch: [30][20800/31148]    Overall Loss 0.009782    Objective Loss 0.000000    Distill Loss 0.009782                     LR 0.000008    Time 0.432529    
+2023-12-04 16:46:35,243 - Epoch: [30][20900/31148]    Overall Loss 0.009783    Objective Loss 0.000000    Distill Loss 0.009783                     LR 0.000008    Time 0.432645    
+2023-12-04 16:47:23,980 - Epoch: [30][21000/31148]    Overall Loss 0.009783    Objective Loss 0.000000    Distill Loss 0.009783                     LR 0.000008    Time 0.432905    
+2023-12-04 16:48:16,085 - Epoch: [30][21100/31148]    Overall Loss 0.009783    Objective Loss 0.000000    Distill Loss 0.009783                     LR 0.000008    Time 0.433323    
+2023-12-04 16:48:56,032 - Epoch: [30][21200/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.433163    
+2023-12-04 16:49:44,750 - Epoch: [30][21300/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.433416    
+2023-12-04 16:50:29,673 - Epoch: [30][21400/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.433489    
+2023-12-04 16:51:35,108 - Epoch: [30][21500/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.434516    
+2023-12-04 16:52:18,946 - Epoch: [30][21600/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.434534    
+2023-12-04 16:52:59,386 - Epoch: [30][21700/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.434395    
+2023-12-04 16:53:38,238 - Epoch: [30][21800/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.434184    
+2023-12-04 16:54:31,376 - Epoch: [30][21900/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.434628    
+2023-12-04 16:55:13,033 - Epoch: [30][22000/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434545    
+2023-12-04 16:55:53,287 - Epoch: [30][22100/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434400    
+2023-12-04 16:56:38,728 - Epoch: [30][22200/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434490    
+2023-12-04 16:57:24,694 - Epoch: [30][22300/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.434602    
+2023-12-04 16:58:08,777 - Epoch: [30][22400/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434630    
+2023-12-04 16:58:52,796 - Epoch: [30][22500/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434654    
+2023-12-04 16:59:43,659 - Epoch: [30][22600/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434981    
+2023-12-04 17:00:26,950 - Epoch: [30][22700/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.434972    
+2023-12-04 17:01:15,970 - Epoch: [30][22800/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.435214    
+2023-12-04 17:01:57,532 - Epoch: [30][22900/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.435128    
+2023-12-04 17:02:51,160 - Epoch: [30][23000/31148]    Overall Loss 0.009785    Objective Loss 0.000000    Distill Loss 0.009785                     LR 0.000008    Time 0.435567    
+2023-12-04 17:03:49,080 - Epoch: [30][23100/31148]    Overall Loss 0.009786    Objective Loss 0.000000    Distill Loss 0.009786                     LR 0.000008    Time 0.436189    
+2023-12-04 17:04:33,842 - Epoch: [30][23200/31148]    Overall Loss 0.009786    Objective Loss 0.000000    Distill Loss 0.009786                     LR 0.000008    Time 0.436238    
+2023-12-04 17:05:15,400 - Epoch: [30][23300/31148]    Overall Loss 0.009786    Objective Loss 0.000000    Distill Loss 0.009786                     LR 0.000008    Time 0.436149    
+2023-12-04 17:06:08,200 - Epoch: [30][23400/31148]    Overall Loss 0.009786    Objective Loss 0.000000    Distill Loss 0.009786                     LR 0.000008    Time 0.436541    
+2023-12-04 17:06:59,044 - Epoch: [30][23500/31148]    Overall Loss 0.009786    Objective Loss 0.000000    Distill Loss 0.009786                     LR 0.000008    Time 0.436847    
+2023-12-04 17:07:47,902 - Epoch: [30][23600/31148]    Overall Loss 0.009787    Objective Loss 0.000000    Distill Loss 0.009787                     LR 0.000008    Time 0.437066    
+2023-12-04 17:08:42,453 - Epoch: [30][23700/31148]    Overall Loss 0.009787    Objective Loss 0.000000    Distill Loss 0.009787                     LR 0.000008    Time 0.437523    
+2023-12-04 17:09:23,649 - Epoch: [30][23800/31148]    Overall Loss 0.009787    Objective Loss 0.000000    Distill Loss 0.009787                     LR 0.000008    Time 0.437415    
+2023-12-04 17:10:05,482 - Epoch: [30][23900/31148]    Overall Loss 0.009787    Objective Loss 0.000000    Distill Loss 0.009787                     LR 0.000008    Time 0.437335    
+2023-12-04 17:10:51,545 - Epoch: [30][24000/31148]    Overall Loss 0.009787    Objective Loss 0.000000    Distill Loss 0.009787                     LR 0.000008    Time 0.437432    
+2023-12-04 17:11:31,071 - Epoch: [30][24100/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.437256    
+2023-12-04 17:12:26,476 - Epoch: [30][24200/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.437739    
+2023-12-04 17:13:18,962 - Epoch: [30][24300/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.438097    
+2023-12-04 17:14:00,169 - Epoch: [30][24400/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.437990    
+2023-12-04 17:14:52,853 - Epoch: [30][24500/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.438352    
+2023-12-04 17:15:37,321 - Epoch: [30][24600/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.438378    
+2023-12-04 17:16:31,439 - Epoch: [30][24700/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438794    
+2023-12-04 17:17:14,101 - Epoch: [30][24800/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438744    
+2023-12-04 17:18:05,130 - Epoch: [30][24900/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.439031    
+2023-12-04 17:18:47,295 - Epoch: [30][25000/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438962    
+2023-12-04 17:19:24,538 - Epoch: [30][25100/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438696    
+2023-12-04 17:20:04,891 - Epoch: [30][25200/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438556    
+2023-12-04 17:20:44,621 - Epoch: [30][25300/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438393    
+2023-12-04 17:21:29,384 - Epoch: [30][25400/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438429    
+2023-12-04 17:22:17,269 - Epoch: [30][25500/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.438587    
+2023-12-04 17:23:04,859 - Epoch: [30][25600/31148]    Overall Loss 0.009790    Objective Loss 0.000000    Distill Loss 0.009790                     LR 0.000008    Time 0.438733    
+2023-12-04 17:23:59,935 - Epoch: [30][25700/31148]    Overall Loss 0.009790    Objective Loss 0.000000    Distill Loss 0.009790                     LR 0.000008    Time 0.439169    
+2023-12-04 17:24:42,567 - Epoch: [30][25800/31148]    Overall Loss 0.009790    Objective Loss 0.000000    Distill Loss 0.009790                     LR 0.000008    Time 0.439119    
+2023-12-04 17:25:40,076 - Epoch: [30][25900/31148]    Overall Loss 0.009790    Objective Loss 0.000000    Distill Loss 0.009790                     LR 0.000008    Time 0.439643    
+2023-12-04 17:26:31,749 - Epoch: [30][26000/31148]    Overall Loss 0.009790    Objective Loss 0.000000    Distill Loss 0.009790                     LR 0.000008    Time 0.439939    
+2023-12-04 17:27:10,452 - Epoch: [30][26100/31148]    Overall Loss 0.009790    Objective Loss 0.000000    Distill Loss 0.009790                     LR 0.000008    Time 0.439737    
+2023-12-04 17:28:01,870 - Epoch: [30][26200/31148]    Overall Loss 0.009791    Objective Loss 0.000000    Distill Loss 0.009791                     LR 0.000008    Time 0.440020    
+2023-12-04 17:28:54,402 - Epoch: [30][26300/31148]    Overall Loss 0.009791    Objective Loss 0.000000    Distill Loss 0.009791                     LR 0.000008    Time 0.440344    
+2023-12-04 17:29:43,258 - Epoch: [30][26400/31148]    Overall Loss 0.009791    Objective Loss 0.000000    Distill Loss 0.009791                     LR 0.000008    Time 0.440527    
+2023-12-04 17:30:33,720 - Epoch: [30][26500/31148]    Overall Loss 0.009791    Objective Loss 0.000000    Distill Loss 0.009791                     LR 0.000008    Time 0.440768    
+2023-12-04 17:31:17,181 - Epoch: [30][26600/31148]    Overall Loss 0.009792    Objective Loss 0.000000    Distill Loss 0.009792                     LR 0.000008    Time 0.440745    
+2023-12-04 17:32:14,487 - Epoch: [30][26700/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441240    
+2023-12-04 17:33:00,887 - Epoch: [30][26800/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441325    
+2023-12-04 17:33:46,296 - Epoch: [30][26900/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441372    
+2023-12-04 17:34:31,563 - Epoch: [30][27000/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441414    
+2023-12-04 17:35:21,156 - Epoch: [30][27100/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441615    
+2023-12-04 17:36:05,807 - Epoch: [30][27200/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441632    
+2023-12-04 17:36:54,626 - Epoch: [30][27300/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441803    
+2023-12-04 17:37:38,149 - Epoch: [30][27400/31148]    Overall Loss 0.009793    Objective Loss 0.000000    Distill Loss 0.009793                     LR 0.000008    Time 0.441779    
+2023-12-04 17:38:20,320 - Epoch: [30][27500/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.441705    
+2023-12-04 17:39:15,023 - Epoch: [30][27600/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442087    
+2023-12-04 17:40:01,625 - Epoch: [30][27700/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442173    
+2023-12-04 17:40:50,557 - Epoch: [30][27800/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442342    
+2023-12-04 17:41:36,052 - Epoch: [30][27900/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442387    
+2023-12-04 17:42:29,581 - Epoch: [30][28000/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442719    
+2023-12-04 17:43:08,278 - Epoch: [30][28100/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442520    
+2023-12-04 17:43:53,117 - Epoch: [30][28200/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442541    
+2023-12-04 17:44:38,067 - Epoch: [30][28300/31148]    Overall Loss 0.009794    Objective Loss 0.000000    Distill Loss 0.009794                     LR 0.000008    Time 0.442565    
+2023-12-04 17:45:25,162 - Epoch: [30][28400/31148]    Overall Loss 0.009795    Objective Loss 0.000000    Distill Loss 0.009795                     LR 0.000008    Time 0.442665    
+2023-12-04 17:46:15,582 - Epoch: [30][28500/31148]    Overall Loss 0.009795    Objective Loss 0.000000    Distill Loss 0.009795                     LR 0.000008    Time 0.442880    
+2023-12-04 17:46:59,501 - Epoch: [30][28600/31148]    Overall Loss 0.009795    Objective Loss 0.000000    Distill Loss 0.009795                     LR 0.000008    Time 0.442867    
+2023-12-04 17:47:42,774 - Epoch: [30][28700/31148]    Overall Loss 0.009796    Objective Loss 0.000000    Distill Loss 0.009796                     LR 0.000008    Time 0.442832    
+2023-12-04 17:48:24,582 - Epoch: [30][28800/31148]    Overall Loss 0.009796    Objective Loss 0.000000    Distill Loss 0.009796                     LR 0.000008    Time 0.442746    
+2023-12-04 17:49:12,503 - Epoch: [30][28900/31148]    Overall Loss 0.009796    Objective Loss 0.000000    Distill Loss 0.009796                     LR 0.000008    Time 0.442871    
+2023-12-04 17:49:56,204 - Epoch: [30][29000/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.442851    
+2023-12-04 17:50:37,064 - Epoch: [30][29100/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.442733    
+2023-12-04 17:51:16,298 - Epoch: [30][29200/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.442560    
+2023-12-04 17:52:04,216 - Epoch: [30][29300/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.442685    
+2023-12-04 17:52:52,919 - Epoch: [30][29400/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.442836    
+2023-12-04 17:53:38,231 - Epoch: [30][29500/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.442870    
+2023-12-04 17:54:33,874 - Epoch: [30][29600/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.443254    
+2023-12-04 17:55:34,910 - Epoch: [30][29700/31148]    Overall Loss 0.009797    Objective Loss 0.000000    Distill Loss 0.009797                     LR 0.000008    Time 0.443816    
+2023-12-04 17:56:31,978 - Epoch: [30][29800/31148]    Overall Loss 0.009798    Objective Loss 0.000000    Distill Loss 0.009798                     LR 0.000008    Time 0.444242    
+2023-12-04 17:57:30,517 - Epoch: [30][29900/31148]    Overall Loss 0.009798    Objective Loss 0.000000    Distill Loss 0.009798                     LR 0.000008    Time 0.444713    
+2023-12-04 17:58:24,642 - Epoch: [30][30000/31148]    Overall Loss 0.009799    Objective Loss 0.000000    Distill Loss 0.009799                     LR 0.000008    Time 0.445035    
+2023-12-04 17:59:25,171 - Epoch: [30][30100/31148]    Overall Loss 0.009799    Objective Loss 0.000000    Distill Loss 0.009799                     LR 0.000008    Time 0.445567    
+2023-12-04 18:00:13,341 - Epoch: [30][30200/31148]    Overall Loss 0.009799    Objective Loss 0.000000    Distill Loss 0.009799                     LR 0.000008    Time 0.445687    
+2023-12-04 18:00:59,615 - Epoch: [30][30300/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.445743    
+2023-12-04 18:01:49,922 - Epoch: [30][30400/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.445931    
+2023-12-04 18:02:40,157 - Epoch: [30][30500/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.446116    
+2023-12-04 18:03:23,457 - Epoch: [30][30600/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.446073    
+2023-12-04 18:04:12,577 - Epoch: [30][30700/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.446219    
+2023-12-04 18:05:07,202 - Epoch: [30][30800/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.446544    
+2023-12-04 18:06:01,238 - Epoch: [30][30900/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.446847    
+2023-12-04 18:06:50,191 - Epoch: [30][31000/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.446985    
+2023-12-04 18:07:48,953 - Epoch: [30][31100/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.447437    
+2023-12-04 18:08:17,777 - Epoch: [30][31148/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.447673    
+2023-12-04 18:08:18,902 - --- validate (epoch=30)-----------
+2023-12-04 18:08:18,902 - 167951 samples (100 per mini-batch)
+2023-12-04 18:08:51,082 - Epoch: [30][  100/ 1680]    Loss 0.000000    Overall Loss 0.010553    
+2023-12-04 18:09:20,109 - Epoch: [30][  200/ 1680]    Loss 0.000000    Overall Loss 0.010549    
+2023-12-04 18:09:47,342 - Epoch: [30][  300/ 1680]    Loss 0.000000    Overall Loss 0.010545    
+2023-12-04 18:10:14,840 - Epoch: [30][  400/ 1680]    Loss 0.000000    Overall Loss 0.010543    
+2023-12-04 18:10:43,083 - Epoch: [30][  500/ 1680]    Loss 0.000000    Overall Loss 0.010541    
+2023-12-04 18:11:10,034 - Epoch: [30][  600/ 1680]    Loss 0.000000    Overall Loss 0.010539    
+2023-12-04 18:11:37,536 - Epoch: [30][  700/ 1680]    Loss 0.000000    Overall Loss 0.010536    
+2023-12-04 18:12:05,412 - Epoch: [30][  800/ 1680]    Loss 0.000000    Overall Loss 0.010544    
+2023-12-04 18:12:32,522 - Epoch: [30][  900/ 1680]    Loss 0.000000    Overall Loss 0.010544    
+2023-12-04 18:13:00,668 - Epoch: [30][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010546    
+2023-12-04 18:13:28,471 - Epoch: [30][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010552    
+2023-12-04 18:13:57,177 - Epoch: [30][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010553    
+2023-12-04 18:14:24,808 - Epoch: [30][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010551    
+2023-12-04 18:14:52,998 - Epoch: [30][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010551    
+2023-12-04 18:15:19,521 - Epoch: [30][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010550    
+2023-12-04 18:15:46,652 - Epoch: [30][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010551    
+2023-12-04 18:16:07,806 - Epoch: [30][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010549    
+2023-12-04 18:16:08,297 - ==> Overall Loss: 0.011
+
+2023-12-04 18:16:08,310 - ==> Best [Overall Loss: 0.010541 on epoch: 29]
+2023-12-04 18:16:08,311 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-04 18:16:08,373 - 
+
+2023-12-04 18:16:08,374 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-04 18:17:19,210 - Epoch: [31][  100/31148]    Overall Loss 0.009784    Objective Loss 0.000000    Distill Loss 0.009784                     LR 0.000008    Time 0.708233    
+2023-12-04 18:17:56,742 - Epoch: [31][  200/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000008    Time 0.541741    
+2023-12-04 18:18:38,120 - Epoch: [31][  300/31148]    Overall Loss 0.009770    Objective Loss 0.000000    Distill Loss 0.009770                     LR 0.000008    Time 0.499061    
+2023-12-04 18:19:28,774 - Epoch: [31][  400/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000008    Time 0.500913    
+2023-12-04 18:20:03,342 - Epoch: [31][  500/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000008    Time 0.469853    
+2023-12-04 18:20:52,245 - Epoch: [31][  600/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000008    Time 0.473037    
+2023-12-04 18:21:42,614 - Epoch: [31][  700/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000008    Time 0.477406    
+2023-12-04 18:22:29,967 - Epoch: [31][  800/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.476913    
+2023-12-04 18:23:12,250 - Epoch: [31][  900/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000008    Time 0.470897    
+2023-12-04 18:24:05,403 - Epoch: [31][ 1000/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000008    Time 0.476953    
+2023-12-04 18:24:48,719 - Epoch: [31][ 1100/31148]    Overall Loss 0.009771    Objective Loss 0.000000    Distill Loss 0.009771                     LR 0.000008    Time 0.472965    
+2023-12-04 18:25:28,334 - Epoch: [31][ 1200/31148]    Overall Loss 0.009775    Objective Loss 0.000000    Distill Loss 0.009775                     LR 0.000008    Time 0.466558    
+2023-12-04 18:26:15,786 - Epoch: [31][ 1300/31148]    Overall Loss 0.009774    Objective Loss 0.000000    Distill Loss 0.009774                     LR 0.000008    Time 0.467165    
+2023-12-04 18:26:56,371 - Epoch: [31][ 1400/31148]    Overall Loss 0.009781    Objective Loss 0.000000    Distill Loss 0.009781                     LR 0.000008    Time 0.462781    
+2023-12-04 18:27:42,898 - Epoch: [31][ 1500/31148]    Overall Loss 0.009776    Objective Loss 0.000000    Distill Loss 0.009776                     LR 0.000008    Time 0.462942    
+2023-12-04 18:28:24,096 - Epoch: [31][ 1600/31148]    Overall Loss 0.009774    Objective Loss 0.000000    Distill Loss 0.009774                     LR 0.000008    Time 0.459753    
+2023-12-04 18:29:15,866 - Epoch: [31][ 1700/31148]    Overall Loss 0.009777    Objective Loss 0.000000    Distill Loss 0.009777                     LR 0.000008    Time 0.463158    
+2023-12-04 18:30:06,926 - Epoch: [31][ 1800/31148]    Overall Loss 0.009781    Objective Loss 0.000000    Distill Loss 0.009781                     LR 0.000008    Time 0.465789    
+2023-12-04 18:30:48,343 - Epoch: [31][ 1900/31148]    Overall Loss 0.009788    Objective Loss 0.000000    Distill Loss 0.009788                     LR 0.000008    Time 0.463068    
+2023-12-04 18:31:27,119 - Epoch: [31][ 2000/31148]    Overall Loss 0.009789    Objective Loss 0.000000    Distill Loss 0.009789                     LR 0.000008    Time 0.459300    
+2023-12-04 18:32:14,427 - Epoch: [31][ 2100/31148]    Overall Loss 0.009798    Objective Loss 0.000000    Distill Loss 0.009798                     LR 0.000008    Time 0.459952    
+2023-12-04 18:32:57,440 - Epoch: [31][ 2200/31148]    Overall Loss 0.009800    Objective Loss 0.000000    Distill Loss 0.009800                     LR 0.000008    Time 0.458593    
+2023-12-04 18:33:36,444 - Epoch: [31][ 2300/31148]    Overall Loss 0.009806    Objective Loss 0.000000    Distill Loss 0.009806                     LR 0.000008    Time 0.455610    
+2023-12-04 18:34:21,818 - Epoch: [31][ 2400/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.455529    
+2023-12-04 18:35:00,853 - Epoch: [31][ 2500/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.452919    
+2023-12-04 18:35:48,692 - Epoch: [31][ 2600/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.453896    
+2023-12-04 18:36:36,566 - Epoch: [31][ 2700/31148]    Overall Loss 0.009816    Objective Loss 0.000000    Distill Loss 0.009816                     LR 0.000008    Time 0.454814    
+2023-12-04 18:37:24,666 - Epoch: [31][ 2800/31148]    Overall Loss 0.009815    Objective Loss 0.000000    Distill Loss 0.009815                     LR 0.000008    Time 0.455746    
+2023-12-04 18:38:12,548 - Epoch: [31][ 2900/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.456540    
+2023-12-04 18:38:48,905 - Epoch: [31][ 3000/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.453438    
+2023-12-04 18:39:34,766 - Epoch: [31][ 3100/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.453603    
+2023-12-04 18:40:18,067 - Epoch: [31][ 3200/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.452957    
+2023-12-04 18:40:46,503 - Epoch: [31][ 3300/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.447847    
+2023-12-04 18:41:15,603 - Epoch: [31][ 3400/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.443232    
+2023-12-04 18:41:43,130 - Epoch: [31][ 3500/31148]    Overall Loss 0.009806    Objective Loss 0.000000    Distill Loss 0.009806                     LR 0.000008    Time 0.438432    
+2023-12-04 18:42:10,899 - Epoch: [31][ 3600/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.433966    
+2023-12-04 18:42:38,756 - Epoch: [31][ 3700/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.429766    
+2023-12-04 18:43:06,490 - Epoch: [31][ 3800/31148]    Overall Loss 0.009804    Objective Loss 0.000000    Distill Loss 0.009804                     LR 0.000008    Time 0.425754    
+2023-12-04 18:43:34,519 - Epoch: [31][ 3900/31148]    Overall Loss 0.009805    Objective Loss 0.000000    Distill Loss 0.009805                     LR 0.000008    Time 0.422023    
+2023-12-04 18:44:02,306 - Epoch: [31][ 4000/31148]    Overall Loss 0.009804    Objective Loss 0.000000    Distill Loss 0.009804                     LR 0.000008    Time 0.418418    
+2023-12-04 18:44:30,322 - Epoch: [31][ 4100/31148]    Overall Loss 0.009805    Objective Loss 0.000000    Distill Loss 0.009805                     LR 0.000008    Time 0.415045    
+2023-12-04 18:44:57,976 - Epoch: [31][ 4200/31148]    Overall Loss 0.009805    Objective Loss 0.000000    Distill Loss 0.009805                     LR 0.000008    Time 0.411747    
+2023-12-04 18:45:26,226 - Epoch: [31][ 4300/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.408740    
+2023-12-04 18:45:54,270 - Epoch: [31][ 4400/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.405824    
+2023-12-04 18:46:34,923 - Epoch: [31][ 4500/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.405838    
+2023-12-04 18:47:15,665 - Epoch: [31][ 4600/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.405871    
+2023-12-04 18:48:03,208 - Epoch: [31][ 4700/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.407349    
+2023-12-04 18:48:57,624 - Epoch: [31][ 4800/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.410198    
+2023-12-04 18:49:47,485 - Epoch: [31][ 4900/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.412001    
+2023-12-04 18:50:28,859 - Epoch: [31][ 5000/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.412034    
+2023-12-04 18:51:21,730 - Epoch: [31][ 5100/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.414320    
+2023-12-04 18:52:03,908 - Epoch: [31][ 5200/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.414462    
+2023-12-04 18:52:45,273 - Epoch: [31][ 5300/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.414446    
+2023-12-04 18:53:31,884 - Epoch: [31][ 5400/31148]    Overall Loss 0.009816    Objective Loss 0.000000    Distill Loss 0.009816                     LR 0.000008    Time 0.415401    
+2023-12-04 18:54:22,569 - Epoch: [31][ 5500/31148]    Overall Loss 0.009815    Objective Loss 0.000000    Distill Loss 0.009815                     LR 0.000008    Time 0.417062    
+2023-12-04 18:55:07,629 - Epoch: [31][ 5600/31148]    Overall Loss 0.009815    Objective Loss 0.000000    Distill Loss 0.009815                     LR 0.000008    Time 0.417660    
+2023-12-04 18:55:48,768 - Epoch: [31][ 5700/31148]    Overall Loss 0.009815    Objective Loss 0.000000    Distill Loss 0.009815                     LR 0.000008    Time 0.417549    
+2023-12-04 18:56:27,888 - Epoch: [31][ 5800/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.417093    
+2023-12-04 18:57:13,287 - Epoch: [31][ 5900/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.417717    
+2023-12-04 18:57:58,310 - Epoch: [31][ 6000/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.418258    
+2023-12-04 18:58:48,674 - Epoch: [31][ 6100/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.419656    
+2023-12-04 18:59:39,788 - Epoch: [31][ 6200/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.421131    
+2023-12-04 19:00:26,748 - Epoch: [31][ 6300/31148]    Overall Loss 0.009806    Objective Loss 0.000000    Distill Loss 0.009806                     LR 0.000008    Time 0.421899    
+2023-12-04 19:01:10,711 - Epoch: [31][ 6400/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.422175    
+2023-12-04 19:01:59,834 - Epoch: [31][ 6500/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.423236    
+2023-12-04 19:02:37,913 - Epoch: [31][ 6600/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.422592    
+2023-12-04 19:03:12,521 - Epoch: [31][ 6700/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.421449    
+2023-12-04 19:03:51,314 - Epoch: [31][ 6800/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.420955    
+2023-12-04 19:04:33,625 - Epoch: [31][ 6900/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.420985    
+2023-12-04 19:05:10,961 - Epoch: [31][ 7000/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.420304    
+2023-12-04 19:05:56,135 - Epoch: [31][ 7100/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.420745    
+2023-12-04 19:06:43,353 - Epoch: [31][ 7200/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.421459    
+2023-12-04 19:07:32,907 - Epoch: [31][ 7300/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.422473    
+2023-12-04 19:08:10,367 - Epoch: [31][ 7400/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.421825    
+2023-12-04 19:08:59,268 - Epoch: [31][ 7500/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.422719    
+2023-12-04 19:09:45,431 - Epoch: [31][ 7600/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.423230    
+2023-12-04 19:10:36,959 - Epoch: [31][ 7700/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.424425    
+2023-12-04 19:11:30,480 - Epoch: [31][ 7800/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.425844    
+2023-12-04 19:12:09,442 - Epoch: [31][ 7900/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.425385    
+2023-12-04 19:12:53,609 - Epoch: [31][ 8000/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.425588    
+2023-12-04 19:13:40,675 - Epoch: [31][ 8100/31148]    Overall Loss 0.009807    Objective Loss 0.000000    Distill Loss 0.009807                     LR 0.000008    Time 0.426143    
+2023-12-04 19:14:25,324 - Epoch: [31][ 8200/31148]    Overall Loss 0.009806    Objective Loss 0.000000    Distill Loss 0.009806                     LR 0.000008    Time 0.426390    
+2023-12-04 19:15:13,904 - Epoch: [31][ 8300/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.427105    
+2023-12-04 19:15:57,637 - Epoch: [31][ 8400/31148]    Overall Loss 0.009808    Objective Loss 0.000000    Distill Loss 0.009808                     LR 0.000008    Time 0.427226    
+2023-12-04 19:16:40,762 - Epoch: [31][ 8500/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.427273    
+2023-12-04 19:17:25,509 - Epoch: [31][ 8600/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.427507    
+2023-12-04 19:18:19,521 - Epoch: [31][ 8700/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.428800    
+2023-12-04 19:18:55,818 - Epoch: [31][ 8800/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.428051    
+2023-12-04 19:19:40,773 - Epoch: [31][ 8900/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.428292    
+2023-12-04 19:20:18,473 - Epoch: [31][ 9000/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.427722    
+2023-12-04 19:21:01,203 - Epoch: [31][ 9100/31148]    Overall Loss 0.009809    Objective Loss 0.000000    Distill Loss 0.009809                     LR 0.000008    Time 0.427716    
+2023-12-04 19:21:42,025 - Epoch: [31][ 9200/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.427504    
+2023-12-04 19:22:25,454 - Epoch: [31][ 9300/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.427576    
+2023-12-04 19:23:09,956 - Epoch: [31][ 9400/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.427761    
+2023-12-04 19:24:02,680 - Epoch: [31][ 9500/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.428807    
+2023-12-04 19:24:57,297 - Epoch: [31][ 9600/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.430029    
+2023-12-04 19:25:41,570 - Epoch: [31][ 9700/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.430159    
+2023-12-04 19:26:21,681 - Epoch: [31][ 9800/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.429862    
+2023-12-04 19:27:07,373 - Epoch: [31][ 9900/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.430134    
+2023-12-04 19:27:53,761 - Epoch: [31][10000/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.430471    
+2023-12-04 19:28:39,175 - Epoch: [31][10100/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.430705    
+2023-12-04 19:29:24,544 - Epoch: [31][10200/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.430929    
+2023-12-04 19:30:05,100 - Epoch: [31][10300/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.430682    
+2023-12-04 19:30:49,348 - Epoch: [31][10400/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.430795    
+2023-12-04 19:31:35,332 - Epoch: [31][10500/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.431071    
+2023-12-04 19:32:15,746 - Epoch: [31][10600/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.430816    
+2023-12-04 19:32:57,136 - Epoch: [31][10700/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.430658    
+2023-12-04 19:33:45,121 - Epoch: [31][10800/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.431112    
+2023-12-04 19:34:28,469 - Epoch: [31][10900/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.431133    
+2023-12-04 19:35:20,262 - Epoch: [31][11000/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.431922    
+2023-12-04 19:36:13,862 - Epoch: [31][11100/31148]    Overall Loss 0.009811    Objective Loss 0.000000    Distill Loss 0.009811                     LR 0.000008    Time 0.432859    
+2023-12-04 19:36:58,073 - Epoch: [31][11200/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.432941    
+2023-12-04 19:37:38,176 - Epoch: [31][11300/31148]    Overall Loss 0.009810    Objective Loss 0.000000    Distill Loss 0.009810                     LR 0.000008    Time 0.432658    
+2023-12-04 19:38:21,691 - Epoch: [31][11400/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.432679    
+2023-12-04 19:39:12,744 - Epoch: [31][11500/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.433355    
+2023-12-04 19:40:04,499 - Epoch: [31][11600/31148]    Overall Loss 0.009812    Objective Loss 0.000000    Distill Loss 0.009812                     LR 0.000008    Time 0.434081    
+2023-12-04 19:40:45,419 - Epoch: [31][11700/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.433867    
+2023-12-04 19:41:30,651 - Epoch: [31][11800/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.434023    
+2023-12-04 19:42:19,763 - Epoch: [31][11900/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.434502    
+2023-12-04 19:43:09,115 - Epoch: [31][12000/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.434993    
+2023-12-04 19:43:58,968 - Epoch: [31][12100/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.435518    
+2023-12-04 19:44:42,189 - Epoch: [31][12200/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.435490    
+2023-12-04 19:45:18,447 - Epoch: [31][12300/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.434897    
+2023-12-04 19:46:10,720 - Epoch: [31][12400/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.435605    
+2023-12-04 19:46:55,815 - Epoch: [31][12500/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.435727    
+2023-12-04 19:47:42,553 - Epoch: [31][12600/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.435977    
+2023-12-04 19:48:26,679 - Epoch: [31][12700/31148]    Overall Loss 0.009813    Objective Loss 0.000000    Distill Loss 0.009813                     LR 0.000008    Time 0.436018    
+2023-12-04 19:49:13,610 - Epoch: [31][12800/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.436278    
+2023-12-04 19:50:00,769 - Epoch: [31][12900/31148]    Overall Loss 0.009814    Objective Loss 0.000000    Distill Loss 0.009814                     LR 0.000008    Time 0.436551    
+2023-12-04 19:50:43,523 - Epoch: [31][13000/31148]    Overall Loss 0.009815    Objective Loss 0.000000    Distill Loss 0.009815                     LR 0.000008    Time 0.436481    
+2023-12-04 19:51:24,680 - Epoch: [31][13100/31148]    Overall Loss 0.009816    Objective Loss 0.000000    Distill Loss 0.009816                     LR 0.000008    Time 0.436291    
+2023-12-04 19:52:06,413 - Epoch: [31][13200/31148]    Overall Loss 0.009816    Objective Loss 0.000000    Distill Loss 0.009816                     LR 0.000008    Time 0.436146    
+2023-12-04 19:52:50,238 - Epoch: [31][13300/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.436161    
+2023-12-04 19:53:40,158 - Epoch: [31][13400/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.436631    
+2023-12-04 19:54:29,823 - Epoch: [31][13500/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.437075    
+2023-12-04 19:55:10,885 - Epoch: [31][13600/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.436880    
+2023-12-04 19:55:52,628 - Epoch: [31][13700/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.436738    
+2023-12-04 19:56:38,807 - Epoch: [31][13800/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.436919    
+2023-12-04 19:57:20,780 - Epoch: [31][13900/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.436795    
+2023-12-04 19:58:09,994 - Epoch: [31][14000/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.437189    
+2023-12-04 19:59:10,310 - Epoch: [31][14100/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.438366    
+2023-12-04 19:59:57,888 - Epoch: [31][14200/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.438629    
+2023-12-04 20:00:47,468 - Epoch: [31][14300/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.439028    
+2023-12-04 20:01:31,060 - Epoch: [31][14400/31148]    Overall Loss 0.009816    Objective Loss 0.000000    Distill Loss 0.009816                     LR 0.000008    Time 0.439006    
+2023-12-04 20:02:09,206 - Epoch: [31][14500/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.438609    
+2023-12-04 20:02:55,277 - Epoch: [31][14600/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.438760    
+2023-12-04 20:03:40,031 - Epoch: [31][14700/31148]    Overall Loss 0.009816    Objective Loss 0.000000    Distill Loss 0.009816                     LR 0.000008    Time 0.438819    
+2023-12-04 20:04:20,619 - Epoch: [31][14800/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.438596    
+2023-12-04 20:05:03,740 - Epoch: [31][14900/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.438546    
+2023-12-04 20:05:44,861 - Epoch: [31][15000/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.438363    
+2023-12-04 20:06:31,490 - Epoch: [31][15100/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.438548    
+2023-12-04 20:07:25,512 - Epoch: [31][15200/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439216    
+2023-12-04 20:08:02,745 - Epoch: [31][15300/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.438778    
+2023-12-04 20:08:50,826 - Epoch: [31][15400/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439051    
+2023-12-04 20:09:38,165 - Epoch: [31][15500/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439272    
+2023-12-04 20:10:22,448 - Epoch: [31][15600/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.439294    
+2023-12-04 20:11:07,498 - Epoch: [31][15700/31148]    Overall Loss 0.009817    Objective Loss 0.000000    Distill Loss 0.009817                     LR 0.000008    Time 0.439365    
+2023-12-04 20:11:56,364 - Epoch: [31][15800/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439677    
+2023-12-04 20:12:37,645 - Epoch: [31][15900/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439507    
+2023-12-04 20:13:27,250 - Epoch: [31][16000/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439860    
+2023-12-04 20:14:16,823 - Epoch: [31][16100/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.440207    
+2023-12-04 20:14:56,172 - Epoch: [31][16200/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.439918    
+2023-12-04 20:15:39,986 - Epoch: [31][16300/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.439907    
+2023-12-04 20:16:17,405 - Epoch: [31][16400/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.439506    
+2023-12-04 20:17:02,690 - Epoch: [31][16500/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.439586    
+2023-12-04 20:17:53,861 - Epoch: [31][16600/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.440020    
+2023-12-04 20:18:39,466 - Epoch: [31][16700/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.440116    
+2023-12-04 20:19:17,797 - Epoch: [31][16800/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.439777    
+2023-12-04 20:20:10,263 - Epoch: [31][16900/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.440279    
+2023-12-04 20:20:50,350 - Epoch: [31][17000/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.440047    
+2023-12-04 20:21:46,200 - Epoch: [31][17100/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.440739    
+2023-12-04 20:22:34,072 - Epoch: [31][17200/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.440960    
+2023-12-04 20:23:19,321 - Epoch: [31][17300/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.441026    
+2023-12-04 20:24:06,013 - Epoch: [31][17400/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441174    
+2023-12-04 20:24:44,942 - Epoch: [31][17500/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.440877    
+2023-12-04 20:25:35,996 - Epoch: [31][17600/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.441273    
+2023-12-04 20:26:20,712 - Epoch: [31][17700/31148]    Overall Loss 0.009818    Objective Loss 0.000000    Distill Loss 0.009818                     LR 0.000008    Time 0.441306    
+2023-12-04 20:27:10,159 - Epoch: [31][17800/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.441604    
+2023-12-04 20:27:50,610 - Epoch: [31][17900/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.441396    
+2023-12-04 20:28:36,750 - Epoch: [31][18000/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441507    
+2023-12-04 20:29:25,842 - Epoch: [31][18100/31148]    Overall Loss 0.009819    Objective Loss 0.000000    Distill Loss 0.009819                     LR 0.000008    Time 0.441780    
+2023-12-04 20:30:03,704 - Epoch: [31][18200/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441432    
+2023-12-04 20:30:48,074 - Epoch: [31][18300/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441444    
+2023-12-04 20:31:30,295 - Epoch: [31][18400/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441339    
+2023-12-04 20:32:08,440 - Epoch: [31][18500/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441015    
+2023-12-04 20:32:51,567 - Epoch: [31][18600/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.440962    
+2023-12-04 20:33:30,148 - Epoch: [31][18700/31148]    Overall Loss 0.009821    Objective Loss 0.000000    Distill Loss 0.009821                     LR 0.000008    Time 0.440667    
+2023-12-04 20:34:24,142 - Epoch: [31][18800/31148]    Overall Loss 0.009821    Objective Loss 0.000000    Distill Loss 0.009821                     LR 0.000008    Time 0.441195    
+2023-12-04 20:35:03,973 - Epoch: [31][18900/31148]    Overall Loss 0.009821    Objective Loss 0.000000    Distill Loss 0.009821                     LR 0.000008    Time 0.440967    
+2023-12-04 20:35:55,845 - Epoch: [31][19000/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441376    
+2023-12-04 20:36:42,152 - Epoch: [31][19100/31148]    Overall Loss 0.009820    Objective Loss 0.000000    Distill Loss 0.009820                     LR 0.000008    Time 0.441489    
+2023-12-04 20:37:21,604 - Epoch: [31][19200/31148]    Overall Loss 0.009821    Objective Loss 0.000000    Distill Loss 0.009821                     LR 0.000008    Time 0.441244    
+2023-12-04 20:38:05,570 - Epoch: [31][19300/31148]    Overall Loss 0.009821    Objective Loss 0.000000    Distill Loss 0.009821                     LR 0.000008    Time 0.441236    
+2023-12-04 20:38:48,613 - Epoch: [31][19400/31148]    Overall Loss 0.009821    Objective Loss 0.000000    Distill Loss 0.009821                     LR 0.000008    Time 0.441180    
+2023-12-04 20:39:33,244 - Epoch: [31][19500/31148]    Overall Loss 0.009822    Objective Loss 0.000000    Distill Loss 0.009822                     LR 0.000008    Time 0.441206    
+2023-12-04 20:40:21,654 - Epoch: [31][19600/31148]    Overall Loss 0.009822    Objective Loss 0.000000    Distill Loss 0.009822                     LR 0.000008    Time 0.441424    
+2023-12-04 20:40:58,636 - Epoch: [31][19700/31148]    Overall Loss 0.009822    Objective Loss 0.000000    Distill Loss 0.009822                     LR 0.000008    Time 0.441060    
+2023-12-04 20:41:45,324 - Epoch: [31][19800/31148]    Overall Loss 0.009822    Objective Loss 0.000000    Distill Loss 0.009822                     LR 0.000008    Time 0.441191    
+2023-12-04 20:42:28,622 - Epoch: [31][19900/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.441149    
+2023-12-04 20:43:18,877 - Epoch: [31][20000/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.441456    
+2023-12-04 20:44:08,334 - Epoch: [31][20100/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441719    
+2023-12-04 20:44:46,478 - Epoch: [31][20200/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441421    
+2023-12-04 20:45:26,000 - Epoch: [31][20300/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441193    
+2023-12-04 20:46:05,622 - Epoch: [31][20400/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.440972    
+2023-12-04 20:46:51,925 - Epoch: [31][20500/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.441079    
+2023-12-04 20:47:24,470 - Epoch: [31][20600/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.440518    
+2023-12-04 20:48:12,878 - Epoch: [31][20700/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.440728    
+2023-12-04 20:49:02,348 - Epoch: [31][20800/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.440987    
+2023-12-04 20:49:50,896 - Epoch: [31][20900/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.441199    
+2023-12-04 20:50:48,624 - Epoch: [31][21000/31148]    Overall Loss 0.009823    Objective Loss 0.000000    Distill Loss 0.009823                     LR 0.000008    Time 0.441847    
+2023-12-04 20:51:28,286 - Epoch: [31][21100/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441632    
+2023-12-04 20:52:19,956 - Epoch: [31][21200/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441986    
+2023-12-04 20:53:02,819 - Epoch: [31][21300/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441923    
+2023-12-04 20:53:45,945 - Epoch: [31][21400/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441873    
+2023-12-04 20:54:30,177 - Epoch: [31][21500/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441875    
+2023-12-04 20:55:05,227 - Epoch: [31][21600/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441451    
+2023-12-04 20:55:49,612 - Epoch: [31][21700/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441462    
+2023-12-04 20:56:35,828 - Epoch: [31][21800/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441557    
+2023-12-04 20:57:12,515 - Epoch: [31][21900/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441215    
+2023-12-04 20:58:01,787 - Epoch: [31][22000/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441449    
+2023-12-04 20:58:43,739 - Epoch: [31][22100/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441349    
+2023-12-04 20:59:27,762 - Epoch: [31][22200/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441344    
+2023-12-04 21:00:17,615 - Epoch: [31][22300/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441600    
+2023-12-04 21:00:58,029 - Epoch: [31][22400/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441433    
+2023-12-04 21:01:41,932 - Epoch: [31][22500/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441422    
+2023-12-04 21:02:30,931 - Epoch: [31][22600/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441636    
+2023-12-04 21:03:21,811 - Epoch: [31][22700/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441932    
+2023-12-04 21:04:06,276 - Epoch: [31][22800/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441943    
+2023-12-04 21:04:54,219 - Epoch: [31][22900/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.442107    
+2023-12-04 21:05:35,474 - Epoch: [31][23000/31148]    Overall Loss 0.009824    Objective Loss 0.000000    Distill Loss 0.009824                     LR 0.000008    Time 0.441978    
+2023-12-04 21:06:18,018 - Epoch: [31][23100/31148]    Overall Loss 0.009825    Objective Loss 0.000000    Distill Loss 0.009825                     LR 0.000008    Time 0.441906    
+2023-12-04 21:06:59,019 - Epoch: [31][23200/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.441768    
+2023-12-04 21:07:43,538 - Epoch: [31][23300/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.441782    
+2023-12-04 21:08:29,637 - Epoch: [31][23400/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.441864    
+2023-12-04 21:09:05,263 - Epoch: [31][23500/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.441500    
+2023-12-04 21:09:51,786 - Epoch: [31][23600/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441600    
+2023-12-04 21:10:37,693 - Epoch: [31][23700/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441673    
+2023-12-04 21:11:26,673 - Epoch: [31][23800/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441875    
+2023-12-04 21:12:09,783 - Epoch: [31][23900/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441830    
+2023-12-04 21:13:02,110 - Epoch: [31][24000/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442169    
+2023-12-04 21:13:49,903 - Epoch: [31][24100/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442317    
+2023-12-04 21:14:37,659 - Epoch: [31][24200/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442462    
+2023-12-04 21:15:26,851 - Epoch: [31][24300/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442666    
+2023-12-04 21:16:06,085 - Epoch: [31][24400/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442459    
+2023-12-04 21:16:49,827 - Epoch: [31][24500/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442438    
+2023-12-04 21:17:31,101 - Epoch: [31][24600/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442317    
+2023-12-04 21:18:11,335 - Epoch: [31][24700/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.442155    
+2023-12-04 21:18:56,466 - Epoch: [31][24800/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.442192    
+2023-12-04 21:19:40,094 - Epoch: [31][24900/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442168    
+2023-12-04 21:20:17,897 - Epoch: [31][25000/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441911    
+2023-12-04 21:21:01,031 - Epoch: [31][25100/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441868    
+2023-12-04 21:21:46,979 - Epoch: [31][25200/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441938    
+2023-12-04 21:22:32,670 - Epoch: [31][25300/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441997    
+2023-12-04 21:23:12,508 - Epoch: [31][25400/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441825    
+2023-12-04 21:24:00,770 - Epoch: [31][25500/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441985    
+2023-12-04 21:24:44,152 - Epoch: [31][25600/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441952    
+2023-12-04 21:25:22,761 - Epoch: [31][25700/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441735    
+2023-12-04 21:26:07,608 - Epoch: [31][25800/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.441761    
+2023-12-04 21:27:00,150 - Epoch: [31][25900/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442083    
+2023-12-04 21:27:52,099 - Epoch: [31][26000/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442381    
+2023-12-04 21:28:39,495 - Epoch: [31][26100/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442501    
+2023-12-04 21:29:22,844 - Epoch: [31][26200/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442467    
+2023-12-04 21:30:04,369 - Epoch: [31][26300/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.442363    
+2023-12-04 21:30:52,674 - Epoch: [31][26400/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442517    
+2023-12-04 21:31:42,972 - Epoch: [31][26500/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442745    
+2023-12-04 21:32:21,883 - Epoch: [31][26600/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.442543    
+2023-12-04 21:33:11,196 - Epoch: [31][26700/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442732    
+2023-12-04 21:33:52,876 - Epoch: [31][26800/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442635    
+2023-12-04 21:34:36,801 - Epoch: [31][26900/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442622    
+2023-12-04 21:35:18,680 - Epoch: [31][27000/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.442534    
+2023-12-04 21:36:10,353 - Epoch: [31][27100/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.442807    
+2023-12-04 21:37:02,155 - Epoch: [31][27200/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443083    
+2023-12-04 21:37:48,217 - Epoch: [31][27300/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443147    
+2023-12-04 21:38:34,180 - Epoch: [31][27400/31148]    Overall Loss 0.009826    Objective Loss 0.000000    Distill Loss 0.009826                     LR 0.000008    Time 0.443207    
+2023-12-04 21:39:21,712 - Epoch: [31][27500/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443324    
+2023-12-04 21:40:05,000 - Epoch: [31][27600/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443286    
+2023-12-04 21:40:51,560 - Epoch: [31][27700/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.443366    
+2023-12-04 21:41:26,319 - Epoch: [31][27800/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443021    
+2023-12-04 21:42:14,576 - Epoch: [31][27900/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443163    
+2023-12-04 21:43:03,614 - Epoch: [31][28000/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443331    
+2023-12-04 21:43:49,453 - Epoch: [31][28100/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443384    
+2023-12-04 21:44:38,799 - Epoch: [31][28200/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443562    
+2023-12-04 21:45:20,421 - Epoch: [31][28300/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443465    
+2023-12-04 21:46:05,359 - Epoch: [31][28400/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443485    
+2023-12-04 21:46:49,880 - Epoch: [31][28500/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.443491    
+2023-12-04 21:47:42,075 - Epoch: [31][28600/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443765    
+2023-12-04 21:48:27,917 - Epoch: [31][28700/31148]    Overall Loss 0.009827    Objective Loss 0.000000    Distill Loss 0.009827                     LR 0.000008    Time 0.443816    
+2023-12-04 21:49:17,217 - Epoch: [31][28800/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.443987    
+2023-12-04 21:50:05,121 - Epoch: [31][28900/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444108    
+2023-12-04 21:50:46,105 - Epoch: [31][29000/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.443989    
+2023-12-04 21:51:23,677 - Epoch: [31][29100/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.443754    
+2023-12-04 21:52:15,448 - Epoch: [31][29200/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444007    
+2023-12-04 21:53:04,197 - Epoch: [31][29300/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444156    
+2023-12-04 21:53:45,101 - Epoch: [31][29400/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444036    
+2023-12-04 21:54:28,976 - Epoch: [31][29500/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444018    
+2023-12-04 21:55:14,489 - Epoch: [31][29600/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444055    
+2023-12-04 21:56:00,609 - Epoch: [31][29700/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444112    
+2023-12-04 21:56:41,786 - Epoch: [31][29800/31148]    Overall Loss 0.009828    Objective Loss 0.000000    Distill Loss 0.009828                     LR 0.000008    Time 0.444004    
+2023-12-04 21:57:36,573 - Epoch: [31][29900/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444351    
+2023-12-04 21:58:21,986 - Epoch: [31][30000/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444383    
+2023-12-04 21:59:10,214 - Epoch: [31][30100/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444509    
+2023-12-04 21:59:57,491 - Epoch: [31][30200/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444602    
+2023-12-04 22:00:50,751 - Epoch: [31][30300/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444892    
+2023-12-04 22:01:28,502 - Epoch: [31][30400/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000008    Time 0.444670    
+2023-12-04 22:02:20,667 - Epoch: [31][30500/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444922    
+2023-12-04 22:03:02,085 - Epoch: [31][30600/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444822    
+2023-12-04 22:03:37,458 - Epoch: [31][30700/31148]    Overall Loss 0.009829    Objective Loss 0.000000    Distill Loss 0.009829                     LR 0.000008    Time 0.444525    
+2023-12-04 22:04:17,960 - Epoch: [31][30800/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000008    Time 0.444396    
+2023-12-04 22:04:58,631 - Epoch: [31][30900/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000008    Time 0.444274    
+2023-12-04 22:05:35,390 - Epoch: [31][31000/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000008    Time 0.444026    
+2023-12-04 22:06:14,861 - Epoch: [31][31100/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000008    Time 0.443868    
+2023-12-04 22:06:39,798 - Epoch: [31][31148/31148]    Overall Loss 0.009830    Objective Loss 0.000000    Distill Loss 0.009830                     LR 0.000008    Time 0.443984    
+2023-12-04 22:06:40,742 - --- validate (epoch=31)-----------
+2023-12-04 22:06:40,743 - 167951 samples (100 per mini-batch)
+2023-12-04 22:07:09,063 - Epoch: [31][  100/ 1680]    Loss 0.000000    Overall Loss 0.010423    
+2023-12-04 22:07:31,865 - Epoch: [31][  200/ 1680]    Loss 0.000000    Overall Loss 0.010438    
+2023-12-04 22:07:54,780 - Epoch: [31][  300/ 1680]    Loss 0.000000    Overall Loss 0.010460    
+2023-12-04 22:08:17,766 - Epoch: [31][  400/ 1680]    Loss 0.000000    Overall Loss 0.010439    
+2023-12-04 22:08:40,299 - Epoch: [31][  500/ 1680]    Loss 0.000000    Overall Loss 0.010448    
+2023-12-04 22:09:02,890 - Epoch: [31][  600/ 1680]    Loss 0.000000    Overall Loss 0.010453    
+2023-12-04 22:09:25,726 - Epoch: [31][  700/ 1680]    Loss 0.000000    Overall Loss 0.010445    
+2023-12-04 22:09:48,394 - Epoch: [31][  800/ 1680]    Loss 0.000000    Overall Loss 0.010451    
+2023-12-04 22:10:11,628 - Epoch: [31][  900/ 1680]    Loss 0.000000    Overall Loss 0.010454    
+2023-12-04 22:10:34,705 - Epoch: [31][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010455    
+2023-12-04 22:10:56,581 - Epoch: [31][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010458    
+2023-12-04 22:11:18,398 - Epoch: [31][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010456    
+2023-12-04 22:11:40,131 - Epoch: [31][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010455    
+2023-12-04 22:12:01,919 - Epoch: [31][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010455    
+2023-12-04 22:12:23,717 - Epoch: [31][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010453    
+2023-12-04 22:12:45,499 - Epoch: [31][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010456    
+2023-12-04 22:13:02,827 - Epoch: [31][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010452    
+2023-12-04 22:13:03,051 - ==> Overall Loss: 0.010
+
+2023-12-04 22:13:03,064 - ==> Best [Overall Loss: 0.010452 on epoch: 31]
+2023-12-04 22:13:03,064 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-04 22:13:03,100 - 
+
+2023-12-04 22:13:03,100 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-04 22:13:39,340 - Epoch: [32][  100/31148]    Overall Loss 0.009634    Objective Loss 0.000000    Distill Loss 0.009634                     LR 0.000004    Time 0.362359    
+2023-12-04 22:14:07,240 - Epoch: [32][  200/31148]    Overall Loss 0.009599    Objective Loss 0.000000    Distill Loss 0.009599                     LR 0.000004    Time 0.320662    
+2023-12-04 22:14:34,875 - Epoch: [32][  300/31148]    Overall Loss 0.009637    Objective Loss 0.000000    Distill Loss 0.009637                     LR 0.000004    Time 0.305878    
+2023-12-04 22:15:02,720 - Epoch: [32][  400/31148]    Overall Loss 0.009620    Objective Loss 0.000000    Distill Loss 0.009620                     LR 0.000004    Time 0.299013    
+2023-12-04 22:15:30,709 - Epoch: [32][  500/31148]    Overall Loss 0.009622    Objective Loss 0.000000    Distill Loss 0.009622                     LR 0.000004    Time 0.295181    
+2023-12-04 22:15:58,619 - Epoch: [32][  600/31148]    Overall Loss 0.009614    Objective Loss 0.000000    Distill Loss 0.009614                     LR 0.000004    Time 0.292496    
+2023-12-04 22:16:31,730 - Epoch: [32][  700/31148]    Overall Loss 0.009636    Objective Loss 0.000000    Distill Loss 0.009636                     LR 0.000004    Time 0.298006    
+2023-12-04 22:17:15,571 - Epoch: [32][  800/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000004    Time 0.315546    
+2023-12-04 22:18:14,623 - Epoch: [32][  900/31148]    Overall Loss 0.009649    Objective Loss 0.000000    Distill Loss 0.009649                     LR 0.000004    Time 0.346090    
+2023-12-04 22:19:02,750 - Epoch: [32][ 1000/31148]    Overall Loss 0.009641    Objective Loss 0.000000    Distill Loss 0.009641                     LR 0.000004    Time 0.359601    
+2023-12-04 22:19:42,863 - Epoch: [32][ 1100/31148]    Overall Loss 0.009646    Objective Loss 0.000000    Distill Loss 0.009646                     LR 0.000004    Time 0.363370    
+2023-12-04 22:20:19,722 - Epoch: [32][ 1200/31148]    Overall Loss 0.009641    Objective Loss 0.000000    Distill Loss 0.009641                     LR 0.000004    Time 0.363800    
+2023-12-04 22:21:02,374 - Epoch: [32][ 1300/31148]    Overall Loss 0.009642    Objective Loss 0.000000    Distill Loss 0.009642                     LR 0.000004    Time 0.368619    
+2023-12-04 22:21:45,230 - Epoch: [32][ 1400/31148]    Overall Loss 0.009649    Objective Loss 0.000000    Distill Loss 0.009649                     LR 0.000004    Time 0.372895    
+2023-12-04 22:22:26,668 - Epoch: [32][ 1500/31148]    Overall Loss 0.009650    Objective Loss 0.000000    Distill Loss 0.009650                     LR 0.000004    Time 0.375656    
+2023-12-04 22:23:13,435 - Epoch: [32][ 1600/31148]    Overall Loss 0.009652    Objective Loss 0.000000    Distill Loss 0.009652                     LR 0.000004    Time 0.381402    
+2023-12-04 22:23:54,697 - Epoch: [32][ 1700/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000004    Time 0.383235    
+2023-12-04 22:24:40,091 - Epoch: [32][ 1800/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000004    Time 0.387159    
+2023-12-04 22:25:27,864 - Epoch: [32][ 1900/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000004    Time 0.391922    
+2023-12-04 22:26:07,847 - Epoch: [32][ 2000/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000004    Time 0.392314    
+2023-12-04 22:26:56,323 - Epoch: [32][ 2100/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000004    Time 0.396713    
+2023-12-04 22:27:38,276 - Epoch: [32][ 2200/31148]    Overall Loss 0.009670    Objective Loss 0.000000    Distill Loss 0.009670                     LR 0.000004    Time 0.397747    
+2023-12-04 22:28:28,500 - Epoch: [32][ 2300/31148]    Overall Loss 0.009676    Objective Loss 0.000000    Distill Loss 0.009676                     LR 0.000004    Time 0.402287    
+2023-12-04 22:29:13,292 - Epoch: [32][ 2400/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000004    Time 0.404185    
+2023-12-04 22:29:58,288 - Epoch: [32][ 2500/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000004    Time 0.406013    
+2023-12-04 22:30:57,421 - Epoch: [32][ 2600/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000004    Time 0.413138    
+2023-12-04 22:31:36,654 - Epoch: [32][ 2700/31148]    Overall Loss 0.009691    Objective Loss 0.000000    Distill Loss 0.009691                     LR 0.000004    Time 0.412364    
+2023-12-04 22:32:19,293 - Epoch: [32][ 2800/31148]    Overall Loss 0.009690    Objective Loss 0.000000    Distill Loss 0.009690                     LR 0.000004    Time 0.412863    
+2023-12-04 22:33:07,663 - Epoch: [32][ 2900/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000004    Time 0.415303    
+2023-12-04 22:33:58,164 - Epoch: [32][ 3000/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000004    Time 0.418290    
+2023-12-04 22:34:46,024 - Epoch: [32][ 3100/31148]    Overall Loss 0.009691    Objective Loss 0.000000    Distill Loss 0.009691                     LR 0.000004    Time 0.420233    
+2023-12-04 22:35:42,772 - Epoch: [32][ 3200/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000004    Time 0.424833    
+2023-12-04 22:36:16,932 - Epoch: [32][ 3300/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000004    Time 0.422308    
+2023-12-04 22:37:01,752 - Epoch: [32][ 3400/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000004    Time 0.423068    
+2023-12-04 22:37:49,164 - Epoch: [32][ 3500/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000004    Time 0.424524    
+2023-12-04 22:38:32,116 - Epoch: [32][ 3600/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000004    Time 0.424661    
+2023-12-04 22:39:16,565 - Epoch: [32][ 3700/31148]    Overall Loss 0.009699    Objective Loss 0.000000    Distill Loss 0.009699                     LR 0.000004    Time 0.425195    
+2023-12-04 22:39:56,641 - Epoch: [32][ 3800/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000004    Time 0.424550    
+2023-12-04 22:40:55,271 - Epoch: [32][ 3900/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.428695    
+2023-12-04 22:41:28,732 - Epoch: [32][ 4000/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.426341    
+2023-12-04 22:42:08,903 - Epoch: [32][ 4100/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.425739    
+2023-12-04 22:42:45,215 - Epoch: [32][ 4200/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.424246    
+2023-12-04 22:43:29,052 - Epoch: [32][ 4300/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.424573    
+2023-12-04 22:44:11,872 - Epoch: [32][ 4400/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.424654    
+2023-12-04 22:44:56,154 - Epoch: [32][ 4500/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.425056    
+2023-12-04 22:45:43,380 - Epoch: [32][ 4600/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.426081    
+2023-12-04 22:46:25,076 - Epoch: [32][ 4700/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.425885    
+2023-12-04 22:47:14,902 - Epoch: [32][ 4800/31148]    Overall Loss 0.009708    Objective Loss 0.000000    Distill Loss 0.009708                     LR 0.000004    Time 0.427392    
+2023-12-04 22:47:57,910 - Epoch: [32][ 4900/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.427445    
+2023-12-04 22:48:35,713 - Epoch: [32][ 5000/31148]    Overall Loss 0.009708    Objective Loss 0.000000    Distill Loss 0.009708                     LR 0.000004    Time 0.426455    
+2023-12-04 22:49:19,575 - Epoch: [32][ 5100/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.426692    
+2023-12-04 22:50:11,198 - Epoch: [32][ 5200/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000004    Time 0.428413    
+2023-12-04 22:50:53,946 - Epoch: [32][ 5300/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.428394    
+2023-12-04 22:51:36,959 - Epoch: [32][ 5400/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000004    Time 0.428425    
+2023-12-04 22:52:20,287 - Epoch: [32][ 5500/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000004    Time 0.428512    
+2023-12-04 22:53:06,336 - Epoch: [32][ 5600/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000004    Time 0.429082    
+2023-12-04 22:53:46,619 - Epoch: [32][ 5700/31148]    Overall Loss 0.009708    Objective Loss 0.000000    Distill Loss 0.009708                     LR 0.000004    Time 0.428620    
+2023-12-04 22:54:30,201 - Epoch: [32][ 5800/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.428743    
+2023-12-04 22:55:15,576 - Epoch: [32][ 5900/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.429165    
+2023-12-04 22:56:03,885 - Epoch: [32][ 6000/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.430063    
+2023-12-04 22:56:54,187 - Epoch: [32][ 6100/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.431258    
+2023-12-04 22:57:38,823 - Epoch: [32][ 6200/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.431500    
+2023-12-04 22:58:21,020 - Epoch: [32][ 6300/31148]    Overall Loss 0.009702    Objective Loss 0.000000    Distill Loss 0.009702                     LR 0.000004    Time 0.431348    
+2023-12-04 22:59:10,746 - Epoch: [32][ 6400/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.432377    
+2023-12-04 22:59:49,123 - Epoch: [32][ 6500/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.431628    
+2023-12-04 23:00:32,466 - Epoch: [32][ 6600/31148]    Overall Loss 0.009699    Objective Loss 0.000000    Distill Loss 0.009699                     LR 0.000004    Time 0.431654    
+2023-12-04 23:01:16,484 - Epoch: [32][ 6700/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.431780    
+2023-12-04 23:02:04,188 - Epoch: [32][ 6800/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.432444    
+2023-12-04 23:02:41,390 - Epoch: [32][ 6900/31148]    Overall Loss 0.009699    Objective Loss 0.000000    Distill Loss 0.009699                     LR 0.000004    Time 0.431568    
+2023-12-04 23:03:26,558 - Epoch: [32][ 7000/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.431854    
+2023-12-04 23:04:04,577 - Epoch: [32][ 7100/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.431125    
+2023-12-04 23:04:53,275 - Epoch: [32][ 7200/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.431900    
+2023-12-04 23:05:40,146 - Epoch: [32][ 7300/31148]    Overall Loss 0.009702    Objective Loss 0.000000    Distill Loss 0.009702                     LR 0.000004    Time 0.432403    
+2023-12-04 23:06:23,511 - Epoch: [32][ 7400/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.432419    
+2023-12-04 23:07:00,139 - Epoch: [32][ 7500/31148]    Overall Loss 0.009702    Objective Loss 0.000000    Distill Loss 0.009702                     LR 0.000004    Time 0.431536    
+2023-12-04 23:07:51,571 - Epoch: [32][ 7600/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.432624    
+2023-12-04 23:08:38,579 - Epoch: [32][ 7700/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.433110    
+2023-12-04 23:09:28,066 - Epoch: [32][ 7800/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000004    Time 0.433901    
+2023-12-04 23:10:25,000 - Epoch: [32][ 7900/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000004    Time 0.435614    
+2023-12-04 23:11:08,844 - Epoch: [32][ 8000/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000004    Time 0.435649    
+2023-12-04 23:11:49,829 - Epoch: [32][ 8100/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000004    Time 0.435329    
+2023-12-04 23:12:38,344 - Epoch: [32][ 8200/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000004    Time 0.435936    
+2023-12-04 23:13:22,082 - Epoch: [32][ 8300/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.435953    
+2023-12-04 23:14:06,688 - Epoch: [32][ 8400/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.436072    
+2023-12-04 23:14:43,073 - Epoch: [32][ 8500/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.435222    
+2023-12-04 23:15:29,044 - Epoch: [32][ 8600/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.435506    
+2023-12-04 23:16:11,546 - Epoch: [32][ 8700/31148]    Overall Loss 0.009702    Objective Loss 0.000000    Distill Loss 0.009702                     LR 0.000004    Time 0.435384    
+2023-12-04 23:16:55,009 - Epoch: [32][ 8800/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.435375    
+2023-12-04 23:17:35,656 - Epoch: [32][ 8900/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.435049    
+2023-12-04 23:18:21,407 - Epoch: [32][ 9000/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.435298    
+2023-12-04 23:19:07,348 - Epoch: [32][ 9100/31148]    Overall Loss 0.009702    Objective Loss 0.000000    Distill Loss 0.009702                     LR 0.000004    Time 0.435562    
+2023-12-04 23:19:49,557 - Epoch: [32][ 9200/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.435415    
+2023-12-04 23:20:36,368 - Epoch: [32][ 9300/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.435766    
+2023-12-04 23:21:24,068 - Epoch: [32][ 9400/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.436204    
+2023-12-04 23:22:11,986 - Epoch: [32][ 9500/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.436655    
+2023-12-04 23:23:06,603 - Epoch: [32][ 9600/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.437795    
+2023-12-04 23:23:57,386 - Epoch: [32][ 9700/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.438517    
+2023-12-04 23:24:39,819 - Epoch: [32][ 9800/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.438371    
+2023-12-04 23:25:26,185 - Epoch: [32][ 9900/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.438626    
+2023-12-04 23:26:09,349 - Epoch: [32][10000/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.438555    
+2023-12-04 23:26:46,297 - Epoch: [32][10100/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.437871    
+2023-12-04 23:27:25,342 - Epoch: [32][10200/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.437405    
+2023-12-04 23:28:12,087 - Epoch: [32][10300/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.437696    
+2023-12-04 23:28:56,291 - Epoch: [32][10400/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.437737    
+2023-12-04 23:29:36,082 - Epoch: [32][10500/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.437357    
+2023-12-04 23:30:22,194 - Epoch: [32][10600/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.437581    
+2023-12-04 23:31:09,376 - Epoch: [32][10700/31148]    Overall Loss 0.009704    Objective Loss 0.000000    Distill Loss 0.009704                     LR 0.000004    Time 0.437900    
+2023-12-04 23:32:04,242 - Epoch: [32][10800/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.438925    
+2023-12-04 23:32:54,169 - Epoch: [32][10900/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.439478    
+2023-12-04 23:33:42,849 - Epoch: [32][11000/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.439907    
+2023-12-04 23:34:26,603 - Epoch: [32][11100/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.439885    
+2023-12-04 23:35:08,207 - Epoch: [32][11200/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.439672    
+2023-12-04 23:35:42,029 - Epoch: [32][11300/31148]    Overall Loss 0.009705    Objective Loss 0.000000    Distill Loss 0.009705                     LR 0.000004    Time 0.438774    
+2023-12-04 23:36:18,825 - Epoch: [32][11400/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.438152    
+2023-12-04 23:37:08,475 - Epoch: [32][11500/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.438658    
+2023-12-04 23:37:45,944 - Epoch: [32][11600/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.438106    
+2023-12-04 23:38:27,074 - Epoch: [32][11700/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.437877    
+2023-12-04 23:39:08,205 - Epoch: [32][11800/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.437651    
+2023-12-04 23:39:53,587 - Epoch: [32][11900/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.437786    
+2023-12-04 23:40:42,459 - Epoch: [32][12000/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.438210    
+2023-12-04 23:41:22,089 - Epoch: [32][12100/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.437863    
+2023-12-04 23:41:59,944 - Epoch: [32][12200/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.437376    
+2023-12-04 23:42:42,488 - Epoch: [32][12300/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.437279    
+2023-12-04 23:43:28,393 - Epoch: [32][12400/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.437454    
+2023-12-04 23:44:09,626 - Epoch: [32][12500/31148]    Overall Loss 0.009706    Objective Loss 0.000000    Distill Loss 0.009706                     LR 0.000004    Time 0.437252    
+2023-12-04 23:44:53,004 - Epoch: [32][12600/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.437224    
+2023-12-04 23:45:46,478 - Epoch: [32][12700/31148]    Overall Loss 0.009707    Objective Loss 0.000000    Distill Loss 0.009707                     LR 0.000004    Time 0.437991    
+2023-12-04 23:46:29,941 - Epoch: [32][12800/31148]    Overall Loss 0.009708    Objective Loss 0.000000    Distill Loss 0.009708                     LR 0.000004    Time 0.437965    
+2023-12-04 23:47:10,270 - Epoch: [32][12900/31148]    Overall Loss 0.009709    Objective Loss 0.000000    Distill Loss 0.009709                     LR 0.000004    Time 0.437695    
+2023-12-04 23:47:53,415 - Epoch: [32][13000/31148]    Overall Loss 0.009711    Objective Loss 0.000000    Distill Loss 0.009711                     LR 0.000004    Time 0.437647    
+2023-12-04 23:48:42,341 - Epoch: [32][13100/31148]    Overall Loss 0.009712    Objective Loss 0.000000    Distill Loss 0.009712                     LR 0.000004    Time 0.438040    
+2023-12-04 23:49:20,995 - Epoch: [32][13200/31148]    Overall Loss 0.009712    Objective Loss 0.000000    Distill Loss 0.009712                     LR 0.000004    Time 0.437649    
+2023-12-04 23:50:06,506 - Epoch: [32][13300/31148]    Overall Loss 0.009712    Objective Loss 0.000000    Distill Loss 0.009712                     LR 0.000004    Time 0.437780    
+2023-12-04 23:50:46,237 - Epoch: [32][13400/31148]    Overall Loss 0.009712    Objective Loss 0.000000    Distill Loss 0.009712                     LR 0.000004    Time 0.437478    
+2023-12-04 23:51:34,651 - Epoch: [32][13500/31148]    Overall Loss 0.009713    Objective Loss 0.000000    Distill Loss 0.009713                     LR 0.000004    Time 0.437823    
+2023-12-04 23:52:17,217 - Epoch: [32][13600/31148]    Overall Loss 0.009713    Objective Loss 0.000000    Distill Loss 0.009713                     LR 0.000004    Time 0.437733    
+2023-12-04 23:53:02,288 - Epoch: [32][13700/31148]    Overall Loss 0.009713    Objective Loss 0.000000    Distill Loss 0.009713                     LR 0.000004    Time 0.437827    
+2023-12-04 23:53:39,817 - Epoch: [32][13800/31148]    Overall Loss 0.009714    Objective Loss 0.000000    Distill Loss 0.009714                     LR 0.000004    Time 0.437374    
+2023-12-04 23:54:23,112 - Epoch: [32][13900/31148]    Overall Loss 0.009715    Objective Loss 0.000000    Distill Loss 0.009715                     LR 0.000004    Time 0.437341    
+2023-12-04 23:55:02,730 - Epoch: [32][14000/31148]    Overall Loss 0.009715    Objective Loss 0.000000    Distill Loss 0.009715                     LR 0.000004    Time 0.437047    
+2023-12-04 23:55:46,441 - Epoch: [32][14100/31148]    Overall Loss 0.009716    Objective Loss 0.000000    Distill Loss 0.009716                     LR 0.000004    Time 0.437047    
+2023-12-04 23:56:25,254 - Epoch: [32][14200/31148]    Overall Loss 0.009716    Objective Loss 0.000000    Distill Loss 0.009716                     LR 0.000004    Time 0.436702    
+2023-12-04 23:57:12,368 - Epoch: [32][14300/31148]    Overall Loss 0.009715    Objective Loss 0.000000    Distill Loss 0.009715                     LR 0.000004    Time 0.436942    
+2023-12-04 23:57:57,587 - Epoch: [32][14400/31148]    Overall Loss 0.009715    Objective Loss 0.000000    Distill Loss 0.009715                     LR 0.000004    Time 0.437047    
+2023-12-04 23:58:36,995 - Epoch: [32][14500/31148]    Overall Loss 0.009716    Objective Loss 0.000000    Distill Loss 0.009716                     LR 0.000004    Time 0.436751    
+2023-12-04 23:59:21,861 - Epoch: [32][14600/31148]    Overall Loss 0.009717    Objective Loss 0.000000    Distill Loss 0.009717                     LR 0.000004    Time 0.436832    
+2023-12-05 00:00:02,369 - Epoch: [32][14700/31148]    Overall Loss 0.009716    Objective Loss 0.000000    Distill Loss 0.009716                     LR 0.000004    Time 0.436615    
+2023-12-05 00:00:43,035 - Epoch: [32][14800/31148]    Overall Loss 0.009716    Objective Loss 0.000000    Distill Loss 0.009716                     LR 0.000004    Time 0.436412    
+2023-12-05 00:01:24,439 - Epoch: [32][14900/31148]    Overall Loss 0.009716    Objective Loss 0.000000    Distill Loss 0.009716                     LR 0.000004    Time 0.436262    
+2023-12-05 00:02:09,574 - Epoch: [32][15000/31148]    Overall Loss 0.009717    Objective Loss 0.000000    Distill Loss 0.009717                     LR 0.000004    Time 0.436362    
+2023-12-05 00:02:56,968 - Epoch: [32][15100/31148]    Overall Loss 0.009718    Objective Loss 0.000000    Distill Loss 0.009718                     LR 0.000004    Time 0.436610    
+2023-12-05 00:03:37,793 - Epoch: [32][15200/31148]    Overall Loss 0.009718    Objective Loss 0.000000    Distill Loss 0.009718                     LR 0.000004    Time 0.436423    
+2023-12-05 00:04:25,510 - Epoch: [32][15300/31148]    Overall Loss 0.009718    Objective Loss 0.000000    Distill Loss 0.009718                     LR 0.000004    Time 0.436689    
+2023-12-05 00:05:11,285 - Epoch: [32][15400/31148]    Overall Loss 0.009718    Objective Loss 0.000000    Distill Loss 0.009718                     LR 0.000004    Time 0.436825    
+2023-12-05 00:05:55,031 - Epoch: [32][15500/31148]    Overall Loss 0.009719    Objective Loss 0.000000    Distill Loss 0.009719                     LR 0.000004    Time 0.436829    
+2023-12-05 00:06:41,808 - Epoch: [32][15600/31148]    Overall Loss 0.009719    Objective Loss 0.000000    Distill Loss 0.009719                     LR 0.000004    Time 0.437027    
+2023-12-05 00:07:31,910 - Epoch: [32][15700/31148]    Overall Loss 0.009719    Objective Loss 0.000000    Distill Loss 0.009719                     LR 0.000004    Time 0.437434    
+2023-12-05 00:08:18,970 - Epoch: [32][15800/31148]    Overall Loss 0.009720    Objective Loss 0.000000    Distill Loss 0.009720                     LR 0.000004    Time 0.437643    
+2023-12-05 00:09:04,527 - Epoch: [32][15900/31148]    Overall Loss 0.009720    Objective Loss 0.000000    Distill Loss 0.009720                     LR 0.000004    Time 0.437756    
+2023-12-05 00:09:45,207 - Epoch: [32][16000/31148]    Overall Loss 0.009720    Objective Loss 0.000000    Distill Loss 0.009720                     LR 0.000004    Time 0.437562    
+2023-12-05 00:10:30,991 - Epoch: [32][16100/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437687    
+2023-12-05 00:11:13,057 - Epoch: [32][16200/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437582    
+2023-12-05 00:12:01,813 - Epoch: [32][16300/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437888    
+2023-12-05 00:12:41,296 - Epoch: [32][16400/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.437625    
+2023-12-05 00:13:24,203 - Epoch: [32][16500/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.437573    
+2023-12-05 00:14:03,875 - Epoch: [32][16600/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.437326    
+2023-12-05 00:14:55,869 - Epoch: [32][16700/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437821    
+2023-12-05 00:15:32,620 - Epoch: [32][16800/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437402    
+2023-12-05 00:16:14,991 - Epoch: [32][16900/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437320    
+2023-12-05 00:17:03,689 - Epoch: [32][17000/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437612    
+2023-12-05 00:17:51,304 - Epoch: [32][17100/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437837    
+2023-12-05 00:18:33,666 - Epoch: [32][17200/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.437754    
+2023-12-05 00:19:27,501 - Epoch: [32][17300/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438335    
+2023-12-05 00:20:08,291 - Epoch: [32][17400/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.438160    
+2023-12-05 00:20:57,478 - Epoch: [32][17500/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438466    
+2023-12-05 00:21:44,729 - Epoch: [32][17600/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438659    
+2023-12-05 00:22:28,469 - Epoch: [32][17700/31148]    Overall Loss 0.009720    Objective Loss 0.000000    Distill Loss 0.009720                     LR 0.000004    Time 0.438652    
+2023-12-05 00:23:11,349 - Epoch: [32][17800/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438596    
+2023-12-05 00:23:53,758 - Epoch: [32][17900/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438514    
+2023-12-05 00:24:49,687 - Epoch: [32][18000/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.439185    
+2023-12-05 00:25:31,496 - Epoch: [32][18100/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.439068    
+2023-12-05 00:26:13,852 - Epoch: [32][18200/31148]    Overall Loss 0.009720    Objective Loss 0.000000    Distill Loss 0.009720                     LR 0.000004    Time 0.438983    
+2023-12-05 00:26:54,490 - Epoch: [32][18300/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438804    
+2023-12-05 00:27:36,566 - Epoch: [32][18400/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.438706    
+2023-12-05 00:28:22,081 - Epoch: [32][18500/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438794    
+2023-12-05 00:29:00,889 - Epoch: [32][18600/31148]    Overall Loss 0.009721    Objective Loss 0.000000    Distill Loss 0.009721                     LR 0.000004    Time 0.438521    
+2023-12-05 00:29:43,369 - Epoch: [32][18700/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.438447    
+2023-12-05 00:30:36,092 - Epoch: [32][18800/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.438919    
+2023-12-05 00:31:32,789 - Epoch: [32][18900/31148]    Overall Loss 0.009723    Objective Loss 0.000000    Distill Loss 0.009723                     LR 0.000004    Time 0.439596    
+2023-12-05 00:32:18,348 - Epoch: [32][19000/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.439680    
+2023-12-05 00:32:59,586 - Epoch: [32][19100/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.439537    
+2023-12-05 00:33:44,942 - Epoch: [32][19200/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.439610    
+2023-12-05 00:34:26,124 - Epoch: [32][19300/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.439465    
+2023-12-05 00:35:00,667 - Epoch: [32][19400/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.438980    
+2023-12-05 00:35:42,974 - Epoch: [32][19500/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.438898    
+2023-12-05 00:36:32,114 - Epoch: [32][19600/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.439166    
+2023-12-05 00:37:09,858 - Epoch: [32][19700/31148]    Overall Loss 0.009723    Objective Loss 0.000000    Distill Loss 0.009723                     LR 0.000004    Time 0.438852    
+2023-12-05 00:37:54,384 - Epoch: [32][19800/31148]    Overall Loss 0.009723    Objective Loss 0.000000    Distill Loss 0.009723                     LR 0.000004    Time 0.438884    
+2023-12-05 00:38:38,984 - Epoch: [32][19900/31148]    Overall Loss 0.009723    Objective Loss 0.000000    Distill Loss 0.009723                     LR 0.000004    Time 0.438919    
+2023-12-05 00:39:24,636 - Epoch: [32][20000/31148]    Overall Loss 0.009723    Objective Loss 0.000000    Distill Loss 0.009723                     LR 0.000004    Time 0.439007    
+2023-12-05 00:40:02,343 - Epoch: [32][20100/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.438699    
+2023-12-05 00:40:48,205 - Epoch: [32][20200/31148]    Overall Loss 0.009723    Objective Loss 0.000000    Distill Loss 0.009723                     LR 0.000004    Time 0.438797    
+2023-12-05 00:41:31,130 - Epoch: [32][20300/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.438750    
+2023-12-05 00:42:15,603 - Epoch: [32][20400/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.438778    
+2023-12-05 00:43:09,776 - Epoch: [32][20500/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.439280    
+2023-12-05 00:43:54,786 - Epoch: [32][20600/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.439333    
+2023-12-05 00:44:36,238 - Epoch: [32][20700/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.439212    
+2023-12-05 00:45:18,007 - Epoch: [32][20800/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.439109    
+2023-12-05 00:46:00,643 - Epoch: [32][20900/31148]    Overall Loss 0.009724    Objective Loss 0.000000    Distill Loss 0.009724                     LR 0.000004    Time 0.439047    
+2023-12-05 00:46:44,927 - Epoch: [32][21000/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000004    Time 0.439065    
+2023-12-05 00:47:24,389 - Epoch: [32][21100/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000004    Time 0.438854    
+2023-12-05 00:48:08,682 - Epoch: [32][21200/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000004    Time 0.438873    
+2023-12-05 00:48:45,825 - Epoch: [32][21300/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000004    Time 0.438556    
+2023-12-05 00:49:29,925 - Epoch: [32][21400/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000004    Time 0.438567    
+2023-12-05 00:50:12,990 - Epoch: [32][21500/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000004    Time 0.438530    
+2023-12-05 00:51:07,409 - Epoch: [32][21600/31148]    Overall Loss 0.009725    Objective Loss 0.000000    Distill Loss 0.009725                     LR 0.000004    Time 0.439019    
+2023-12-05 00:51:58,828 - Epoch: [32][21700/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000004    Time 0.439365    
+2023-12-05 00:52:46,963 - Epoch: [32][21800/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000004    Time 0.439557    
+2023-12-05 00:53:32,278 - Epoch: [32][21900/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000004    Time 0.439619    
+2023-12-05 00:54:21,535 - Epoch: [32][22000/31148]    Overall Loss 0.009727    Objective Loss 0.000000    Distill Loss 0.009727                     LR 0.000004    Time 0.439859    
+2023-12-05 00:54:56,851 - Epoch: [32][22100/31148]    Overall Loss 0.009727    Objective Loss 0.000000    Distill Loss 0.009727                     LR 0.000004    Time 0.439467    
+2023-12-05 00:55:36,411 - Epoch: [32][22200/31148]    Overall Loss 0.009727    Objective Loss 0.000000    Distill Loss 0.009727                     LR 0.000004    Time 0.439269    
+2023-12-05 00:56:14,592 - Epoch: [32][22300/31148]    Overall Loss 0.009727    Objective Loss 0.000000    Distill Loss 0.009727                     LR 0.000004    Time 0.439011    
+2023-12-05 00:56:53,680 - Epoch: [32][22400/31148]    Overall Loss 0.009727    Objective Loss 0.000000    Distill Loss 0.009727                     LR 0.000004    Time 0.438795    
+2023-12-05 00:57:33,672 - Epoch: [32][22500/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000004    Time 0.438622    
+2023-12-05 00:58:30,592 - Epoch: [32][22600/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000004    Time 0.439200    
+2023-12-05 00:59:21,302 - Epoch: [32][22700/31148]    Overall Loss 0.009727    Objective Loss 0.000000    Distill Loss 0.009727                     LR 0.000004    Time 0.439499    
+2023-12-05 01:00:07,547 - Epoch: [32][22800/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000004    Time 0.439599    
+2023-12-05 01:00:51,376 - Epoch: [32][22900/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000004    Time 0.439593    
+2023-12-05 01:01:49,276 - Epoch: [32][23000/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000004    Time 0.440199    
+2023-12-05 01:02:27,290 - Epoch: [32][23100/31148]    Overall Loss 0.009728    Objective Loss 0.000000    Distill Loss 0.009728                     LR 0.000004    Time 0.439938    
+2023-12-05 01:03:15,622 - Epoch: [32][23200/31148]    Overall Loss 0.009729    Objective Loss 0.000000    Distill Loss 0.009729                     LR 0.000004    Time 0.440125    
+2023-12-05 01:04:00,364 - Epoch: [32][23300/31148]    Overall Loss 0.009729    Objective Loss 0.000000    Distill Loss 0.009729                     LR 0.000004    Time 0.440156    
+2023-12-05 01:04:50,424 - Epoch: [32][23400/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000004    Time 0.440414    
+2023-12-05 01:05:33,237 - Epoch: [32][23500/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000004    Time 0.440362    
+2023-12-05 01:06:29,257 - Epoch: [32][23600/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000004    Time 0.440869    
+2023-12-05 01:07:13,454 - Epoch: [32][23700/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000004    Time 0.440873    
+2023-12-05 01:07:52,454 - Epoch: [32][23800/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000004    Time 0.440659    
+2023-12-05 01:08:44,154 - Epoch: [32][23900/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.440979    
+2023-12-05 01:09:29,644 - Epoch: [32][24000/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441036    
+2023-12-05 01:10:05,890 - Epoch: [32][24100/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.440710    
+2023-12-05 01:10:57,784 - Epoch: [32][24200/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441033    
+2023-12-05 01:11:43,430 - Epoch: [32][24300/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441096    
+2023-12-05 01:12:26,296 - Epoch: [32][24400/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441045    
+2023-12-05 01:13:18,192 - Epoch: [32][24500/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441363    
+2023-12-05 01:14:05,269 - Epoch: [32][24600/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441482    
+2023-12-05 01:14:50,888 - Epoch: [32][24700/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441541    
+2023-12-05 01:15:37,503 - Epoch: [32][24800/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441640    
+2023-12-05 01:16:18,854 - Epoch: [32][24900/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441527    
+2023-12-05 01:17:03,808 - Epoch: [32][25000/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441559    
+2023-12-05 01:17:46,249 - Epoch: [32][25100/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441490    
+2023-12-05 01:18:30,002 - Epoch: [32][25200/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441474    
+2023-12-05 01:19:14,846 - Epoch: [32][25300/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441501    
+2023-12-05 01:20:08,523 - Epoch: [32][25400/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441876    
+2023-12-05 01:20:49,788 - Epoch: [32][25500/31148]    Overall Loss 0.009731    Objective Loss 0.000000    Distill Loss 0.009731                     LR 0.000004    Time 0.441761    
+2023-12-05 01:21:35,924 - Epoch: [32][25600/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441837    
+2023-12-05 01:22:19,449 - Epoch: [32][25700/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.441811    
+2023-12-05 01:23:10,789 - Epoch: [32][25800/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.442089    
+2023-12-05 01:23:59,996 - Epoch: [32][25900/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.442281    
+2023-12-05 01:24:43,851 - Epoch: [32][26000/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.442267    
+2023-12-05 01:25:33,229 - Epoch: [32][26100/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.442464    
+2023-12-05 01:26:27,080 - Epoch: [32][26200/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.442830    
+2023-12-05 01:27:13,168 - Epoch: [32][26300/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.442898    
+2023-12-05 01:28:00,322 - Epoch: [32][26400/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.443007    
+2023-12-05 01:28:51,917 - Epoch: [32][26500/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.443282    
+2023-12-05 01:29:45,095 - Epoch: [32][26600/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.443614    
+2023-12-05 01:30:32,691 - Epoch: [32][26700/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.443735    
+2023-12-05 01:31:18,909 - Epoch: [32][26800/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.443804    
+2023-12-05 01:32:05,780 - Epoch: [32][26900/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.443896    
+2023-12-05 01:32:54,510 - Epoch: [32][27000/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444056    
+2023-12-05 01:33:38,261 - Epoch: [32][27100/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444032    
+2023-12-05 01:34:23,074 - Epoch: [32][27200/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444047    
+2023-12-05 01:35:09,334 - Epoch: [32][27300/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444115    
+2023-12-05 01:36:02,151 - Epoch: [32][27400/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444421    
+2023-12-05 01:36:43,148 - Epoch: [32][27500/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444295    
+2023-12-05 01:37:33,715 - Epoch: [32][27600/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444518    
+2023-12-05 01:38:22,422 - Epoch: [32][27700/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444671    
+2023-12-05 01:39:15,352 - Epoch: [32][27800/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444975    
+2023-12-05 01:40:03,579 - Epoch: [32][27900/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.445109    
+2023-12-05 01:40:45,571 - Epoch: [32][28000/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.445018    
+2023-12-05 01:41:32,962 - Epoch: [32][28100/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.445121    
+2023-12-05 01:42:15,796 - Epoch: [32][28200/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.445061    
+2023-12-05 01:42:47,100 - Epoch: [32][28300/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.444595    
+2023-12-05 01:43:15,034 - Epoch: [32][28400/31148]    Overall Loss 0.009734    Objective Loss 0.000000    Distill Loss 0.009734                     LR 0.000004    Time 0.444013    
+2023-12-05 01:43:43,055 - Epoch: [32][28500/31148]    Overall Loss 0.009735    Objective Loss 0.000000    Distill Loss 0.009735                     LR 0.000004    Time 0.443438    
+2023-12-05 01:44:10,793 - Epoch: [32][28600/31148]    Overall Loss 0.009735    Objective Loss 0.000000    Distill Loss 0.009735                     LR 0.000004    Time 0.442857    
+2023-12-05 01:44:40,139 - Epoch: [32][28700/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.442336    
+2023-12-05 01:45:09,031 - Epoch: [32][28800/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.441803    
+2023-12-05 01:45:38,053 - Epoch: [32][28900/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.441279    
+2023-12-05 01:46:06,266 - Epoch: [32][29000/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.440730    
+2023-12-05 01:46:34,756 - Epoch: [32][29100/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.440194    
+2023-12-05 01:47:03,508 - Epoch: [32][29200/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.439671    
+2023-12-05 01:47:32,752 - Epoch: [32][29300/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.439168    
+2023-12-05 01:48:01,256 - Epoch: [32][29400/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.438644    
+2023-12-05 01:48:45,422 - Epoch: [32][29500/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.438654    
+2023-12-05 01:49:25,172 - Epoch: [32][29600/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.438515    
+2023-12-05 01:50:13,325 - Epoch: [32][29700/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.438659    
+2023-12-05 01:50:55,362 - Epoch: [32][29800/31148]    Overall Loss 0.009737    Objective Loss 0.000000    Distill Loss 0.009737                     LR 0.000004    Time 0.438598    
+2023-12-05 01:51:58,965 - Epoch: [32][29900/31148]    Overall Loss 0.009737    Objective Loss 0.000000    Distill Loss 0.009737                     LR 0.000004    Time 0.439258    
+2023-12-05 01:52:49,224 - Epoch: [32][30000/31148]    Overall Loss 0.009737    Objective Loss 0.000000    Distill Loss 0.009737                     LR 0.000004    Time 0.439469    
+2023-12-05 01:53:40,300 - Epoch: [32][30100/31148]    Overall Loss 0.009737    Objective Loss 0.000000    Distill Loss 0.009737                     LR 0.000004    Time 0.439705    
+2023-12-05 01:54:29,025 - Epoch: [32][30200/31148]    Overall Loss 0.009737    Objective Loss 0.000000    Distill Loss 0.009737                     LR 0.000004    Time 0.439863    
+2023-12-05 01:55:17,674 - Epoch: [32][30300/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440016    
+2023-12-05 01:56:04,343 - Epoch: [32][30400/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440104    
+2023-12-05 01:56:46,998 - Epoch: [32][30500/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440059    
+2023-12-05 01:57:35,048 - Epoch: [32][30600/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440191    
+2023-12-05 01:58:25,102 - Epoch: [32][30700/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440387    
+2023-12-05 01:59:14,374 - Epoch: [32][30800/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440557    
+2023-12-05 02:00:11,289 - Epoch: [32][30900/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440973    
+2023-12-05 02:00:53,985 - Epoch: [32][31000/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440928    
+2023-12-05 02:01:39,283 - Epoch: [32][31100/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440966    
+2023-12-05 02:01:57,639 - Epoch: [32][31148/31148]    Overall Loss 0.009738    Objective Loss 0.000000    Distill Loss 0.009738                     LR 0.000004    Time 0.440876    
+2023-12-05 02:01:58,430 - --- validate (epoch=32)-----------
+2023-12-05 02:01:58,430 - 167951 samples (100 per mini-batch)
+2023-12-05 02:02:26,287 - Epoch: [32][  100/ 1680]    Loss 0.000000    Overall Loss 0.010432    
+2023-12-05 02:02:50,069 - Epoch: [32][  200/ 1680]    Loss 0.000000    Overall Loss 0.010418    
+2023-12-05 02:03:13,359 - Epoch: [32][  300/ 1680]    Loss 0.000000    Overall Loss 0.010376    
+2023-12-05 02:03:36,903 - Epoch: [32][  400/ 1680]    Loss 0.000000    Overall Loss 0.010389    
+2023-12-05 02:04:00,717 - Epoch: [32][  500/ 1680]    Loss 0.000000    Overall Loss 0.010380    
+2023-12-05 02:04:24,457 - Epoch: [32][  600/ 1680]    Loss 0.000000    Overall Loss 0.010387    
+2023-12-05 02:04:47,810 - Epoch: [32][  700/ 1680]    Loss 0.000000    Overall Loss 0.010397    
+2023-12-05 02:05:10,866 - Epoch: [32][  800/ 1680]    Loss 0.000000    Overall Loss 0.010386    
+2023-12-05 02:05:33,623 - Epoch: [32][  900/ 1680]    Loss 0.000000    Overall Loss 0.010386    
+2023-12-05 02:05:56,169 - Epoch: [32][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010389    
+2023-12-05 02:06:18,951 - Epoch: [32][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010386    
+2023-12-05 02:06:41,879 - Epoch: [32][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010383    
+2023-12-05 02:07:04,693 - Epoch: [32][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010381    
+2023-12-05 02:07:27,328 - Epoch: [32][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010381    
+2023-12-05 02:07:49,833 - Epoch: [32][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010382    
+2023-12-05 02:08:12,552 - Epoch: [32][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010379    
+2023-12-05 02:08:30,435 - Epoch: [32][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010381    
+2023-12-05 02:08:30,919 - ==> Overall Loss: 0.010
+
+2023-12-05 02:08:30,927 - ==> Best [Overall Loss: 0.010381 on epoch: 32]
+2023-12-05 02:08:30,927 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-05 02:08:30,986 - 
+
+2023-12-05 02:08:30,986 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-05 02:09:43,913 - Epoch: [33][  100/31148]    Overall Loss 0.009735    Objective Loss 0.000000    Distill Loss 0.009735                     LR 0.000004    Time 0.729165    
+2023-12-05 02:10:41,289 - Epoch: [33][  200/31148]    Overall Loss 0.009700    Objective Loss 0.000000    Distill Loss 0.009700                     LR 0.000004    Time 0.651427    
+2023-12-05 02:11:26,033 - Epoch: [33][  300/31148]    Overall Loss 0.009711    Objective Loss 0.000000    Distill Loss 0.009711                     LR 0.000004    Time 0.583409    
+2023-12-05 02:12:17,458 - Epoch: [33][  400/31148]    Overall Loss 0.009701    Objective Loss 0.000000    Distill Loss 0.009701                     LR 0.000004    Time 0.566103    
+2023-12-05 02:12:56,683 - Epoch: [33][  500/31148]    Overall Loss 0.009703    Objective Loss 0.000000    Distill Loss 0.009703                     LR 0.000004    Time 0.531318    
+2023-12-05 02:13:35,438 - Epoch: [33][  600/31148]    Overall Loss 0.009712    Objective Loss 0.000000    Distill Loss 0.009712                     LR 0.000004    Time 0.507345    
+2023-12-05 02:14:25,421 - Epoch: [33][  700/31148]    Overall Loss 0.009722    Objective Loss 0.000000    Distill Loss 0.009722                     LR 0.000004    Time 0.506262    
+2023-12-05 02:15:09,674 - Epoch: [33][  800/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.498286    
+2023-12-05 02:15:58,964 - Epoch: [33][  900/31148]    Overall Loss 0.009726    Objective Loss 0.000000    Distill Loss 0.009726                     LR 0.000004    Time 0.497680    
+2023-12-05 02:16:42,752 - Epoch: [33][ 1000/31148]    Overall Loss 0.009730    Objective Loss 0.000000    Distill Loss 0.009730                     LR 0.000004    Time 0.491692    
+2023-12-05 02:17:24,948 - Epoch: [33][ 1100/31148]    Overall Loss 0.009735    Objective Loss 0.000000    Distill Loss 0.009735                     LR 0.000004    Time 0.485347    
+2023-12-05 02:18:17,642 - Epoch: [33][ 1200/31148]    Overall Loss 0.009733    Objective Loss 0.000000    Distill Loss 0.009733                     LR 0.000004    Time 0.488807    
+2023-12-05 02:19:13,429 - Epoch: [33][ 1300/31148]    Overall Loss 0.009732    Objective Loss 0.000000    Distill Loss 0.009732                     LR 0.000004    Time 0.494115    
+2023-12-05 02:20:05,128 - Epoch: [33][ 1400/31148]    Overall Loss 0.009736    Objective Loss 0.000000    Distill Loss 0.009736                     LR 0.000004    Time 0.495744    
+2023-12-05 02:20:48,613 - Epoch: [33][ 1500/31148]    Overall Loss 0.009735    Objective Loss 0.000000    Distill Loss 0.009735                     LR 0.000004    Time 0.491680    
+2023-12-05 02:21:28,037 - Epoch: [33][ 1600/31148]    Overall Loss 0.009740    Objective Loss 0.000000    Distill Loss 0.009740                     LR 0.000004    Time 0.485586    
+2023-12-05 02:22:09,813 - Epoch: [33][ 1700/31148]    Overall Loss 0.009739    Objective Loss 0.000000    Distill Loss 0.009739                     LR 0.000004    Time 0.481592    
+2023-12-05 02:22:47,007 - Epoch: [33][ 1800/31148]    Overall Loss 0.009739    Objective Loss 0.000000    Distill Loss 0.009739                     LR 0.000004    Time 0.475496    
+2023-12-05 02:23:33,812 - Epoch: [33][ 1900/31148]    Overall Loss 0.009741    Objective Loss 0.000000    Distill Loss 0.009741                     LR 0.000004    Time 0.475101    
+2023-12-05 02:24:20,350 - Epoch: [33][ 2000/31148]    Overall Loss 0.009741    Objective Loss 0.000000    Distill Loss 0.009741                     LR 0.000004    Time 0.474611    
+2023-12-05 02:24:59,935 - Epoch: [33][ 2100/31148]    Overall Loss 0.009745    Objective Loss 0.000000    Distill Loss 0.009745                     LR 0.000004    Time 0.470857    
+2023-12-05 02:25:54,951 - Epoch: [33][ 2200/31148]    Overall Loss 0.009743    Objective Loss 0.000000    Distill Loss 0.009743                     LR 0.000004    Time 0.474459    
+2023-12-05 02:26:41,405 - Epoch: [33][ 2300/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.474024    
+2023-12-05 02:27:27,013 - Epoch: [33][ 2400/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.473273    
+2023-12-05 02:28:15,749 - Epoch: [33][ 2500/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.473834    
+2023-12-05 02:28:59,909 - Epoch: [33][ 2600/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.472591    
+2023-12-05 02:29:46,790 - Epoch: [33][ 2700/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.472449    
+2023-12-05 02:30:38,429 - Epoch: [33][ 2800/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.474016    
+2023-12-05 02:31:22,563 - Epoch: [33][ 2900/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.472887    
+2023-12-05 02:32:09,632 - Epoch: [33][ 3000/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.472811    
+2023-12-05 02:33:03,829 - Epoch: [33][ 3100/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.475040    
+2023-12-05 02:33:46,225 - Epoch: [33][ 3200/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.473441    
+2023-12-05 02:34:29,233 - Epoch: [33][ 3300/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.472124    
+2023-12-05 02:35:09,740 - Epoch: [33][ 3400/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.470150    
+2023-12-05 02:35:55,056 - Epoch: [33][ 3500/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.469663    
+2023-12-05 02:36:40,460 - Epoch: [33][ 3600/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.469227    
+2023-12-05 02:37:24,504 - Epoch: [33][ 3700/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.468447    
+2023-12-05 02:38:08,897 - Epoch: [33][ 3800/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.467800    
+2023-12-05 02:38:51,114 - Epoch: [33][ 3900/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.466628    
+2023-12-05 02:39:29,570 - Epoch: [33][ 4000/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.464574    
+2023-12-05 02:40:06,790 - Epoch: [33][ 4100/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.462320    
+2023-12-05 02:40:50,485 - Epoch: [33][ 4200/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.461714    
+2023-12-05 02:41:30,000 - Epoch: [33][ 4300/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000004    Time 0.460164    
+2023-12-05 02:42:14,033 - Epoch: [33][ 4400/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.459712    
+2023-12-05 02:43:00,692 - Epoch: [33][ 4500/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.459863    
+2023-12-05 02:43:54,185 - Epoch: [33][ 4600/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.461493    
+2023-12-05 02:44:44,680 - Epoch: [33][ 4700/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.462416    
+2023-12-05 02:45:36,623 - Epoch: [33][ 4800/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.463603    
+2023-12-05 02:46:20,539 - Epoch: [33][ 4900/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.463102    
+2023-12-05 02:47:03,906 - Epoch: [33][ 5000/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.462512    
+2023-12-05 02:47:45,788 - Epoch: [33][ 5100/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.461654    
+2023-12-05 02:48:33,485 - Epoch: [33][ 5200/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.461947    
+2023-12-05 02:49:18,387 - Epoch: [33][ 5300/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.461702    
+2023-12-05 02:50:10,602 - Epoch: [33][ 5400/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.462821    
+2023-12-05 02:50:53,108 - Epoch: [33][ 5500/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.462133    
+2023-12-05 02:51:37,770 - Epoch: [33][ 5600/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.461854    
+2023-12-05 02:52:25,332 - Epoch: [33][ 5700/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.462095    
+2023-12-05 02:53:10,670 - Epoch: [33][ 5800/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.461943    
+2023-12-05 02:53:55,495 - Epoch: [33][ 5900/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.461710    
+2023-12-05 02:54:34,639 - Epoch: [33][ 6000/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.460538    
+2023-12-05 02:55:13,985 - Epoch: [33][ 6100/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.459437    
+2023-12-05 02:56:02,742 - Epoch: [33][ 6200/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.459889    
+2023-12-05 02:56:53,935 - Epoch: [33][ 6300/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.460714    
+2023-12-05 02:57:37,549 - Epoch: [33][ 6400/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.460329    
+2023-12-05 02:58:13,840 - Epoch: [33][ 6500/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.458829    
+2023-12-05 02:58:58,621 - Epoch: [33][ 6600/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.458661    
+2023-12-05 02:59:43,925 - Epoch: [33][ 6700/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.458576    
+2023-12-05 03:00:23,651 - Epoch: [33][ 6800/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.457674    
+2023-12-05 03:01:09,652 - Epoch: [33][ 6900/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.457706    
+2023-12-05 03:01:51,113 - Epoch: [33][ 7000/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.457090    
+2023-12-05 03:02:26,013 - Epoch: [33][ 7100/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.455566    
+2023-12-05 03:03:18,058 - Epoch: [33][ 7200/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.456466    
+2023-12-05 03:03:52,379 - Epoch: [33][ 7300/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.454914    
+2023-12-05 03:04:30,887 - Epoch: [33][ 7400/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.453969    
+2023-12-05 03:05:16,713 - Epoch: [33][ 7500/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.454026    
+2023-12-05 03:06:00,176 - Epoch: [33][ 7600/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.453769    
+2023-12-05 03:06:41,350 - Epoch: [33][ 7700/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.453223    
+2023-12-05 03:07:30,140 - Epoch: [33][ 7800/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.453666    
+2023-12-05 03:08:15,475 - Epoch: [33][ 7900/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.453661    
+2023-12-05 03:08:55,822 - Epoch: [33][ 8000/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.453033    
+2023-12-05 03:09:36,491 - Epoch: [33][ 8100/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.452460    
+2023-12-05 03:10:22,649 - Epoch: [33][ 8200/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.452570    
+2023-12-05 03:11:15,562 - Epoch: [33][ 8300/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.453492    
+2023-12-05 03:11:54,501 - Epoch: [33][ 8400/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.452728    
+2023-12-05 03:12:38,239 - Epoch: [33][ 8500/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.452547    
+2023-12-05 03:13:29,922 - Epoch: [33][ 8600/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.453293    
+2023-12-05 03:14:05,665 - Epoch: [33][ 8700/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452191    
+2023-12-05 03:14:49,189 - Epoch: [33][ 8800/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.451997    
+2023-12-05 03:15:29,720 - Epoch: [33][ 8900/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451472    
+2023-12-05 03:16:20,424 - Epoch: [33][ 9000/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452089    
+2023-12-05 03:17:10,652 - Epoch: [33][ 9100/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452639    
+2023-12-05 03:17:54,992 - Epoch: [33][ 9200/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452538    
+2023-12-05 03:18:38,378 - Epoch: [33][ 9300/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452336    
+2023-12-05 03:19:23,948 - Epoch: [33][ 9400/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452371    
+2023-12-05 03:20:09,857 - Epoch: [33][ 9500/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452441    
+2023-12-05 03:20:52,604 - Epoch: [33][ 9600/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452181    
+2023-12-05 03:21:36,235 - Epoch: [33][ 9700/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452016    
+2023-12-05 03:22:22,565 - Epoch: [33][ 9800/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452131    
+2023-12-05 03:23:04,541 - Epoch: [33][ 9900/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.451803    
+2023-12-05 03:23:55,414 - Epoch: [33][10000/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452372    
+2023-12-05 03:24:38,999 - Epoch: [33][10100/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452207    
+2023-12-05 03:25:26,929 - Epoch: [33][10200/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452472    
+2023-12-05 03:26:10,757 - Epoch: [33][10300/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452334    
+2023-12-05 03:26:52,359 - Epoch: [33][10400/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.451984    
+2023-12-05 03:27:30,804 - Epoch: [33][10500/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.451340    
+2023-12-05 03:28:18,236 - Epoch: [33][10600/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.451556    
+2023-12-05 03:28:59,268 - Epoch: [33][10700/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451170    
+2023-12-05 03:29:46,983 - Epoch: [33][10800/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451410    
+2023-12-05 03:30:31,804 - Epoch: [33][10900/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451380    
+2023-12-05 03:31:14,648 - Epoch: [33][11000/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451171    
+2023-12-05 03:32:06,405 - Epoch: [33][11100/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451768    
+2023-12-05 03:32:45,951 - Epoch: [33][11200/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.451265    
+2023-12-05 03:33:41,010 - Epoch: [33][11300/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.452143    
+2023-12-05 03:34:23,746 - Epoch: [33][11400/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451925    
+2023-12-05 03:35:08,217 - Epoch: [33][11500/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451862    
+2023-12-05 03:35:54,879 - Epoch: [33][11600/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451988    
+2023-12-05 03:36:45,292 - Epoch: [33][11700/31148]    Overall Loss 0.009748    Objective Loss 0.000000    Distill Loss 0.009748                     LR 0.000004    Time 0.452434    
+2023-12-05 03:37:27,687 - Epoch: [33][11800/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.452192    
+2023-12-05 03:38:12,439 - Epoch: [33][11900/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.452152    
+2023-12-05 03:38:57,490 - Epoch: [33][12000/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452137    
+2023-12-05 03:39:41,605 - Epoch: [33][12100/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452046    
+2023-12-05 03:40:24,437 - Epoch: [33][12200/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451851    
+2023-12-05 03:41:10,269 - Epoch: [33][12300/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451903    
+2023-12-05 03:41:56,372 - Epoch: [33][12400/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451976    
+2023-12-05 03:42:43,895 - Epoch: [33][12500/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.452161    
+2023-12-05 03:43:26,672 - Epoch: [33][12600/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451967    
+2023-12-05 03:44:10,057 - Epoch: [33][12700/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451824    
+2023-12-05 03:44:56,042 - Epoch: [33][12800/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451886    
+2023-12-05 03:45:40,682 - Epoch: [33][12900/31148]    Overall Loss 0.009749    Objective Loss 0.000000    Distill Loss 0.009749                     LR 0.000004    Time 0.451843    
+2023-12-05 03:46:27,889 - Epoch: [33][13000/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451998    
+2023-12-05 03:47:15,413 - Epoch: [33][13100/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452175    
+2023-12-05 03:47:58,249 - Epoch: [33][13200/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.451994    
+2023-12-05 03:48:44,911 - Epoch: [33][13300/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452104    
+2023-12-05 03:49:29,558 - Epoch: [33][13400/31148]    Overall Loss 0.009750    Objective Loss 0.000000    Distill Loss 0.009750                     LR 0.000004    Time 0.452061    
+2023-12-05 03:50:19,098 - Epoch: [33][13500/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452382    
+2023-12-05 03:51:04,811 - Epoch: [33][13600/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452416    
+2023-12-05 03:51:59,622 - Epoch: [33][13700/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.453114    
+2023-12-05 03:52:40,388 - Epoch: [33][13800/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452784    
+2023-12-05 03:53:29,435 - Epoch: [33][13900/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.453055    
+2023-12-05 03:54:14,932 - Epoch: [33][14000/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.453068    
+2023-12-05 03:54:54,644 - Epoch: [33][14100/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452670    
+2023-12-05 03:55:34,910 - Epoch: [33][14200/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452318    
+2023-12-05 03:56:26,951 - Epoch: [33][14300/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452793    
+2023-12-05 03:57:14,370 - Epoch: [33][14400/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452942    
+2023-12-05 03:57:58,763 - Epoch: [33][14500/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452879    
+2023-12-05 03:58:36,578 - Epoch: [33][14600/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452367    
+2023-12-05 03:59:23,693 - Epoch: [33][14700/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452494    
+2023-12-05 04:00:14,548 - Epoch: [33][14800/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452872    
+2023-12-05 04:01:00,288 - Epoch: [33][14900/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452902    
+2023-12-05 04:01:40,405 - Epoch: [33][15000/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452557    
+2023-12-05 04:02:29,386 - Epoch: [33][15100/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452803    
+2023-12-05 04:03:19,979 - Epoch: [33][15200/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.453152    
+2023-12-05 04:03:54,581 - Epoch: [33][15300/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452451    
+2023-12-05 04:04:40,175 - Epoch: [33][15400/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452474    
+2023-12-05 04:05:23,203 - Epoch: [33][15500/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452330    
+2023-12-05 04:06:17,736 - Epoch: [33][15600/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452926    
+2023-12-05 04:06:59,702 - Epoch: [33][15700/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452713    
+2023-12-05 04:07:47,445 - Epoch: [33][15800/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452869    
+2023-12-05 04:08:29,433 - Epoch: [33][15900/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452661    
+2023-12-05 04:09:24,948 - Epoch: [33][16000/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.453301    
+2023-12-05 04:10:04,820 - Epoch: [33][16100/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452962    
+2023-12-05 04:10:48,572 - Epoch: [33][16200/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452866    
+2023-12-05 04:11:33,663 - Epoch: [33][16300/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452854    
+2023-12-05 04:12:14,443 - Epoch: [33][16400/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452579    
+2023-12-05 04:13:09,371 - Epoch: [33][16500/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.453164    
+2023-12-05 04:13:54,568 - Epoch: [33][16600/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.453157    
+2023-12-05 04:14:39,001 - Epoch: [33][16700/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.453103    
+2023-12-05 04:15:17,335 - Epoch: [33][16800/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452688    
+2023-12-05 04:16:00,587 - Epoch: [33][16900/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452568    
+2023-12-05 04:16:49,210 - Epoch: [33][17000/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452766    
+2023-12-05 04:17:29,693 - Epoch: [33][17100/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452485    
+2023-12-05 04:18:19,264 - Epoch: [33][17200/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452736    
+2023-12-05 04:18:57,418 - Epoch: [33][17300/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452324    
+2023-12-05 04:19:39,563 - Epoch: [33][17400/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.452146    
+2023-12-05 04:20:24,352 - Epoch: [33][17500/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452121    
+2023-12-05 04:21:15,275 - Epoch: [33][17600/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452445    
+2023-12-05 04:21:53,207 - Epoch: [33][17700/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.452032    
+2023-12-05 04:22:37,433 - Epoch: [33][17800/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.451977    
+2023-12-05 04:23:20,579 - Epoch: [33][17900/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.451862    
+2023-12-05 04:24:16,539 - Epoch: [33][18000/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452460    
+2023-12-05 04:25:04,304 - Epoch: [33][18100/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452598    
+2023-12-05 04:25:44,926 - Epoch: [33][18200/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452343    
+2023-12-05 04:26:32,243 - Epoch: [33][18300/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452457    
+2023-12-05 04:27:19,257 - Epoch: [33][18400/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452552    
+2023-12-05 04:28:04,014 - Epoch: [33][18500/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452525    
+2023-12-05 04:28:45,550 - Epoch: [33][18600/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452325    
+2023-12-05 04:29:37,226 - Epoch: [33][18700/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452669    
+2023-12-05 04:30:22,047 - Epoch: [33][18800/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452645    
+2023-12-05 04:31:01,074 - Epoch: [33][18900/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452315    
+2023-12-05 04:31:43,703 - Epoch: [33][19000/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452177    
+2023-12-05 04:32:25,505 - Epoch: [33][19100/31148]    Overall Loss 0.009751    Objective Loss 0.000000    Distill Loss 0.009751                     LR 0.000004    Time 0.451998    
+2023-12-05 04:33:16,681 - Epoch: [33][19200/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452309    
+2023-12-05 04:33:56,401 - Epoch: [33][19300/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452023    
+2023-12-05 04:34:44,318 - Epoch: [33][19400/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452163    
+2023-12-05 04:35:26,086 - Epoch: [33][19500/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.451985    
+2023-12-05 04:36:14,430 - Epoch: [33][19600/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452146    
+2023-12-05 04:36:59,816 - Epoch: [33][19700/31148]    Overall Loss 0.009752    Objective Loss 0.000000    Distill Loss 0.009752                     LR 0.000004    Time 0.452154    
+2023-12-05 04:37:36,449 - Epoch: [33][19800/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.451720    
+2023-12-05 04:38:21,334 - Epoch: [33][19900/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.451705    
+2023-12-05 04:39:02,714 - Epoch: [33][20000/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.451515    
+2023-12-05 04:39:52,096 - Epoch: [33][20100/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.451726    
+2023-12-05 04:40:33,502 - Epoch: [33][20200/31148]    Overall Loss 0.009753    Objective Loss 0.000000    Distill Loss 0.009753                     LR 0.000004    Time 0.451539    
+2023-12-05 04:41:18,141 - Epoch: [33][20300/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.451513    
+2023-12-05 04:42:11,947 - Epoch: [33][20400/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.451937    
+2023-12-05 04:42:50,222 - Epoch: [33][20500/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.451599    
+2023-12-05 04:43:39,590 - Epoch: [33][20600/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.451803    
+2023-12-05 04:44:30,328 - Epoch: [33][20700/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452071    
+2023-12-05 04:45:20,377 - Epoch: [33][20800/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452304    
+2023-12-05 04:46:07,271 - Epoch: [33][20900/31148]    Overall Loss 0.009754    Objective Loss 0.000000    Distill Loss 0.009754                     LR 0.000004    Time 0.452383    
+2023-12-05 04:46:57,112 - Epoch: [33][21000/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452602    
+2023-12-05 04:47:43,425 - Epoch: [33][21100/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452651    
+2023-12-05 04:48:34,545 - Epoch: [33][21200/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452927    
+2023-12-05 04:49:18,951 - Epoch: [33][21300/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452885    
+2023-12-05 04:50:01,370 - Epoch: [33][21400/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452751    
+2023-12-05 04:50:40,872 - Epoch: [33][21500/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452482    
+2023-12-05 04:51:28,055 - Epoch: [33][21600/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452571    
+2023-12-05 04:52:06,072 - Epoch: [33][21700/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452237    
+2023-12-05 04:52:54,034 - Epoch: [33][21800/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452362    
+2023-12-05 04:53:33,225 - Epoch: [33][21900/31148]    Overall Loss 0.009755    Objective Loss 0.000000    Distill Loss 0.009755                     LR 0.000004    Time 0.452086    
+2023-12-05 04:54:18,094 - Epoch: [33][22000/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.452070    
+2023-12-05 04:54:57,324 - Epoch: [33][22100/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451800    
+2023-12-05 04:55:40,062 - Epoch: [33][22200/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.451689    
+2023-12-05 04:56:21,983 - Epoch: [33][22300/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451543    
+2023-12-05 04:57:20,643 - Epoch: [33][22400/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.452146    
+2023-12-05 04:58:03,313 - Epoch: [33][22500/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.452033    
+2023-12-05 04:58:46,950 - Epoch: [33][22600/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451963    
+2023-12-05 04:59:30,415 - Epoch: [33][22700/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451886    
+2023-12-05 05:00:07,775 - Epoch: [33][22800/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451543    
+2023-12-05 05:00:53,934 - Epoch: [33][22900/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451586    
+2023-12-05 05:01:33,569 - Epoch: [33][23000/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451346    
+2023-12-05 05:02:22,488 - Epoch: [33][23100/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451509    
+2023-12-05 05:03:08,911 - Epoch: [33][23200/31148]    Overall Loss 0.009756    Objective Loss 0.000000    Distill Loss 0.009756                     LR 0.000004    Time 0.451564    
+2023-12-05 05:03:51,316 - Epoch: [33][23300/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.451445    
+2023-12-05 05:04:36,533 - Epoch: [33][23400/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.451448    
+2023-12-05 05:05:13,011 - Epoch: [33][23500/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.451079    
+2023-12-05 05:05:57,598 - Epoch: [33][23600/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.451057    
+2023-12-05 05:06:37,557 - Epoch: [33][23700/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.450839    
+2023-12-05 05:07:20,463 - Epoch: [33][23800/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.450747    
+2023-12-05 05:08:04,944 - Epoch: [33][23900/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.450722    
+2023-12-05 05:08:54,105 - Epoch: [33][24000/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.450892    
+2023-12-05 05:09:39,666 - Epoch: [33][24100/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.450912    
+2023-12-05 05:10:31,045 - Epoch: [33][24200/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.451171    
+2023-12-05 05:11:16,321 - Epoch: [33][24300/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.451177    
+2023-12-05 05:12:02,221 - Epoch: [33][24400/31148]    Overall Loss 0.009757    Objective Loss 0.000000    Distill Loss 0.009757                     LR 0.000004    Time 0.451209    
+2023-12-05 05:12:40,605 - Epoch: [33][24500/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.450934    
+2023-12-05 05:13:12,022 - Epoch: [33][24600/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.450378    
+2023-12-05 05:13:39,661 - Epoch: [33][24700/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.449673    
+2023-12-05 05:14:07,733 - Epoch: [33][24800/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.448992    
+2023-12-05 05:14:35,318 - Epoch: [33][24900/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.448296    
+2023-12-05 05:15:03,156 - Epoch: [33][25000/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.447616    
+2023-12-05 05:15:31,005 - Epoch: [33][25100/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.446943    
+2023-12-05 05:15:58,878 - Epoch: [33][25200/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.446275    
+2023-12-05 05:16:26,694 - Epoch: [33][25300/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.445610    
+2023-12-05 05:16:54,548 - Epoch: [33][25400/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.444952    
+2023-12-05 05:17:22,456 - Epoch: [33][25500/31148]    Overall Loss 0.009758    Objective Loss 0.000000    Distill Loss 0.009758                     LR 0.000004    Time 0.444302    
+2023-12-05 05:17:50,398 - Epoch: [33][25600/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.443658    
+2023-12-05 05:18:19,990 - Epoch: [33][25700/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.443083    
+2023-12-05 05:18:57,606 - Epoch: [33][25800/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.442823    
+2023-12-05 05:19:38,976 - Epoch: [33][25900/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.442710    
+2023-12-05 05:20:15,158 - Epoch: [33][26000/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.442399    
+2023-12-05 05:21:06,405 - Epoch: [33][26100/31148]    Overall Loss 0.009759    Objective Loss 0.000000    Distill Loss 0.009759                     LR 0.000004    Time 0.442667    
+2023-12-05 05:21:50,101 - Epoch: [33][26200/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442645    
+2023-12-05 05:22:24,222 - Epoch: [33][26300/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442259    
+2023-12-05 05:23:14,210 - Epoch: [33][26400/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442477    
+2023-12-05 05:23:58,486 - Epoch: [33][26500/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442478    
+2023-12-05 05:24:47,620 - Epoch: [33][26600/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442661    
+2023-12-05 05:25:37,072 - Epoch: [33][26700/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442855    
+2023-12-05 05:26:20,968 - Epoch: [33][26800/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.442840    
+2023-12-05 05:27:08,685 - Epoch: [33][26900/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.442968    
+2023-12-05 05:27:56,639 - Epoch: [33][27000/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443103    
+2023-12-05 05:28:38,896 - Epoch: [33][27100/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443027    
+2023-12-05 05:29:31,003 - Epoch: [33][27200/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443314    
+2023-12-05 05:30:13,322 - Epoch: [33][27300/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443240    
+2023-12-05 05:30:58,343 - Epoch: [33][27400/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443265    
+2023-12-05 05:31:35,454 - Epoch: [33][27500/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443002    
+2023-12-05 05:32:21,475 - Epoch: [33][27600/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443064    
+2023-12-05 05:33:14,352 - Epoch: [33][27700/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443373    
+2023-12-05 05:33:59,366 - Epoch: [33][27800/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443397    
+2023-12-05 05:34:45,190 - Epoch: [33][27900/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443450    
+2023-12-05 05:35:28,107 - Epoch: [33][28000/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443399    
+2023-12-05 05:36:14,746 - Epoch: [33][28100/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443481    
+2023-12-05 05:37:01,086 - Epoch: [33][28200/31148]    Overall Loss 0.009760    Objective Loss 0.000000    Distill Loss 0.009760                     LR 0.000004    Time 0.443551    
+2023-12-05 05:37:40,718 - Epoch: [33][28300/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443384    
+2023-12-05 05:38:29,481 - Epoch: [33][28400/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443539    
+2023-12-05 05:39:18,348 - Epoch: [33][28500/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000004    Time 0.443697    
+2023-12-05 05:40:03,616 - Epoch: [33][28600/31148]    Overall Loss 0.009761    Objective Loss 0.000000    Distill Loss 0.009761                     LR 0.000004    Time 0.443729    
+2023-12-05 05:40:44,668 - Epoch: [33][28700/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000004    Time 0.443613    
+2023-12-05 05:41:37,090 - Epoch: [33][28800/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000004    Time 0.443892    
+2023-12-05 05:42:37,130 - Epoch: [33][28900/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444434    
+2023-12-05 05:43:23,489 - Epoch: [33][29000/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444499    
+2023-12-05 05:44:06,803 - Epoch: [33][29100/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444460    
+2023-12-05 05:44:51,609 - Epoch: [33][29200/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444472    
+2023-12-05 05:45:36,116 - Epoch: [33][29300/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444474    
+2023-12-05 05:46:21,716 - Epoch: [33][29400/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444513    
+2023-12-05 05:47:08,078 - Epoch: [33][29500/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444578    
+2023-12-05 05:47:52,605 - Epoch: [33][29600/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000004    Time 0.444580    
+2023-12-05 05:48:41,118 - Epoch: [33][29700/31148]    Overall Loss 0.009762    Objective Loss 0.000000    Distill Loss 0.009762                     LR 0.000004    Time 0.444716    
+2023-12-05 05:49:22,539 - Epoch: [33][29800/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.444613    
+2023-12-05 05:50:24,162 - Epoch: [33][29900/31148]    Overall Loss 0.009763    Objective Loss 0.000000    Distill Loss 0.009763                     LR 0.000004    Time 0.445187    
+2023-12-05 05:51:14,564 - Epoch: [33][30000/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445383    
+2023-12-05 05:51:54,977 - Epoch: [33][30100/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445246    
+2023-12-05 05:52:41,723 - Epoch: [33][30200/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445319    
+2023-12-05 05:53:25,964 - Epoch: [33][30300/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445309    
+2023-12-05 05:54:11,055 - Epoch: [33][30400/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445327    
+2023-12-05 05:55:09,304 - Epoch: [33][30500/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445777    
+2023-12-05 05:55:52,793 - Epoch: [33][30600/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445741    
+2023-12-05 05:56:29,434 - Epoch: [33][30700/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445482    
+2023-12-05 05:57:12,135 - Epoch: [33][30800/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445422    
+2023-12-05 05:58:08,185 - Epoch: [33][30900/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445794    
+2023-12-05 05:58:46,809 - Epoch: [33][31000/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445602    
+2023-12-05 05:59:27,881 - Epoch: [33][31100/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445490    
+2023-12-05 05:59:56,511 - Epoch: [33][31148/31148]    Overall Loss 0.009764    Objective Loss 0.000000    Distill Loss 0.009764                     LR 0.000004    Time 0.445722    
+2023-12-05 05:59:57,563 - --- validate (epoch=33)-----------
+2023-12-05 05:59:57,563 - 167951 samples (100 per mini-batch)
+2023-12-05 06:00:24,418 - Epoch: [33][  100/ 1680]    Loss 0.000000    Overall Loss 0.010318    
+2023-12-05 06:00:47,202 - Epoch: [33][  200/ 1680]    Loss 0.000000    Overall Loss 0.010344    
+2023-12-05 06:01:09,905 - Epoch: [33][  300/ 1680]    Loss 0.000000    Overall Loss 0.010346    
+2023-12-05 06:01:34,118 - Epoch: [33][  400/ 1680]    Loss 0.000000    Overall Loss 0.010334    
+2023-12-05 06:01:57,402 - Epoch: [33][  500/ 1680]    Loss 0.000000    Overall Loss 0.010335    
+2023-12-05 06:02:20,374 - Epoch: [33][  600/ 1680]    Loss 0.000000    Overall Loss 0.010338    
+2023-12-05 06:02:43,139 - Epoch: [33][  700/ 1680]    Loss 0.000000    Overall Loss 0.010336    
+2023-12-05 06:03:05,770 - Epoch: [33][  800/ 1680]    Loss 0.000000    Overall Loss 0.010328    
+2023-12-05 06:03:29,765 - Epoch: [33][  900/ 1680]    Loss 0.000000    Overall Loss 0.010333    
+2023-12-05 06:03:52,513 - Epoch: [33][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010332    
+2023-12-05 06:04:16,119 - Epoch: [33][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010336    
+2023-12-05 06:04:38,809 - Epoch: [33][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010331    
+2023-12-05 06:05:01,436 - Epoch: [33][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010331    
+2023-12-05 06:05:24,053 - Epoch: [33][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010328    
+2023-12-05 06:05:46,787 - Epoch: [33][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010328    
+2023-12-05 06:06:10,079 - Epoch: [33][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010329    
+2023-12-05 06:06:29,800 - Epoch: [33][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010329    
+2023-12-05 06:06:30,435 - ==> Overall Loss: 0.010
+
+2023-12-05 06:06:30,442 - ==> Best [Overall Loss: 0.010329 on epoch: 33]
+2023-12-05 06:06:30,442 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-05 06:06:30,509 - 
+
+2023-12-05 06:06:30,510 - Training epoch: 3114790 samples (100 per mini-batch)
+2023-12-05 06:07:33,880 - Epoch: [34][  100/31148]    Overall Loss 0.009518    Objective Loss 0.000000    Distill Loss 0.009518                     LR 0.000002    Time 0.633600    
+2023-12-05 06:08:23,606 - Epoch: [34][  200/31148]    Overall Loss 0.009541    Objective Loss 0.000000    Distill Loss 0.009541                     LR 0.000002    Time 0.565396    
+2023-12-05 06:09:05,377 - Epoch: [34][  300/31148]    Overall Loss 0.009557    Objective Loss 0.000000    Distill Loss 0.009557                     LR 0.000002    Time 0.516141    
+2023-12-05 06:09:47,471 - Epoch: [34][  400/31148]    Overall Loss 0.009578    Objective Loss 0.000000    Distill Loss 0.009578                     LR 0.000002    Time 0.492323    
+2023-12-05 06:10:27,676 - Epoch: [34][  500/31148]    Overall Loss 0.009571    Objective Loss 0.000000    Distill Loss 0.009571                     LR 0.000002    Time 0.474252    
+2023-12-05 06:11:08,027 - Epoch: [34][  600/31148]    Overall Loss 0.009571    Objective Loss 0.000000    Distill Loss 0.009571                     LR 0.000002    Time 0.462451    
+2023-12-05 06:11:52,026 - Epoch: [34][  700/31148]    Overall Loss 0.009593    Objective Loss 0.000000    Distill Loss 0.009593                     LR 0.000002    Time 0.459232    
+2023-12-05 06:12:37,699 - Epoch: [34][  800/31148]    Overall Loss 0.009606    Objective Loss 0.000000    Distill Loss 0.009606                     LR 0.000002    Time 0.458911    
+2023-12-05 06:13:29,207 - Epoch: [34][  900/31148]    Overall Loss 0.009597    Objective Loss 0.000000    Distill Loss 0.009597                     LR 0.000002    Time 0.465144    
+2023-12-05 06:14:09,363 - Epoch: [34][ 1000/31148]    Overall Loss 0.009595    Objective Loss 0.000000    Distill Loss 0.009595                     LR 0.000002    Time 0.458777    
+2023-12-05 06:14:56,014 - Epoch: [34][ 1100/31148]    Overall Loss 0.009596    Objective Loss 0.000000    Distill Loss 0.009596                     LR 0.000002    Time 0.459474    
+2023-12-05 06:15:37,397 - Epoch: [34][ 1200/31148]    Overall Loss 0.009594    Objective Loss 0.000000    Distill Loss 0.009594                     LR 0.000002    Time 0.455664    
+2023-12-05 06:16:25,177 - Epoch: [34][ 1300/31148]    Overall Loss 0.009596    Objective Loss 0.000000    Distill Loss 0.009596                     LR 0.000002    Time 0.457361    
+2023-12-05 06:17:05,323 - Epoch: [34][ 1400/31148]    Overall Loss 0.009600    Objective Loss 0.000000    Distill Loss 0.009600                     LR 0.000002    Time 0.453363    
+2023-12-05 06:17:46,352 - Epoch: [34][ 1500/31148]    Overall Loss 0.009595    Objective Loss 0.000000    Distill Loss 0.009595                     LR 0.000002    Time 0.450487    
+2023-12-05 06:18:29,966 - Epoch: [34][ 1600/31148]    Overall Loss 0.009595    Objective Loss 0.000000    Distill Loss 0.009595                     LR 0.000002    Time 0.449585    
+2023-12-05 06:19:23,681 - Epoch: [34][ 1700/31148]    Overall Loss 0.009602    Objective Loss 0.000000    Distill Loss 0.009602                     LR 0.000002    Time 0.454731    
+2023-12-05 06:20:10,976 - Epoch: [34][ 1800/31148]    Overall Loss 0.009605    Objective Loss 0.000000    Distill Loss 0.009605                     LR 0.000002    Time 0.455740    
+2023-12-05 06:20:54,185 - Epoch: [34][ 1900/31148]    Overall Loss 0.009608    Objective Loss 0.000000    Distill Loss 0.009608                     LR 0.000002    Time 0.454491    
+2023-12-05 06:21:44,461 - Epoch: [34][ 2000/31148]    Overall Loss 0.009609    Objective Loss 0.000000    Distill Loss 0.009609                     LR 0.000002    Time 0.456901    
+2023-12-05 06:22:23,788 - Epoch: [34][ 2100/31148]    Overall Loss 0.009615    Objective Loss 0.000000    Distill Loss 0.009615                     LR 0.000002    Time 0.453868    
+2023-12-05 06:23:08,291 - Epoch: [34][ 2200/31148]    Overall Loss 0.009618    Objective Loss 0.000000    Distill Loss 0.009618                     LR 0.000002    Time 0.453463    
+2023-12-05 06:23:50,005 - Epoch: [34][ 2300/31148]    Overall Loss 0.009626    Objective Loss 0.000000    Distill Loss 0.009626                     LR 0.000002    Time 0.451881    
+2023-12-05 06:24:38,476 - Epoch: [34][ 2400/31148]    Overall Loss 0.009629    Objective Loss 0.000000    Distill Loss 0.009629                     LR 0.000002    Time 0.453245    
+2023-12-05 06:25:25,329 - Epoch: [34][ 2500/31148]    Overall Loss 0.009628    Objective Loss 0.000000    Distill Loss 0.009628                     LR 0.000002    Time 0.453854    
+2023-12-05 06:26:06,869 - Epoch: [34][ 2600/31148]    Overall Loss 0.009633    Objective Loss 0.000000    Distill Loss 0.009633                     LR 0.000002    Time 0.452372    
+2023-12-05 06:26:42,851 - Epoch: [34][ 2700/31148]    Overall Loss 0.009637    Objective Loss 0.000000    Distill Loss 0.009637                     LR 0.000002    Time 0.448942    
+2023-12-05 06:27:30,767 - Epoch: [34][ 2800/31148]    Overall Loss 0.009636    Objective Loss 0.000000    Distill Loss 0.009636                     LR 0.000002    Time 0.450018    
+2023-12-05 06:28:19,314 - Epoch: [34][ 2900/31148]    Overall Loss 0.009635    Objective Loss 0.000000    Distill Loss 0.009635                     LR 0.000002    Time 0.451238    
+2023-12-05 06:29:04,436 - Epoch: [34][ 3000/31148]    Overall Loss 0.009636    Objective Loss 0.000000    Distill Loss 0.009636                     LR 0.000002    Time 0.451235    
+2023-12-05 06:29:51,017 - Epoch: [34][ 3100/31148]    Overall Loss 0.009635    Objective Loss 0.000000    Distill Loss 0.009635                     LR 0.000002    Time 0.451703    
+2023-12-05 06:30:32,105 - Epoch: [34][ 3200/31148]    Overall Loss 0.009640    Objective Loss 0.000000    Distill Loss 0.009640                     LR 0.000002    Time 0.450425    
+2023-12-05 06:31:23,201 - Epoch: [34][ 3300/31148]    Overall Loss 0.009639    Objective Loss 0.000000    Distill Loss 0.009639                     LR 0.000002    Time 0.452257    
+2023-12-05 06:32:01,665 - Epoch: [34][ 3400/31148]    Overall Loss 0.009639    Objective Loss 0.000000    Distill Loss 0.009639                     LR 0.000002    Time 0.450266    
+2023-12-05 06:32:37,326 - Epoch: [34][ 3500/31148]    Overall Loss 0.009638    Objective Loss 0.000000    Distill Loss 0.009638                     LR 0.000002    Time 0.447588    
+2023-12-05 06:33:22,110 - Epoch: [34][ 3600/31148]    Overall Loss 0.009641    Objective Loss 0.000000    Distill Loss 0.009641                     LR 0.000002    Time 0.447593    
+2023-12-05 06:34:01,515 - Epoch: [34][ 3700/31148]    Overall Loss 0.009642    Objective Loss 0.000000    Distill Loss 0.009642                     LR 0.000002    Time 0.446144    
+2023-12-05 06:34:57,315 - Epoch: [34][ 3800/31148]    Overall Loss 0.009643    Objective Loss 0.000000    Distill Loss 0.009643                     LR 0.000002    Time 0.449086    
+2023-12-05 06:35:40,284 - Epoch: [34][ 3900/31148]    Overall Loss 0.009644    Objective Loss 0.000000    Distill Loss 0.009644                     LR 0.000002    Time 0.448587    
+2023-12-05 06:36:23,561 - Epoch: [34][ 4000/31148]    Overall Loss 0.009645    Objective Loss 0.000000    Distill Loss 0.009645                     LR 0.000002    Time 0.448189    
+2023-12-05 06:37:14,962 - Epoch: [34][ 4100/31148]    Overall Loss 0.009646    Objective Loss 0.000000    Distill Loss 0.009646                     LR 0.000002    Time 0.449793    
+2023-12-05 06:37:53,668 - Epoch: [34][ 4200/31148]    Overall Loss 0.009647    Objective Loss 0.000000    Distill Loss 0.009647                     LR 0.000002    Time 0.448298    
+2023-12-05 06:38:43,179 - Epoch: [34][ 4300/31148]    Overall Loss 0.009652    Objective Loss 0.000000    Distill Loss 0.009652                     LR 0.000002    Time 0.449385    
+2023-12-05 06:39:33,591 - Epoch: [34][ 4400/31148]    Overall Loss 0.009651    Objective Loss 0.000000    Distill Loss 0.009651                     LR 0.000002    Time 0.450627    
+2023-12-05 06:40:17,508 - Epoch: [34][ 4500/31148]    Overall Loss 0.009653    Objective Loss 0.000000    Distill Loss 0.009653                     LR 0.000002    Time 0.450371    
+2023-12-05 06:41:06,326 - Epoch: [34][ 4600/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.451191    
+2023-12-05 06:41:51,706 - Epoch: [34][ 4700/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.451245    
+2023-12-05 06:42:32,858 - Epoch: [34][ 4800/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000002    Time 0.450416    
+2023-12-05 06:43:11,964 - Epoch: [34][ 4900/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000002    Time 0.449203    
+2023-12-05 06:43:59,729 - Epoch: [34][ 5000/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.449770    
+2023-12-05 06:44:49,588 - Epoch: [34][ 5100/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.450726    
+2023-12-05 06:45:35,247 - Epoch: [34][ 5200/31148]    Overall Loss 0.009659    Objective Loss 0.000000    Distill Loss 0.009659                     LR 0.000002    Time 0.450837    
+2023-12-05 06:46:26,266 - Epoch: [34][ 5300/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.451956    
+2023-12-05 06:47:11,820 - Epoch: [34][ 5400/31148]    Overall Loss 0.009660    Objective Loss 0.000000    Distill Loss 0.009660                     LR 0.000002    Time 0.452021    
+2023-12-05 06:47:57,730 - Epoch: [34][ 5500/31148]    Overall Loss 0.009661    Objective Loss 0.000000    Distill Loss 0.009661                     LR 0.000002    Time 0.452148    
+2023-12-05 06:48:47,907 - Epoch: [34][ 5600/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.453033    
+2023-12-05 06:49:26,796 - Epoch: [34][ 5700/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.451907    
+2023-12-05 06:50:05,792 - Epoch: [34][ 5800/31148]    Overall Loss 0.009661    Objective Loss 0.000000    Distill Loss 0.009661                     LR 0.000002    Time 0.450837    
+2023-12-05 06:50:52,395 - Epoch: [34][ 5900/31148]    Overall Loss 0.009660    Objective Loss 0.000000    Distill Loss 0.009660                     LR 0.000002    Time 0.451094    
+2023-12-05 06:51:29,806 - Epoch: [34][ 6000/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.449810    
+2023-12-05 06:52:12,410 - Epoch: [34][ 6100/31148]    Overall Loss 0.009660    Objective Loss 0.000000    Distill Loss 0.009660                     LR 0.000002    Time 0.449419    
+2023-12-05 06:53:03,425 - Epoch: [34][ 6200/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.450397    
+2023-12-05 06:53:43,685 - Epoch: [34][ 6300/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.449637    
+2023-12-05 06:54:38,930 - Epoch: [34][ 6400/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.451243    
+2023-12-05 06:55:27,101 - Epoch: [34][ 6500/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.451710    
+2023-12-05 06:56:13,146 - Epoch: [34][ 6600/31148]    Overall Loss 0.009652    Objective Loss 0.000000    Distill Loss 0.009652                     LR 0.000002    Time 0.451841    
+2023-12-05 06:56:59,069 - Epoch: [34][ 6700/31148]    Overall Loss 0.009653    Objective Loss 0.000000    Distill Loss 0.009653                     LR 0.000002    Time 0.451951    
+2023-12-05 06:57:37,454 - Epoch: [34][ 6800/31148]    Overall Loss 0.009653    Objective Loss 0.000000    Distill Loss 0.009653                     LR 0.000002    Time 0.450948    
+2023-12-05 06:58:29,428 - Epoch: [34][ 6900/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000002    Time 0.451944    
+2023-12-05 06:59:09,632 - Epoch: [34][ 7000/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000002    Time 0.451230    
+2023-12-05 06:59:54,899 - Epoch: [34][ 7100/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000002    Time 0.451249    
+2023-12-05 07:00:43,583 - Epoch: [34][ 7200/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.451743    
+2023-12-05 07:01:25,359 - Epoch: [34][ 7300/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.451276    
+2023-12-05 07:02:06,007 - Epoch: [34][ 7400/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.450670    
+2023-12-05 07:02:44,827 - Epoch: [34][ 7500/31148]    Overall Loss 0.009659    Objective Loss 0.000000    Distill Loss 0.009659                     LR 0.000002    Time 0.449836    
+2023-12-05 07:03:32,721 - Epoch: [34][ 7600/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.450218    
+2023-12-05 07:04:32,944 - Epoch: [34][ 7700/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.452191    
+2023-12-05 07:05:14,711 - Epoch: [34][ 7800/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.451748    
+2023-12-05 07:05:55,672 - Epoch: [34][ 7900/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.451213    
+2023-12-05 07:06:44,618 - Epoch: [34][ 8000/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.451691    
+2023-12-05 07:07:29,114 - Epoch: [34][ 8100/31148]    Overall Loss 0.009655    Objective Loss 0.000000    Distill Loss 0.009655                     LR 0.000002    Time 0.451607    
+2023-12-05 07:08:18,503 - Epoch: [34][ 8200/31148]    Overall Loss 0.009654    Objective Loss 0.000000    Distill Loss 0.009654                     LR 0.000002    Time 0.452121    
+2023-12-05 07:09:00,875 - Epoch: [34][ 8300/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.451778    
+2023-12-05 07:09:42,018 - Epoch: [34][ 8400/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.451297    
+2023-12-05 07:10:21,387 - Epoch: [34][ 8500/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.450619    
+2023-12-05 07:11:01,533 - Epoch: [34][ 8600/31148]    Overall Loss 0.009656    Objective Loss 0.000000    Distill Loss 0.009656                     LR 0.000002    Time 0.450046    
+2023-12-05 07:11:45,521 - Epoch: [34][ 8700/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.449929    
+2023-12-05 07:12:33,409 - Epoch: [34][ 8800/31148]    Overall Loss 0.009659    Objective Loss 0.000000    Distill Loss 0.009659                     LR 0.000002    Time 0.450257    
+2023-12-05 07:13:14,523 - Epoch: [34][ 8900/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.449816    
+2023-12-05 07:14:01,608 - Epoch: [34][ 9000/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.450049    
+2023-12-05 07:14:48,197 - Epoch: [34][ 9100/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.450222    
+2023-12-05 07:15:35,467 - Epoch: [34][ 9200/31148]    Overall Loss 0.009657    Objective Loss 0.000000    Distill Loss 0.009657                     LR 0.000002    Time 0.450466    
+2023-12-05 07:16:14,601 - Epoch: [34][ 9300/31148]    Overall Loss 0.009658    Objective Loss 0.000000    Distill Loss 0.009658                     LR 0.000002    Time 0.449829    
+2023-12-05 07:16:58,879 - Epoch: [34][ 9400/31148]    Overall Loss 0.009660    Objective Loss 0.000000    Distill Loss 0.009660                     LR 0.000002    Time 0.449754    
+2023-12-05 07:17:38,903 - Epoch: [34][ 9500/31148]    Overall Loss 0.009659    Objective Loss 0.000000    Distill Loss 0.009659                     LR 0.000002    Time 0.449232    
+2023-12-05 07:18:26,826 - Epoch: [34][ 9600/31148]    Overall Loss 0.009661    Objective Loss 0.000000    Distill Loss 0.009661                     LR 0.000002    Time 0.449543    
+2023-12-05 07:19:12,571 - Epoch: [34][ 9700/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.449624    
+2023-12-05 07:19:59,123 - Epoch: [34][ 9800/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.449786    
+2023-12-05 07:20:39,816 - Epoch: [34][ 9900/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.449352    
+2023-12-05 07:21:23,178 - Epoch: [34][10000/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.449194    
+2023-12-05 07:22:03,569 - Epoch: [34][10100/31148]    Overall Loss 0.009661    Objective Loss 0.000000    Distill Loss 0.009661                     LR 0.000002    Time 0.448745    
+2023-12-05 07:22:48,039 - Epoch: [34][10200/31148]    Overall Loss 0.009660    Objective Loss 0.000000    Distill Loss 0.009660                     LR 0.000002    Time 0.448705    
+2023-12-05 07:23:29,276 - Epoch: [34][10300/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.448351    
+2023-12-05 07:24:08,445 - Epoch: [34][10400/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.447806    
+2023-12-05 07:24:48,681 - Epoch: [34][10500/31148]    Overall Loss 0.009662    Objective Loss 0.000000    Distill Loss 0.009662                     LR 0.000002    Time 0.447372    
+2023-12-05 07:25:33,808 - Epoch: [34][10600/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.447408    
+2023-12-05 07:26:14,943 - Epoch: [34][10700/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.447071    
+2023-12-05 07:27:00,771 - Epoch: [34][10800/31148]    Overall Loss 0.009664    Objective Loss 0.000000    Distill Loss 0.009664                     LR 0.000002    Time 0.447174    
+2023-12-05 07:27:51,557 - Epoch: [34][10900/31148]    Overall Loss 0.009664    Objective Loss 0.000000    Distill Loss 0.009664                     LR 0.000002    Time 0.447730    
+2023-12-05 07:28:41,495 - Epoch: [34][11000/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.448199    
+2023-12-05 07:29:29,684 - Epoch: [34][11100/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.448502    
+2023-12-05 07:30:13,110 - Epoch: [34][11200/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.448374    
+2023-12-05 07:30:55,015 - Epoch: [34][11300/31148]    Overall Loss 0.009663    Objective Loss 0.000000    Distill Loss 0.009663                     LR 0.000002    Time 0.448114    
+2023-12-05 07:31:47,067 - Epoch: [34][11400/31148]    Overall Loss 0.009664    Objective Loss 0.000000    Distill Loss 0.009664                     LR 0.000002    Time 0.448748    
+2023-12-05 07:32:34,362 - Epoch: [34][11500/31148]    Overall Loss 0.009665    Objective Loss 0.000000    Distill Loss 0.009665                     LR 0.000002    Time 0.448958    
+2023-12-05 07:33:15,847 - Epoch: [34][11600/31148]    Overall Loss 0.009665    Objective Loss 0.000000    Distill Loss 0.009665                     LR 0.000002    Time 0.448664    
+2023-12-05 07:34:03,291 - Epoch: [34][11700/31148]    Overall Loss 0.009665    Objective Loss 0.000000    Distill Loss 0.009665                     LR 0.000002    Time 0.448883    
+2023-12-05 07:34:51,060 - Epoch: [34][11800/31148]    Overall Loss 0.009665    Objective Loss 0.000000    Distill Loss 0.009665                     LR 0.000002    Time 0.449127    
+2023-12-05 07:35:39,968 - Epoch: [34][11900/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000002    Time 0.449462    
+2023-12-05 07:36:23,999 - Epoch: [34][12000/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000002    Time 0.449385    
+2023-12-05 07:37:11,865 - Epoch: [34][12100/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000002    Time 0.449626    
+2023-12-05 07:37:49,571 - Epoch: [34][12200/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000002    Time 0.449031    
+2023-12-05 07:38:31,118 - Epoch: [34][12300/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000002    Time 0.448758    
+2023-12-05 07:39:19,503 - Epoch: [34][12400/31148]    Overall Loss 0.009667    Objective Loss 0.000000    Distill Loss 0.009667                     LR 0.000002    Time 0.449040    
+2023-12-05 07:40:03,457 - Epoch: [34][12500/31148]    Overall Loss 0.009666    Objective Loss 0.000000    Distill Loss 0.009666                     LR 0.000002    Time 0.448963    
+2023-12-05 07:40:51,092 - Epoch: [34][12600/31148]    Overall Loss 0.009667    Objective Loss 0.000000    Distill Loss 0.009667                     LR 0.000002    Time 0.449180    
+2023-12-05 07:41:30,967 - Epoch: [34][12700/31148]    Overall Loss 0.009667    Objective Loss 0.000000    Distill Loss 0.009667                     LR 0.000002    Time 0.448783    
+2023-12-05 07:42:15,522 - Epoch: [34][12800/31148]    Overall Loss 0.009667    Objective Loss 0.000000    Distill Loss 0.009667                     LR 0.000002    Time 0.448757    
+2023-12-05 07:42:55,303 - Epoch: [34][12900/31148]    Overall Loss 0.009667    Objective Loss 0.000000    Distill Loss 0.009667                     LR 0.000002    Time 0.448361    
+2023-12-05 07:43:41,206 - Epoch: [34][13000/31148]    Overall Loss 0.009669    Objective Loss 0.000000    Distill Loss 0.009669                     LR 0.000002    Time 0.448443    
+2023-12-05 07:44:32,844 - Epoch: [34][13100/31148]    Overall Loss 0.009669    Objective Loss 0.000000    Distill Loss 0.009669                     LR 0.000002    Time 0.448961    
+2023-12-05 07:45:22,177 - Epoch: [34][13200/31148]    Overall Loss 0.009671    Objective Loss 0.000000    Distill Loss 0.009671                     LR 0.000002    Time 0.449296    
+2023-12-05 07:46:02,360 - Epoch: [34][13300/31148]    Overall Loss 0.009670    Objective Loss 0.000000    Distill Loss 0.009670                     LR 0.000002    Time 0.448939    
+2023-12-05 07:46:47,297 - Epoch: [34][13400/31148]    Overall Loss 0.009670    Objective Loss 0.000000    Distill Loss 0.009670                     LR 0.000002    Time 0.448942    
+2023-12-05 07:47:37,895 - Epoch: [34][13500/31148]    Overall Loss 0.009671    Objective Loss 0.000000    Distill Loss 0.009671                     LR 0.000002    Time 0.449364    
+2023-12-05 07:48:19,024 - Epoch: [34][13600/31148]    Overall Loss 0.009671    Objective Loss 0.000000    Distill Loss 0.009671                     LR 0.000002    Time 0.449083    
+2023-12-05 07:48:53,540 - Epoch: [34][13700/31148]    Overall Loss 0.009672    Objective Loss 0.000000    Distill Loss 0.009672                     LR 0.000002    Time 0.448324    
+2023-12-05 07:49:40,293 - Epoch: [34][13800/31148]    Overall Loss 0.009673    Objective Loss 0.000000    Distill Loss 0.009673                     LR 0.000002    Time 0.448463    
+2023-12-05 07:50:19,277 - Epoch: [34][13900/31148]    Overall Loss 0.009673    Objective Loss 0.000000    Distill Loss 0.009673                     LR 0.000002    Time 0.448040    
+2023-12-05 07:51:15,870 - Epoch: [34][14000/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.448882    
+2023-12-05 07:52:05,726 - Epoch: [34][14100/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.449234    
+2023-12-05 07:52:57,538 - Epoch: [34][14200/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.449718    
+2023-12-05 07:53:42,532 - Epoch: [34][14300/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.449719    
+2023-12-05 07:54:26,779 - Epoch: [34][14400/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.449669    
+2023-12-05 07:55:10,136 - Epoch: [34][14500/31148]    Overall Loss 0.009675    Objective Loss 0.000000    Distill Loss 0.009675                     LR 0.000002    Time 0.449557    
+2023-12-05 07:56:02,624 - Epoch: [34][14600/31148]    Overall Loss 0.009675    Objective Loss 0.000000    Distill Loss 0.009675                     LR 0.000002    Time 0.450073    
+2023-12-05 07:56:48,784 - Epoch: [34][14700/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.450150    
+2023-12-05 07:57:31,496 - Epoch: [34][14800/31148]    Overall Loss 0.009674    Objective Loss 0.000000    Distill Loss 0.009674                     LR 0.000002    Time 0.449994    
+2023-12-05 07:58:20,431 - Epoch: [34][14900/31148]    Overall Loss 0.009675    Objective Loss 0.000000    Distill Loss 0.009675                     LR 0.000002    Time 0.450258    
+2023-12-05 07:59:01,944 - Epoch: [34][15000/31148]    Overall Loss 0.009675    Objective Loss 0.000000    Distill Loss 0.009675                     LR 0.000002    Time 0.450023    
+2023-12-05 07:59:48,505 - Epoch: [34][15100/31148]    Overall Loss 0.009677    Objective Loss 0.000000    Distill Loss 0.009677                     LR 0.000002    Time 0.450126    
+2023-12-05 08:00:29,136 - Epoch: [34][15200/31148]    Overall Loss 0.009677    Objective Loss 0.000000    Distill Loss 0.009677                     LR 0.000002    Time 0.449837    
+2023-12-05 08:01:15,684 - Epoch: [34][15300/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.449939    
+2023-12-05 08:01:52,152 - Epoch: [34][15400/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.449385    
+2023-12-05 08:02:32,424 - Epoch: [34][15500/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.449084    
+2023-12-05 08:03:16,706 - Epoch: [34][15600/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.449043    
+2023-12-05 08:04:02,443 - Epoch: [34][15700/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.449096    
+2023-12-05 08:04:40,956 - Epoch: [34][15800/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.448690    
+2023-12-05 08:05:26,122 - Epoch: [34][15900/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.448708    
+2023-12-05 08:06:04,419 - Epoch: [34][16000/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.448297    
+2023-12-05 08:06:46,915 - Epoch: [34][16100/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.448152    
+2023-12-05 08:07:38,808 - Epoch: [34][16200/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.448588    
+2023-12-05 08:08:26,998 - Epoch: [34][16300/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.448792    
+2023-12-05 08:09:11,815 - Epoch: [34][16400/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.448788    
+2023-12-05 08:09:58,186 - Epoch: [34][16500/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.448878    
+2023-12-05 08:10:38,060 - Epoch: [34][16600/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.448575    
+2023-12-05 08:11:21,600 - Epoch: [34][16700/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.448496    
+2023-12-05 08:12:06,660 - Epoch: [34][16800/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.448508    
+2023-12-05 08:12:45,602 - Epoch: [34][16900/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.448158    
+2023-12-05 08:13:25,089 - Epoch: [34][17000/31148]    Overall Loss 0.009678    Objective Loss 0.000000    Distill Loss 0.009678                     LR 0.000002    Time 0.447844    
+2023-12-05 08:14:00,546 - Epoch: [34][17100/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.447298    
+2023-12-05 08:14:50,005 - Epoch: [34][17200/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.447573    
+2023-12-05 08:15:36,325 - Epoch: [34][17300/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.447663    
+2023-12-05 08:16:20,004 - Epoch: [34][17400/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.447600    
+2023-12-05 08:17:03,555 - Epoch: [34][17500/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.447530    
+2023-12-05 08:17:43,590 - Epoch: [34][17600/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.447262    
+2023-12-05 08:18:24,781 - Epoch: [34][17700/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.447062    
+2023-12-05 08:19:01,948 - Epoch: [34][17800/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.446638    
+2023-12-05 08:19:43,167 - Epoch: [34][17900/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.446445    
+2023-12-05 08:20:29,376 - Epoch: [34][18000/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.446532    
+2023-12-05 08:21:22,497 - Epoch: [34][18100/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.446999    
+2023-12-05 08:22:02,023 - Epoch: [34][18200/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.446714    
+2023-12-05 08:22:47,223 - Epoch: [34][18300/31148]    Overall Loss 0.009679    Objective Loss 0.000000    Distill Loss 0.009679                     LR 0.000002    Time 0.446743    
+2023-12-05 08:23:29,479 - Epoch: [34][18400/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446611    
+2023-12-05 08:24:12,639 - Epoch: [34][18500/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446529    
+2023-12-05 08:24:56,843 - Epoch: [34][18600/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446505    
+2023-12-05 08:25:34,393 - Epoch: [34][18700/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446125    
+2023-12-05 08:26:21,028 - Epoch: [34][18800/31148]    Overall Loss 0.009681    Objective Loss 0.000000    Distill Loss 0.009681                     LR 0.000002    Time 0.446232    
+2023-12-05 08:27:00,766 - Epoch: [34][18900/31148]    Overall Loss 0.009681    Objective Loss 0.000000    Distill Loss 0.009681                     LR 0.000002    Time 0.445973    
+2023-12-05 08:27:47,856 - Epoch: [34][19000/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446104    
+2023-12-05 08:28:30,362 - Epoch: [34][19100/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.445993    
+2023-12-05 08:29:17,551 - Epoch: [34][19200/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446128    
+2023-12-05 08:30:04,865 - Epoch: [34][19300/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446268    
+2023-12-05 08:30:46,164 - Epoch: [34][19400/31148]    Overall Loss 0.009680    Objective Loss 0.000000    Distill Loss 0.009680                     LR 0.000002    Time 0.446096    
+2023-12-05 08:31:28,049 - Epoch: [34][19500/31148]    Overall Loss 0.009681    Objective Loss 0.000000    Distill Loss 0.009681                     LR 0.000002    Time 0.445956    
+2023-12-05 08:32:19,970 - Epoch: [34][19600/31148]    Overall Loss 0.009681    Objective Loss 0.000000    Distill Loss 0.009681                     LR 0.000002    Time 0.446329    
+2023-12-05 08:33:08,144 - Epoch: [34][19700/31148]    Overall Loss 0.009681    Objective Loss 0.000000    Distill Loss 0.009681                     LR 0.000002    Time 0.446508    
+2023-12-05 08:33:51,244 - Epoch: [34][19800/31148]    Overall Loss 0.009682    Objective Loss 0.000000    Distill Loss 0.009682                     LR 0.000002    Time 0.446430    
+2023-12-05 08:34:37,318 - Epoch: [34][19900/31148]    Overall Loss 0.009682    Objective Loss 0.000000    Distill Loss 0.009682                     LR 0.000002    Time 0.446501    
+2023-12-05 08:35:14,977 - Epoch: [34][20000/31148]    Overall Loss 0.009682    Objective Loss 0.000000    Distill Loss 0.009682                     LR 0.000002    Time 0.446151    
+2023-12-05 08:36:02,367 - Epoch: [34][20100/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.446289    
+2023-12-05 08:36:45,065 - Epoch: [34][20200/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.446193    
+2023-12-05 08:37:20,768 - Epoch: [34][20300/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.445753    
+2023-12-05 08:38:06,325 - Epoch: [34][20400/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.445801    
+2023-12-05 08:38:44,983 - Epoch: [34][20500/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.445512    
+2023-12-05 08:39:26,734 - Epoch: [34][20600/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.445376    
+2023-12-05 08:40:12,687 - Epoch: [34][20700/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.445444    
+2023-12-05 08:41:02,099 - Epoch: [34][20800/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.445677    
+2023-12-05 08:41:35,144 - Epoch: [34][20900/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.445126    
+2023-12-05 08:42:05,288 - Epoch: [34][21000/31148]    Overall Loss 0.009683    Objective Loss 0.000000    Distill Loss 0.009683                     LR 0.000002    Time 0.444441    
+2023-12-05 08:42:33,160 - Epoch: [34][21100/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.443656    
+2023-12-05 08:43:00,757 - Epoch: [34][21200/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.442865    
+2023-12-05 08:43:28,747 - Epoch: [34][21300/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.442099    
+2023-12-05 08:43:56,611 - Epoch: [34][21400/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.441335    
+2023-12-05 08:44:24,458 - Epoch: [34][21500/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.440578    
+2023-12-05 08:44:52,295 - Epoch: [34][21600/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.439827    
+2023-12-05 08:45:19,966 - Epoch: [34][21700/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.439075    
+2023-12-05 08:45:47,535 - Epoch: [34][21800/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.438325    
+2023-12-05 08:46:15,300 - Epoch: [34][21900/31148]    Overall Loss 0.009684    Objective Loss 0.000000    Distill Loss 0.009684                     LR 0.000002    Time 0.437591    
+2023-12-05 08:46:43,002 - Epoch: [34][22000/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.436861    
+2023-12-05 08:47:21,010 - Epoch: [34][22100/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.436604    
+2023-12-05 08:48:18,243 - Epoch: [34][22200/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000002    Time 0.437215    
+2023-12-05 08:49:10,052 - Epoch: [34][22300/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.437577    
+2023-12-05 08:49:58,385 - Epoch: [34][22400/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.437781    
+2023-12-05 08:50:51,820 - Epoch: [34][22500/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.438210    
+2023-12-05 08:51:43,470 - Epoch: [34][22600/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000002    Time 0.438556    
+2023-12-05 08:52:31,094 - Epoch: [34][22700/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000002    Time 0.438722    
+2023-12-05 08:53:22,537 - Epoch: [34][22800/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000002    Time 0.439054    
+2023-12-05 08:54:03,938 - Epoch: [34][22900/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000002    Time 0.438944    
+2023-12-05 08:55:03,000 - Epoch: [34][23000/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.439603    
+2023-12-05 08:55:50,280 - Epoch: [34][23100/31148]    Overall Loss 0.009685    Objective Loss 0.000000    Distill Loss 0.009685                     LR 0.000002    Time 0.439747    
+2023-12-05 08:56:35,477 - Epoch: [34][23200/31148]    Overall Loss 0.009686    Objective Loss 0.000000    Distill Loss 0.009686                     LR 0.000002    Time 0.439799    
+2023-12-05 08:57:22,521 - Epoch: [34][23300/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000002    Time 0.439930    
+2023-12-05 08:58:10,093 - Epoch: [34][23400/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000002    Time 0.440083    
+2023-12-05 08:58:58,932 - Epoch: [34][23500/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000002    Time 0.440288    
+2023-12-05 08:59:46,088 - Epoch: [34][23600/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000002    Time 0.440420    
+2023-12-05 09:00:40,528 - Epoch: [34][23700/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000002    Time 0.440859    
+2023-12-05 09:01:42,246 - Epoch: [34][23800/31148]    Overall Loss 0.009687    Objective Loss 0.000000    Distill Loss 0.009687                     LR 0.000002    Time 0.441599    
+2023-12-05 09:02:31,719 - Epoch: [34][23900/31148]    Overall Loss 0.009688    Objective Loss 0.000000    Distill Loss 0.009688                     LR 0.000002    Time 0.441821    
+2023-12-05 09:03:19,864 - Epoch: [34][24000/31148]    Overall Loss 0.009688    Objective Loss 0.000000    Distill Loss 0.009688                     LR 0.000002    Time 0.441986    
+2023-12-05 09:04:01,147 - Epoch: [34][24100/31148]    Overall Loss 0.009688    Objective Loss 0.000000    Distill Loss 0.009688                     LR 0.000002    Time 0.441865    
+2023-12-05 09:04:55,080 - Epoch: [34][24200/31148]    Overall Loss 0.009688    Objective Loss 0.000000    Distill Loss 0.009688                     LR 0.000002    Time 0.442267    
+2023-12-05 09:05:43,599 - Epoch: [34][24300/31148]    Overall Loss 0.009688    Objective Loss 0.000000    Distill Loss 0.009688                     LR 0.000002    Time 0.442443    
+2023-12-05 09:06:23,251 - Epoch: [34][24400/31148]    Overall Loss 0.009688    Objective Loss 0.000000    Distill Loss 0.009688                     LR 0.000002    Time 0.442255    
+2023-12-05 09:07:09,020 - Epoch: [34][24500/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.442318    
+2023-12-05 09:07:51,180 - Epoch: [34][24600/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.442233    
+2023-12-05 09:08:34,369 - Epoch: [34][24700/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.442191    
+2023-12-05 09:09:22,730 - Epoch: [34][24800/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.442358    
+2023-12-05 09:10:05,940 - Epoch: [34][24900/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.442316    
+2023-12-05 09:10:55,049 - Epoch: [34][25000/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.442511    
+2023-12-05 09:11:52,420 - Epoch: [34][25100/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.443033    
+2023-12-05 09:12:38,444 - Epoch: [34][25200/31148]    Overall Loss 0.009689    Objective Loss 0.000000    Distill Loss 0.009689                     LR 0.000002    Time 0.443101    
+2023-12-05 09:13:36,733 - Epoch: [34][25300/31148]    Overall Loss 0.009690    Objective Loss 0.000000    Distill Loss 0.009690                     LR 0.000002    Time 0.443654    
+2023-12-05 09:14:28,988 - Epoch: [34][25400/31148]    Overall Loss 0.009690    Objective Loss 0.000000    Distill Loss 0.009690                     LR 0.000002    Time 0.443964    
+2023-12-05 09:15:09,178 - Epoch: [34][25500/31148]    Overall Loss 0.009690    Objective Loss 0.000000    Distill Loss 0.009690                     LR 0.000002    Time 0.443799    
+2023-12-05 09:15:50,764 - Epoch: [34][25600/31148]    Overall Loss 0.009690    Objective Loss 0.000000    Distill Loss 0.009690                     LR 0.000002    Time 0.443689    
+2023-12-05 09:16:38,764 - Epoch: [34][25700/31148]    Overall Loss 0.009690    Objective Loss 0.000000    Distill Loss 0.009690                     LR 0.000002    Time 0.443830    
+2023-12-05 09:17:27,635 - Epoch: [34][25800/31148]    Overall Loss 0.009691    Objective Loss 0.000000    Distill Loss 0.009691                     LR 0.000002    Time 0.444004    
+2023-12-05 09:18:11,691 - Epoch: [34][25900/31148]    Overall Loss 0.009691    Objective Loss 0.000000    Distill Loss 0.009691                     LR 0.000002    Time 0.443990    
+2023-12-05 09:18:50,165 - Epoch: [34][26000/31148]    Overall Loss 0.009691    Objective Loss 0.000000    Distill Loss 0.009691                     LR 0.000002    Time 0.443762    
+2023-12-05 09:19:42,030 - Epoch: [34][26100/31148]    Overall Loss 0.009691    Objective Loss 0.000000    Distill Loss 0.009691                     LR 0.000002    Time 0.444049    
+2023-12-05 09:20:28,936 - Epoch: [34][26200/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000002    Time 0.444144    
+2023-12-05 09:21:16,560 - Epoch: [34][26300/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000002    Time 0.444266    
+2023-12-05 09:22:03,003 - Epoch: [34][26400/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000002    Time 0.444342    
+2023-12-05 09:22:52,898 - Epoch: [34][26500/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000002    Time 0.444548    
+2023-12-05 09:23:31,123 - Epoch: [34][26600/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000002    Time 0.444313    
+2023-12-05 09:24:14,573 - Epoch: [34][26700/31148]    Overall Loss 0.009692    Objective Loss 0.000000    Distill Loss 0.009692                     LR 0.000002    Time 0.444276    
+2023-12-05 09:24:55,452 - Epoch: [34][26800/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444144    
+2023-12-05 09:25:46,916 - Epoch: [34][26900/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444405    
+2023-12-05 09:26:31,283 - Epoch: [34][27000/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444402    
+2023-12-05 09:27:19,873 - Epoch: [34][27100/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444555    
+2023-12-05 09:28:03,989 - Epoch: [34][27200/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444543    
+2023-12-05 09:28:44,671 - Epoch: [34][27300/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444404    
+2023-12-05 09:29:22,965 - Epoch: [34][27400/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444180    
+2023-12-05 09:30:05,788 - Epoch: [34][27500/31148]    Overall Loss 0.009693    Objective Loss 0.000000    Distill Loss 0.009693                     LR 0.000002    Time 0.444121    
+2023-12-05 09:30:54,304 - Epoch: [34][27600/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444270    
+2023-12-05 09:31:40,957 - Epoch: [34][27700/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444350    
+2023-12-05 09:32:34,934 - Epoch: [34][27800/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444693    
+2023-12-05 09:33:17,791 - Epoch: [34][27900/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444635    
+2023-12-05 09:34:07,569 - Epoch: [34][28000/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444824    
+2023-12-05 09:34:46,966 - Epoch: [34][28100/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444643    
+2023-12-05 09:35:40,963 - Epoch: [34][28200/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444981    
+2023-12-05 09:36:23,103 - Epoch: [34][28300/31148]    Overall Loss 0.009694    Objective Loss 0.000000    Distill Loss 0.009694                     LR 0.000002    Time 0.444897    
+2023-12-05 09:37:04,326 - Epoch: [34][28400/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.444782    
+2023-12-05 09:37:45,991 - Epoch: [34][28500/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.444683    
+2023-12-05 09:38:41,601 - Epoch: [34][28600/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445072    
+2023-12-05 09:39:28,851 - Epoch: [34][28700/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445168    
+2023-12-05 09:40:11,785 - Epoch: [34][28800/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445112    
+2023-12-05 09:41:02,917 - Epoch: [34][28900/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445341    
+2023-12-05 09:41:49,602 - Epoch: [34][29000/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445415    
+2023-12-05 09:42:41,979 - Epoch: [34][29100/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445684    
+2023-12-05 09:43:37,995 - Epoch: [34][29200/31148]    Overall Loss 0.009696    Objective Loss 0.000000    Distill Loss 0.009696                     LR 0.000002    Time 0.446076    
+2023-12-05 09:44:12,650 - Epoch: [34][29300/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445736    
+2023-12-05 09:44:58,678 - Epoch: [34][29400/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445785    
+2023-12-05 09:45:44,303 - Epoch: [34][29500/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445821    
+2023-12-05 09:46:22,534 - Epoch: [34][29600/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445606    
+2023-12-05 09:47:11,272 - Epoch: [34][29700/31148]    Overall Loss 0.009695    Objective Loss 0.000000    Distill Loss 0.009695                     LR 0.000002    Time 0.445746    
+2023-12-05 09:47:55,663 - Epoch: [34][29800/31148]    Overall Loss 0.009696    Objective Loss 0.000000    Distill Loss 0.009696                     LR 0.000002    Time 0.445740    
+2023-12-05 09:48:39,959 - Epoch: [34][29900/31148]    Overall Loss 0.009696    Objective Loss 0.000000    Distill Loss 0.009696                     LR 0.000002    Time 0.445730    
+2023-12-05 09:49:26,122 - Epoch: [34][30000/31148]    Overall Loss 0.009696    Objective Loss 0.000000    Distill Loss 0.009696                     LR 0.000002    Time 0.445783    
+2023-12-05 09:50:14,690 - Epoch: [34][30100/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445915    
+2023-12-05 09:50:55,329 - Epoch: [34][30200/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445784    
+2023-12-05 09:51:40,430 - Epoch: [34][30300/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445801    
+2023-12-05 09:52:19,825 - Epoch: [34][30400/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445630    
+2023-12-05 09:53:07,334 - Epoch: [34][30500/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445727    
+2023-12-05 09:53:52,874 - Epoch: [34][30600/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445758    
+2023-12-05 09:54:34,969 - Epoch: [34][30700/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445677    
+2023-12-05 09:55:14,991 - Epoch: [34][30800/31148]    Overall Loss 0.009697    Objective Loss 0.000000    Distill Loss 0.009697                     LR 0.000002    Time 0.445529    
+2023-12-05 09:55:56,702 - Epoch: [34][30900/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000002    Time 0.445437    
+2023-12-05 09:56:38,525 - Epoch: [34][31000/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000002    Time 0.445349    
+2023-12-05 09:57:25,501 - Epoch: [34][31100/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000002    Time 0.445427    
+2023-12-05 09:57:44,897 - Epoch: [34][31148/31148]    Overall Loss 0.009698    Objective Loss 0.000000    Distill Loss 0.009698                     LR 0.000002    Time 0.445364    
+2023-12-05 09:57:45,749 - --- validate (epoch=34)-----------
+2023-12-05 09:57:45,749 - 167951 samples (100 per mini-batch)
+2023-12-05 09:58:15,280 - Epoch: [34][  100/ 1680]    Loss 0.000000    Overall Loss 0.010368    
+2023-12-05 09:58:38,120 - Epoch: [34][  200/ 1680]    Loss 0.000000    Overall Loss 0.010381    
+2023-12-05 09:59:00,742 - Epoch: [34][  300/ 1680]    Loss 0.000000    Overall Loss 0.010400    
+2023-12-05 09:59:23,575 - Epoch: [34][  400/ 1680]    Loss 0.000000    Overall Loss 0.010385    
+2023-12-05 09:59:46,362 - Epoch: [34][  500/ 1680]    Loss 0.000000    Overall Loss 0.010387    
+2023-12-05 10:00:09,126 - Epoch: [34][  600/ 1680]    Loss 0.000000    Overall Loss 0.010383    
+2023-12-05 10:00:32,548 - Epoch: [34][  700/ 1680]    Loss 0.000000    Overall Loss 0.010380    
+2023-12-05 10:00:55,786 - Epoch: [34][  800/ 1680]    Loss 0.000000    Overall Loss 0.010391    
+2023-12-05 10:01:18,401 - Epoch: [34][  900/ 1680]    Loss 0.000000    Overall Loss 0.010391    
+2023-12-05 10:01:41,477 - Epoch: [34][ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010384    
+2023-12-05 10:02:04,216 - Epoch: [34][ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010386    
+2023-12-05 10:02:27,131 - Epoch: [34][ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010385    
+2023-12-05 10:02:50,160 - Epoch: [34][ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010386    
+2023-12-05 10:03:12,936 - Epoch: [34][ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010385    
+2023-12-05 10:03:35,533 - Epoch: [34][ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010382    
+2023-12-05 10:03:58,396 - Epoch: [34][ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010383    
+2023-12-05 10:04:16,829 - Epoch: [34][ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010382    
+2023-12-05 10:04:17,359 - ==> Overall Loss: 0.010
+
+2023-12-05 10:04:17,363 - ==> Best [Overall Loss: 0.010329 on epoch: 33]
+2023-12-05 10:04:17,364 - Saving checkpoint to: logs/2023.11.30-015335/qat_checkpoint.pth.tar
+2023-12-05 10:04:17,398 - --- test ---------------------
+2023-12-05 10:04:17,398 - 167951 samples (100 per mini-batch)
+2023-12-05 10:04:44,288 - Test: [  100/ 1680]    Loss 0.000000    Overall Loss 0.010341    
+2023-12-05 10:05:07,753 - Test: [  200/ 1680]    Loss 0.000000    Overall Loss 0.010376    
+2023-12-05 10:05:30,501 - Test: [  300/ 1680]    Loss 0.000000    Overall Loss 0.010383    
+2023-12-05 10:05:53,566 - Test: [  400/ 1680]    Loss 0.000000    Overall Loss 0.010389    
+2023-12-05 10:06:16,623 - Test: [  500/ 1680]    Loss 0.000000    Overall Loss 0.010386    
+2023-12-05 10:06:39,284 - Test: [  600/ 1680]    Loss 0.000000    Overall Loss 0.010396    
+2023-12-05 10:07:02,016 - Test: [  700/ 1680]    Loss 0.000000    Overall Loss 0.010391    
+2023-12-05 10:07:24,884 - Test: [  800/ 1680]    Loss 0.000000    Overall Loss 0.010392    
+2023-12-05 10:07:48,875 - Test: [  900/ 1680]    Loss 0.000000    Overall Loss 0.010391    
+2023-12-05 10:08:11,907 - Test: [ 1000/ 1680]    Loss 0.000000    Overall Loss 0.010389    
+2023-12-05 10:08:34,599 - Test: [ 1100/ 1680]    Loss 0.000000    Overall Loss 0.010395    
+2023-12-05 10:08:57,871 - Test: [ 1200/ 1680]    Loss 0.000000    Overall Loss 0.010389    
+2023-12-05 10:09:20,613 - Test: [ 1300/ 1680]    Loss 0.000000    Overall Loss 0.010388    
+2023-12-05 10:09:44,303 - Test: [ 1400/ 1680]    Loss 0.000000    Overall Loss 0.010388    
+2023-12-05 10:10:08,234 - Test: [ 1500/ 1680]    Loss 0.000000    Overall Loss 0.010385    
+2023-12-05 10:10:31,080 - Test: [ 1600/ 1680]    Loss 0.000000    Overall Loss 0.010385    
+2023-12-05 10:10:49,084 - Test: [ 1680/ 1680]    Loss 0.000000    Overall Loss 0.010383    
+2023-12-05 10:10:49,634 - ==> Overall Loss: 0.010
+
+2023-12-05 10:10:51,671 - 
+2023-12-05 10:10:51,671 - Log file for this run: /home/oguzhanbuyuksolak/Repos/pr271/ai8x-training/logs/2023.11.30-015335/2023.11.30-015335.log
diff --git a/trained/ai87-mobilefacenet-112-qat.pth.tar b/trained/ai87-mobilefacenet-112-qat.pth.tar
new file mode 100644
index 00000000..dd3d1c74
Binary files /dev/null and b/trained/ai87-mobilefacenet-112-qat.pth.tar differ