zylim0702 / sdxl-lora-customize-training

Introducing a Lora Instant Training model for crafting stunning 1024x1024 visuals. Train your own Lora Model via zip photos for instant outputs. Try Lora Model using this link: https://replicate.com/zylim0702/sdxl-lora-customize-model.

Warm

Public
21.7K runs
L40S

Run with an API

Playground API Examples README Versions

Prediction

zylim0702/sdxl-lora-customize-training:a4eefb9bbc944eaefc56d67acba982ab73d85ec449de6606cf48b13f1483a495

Model

zylim0702/sdxl-lora-customize-training:a4eefb9b

5jgdk6tbddz5rcgpphbiinilea

Status

Succeeded

Source

Web

Hardware

A40 (Large)

Total duration

7m 6s

Created

over 1 year ago by @zylim0702

Input

ti_lr: 0.0003
is_lora
lora_lr: 0.0001
verbose
lora_rank: 32
resolution: 768
input_images: barbie.zip
lr_scheduler: constant
token_string: TOK
caption_prefix: a photo of TOK,
lr_warmup_steps: 100
max_train_steps: 1000
num_train_epochs: 4000
train_batch_size: 4
unet_learning_rate: 0.000001
checkpointing_steps: 999999
clipseg_temperature: 1
input_images_filetype: infer
crop_based_on_salience
use_face_detection_instead

{
  "ti_lr": 0.0003,
  "is_lora": true,
  "lora_lr": 0.0001,
  "verbose": true,
  "lora_rank": 32,
  "resolution": 768,
  "input_images": "https://replicate.delivery/pbxt/JNkYrCKwBoZ1ZSs5JgkXJuKhSfmSIORzOwNFuVDn9pIMi8Xl/barbie.zip",
  "lr_scheduler": "constant",
  "token_string": "TOK",
  "caption_prefix": "a photo of TOK, ",
  "lr_warmup_steps": 100,
  "max_train_steps": 1000,
  "num_train_epochs": 4000,
  "train_batch_size": 4,
  "unet_learning_rate": 0.000001,
  "checkpointing_steps": 999999,
  "clipseg_temperature": 1,
  "input_images_filetype": "infer",
  "crop_based_on_salience": true,
  "use_face_detection_instead": true
}

Install Replicate’s Node.js client library:

npm install replicate

Import and set up the client:

import Replicate from "replicate";

const replicate = new Replicate({
  auth: process.env.REPLICATE_API_TOKEN,
});

Run zylim0702/sdxl-lora-customize-training using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

const output = await replicate.run(
  "zylim0702/sdxl-lora-customize-training:a4eefb9bbc944eaefc56d67acba982ab73d85ec449de6606cf48b13f1483a495",
  {
    input: {
      ti_lr: 0.0003,
      is_lora: true,
      lora_lr: 0.0001,
      verbose: true,
      lora_rank: 32,
      resolution: 768,
      input_images: "https://replicate.delivery/pbxt/JNkYrCKwBoZ1ZSs5JgkXJuKhSfmSIORzOwNFuVDn9pIMi8Xl/barbie.zip",
      lr_scheduler: "constant",
      token_string: "TOK",
      caption_prefix: "a photo of TOK, ",
      lr_warmup_steps: 100,
      max_train_steps: 1000,
      num_train_epochs: 4000,
      train_batch_size: 4,
      unet_learning_rate: 0.000001,
      checkpointing_steps: 999999,
      clipseg_temperature: 1,
      input_images_filetype: "infer",
      crop_based_on_salience: true,
      use_face_detection_instead: true
    }
  }
);

// To access the file URL:
console.log(output.url()); //=> "http://example.com"

// To write the file to disk:
fs.writeFile("my-image.png", output);

To learn more, take a look at the guide on getting started with Node.js.

Install Replicate’s Python client library:

pip install replicate

Import the client:

import replicate

Run zylim0702/sdxl-lora-customize-training using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

output = replicate.run(
    "zylim0702/sdxl-lora-customize-training:a4eefb9bbc944eaefc56d67acba982ab73d85ec449de6606cf48b13f1483a495",
    input={
        "ti_lr": 0.0003,
        "is_lora": True,
        "lora_lr": 0.0001,
        "verbose": True,
        "lora_rank": 32,
        "resolution": 768,
        "input_images": "https://replicate.delivery/pbxt/JNkYrCKwBoZ1ZSs5JgkXJuKhSfmSIORzOwNFuVDn9pIMi8Xl/barbie.zip",
        "lr_scheduler": "constant",
        "token_string": "TOK",
        "caption_prefix": "a photo of TOK, ",
        "lr_warmup_steps": 100,
        "max_train_steps": 1000,
        "num_train_epochs": 4000,
        "train_batch_size": 4,
        "unet_learning_rate": 0.000001,
        "checkpointing_steps": 999999,
        "clipseg_temperature": 1,
        "input_images_filetype": "infer",
        "crop_based_on_salience": True,
        "use_face_detection_instead": True
    }
)
print(output)

To learn more, take a look at the guide on getting started with Python.

Run zylim0702/sdxl-lora-customize-training using Replicate’s API. Check out the model's schema for an overview of inputs and outputs.

curl -s -X POST \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Prefer: wait" \
  -d $'{
    "version": "zylim0702/sdxl-lora-customize-training:a4eefb9bbc944eaefc56d67acba982ab73d85ec449de6606cf48b13f1483a495",
    "input": {
      "ti_lr": 0.0003,
      "is_lora": true,
      "lora_lr": 0.0001,
      "verbose": true,
      "lora_rank": 32,
      "resolution": 768,
      "input_images": "https://replicate.delivery/pbxt/JNkYrCKwBoZ1ZSs5JgkXJuKhSfmSIORzOwNFuVDn9pIMi8Xl/barbie.zip",
      "lr_scheduler": "constant",
      "token_string": "TOK",
      "caption_prefix": "a photo of TOK, ",
      "lr_warmup_steps": 100,
      "max_train_steps": 1000,
      "num_train_epochs": 4000,
      "train_batch_size": 4,
      "unet_learning_rate": 0.000001,
      "checkpointing_steps": 999999,
      "clipseg_temperature": 1,
      "input_images_filetype": "infer",
      "crop_based_on_salience": true,
      "use_face_detection_instead": true
    }
  }' \
  https://api.replicate.com/v1/predictions

To learn more, take a look at Replicate’s HTTP API reference docs.

Output

trained_model.tar

{
  "completed_at": "2023-08-20T08:08:36.702505Z",
  "created_at": "2023-08-20T08:01:30.812363Z",
  "data_removed": false,
  "error": null,
  "id": "5jgdk6tbddz5rcgpphbiinilea",
  "input": {
    "ti_lr": 0.0003,
    "is_lora": true,
    "lora_lr": 0.0001,
    "verbose": true,
    "lora_rank": 32,
    "resolution": 768,
    "input_images": "https://replicate.delivery/pbxt/JNkYrCKwBoZ1ZSs5JgkXJuKhSfmSIORzOwNFuVDn9pIMi8Xl/barbie.zip",
    "lr_scheduler": "constant",
    "token_string": "TOK",
    "caption_prefix": "a photo of TOK, ",
    "lr_warmup_steps": 100,
    "max_train_steps": 1000,
    "num_train_epochs": 4000,
    "train_batch_size": 4,
    "unet_learning_rate": 0.000001,
    "checkpointing_steps": 999999,
    "clipseg_temperature": 1,
    "input_images_filetype": "infer",
    "crop_based_on_salience": true,
    "use_face_detection_instead": true
  },
  "logs": "['./temp_in/BAR-00238.jpg', './temp_in/Margot-Robbie-Barbie-750x422.jpg', './temp_in/_methode_sundaytimes_prod_web_bin_f173c0a2-1825-11ee-87bf-4c05f9202e96.jpg', './temp_in/imago0257930673h-768x432.jpg', './temp_in/margot-robbie-barbie-event-seoul-070323-1-21a1fad7406b4901bb5b7628beb0c551.jpg', './temp_in/rev-1-BAR-00362HighResJPEG-161c750-bf849b2-e1690197084134.jpg']\nGenerating 6 captions...\nInput captioning text: a photo of TOK,\nTOK\na photo of tok, a blonde haired woman in a pink car\n  0%|          | 0/6 [00:00<?, ?it/s]\nTOK\na photo of tok, a very pretty, young lady in a pink dress\n 17%|█▋        | 1/6 [00:02<00:11,  2.22s/it]\nTOK\na photo of tok, who is currently a actress, is also one of the stars in a film\n 33%|███▎      | 2/6 [00:02<00:04,  1.02s/it]\nTOK\na photo of tok, a pretty blond in a pink hat\n 50%|█████     | 3/6 [00:02<00:01,  1.50it/s]\nTOK\na photo of tok, a woman in a pink suit and white hat, holding a cell phone\n 67%|██████▋   | 4/6 [00:02<00:00,  2.19it/s]\nTOK\na photo of tok, blonde, dress, pink, girl, fashion\nGenerated captions ['a photo of tok, a blonde haired woman in a pink car', 'a photo of tok, a very pretty, young lady in a pink dress', 'a photo of tok, who is currently a actress, is also one of the stars in a film', 'a photo of tok, a pretty blond in a pink hat', 'a photo of tok, a woman in a pink suit and white hat, holding a cell phone', 'a photo of tok, blonde, dress, pink, girl, fashion']\n 83%|████████▎ | 5/6 [00:03<00:00,  2.66it/s]\n100%|██████████| 6/6 [00:03<00:00,  3.30it/s]\n100%|██████████| 6/6 [00:03<00:00,  1.89it/s]\nGenerating 6 masks...\nINFO: Created TensorFlow Lite XNNPACK delegate for CPU.\n  0%|          | 0/6 [00:00<?, ?it/s]\n 83%|████████▎ | 5/6 [00:00<00:00, 43.49it/s]\n100%|██████████| 6/6 [00:00<00:00, 45.12it/s]\nUpscaling 6 images...\nDownloading (…)lve/main/config.json:   0%|          | 0.00/772 [00:00<?, ?B/s]\nDownloading (…)lve/main/config.json: 100%|██████████| 772/772 [00:00<00:00, 3.76MB/s]\nDownloading pytorch_model.bin:   0%|          | 0.00/48.5M [00:00<?, ?B/s]\nDownloading pytorch_model.bin:  22%|██▏       | 10.5M/48.5M [00:00<00:01, 23.9MB/s]\nDownloading pytorch_model.bin:  87%|████████▋ | 41.9M/48.5M [00:00<00:00, 88.9MB/s]\nDownloading pytorch_model.bin: 100%|██████████| 48.5M/48.5M [00:00<00:00, 82.0MB/s]\n  0%|          | 0/6 [00:00<?, ?it/s]\n 33%|███▎      | 2/6 [00:01<00:02,  1.75it/s]\n 67%|██████▋   | 4/6 [00:02<00:01,  1.68it/s]\n100%|██████████| 6/6 [00:05<00:00,  1.06it/s]\n100%|██████████| 6/6 [00:05<00:00,  1.18it/s]\nUsing seed 3860335812\nYou are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.\nYou are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.\n# PTI : Loaded models\n0 text encodedr's std_token_embedding: 0.01531982421875\ntorch.Size([49410])\n1 text encodedr's std_token_embedding: 0.01446533203125\ntorch.Size([49410])\ntext_model.embeddings.token_embedding.weight\ntext_model.embeddings.token_embedding.weight\n# PTI : Loading dataset, do_cache True\nCaptions to train on:\na photo of <s0><s1>, a blonde haired woman in a pink car\na photo of <s0><s1>, a very pretty, young lady in a pink dress\na photo of <s0><s1>, who is currently a actress, is also one of the stars in a film\na photo of <s0><s1>, a pretty blond in a pink hat\na photo of <s0><s1>, a woman in a pink suit and white hat, holding a cell phone\na photo of <s0><s1>, blonde, dress, pink, girl, fashion\n# PTI : Loaded dataset\n# PTI :  Running training\n# PTI :  Num examples = 6\n# PTI :  Num batches each epoch = 2\n# PTI :  Num Epochs = 500\n# PTI :  Instantaneous batch size per device = 4\nTotal train batch size (w. parallel, distributed & accumulation) = 4\n# PTI :  Gradient Accumulation steps = 1\n# PTI :  Total optimization steps = 1000\n  0%|          | 0/1000 [00:00<?, ?it/s]\n# PTI :step: 0, epoch: 0:   0%|          | 1/1000 [00:00<00:14, 71.11it/s]\n# PTI :step: 0, epoch: 0:   0%|          | 2/1000 [00:00<06:55,  2.40it/s]\n# PTI :step: 1, epoch: 0:   0%|          | 2/1000 [00:00<06:55,  2.40it/s]\n# PTI :step: 1, epoch: 0:   0%|          | 3/1000 [00:01<07:23,  2.25it/s]\n# PTI :step: 2, epoch: 1:   0%|          | 3/1000 [00:01<07:23,  2.25it/s]\n# PTI :step: 2, epoch: 1:   0%|          | 4/1000 [00:01<07:09,  2.32it/s]\n# PTI :step: 3, epoch: 1:   0%|          | 4/1000 [00:01<07:09,  2.32it/s]\n# PTI :step: 3, epoch: 1:   0%|          | 5/1000 [00:02<06:49,  2.43it/s]\n# PTI :step: 4, epoch: 2:   0%|          | 5/1000 [00:02<06:49,  2.43it/s]\n# PTI :step: 4, epoch: 2:   1%|          | 6/1000 [00:02<06:43,  2.46it/s]\n# PTI :step: 5, epoch: 2:   1%|          | 6/1000 [00:02<06:43,  2.46it/s]\n# PTI :step: 5, epoch: 2:   1%|          | 7/1000 [00:02<06:33,  2.52it/s]\n# PTI :step: 6, epoch: 3:   1%|          | 7/1000 [00:02<06:33,  2.52it/s]\n# PTI :step: 6, epoch: 3:   1%|          | 8/1000 [00:03<06:33,  2.52it/s]\n# PTI :step: 7, epoch: 3:   1%|          | 8/1000 [00:03<06:33,  2.52it/s]\n# PTI :step: 7, epoch: 3:   1%|          | 9/1000 [00:03<06:29,  2.54it/s]\n# PTI :step: 8, epoch: 4:   1%|          | 9/1000 [00:03<06:29,  2.54it/s]\n# PTI :step: 8, epoch: 4:   1%|          | 10/1000 [00:04<06:30,  2.54it/s]\n# PTI :step: 9, epoch: 4:   1%|          | 10/1000 [00:04<06:30,  2.54it/s]\n# PTI :step: 9, epoch: 4:   1%|          | 11/1000 [00:04<06:26,  2.56it/s]\n# PTI :step: 10, epoch: 5:   1%|          | 11/1000 [00:04<06:26,  2.56it/s]\n# PTI :step: 10, epoch: 5:   1%|          | 12/1000 [00:04<06:27,  2.55it/s]\n# PTI :step: 11, epoch: 5:   1%|          | 12/1000 [00:04<06:27,  2.55it/s]\n# PTI :step: 11, epoch: 5:   1%|▏         | 13/1000 [00:05<06:24,  2.57it/s]\n# PTI :step: 12, epoch: 6:   1%|▏         | 13/1000 [00:05<06:24,  2.57it/s]\n# PTI :step: 12, epoch: 6:   1%|▏         | 14/1000 [00:05<06:28,  2.54it/s]\n# PTI :step: 13, epoch: 6:   1%|▏         | 14/1000 [00:05<06:28,  2.54it/s]\n# PTI :step: 13, epoch: 6:   2%|▏         | 15/1000 [00:05<06:22,  2.57it/s]\n# PTI :step: 14, epoch: 7:   2%|▏         | 15/1000 [00:05<06:22,  2.57it/s]\n# PTI :step: 14, epoch: 7:   2%|▏         | 16/1000 [00:06<06:24,  2.56it/s]\n# PTI :step: 15, epoch: 7:   2%|▏         | 16/1000 [00:06<06:24,  2.56it/s]\n# PTI :step: 15, epoch: 7:   2%|▏         | 17/1000 [00:06<06:24,  2.56it/s]\n# PTI :step: 16, epoch: 8:   2%|▏         | 17/1000 [00:06<06:24,  2.56it/s]\n# PTI :step: 16, epoch: 8:   2%|▏         | 18/1000 [00:07<06:25,  2.55it/s]\n# PTI :step: 17, epoch: 8:   2%|▏         | 18/1000 [00:07<06:25,  2.55it/s]\n# PTI :step: 17, epoch: 8:   2%|▏         | 19/1000 [00:07<06:22,  2.56it/s]\n# PTI :step: 18, epoch: 9:   2%|▏         | 19/1000 [00:07<06:22,  2.56it/s]\n# PTI :step: 18, epoch: 9:   2%|▏         | 20/1000 [00:07<06:23,  2.55it/s]\n# PTI :step: 19, epoch: 9:   2%|▏         | 20/1000 [00:07<06:23,  2.55it/s]\n# PTI :step: 19, epoch: 9:   2%|▏         | 21/1000 [00:08<06:17,  2.59it/s]\n# PTI :step: 20, epoch: 10:   2%|▏         | 21/1000 [00:08<06:17,  2.59it/s]\n# PTI :step: 20, epoch: 10:   2%|▏         | 22/1000 [00:08<06:24,  2.55it/s]\n# PTI :step: 21, epoch: 10:   2%|▏         | 22/1000 [00:08<06:24,  2.55it/s]\n# PTI :step: 21, epoch: 10:   2%|▏         | 23/1000 [00:09<06:19,  2.58it/s]\n# PTI :step: 22, epoch: 11:   2%|▏         | 23/1000 [00:09<06:19,  2.58it/s]\n# PTI :step: 22, epoch: 11:   2%|▏         | 24/1000 [00:09<06:20,  2.56it/s]\n# PTI :step: 23, epoch: 11:   2%|▏         | 24/1000 [00:09<06:20,  2.56it/s]\n# PTI :step: 23, epoch: 11:   2%|▎         | 25/1000 [00:09<06:16,  2.59it/s]\n# PTI :step: 24, epoch: 12:   2%|▎         | 25/1000 [00:09<06:16,  2.59it/s]\n# PTI :step: 24, epoch: 12:   3%|▎         | 26/1000 [00:10<06:19,  2.57it/s]\n# PTI :step: 25, epoch: 12:   3%|▎         | 26/1000 [00:10<06:19,  2.57it/s]\n# PTI :step: 25, epoch: 12:   3%|▎         | 27/1000 [00:10<06:17,  2.58it/s]\n# PTI :step: 26, epoch: 13:   3%|▎         | 27/1000 [00:10<06:17,  2.58it/s]\n# PTI :step: 26, epoch: 13:   3%|▎         | 28/1000 [00:11<06:19,  2.56it/s]\n# PTI :step: 27, epoch: 13:   3%|▎         | 28/1000 [00:11<06:19,  2.56it/s]\n# PTI :step: 27, epoch: 13:   3%|▎         | 29/1000 [00:11<06:15,  2.59it/s]\n# PTI :step: 28, epoch: 14:   3%|▎         | 29/1000 [00:11<06:15,  2.59it/s]\n# PTI :step: 28, epoch: 14:   3%|▎         | 30/1000 [00:11<06:17,  2.57it/s]\n# PTI :step: 29, epoch: 14:   3%|▎         | 30/1000 [00:11<06:17,  2.57it/s]\n# PTI :step: 29, epoch: 14:   3%|▎         | 31/1000 [00:12<06:14,  2.59it/s]\n# PTI :step: 30, epoch: 15:   3%|▎         | 31/1000 [00:12<06:14,  2.59it/s]\n# PTI :step: 30, epoch: 15:   3%|▎         | 32/1000 [00:12<06:16,  2.57it/s]\n# PTI :step: 31, epoch: 15:   3%|▎         | 32/1000 [00:12<06:16,  2.57it/s]\n# PTI :step: 31, epoch: 15:   3%|▎         | 33/1000 [00:12<06:12,  2.59it/s]\n# PTI :step: 32, epoch: 16:   3%|▎         | 33/1000 [00:12<06:12,  2.59it/s]\n# PTI :step: 32, epoch: 16:   3%|▎         | 34/1000 [00:13<06:15,  2.57it/s]\n# PTI :step: 33, epoch: 16:   3%|▎         | 34/1000 [00:13<06:15,  2.57it/s]\n# PTI :step: 33, epoch: 16:   4%|▎         | 35/1000 [00:13<06:12,  2.59it/s]\n# PTI :step: 34, epoch: 17:   4%|▎         | 35/1000 [00:13<06:12,  2.59it/s]\n# PTI :step: 34, epoch: 17:   4%|▎         | 36/1000 [00:14<06:15,  2.57it/s]\n# PTI :step: 35, epoch: 17:   4%|▎         | 36/1000 [00:14<06:15,  2.57it/s]\n# PTI :step: 35, epoch: 17:   4%|▎         | 37/1000 [00:14<06:13,  2.58it/s]\n# PTI :step: 36, epoch: 18:   4%|▎         | 37/1000 [00:14<06:13,  2.58it/s]\n# PTI :step: 36, epoch: 18:   4%|▍         | 38/1000 [00:14<06:15,  2.56it/s]\n# PTI :step: 37, epoch: 18:   4%|▍         | 38/1000 [00:14<06:15,  2.56it/s]\n# PTI :step: 37, epoch: 18:   4%|▍         | 39/1000 [00:15<06:10,  2.59it/s]\n# PTI :step: 38, epoch: 19:   4%|▍         | 39/1000 [00:15<06:10,  2.59it/s]\n# PTI :step: 38, epoch: 19:   4%|▍         | 40/1000 [00:15<06:17,  2.54it/s]\n# PTI :step: 39, epoch: 19:   4%|▍         | 40/1000 [00:15<06:17,  2.54it/s]\n# PTI :step: 39, epoch: 19:   4%|▍         | 41/1000 [00:16<06:13,  2.57it/s]\n# PTI :step: 40, epoch: 20:   4%|▍         | 41/1000 [00:16<06:13,  2.57it/s]\n# PTI :step: 40, epoch: 20:   4%|▍         | 42/1000 [00:16<06:15,  2.55it/s]\n# PTI :step: 41, epoch: 20:   4%|▍         | 42/1000 [00:16<06:15,  2.55it/s]\n# PTI :step: 41, epoch: 20:   4%|▍         | 43/1000 [00:16<06:10,  2.58it/s]\n# PTI :step: 42, epoch: 21:   4%|▍         | 43/1000 [00:16<06:10,  2.58it/s]\n# PTI :step: 42, epoch: 21:   4%|▍         | 44/1000 [00:17<06:13,  2.56it/s]\n# PTI :step: 43, epoch: 21:   4%|▍         | 44/1000 [00:17<06:13,  2.56it/s]\n# PTI :step: 43, epoch: 21:   4%|▍         | 45/1000 [00:17<06:10,  2.58it/s]\n# PTI :step: 44, epoch: 22:   4%|▍         | 45/1000 [00:17<06:10,  2.58it/s]\n# PTI :step: 44, epoch: 22:   5%|▍         | 46/1000 [00:18<06:41,  2.38it/s]\n# PTI :step: 45, epoch: 22:   5%|▍         | 46/1000 [00:18<06:41,  2.38it/s]\n# PTI :step: 45, epoch: 22:   5%|▍         | 47/1000 [00:18<06:29,  2.45it/s]\n# PTI :step: 46, epoch: 23:   5%|▍         | 47/1000 [00:18<06:29,  2.45it/s]\n# PTI :step: 46, epoch: 23:   5%|▍         | 48/1000 [00:18<06:26,  2.47it/s]\n# PTI :step: 47, epoch: 23:   5%|▍         | 48/1000 [00:18<06:26,  2.47it/s]\n# PTI :step: 47, epoch: 23:   5%|▍         | 49/1000 [00:19<06:18,  2.51it/s]\n# PTI :step: 48, epoch: 24:   5%|▍         | 49/1000 [00:19<06:18,  2.51it/s]\n# PTI :step: 48, epoch: 24:   5%|▌         | 50/1000 [00:19<06:18,  2.51it/s]\n# PTI :step: 49, epoch: 24:   5%|▌         | 50/1000 [00:19<06:18,  2.51it/s]\n# PTI :step: 49, epoch: 24:   5%|▌         | 51/1000 [00:20<06:11,  2.55it/s]\n# PTI :step: 50, epoch: 25:   5%|▌         | 51/1000 [00:20<06:11,  2.55it/s]\n# PTI :step: 50, epoch: 25:   5%|▌         | 52/1000 [00:20<06:12,  2.54it/s]\n# PTI :step: 51, epoch: 25:   5%|▌         | 52/1000 [00:20<06:12,  2.54it/s]\n# PTI :step: 51, epoch: 25:   5%|▌         | 53/1000 [00:20<06:07,  2.58it/s]\n# PTI :step: 52, epoch: 26:   5%|▌         | 53/1000 [00:20<06:07,  2.58it/s]\n# PTI :step: 52, epoch: 26:   5%|▌         | 54/1000 [00:21<06:09,  2.56it/s]\n# PTI :step: 53, epoch: 26:   5%|▌         | 54/1000 [00:21<06:09,  2.56it/s]\n# PTI :step: 53, epoch: 26:   6%|▌         | 55/1000 [00:21<06:08,  2.56it/s]\n# PTI :step: 54, epoch: 27:   6%|▌         | 55/1000 [00:21<06:08,  2.56it/s]\n# PTI :step: 54, epoch: 27:   6%|▌         | 56/1000 [00:22<06:11,  2.54it/s]\n# PTI :step: 55, epoch: 27:   6%|▌         | 56/1000 [00:22<06:11,  2.54it/s]\n# PTI :step: 55, epoch: 27:   6%|▌         | 57/1000 [00:22<06:09,  2.55it/s]\n# PTI :step: 56, epoch: 28:   6%|▌         | 57/1000 [00:22<06:09,  2.55it/s]\n# PTI :step: 56, epoch: 28:   6%|▌         | 58/1000 [00:22<06:10,  2.54it/s]\n# PTI :step: 57, epoch: 28:   6%|▌         | 58/1000 [00:22<06:10,  2.54it/s]\n# PTI :step: 57, epoch: 28:   6%|▌         | 59/1000 [00:23<06:05,  2.58it/s]\n# PTI :step: 58, epoch: 29:   6%|▌         | 59/1000 [00:23<06:05,  2.58it/s]\n# PTI :step: 58, epoch: 29:   6%|▌         | 60/1000 [00:23<06:09,  2.55it/s]\n# PTI :step: 59, epoch: 29:   6%|▌         | 60/1000 [00:23<06:09,  2.55it/s]\n# PTI :step: 59, epoch: 29:   6%|▌         | 61/1000 [00:23<06:04,  2.58it/s]\n# PTI :step: 60, epoch: 30:   6%|▌         | 61/1000 [00:23<06:04,  2.58it/s]\n# PTI :step: 60, epoch: 30:   6%|▌         | 62/1000 [00:24<06:11,  2.53it/s]\n# PTI :step: 61, epoch: 30:   6%|▌         | 62/1000 [00:24<06:11,  2.53it/s]\n# PTI :step: 61, epoch: 30:   6%|▋         | 63/1000 [00:24<06:06,  2.56it/s]\n# PTI :step: 62, epoch: 31:   6%|▋         | 63/1000 [00:24<06:06,  2.56it/s]\n# PTI :step: 62, epoch: 31:   6%|▋         | 64/1000 [00:25<06:07,  2.55it/s]\n# PTI :step: 63, epoch: 31:   6%|▋         | 64/1000 [00:25<06:07,  2.55it/s]\n# PTI :step: 63, epoch: 31:   6%|▋         | 65/1000 [00:25<06:04,  2.56it/s]\n# PTI :step: 64, epoch: 32:   6%|▋         | 65/1000 [00:25<06:04,  2.56it/s]\n# PTI :step: 64, epoch: 32:   7%|▋         | 66/1000 [00:25<06:06,  2.55it/s]\n# PTI :step: 65, epoch: 32:   7%|▋         | 66/1000 [00:25<06:06,  2.55it/s]\n# PTI :step: 65, epoch: 32:   7%|▋         | 67/1000 [00:26<06:01,  2.58it/s]\n# PTI :step: 66, epoch: 33:   7%|▋         | 67/1000 [00:26<06:01,  2.58it/s]\n# PTI :step: 66, epoch: 33:   7%|▋         | 68/1000 [00:26<06:04,  2.56it/s]\n# PTI :step: 67, epoch: 33:   7%|▋         | 68/1000 [00:26<06:04,  2.56it/s]\n# PTI :step: 67, epoch: 33:   7%|▋         | 69/1000 [00:27<05:59,  2.59it/s]\n# PTI :step: 68, epoch: 34:   7%|▋         | 69/1000 [00:27<05:59,  2.59it/s]\n# PTI :step: 68, epoch: 34:   7%|▋         | 70/1000 [00:27<06:02,  2.57it/s]\n# PTI :step: 69, epoch: 34:   7%|▋         | 70/1000 [00:27<06:02,  2.57it/s]\n# PTI :step: 69, epoch: 34:   7%|▋         | 71/1000 [00:27<05:58,  2.59it/s]\n# PTI :step: 70, epoch: 35:   7%|▋         | 71/1000 [00:27<05:58,  2.59it/s]\n# PTI :step: 70, epoch: 35:   7%|▋         | 72/1000 [00:28<06:01,  2.57it/s]\n# PTI :step: 71, epoch: 35:   7%|▋         | 72/1000 [00:28<06:01,  2.57it/s]\n# PTI :step: 71, epoch: 35:   7%|▋         | 73/1000 [00:28<06:00,  2.57it/s]\n# PTI :step: 72, epoch: 36:   7%|▋         | 73/1000 [00:28<06:00,  2.57it/s]\n# PTI :step: 72, epoch: 36:   7%|▋         | 74/1000 [00:29<06:02,  2.55it/s]\n# PTI :step: 73, epoch: 36:   7%|▋         | 74/1000 [00:29<06:02,  2.55it/s]\n# PTI :step: 73, epoch: 36:   8%|▊         | 75/1000 [00:29<06:02,  2.55it/s]\n# PTI :step: 74, epoch: 37:   8%|▊         | 75/1000 [00:29<06:02,  2.55it/s]\n# PTI :step: 74, epoch: 37:   8%|▊         | 76/1000 [00:29<06:03,  2.54it/s]\n# PTI :step: 75, epoch: 37:   8%|▊         | 76/1000 [00:29<06:03,  2.54it/s]\n# PTI :step: 75, epoch: 37:   8%|▊         | 77/1000 [00:30<05:57,  2.58it/s]\n# PTI :step: 76, epoch: 38:   8%|▊         | 77/1000 [00:30<05:57,  2.58it/s]\n# PTI :step: 76, epoch: 38:   8%|▊         | 78/1000 [00:30<06:02,  2.55it/s]\n# PTI :step: 77, epoch: 38:   8%|▊         | 78/1000 [00:30<06:02,  2.55it/s]\n# PTI :step: 77, epoch: 38:   8%|▊         | 79/1000 [00:31<05:59,  2.56it/s]\n# PTI :step: 78, epoch: 39:   8%|▊         | 79/1000 [00:31<05:59,  2.56it/s]\n# PTI :step: 78, epoch: 39:   8%|▊         | 80/1000 [00:31<06:01,  2.54it/s]\n# PTI :step: 79, epoch: 39:   8%|▊         | 80/1000 [00:31<06:01,  2.54it/s]\n# PTI :step: 79, epoch: 39:   8%|▊         | 81/1000 [00:31<05:56,  2.58it/s]\n# PTI :step: 80, epoch: 40:   8%|▊         | 81/1000 [00:31<05:56,  2.58it/s]\n# PTI :step: 80, epoch: 40:   8%|▊         | 82/1000 [00:32<05:58,  2.56it/s]\n# PTI :step: 81, epoch: 40:   8%|▊         | 82/1000 [00:32<05:58,  2.56it/s]\n# PTI :step: 81, epoch: 40:   8%|▊         | 83/1000 [00:32<05:56,  2.57it/s]\n# PTI :step: 82, epoch: 41:   8%|▊         | 83/1000 [00:32<05:56,  2.57it/s]\n# PTI :step: 82, epoch: 41:   8%|▊         | 84/1000 [00:32<06:00,  2.54it/s]\n# PTI :step: 83, epoch: 41:   8%|▊         | 84/1000 [00:32<06:00,  2.54it/s]\n# PTI :step: 83, epoch: 41:   8%|▊         | 85/1000 [00:33<05:55,  2.58it/s]\n# PTI :step: 84, epoch: 42:   8%|▊         | 85/1000 [00:33<05:55,  2.58it/s]\n# PTI :step: 84, epoch: 42:   9%|▊         | 86/1000 [00:33<06:01,  2.53it/s]\n# PTI :step: 85, epoch: 42:   9%|▊         | 86/1000 [00:33<06:01,  2.53it/s]\n# PTI :step: 85, epoch: 42:   9%|▊         | 87/1000 [00:34<05:56,  2.56it/s]\n# PTI :step: 86, epoch: 43:   9%|▊         | 87/1000 [00:34<05:56,  2.56it/s]\n# PTI :step: 86, epoch: 43:   9%|▉         | 88/1000 [00:34<05:57,  2.55it/s]\n# PTI :step: 87, epoch: 43:   9%|▉         | 88/1000 [00:34<05:57,  2.55it/s]\n# PTI :step: 87, epoch: 43:   9%|▉         | 89/1000 [00:34<05:52,  2.58it/s]\n# PTI :step: 88, epoch: 44:   9%|▉         | 89/1000 [00:34<05:52,  2.58it/s]\n# PTI :step: 88, epoch: 44:   9%|▉         | 90/1000 [00:35<05:54,  2.57it/s]\n# PTI :step: 89, epoch: 44:   9%|▉         | 90/1000 [00:35<05:54,  2.57it/s]\n# PTI :step: 89, epoch: 44:   9%|▉         | 91/1000 [00:35<05:54,  2.56it/s]\n# PTI :step: 90, epoch: 45:   9%|▉         | 91/1000 [00:35<05:54,  2.56it/s]\n# PTI :step: 90, epoch: 45:   9%|▉         | 92/1000 [00:36<05:56,  2.55it/s]\n# PTI :step: 91, epoch: 45:   9%|▉         | 92/1000 [00:36<05:56,  2.55it/s]\n# PTI :step: 91, epoch: 45:   9%|▉         | 93/1000 [00:36<05:53,  2.56it/s]\n# PTI :step: 92, epoch: 46:   9%|▉         | 93/1000 [00:36<05:53,  2.56it/s]\n# PTI :step: 92, epoch: 46:   9%|▉         | 94/1000 [00:36<05:56,  2.54it/s]\n# PTI :step: 93, epoch: 46:   9%|▉         | 94/1000 [00:36<05:56,  2.54it/s]\n# PTI :step: 93, epoch: 46:  10%|▉         | 95/1000 [00:37<05:51,  2.58it/s]\n# PTI :step: 94, epoch: 47:  10%|▉         | 95/1000 [00:37<05:51,  2.58it/s]\n# PTI :step: 94, epoch: 47:  10%|▉         | 96/1000 [00:37<05:56,  2.54it/s]\n# PTI :step: 95, epoch: 47:  10%|▉         | 96/1000 [00:37<05:56,  2.54it/s]\n# PTI :step: 95, epoch: 47:  10%|▉         | 97/1000 [00:38<05:51,  2.57it/s]\n# PTI :step: 96, epoch: 48:  10%|▉         | 97/1000 [00:38<05:51,  2.57it/s]\n# PTI :step: 96, epoch: 48:  10%|▉         | 98/1000 [00:38<05:52,  2.56it/s]\n# PTI :step: 97, epoch: 48:  10%|▉         | 98/1000 [00:38<05:52,  2.56it/s]\n# PTI :step: 97, epoch: 48:  10%|▉         | 99/1000 [00:38<05:50,  2.57it/s]\n# PTI :step: 98, epoch: 49:  10%|▉         | 99/1000 [00:38<05:50,  2.57it/s]\n# PTI :step: 98, epoch: 49:  10%|█         | 100/1000 [00:39<06:25,  2.33it/s]\n# PTI :step: 99, epoch: 49:  10%|█         | 100/1000 [00:39<06:25,  2.33it/s]\n# PTI :step: 99, epoch: 49:  10%|█         | 101/1000 [00:39<06:15,  2.39it/s]\n# PTI :step: 100, epoch: 50:  10%|█         | 101/1000 [00:39<06:15,  2.39it/s]\n# PTI :step: 100, epoch: 50:  10%|█         | 102/1000 [00:40<06:09,  2.43it/s]\n# PTI :step: 101, epoch: 50:  10%|█         | 102/1000 [00:40<06:09,  2.43it/s]\n# PTI :step: 101, epoch: 50:  10%|█         | 103/1000 [00:40<06:00,  2.49it/s]\n# PTI :step: 102, epoch: 51:  10%|█         | 103/1000 [00:40<06:00,  2.49it/s]\n# PTI :step: 102, epoch: 51:  10%|█         | 104/1000 [00:40<05:58,  2.50it/s]\n# PTI :step: 103, epoch: 51:  10%|█         | 104/1000 [00:40<05:58,  2.50it/s]\n# PTI :step: 103, epoch: 51:  10%|█         | 105/1000 [00:41<05:52,  2.54it/s]\n# PTI :step: 104, epoch: 52:  10%|█         | 105/1000 [00:41<05:52,  2.54it/s]\n# PTI :step: 104, epoch: 52:  11%|█         | 106/1000 [00:41<05:56,  2.51it/s]\n# PTI :step: 105, epoch: 52:  11%|█         | 106/1000 [00:41<05:56,  2.51it/s]\n# PTI :step: 105, epoch: 52:  11%|█         | 107/1000 [00:42<05:50,  2.55it/s]\n# PTI :step: 106, epoch: 53:  11%|█         | 107/1000 [00:42<05:50,  2.55it/s]\n# PTI :step: 106, epoch: 53:  11%|█         | 108/1000 [00:42<05:51,  2.54it/s]\n# PTI :step: 107, epoch: 53:  11%|█         | 108/1000 [00:42<05:51,  2.54it/s]\n# PTI :step: 107, epoch: 53:  11%|█         | 109/1000 [00:42<05:45,  2.58it/s]\n# PTI :step: 108, epoch: 54:  11%|█         | 109/1000 [00:42<05:45,  2.58it/s]\n# PTI :step: 108, epoch: 54:  11%|█         | 110/1000 [00:43<05:47,  2.56it/s]\n# PTI :step: 109, epoch: 54:  11%|█         | 110/1000 [00:43<05:47,  2.56it/s]\n# PTI :step: 109, epoch: 54:  11%|█         | 111/1000 [00:43<05:46,  2.57it/s]\n# PTI :step: 110, epoch: 55:  11%|█         | 111/1000 [00:43<05:46,  2.57it/s]\n# PTI :step: 110, epoch: 55:  11%|█         | 112/1000 [00:44<05:48,  2.55it/s]\n# PTI :step: 111, epoch: 55:  11%|█         | 112/1000 [00:44<05:48,  2.55it/s]\n# PTI :step: 111, epoch: 55:  11%|█▏        | 113/1000 [00:44<05:43,  2.58it/s]\n# PTI :step: 112, epoch: 56:  11%|█▏        | 113/1000 [00:44<05:43,  2.58it/s]\n# PTI :step: 112, epoch: 56:  11%|█▏        | 114/1000 [00:44<05:46,  2.56it/s]\n# PTI :step: 113, epoch: 56:  11%|█▏        | 114/1000 [00:44<05:46,  2.56it/s]\n# PTI :step: 113, epoch: 56:  12%|█▏        | 115/1000 [00:45<05:42,  2.58it/s]\n# PTI :step: 114, epoch: 57:  12%|█▏        | 115/1000 [00:45<05:42,  2.58it/s]\n# PTI :step: 114, epoch: 57:  12%|█▏        | 116/1000 [00:45<05:45,  2.56it/s]\n# PTI :step: 115, epoch: 57:  12%|█▏        | 116/1000 [00:45<05:45,  2.56it/s]\n# PTI :step: 115, epoch: 57:  12%|█▏        | 117/1000 [00:45<05:42,  2.58it/s]\n# PTI :step: 116, epoch: 58:  12%|█▏        | 117/1000 [00:45<05:42,  2.58it/s]\n# PTI :step: 116, epoch: 58:  12%|█▏        | 118/1000 [00:46<05:43,  2.57it/s]\n# PTI :step: 117, epoch: 58:  12%|█▏        | 118/1000 [00:46<05:43,  2.57it/s]\n# PTI :step: 117, epoch: 58:  12%|█▏        | 119/1000 [00:46<05:42,  2.57it/s]\n# PTI :step: 118, epoch: 59:  12%|█▏        | 119/1000 [00:46<05:42,  2.57it/s]\n# PTI :step: 118, epoch: 59:  12%|█▏        | 120/1000 [00:47<05:44,  2.55it/s]\n# PTI :step: 119, epoch: 59:  12%|█▏        | 120/1000 [00:47<05:44,  2.55it/s]\n# PTI :step: 119, epoch: 59:  12%|█▏        | 121/1000 [00:47<05:41,  2.58it/s]\n# PTI :step: 120, epoch: 60:  12%|█▏        | 121/1000 [00:47<05:41,  2.58it/s]\n# PTI :step: 120, epoch: 60:  12%|█▏        | 122/1000 [00:47<05:43,  2.55it/s]\n# PTI :step: 121, epoch: 60:  12%|█▏        | 122/1000 [00:47<05:43,  2.55it/s]\n# PTI :step: 121, epoch: 60:  12%|█▏        | 123/1000 [00:48<05:39,  2.58it/s]\n# PTI :step: 122, epoch: 61:  12%|█▏        | 123/1000 [00:48<05:39,  2.58it/s]\n# PTI :step: 122, epoch: 61:  12%|█▏        | 124/1000 [00:48<05:45,  2.54it/s]\n# PTI :step: 123, epoch: 61:  12%|█▏        | 124/1000 [00:48<05:45,  2.54it/s]\n# PTI :step: 123, epoch: 61:  12%|█▎        | 125/1000 [00:49<05:40,  2.57it/s]\n# PTI :step: 124, epoch: 62:  12%|█▎        | 125/1000 [00:49<05:40,  2.57it/s]\n# PTI :step: 124, epoch: 62:  13%|█▎        | 126/1000 [00:49<05:42,  2.55it/s]\n# PTI :step: 125, epoch: 62:  13%|█▎        | 126/1000 [00:49<05:42,  2.55it/s]\n# PTI :step: 125, epoch: 62:  13%|█▎        | 127/1000 [00:49<05:39,  2.57it/s]\n# PTI :step: 126, epoch: 63:  13%|█▎        | 127/1000 [00:49<05:39,  2.57it/s]\n# PTI :step: 126, epoch: 63:  13%|█▎        | 128/1000 [00:50<05:41,  2.56it/s]\n# PTI :step: 127, epoch: 63:  13%|█▎        | 128/1000 [00:50<05:41,  2.56it/s]\n# PTI :step: 127, epoch: 63:  13%|█▎        | 129/1000 [00:50<05:39,  2.56it/s]\n# PTI :step: 128, epoch: 64:  13%|█▎        | 129/1000 [00:50<05:39,  2.56it/s]\n# PTI :step: 128, epoch: 64:  13%|█▎        | 130/1000 [00:51<05:41,  2.55it/s]\n# PTI :step: 129, epoch: 64:  13%|█▎        | 130/1000 [00:51<05:41,  2.55it/s]\n# PTI :step: 129, epoch: 64:  13%|█▎        | 131/1000 [00:51<05:37,  2.58it/s]\n# PTI :step: 130, epoch: 65:  13%|█▎        | 131/1000 [00:51<05:37,  2.58it/s]\n# PTI :step: 130, epoch: 65:  13%|█▎        | 132/1000 [00:51<05:41,  2.54it/s]\n# PTI :step: 131, epoch: 65:  13%|█▎        | 132/1000 [00:51<05:41,  2.54it/s]\n# PTI :step: 131, epoch: 65:  13%|█▎        | 133/1000 [00:52<05:38,  2.56it/s]\n# PTI :step: 132, epoch: 66:  13%|█▎        | 133/1000 [00:52<05:38,  2.56it/s]\n# PTI :step: 132, epoch: 66:  13%|█▎        | 134/1000 [00:52<05:40,  2.54it/s]\n# PTI :step: 133, epoch: 66:  13%|█▎        | 134/1000 [00:52<05:40,  2.54it/s]\n# PTI :step: 133, epoch: 66:  14%|█▎        | 135/1000 [00:53<05:35,  2.58it/s]\n# PTI :step: 134, epoch: 67:  14%|█▎        | 135/1000 [00:53<05:35,  2.58it/s]\n# PTI :step: 134, epoch: 67:  14%|█▎        | 136/1000 [00:53<05:38,  2.55it/s]\n# PTI :step: 135, epoch: 67:  14%|█▎        | 136/1000 [00:53<05:38,  2.55it/s]\n# PTI :step: 135, epoch: 67:  14%|█▎        | 137/1000 [00:53<05:37,  2.56it/s]\n# PTI :step: 136, epoch: 68:  14%|█▎        | 137/1000 [00:53<05:37,  2.56it/s]\n# PTI :step: 136, epoch: 68:  14%|█▍        | 138/1000 [00:54<05:38,  2.54it/s]\n# PTI :step: 137, epoch: 68:  14%|█▍        | 138/1000 [00:54<05:38,  2.54it/s]\n# PTI :step: 137, epoch: 68:  14%|█▍        | 139/1000 [00:54<05:35,  2.57it/s]\n# PTI :step: 138, epoch: 69:  14%|█▍        | 139/1000 [00:54<05:35,  2.57it/s]\n# PTI :step: 138, epoch: 69:  14%|█▍        | 140/1000 [00:54<05:37,  2.54it/s]\n# PTI :step: 139, epoch: 69:  14%|█▍        | 140/1000 [00:54<05:37,  2.54it/s]\n# PTI :step: 139, epoch: 69:  14%|█▍        | 141/1000 [00:55<05:33,  2.57it/s]\n# PTI :step: 140, epoch: 70:  14%|█▍        | 141/1000 [00:55<05:33,  2.57it/s]\n# PTI :step: 140, epoch: 70:  14%|█▍        | 142/1000 [00:55<05:36,  2.55it/s]\n# PTI :step: 141, epoch: 70:  14%|█▍        | 142/1000 [00:55<05:36,  2.55it/s]\n# PTI :step: 141, epoch: 70:  14%|█▍        | 143/1000 [00:56<05:34,  2.56it/s]\n# PTI :step: 142, epoch: 71:  14%|█▍        | 143/1000 [00:56<05:34,  2.56it/s]\n# PTI :step: 142, epoch: 71:  14%|█▍        | 144/1000 [00:56<05:36,  2.54it/s]\n# PTI :step: 143, epoch: 71:  14%|█▍        | 144/1000 [00:56<05:36,  2.54it/s]\n# PTI :step: 143, epoch: 71:  14%|█▍        | 145/1000 [00:56<05:35,  2.55it/s]\n# PTI :step: 144, epoch: 72:  14%|█▍        | 145/1000 [00:56<05:35,  2.55it/s]\n# PTI :step: 144, epoch: 72:  15%|█▍        | 146/1000 [00:57<05:39,  2.52it/s]\n# PTI :step: 145, epoch: 72:  15%|█▍        | 146/1000 [00:57<05:39,  2.52it/s]\n# PTI :step: 145, epoch: 72:  15%|█▍        | 147/1000 [00:57<05:34,  2.55it/s]\n# PTI :step: 146, epoch: 73:  15%|█▍        | 147/1000 [00:57<05:34,  2.55it/s]\n# PTI :step: 146, epoch: 73:  15%|█▍        | 148/1000 [00:58<05:36,  2.53it/s]\n# PTI :step: 147, epoch: 73:  15%|█▍        | 148/1000 [00:58<05:36,  2.53it/s]\n# PTI :step: 147, epoch: 73:  15%|█▍        | 149/1000 [00:58<05:35,  2.53it/s]\n# PTI :step: 148, epoch: 74:  15%|█▍        | 149/1000 [00:58<05:35,  2.53it/s]\n# PTI :step: 148, epoch: 74:  15%|█▌        | 150/1000 [00:58<05:36,  2.53it/s]\n# PTI :step: 149, epoch: 74:  15%|█▌        | 150/1000 [00:58<05:36,  2.53it/s]\n# PTI :step: 149, epoch: 74:  15%|█▌        | 151/1000 [00:59<05:31,  2.56it/s]\n# PTI :step: 150, epoch: 75:  15%|█▌        | 151/1000 [00:59<05:31,  2.56it/s]\n# PTI :step: 150, epoch: 75:  15%|█▌        | 152/1000 [00:59<05:33,  2.54it/s]\n# PTI :step: 151, epoch: 75:  15%|█▌        | 152/1000 [00:59<05:33,  2.54it/s]\n# PTI :step: 151, epoch: 75:  15%|█▌        | 153/1000 [01:00<05:29,  2.57it/s]\n# PTI :step: 152, epoch: 76:  15%|█▌        | 153/1000 [01:00<05:29,  2.57it/s]\n# PTI :step: 152, epoch: 76:  15%|█▌        | 154/1000 [01:00<05:31,  2.55it/s]\n# PTI :step: 153, epoch: 76:  15%|█▌        | 154/1000 [01:00<05:31,  2.55it/s]\n# PTI :step: 153, epoch: 76:  16%|█▌        | 155/1000 [01:00<05:27,  2.58it/s]\n# PTI :step: 154, epoch: 77:  16%|█▌        | 155/1000 [01:00<05:27,  2.58it/s]\n# PTI :step: 154, epoch: 77:  16%|█▌        | 156/1000 [01:01<05:29,  2.56it/s]\n# PTI :step: 155, epoch: 77:  16%|█▌        | 156/1000 [01:01<05:29,  2.56it/s]\n# PTI :step: 155, epoch: 77:  16%|█▌        | 157/1000 [01:01<05:26,  2.58it/s]\n# PTI :step: 156, epoch: 78:  16%|█▌        | 157/1000 [01:01<05:26,  2.58it/s]\n# PTI :step: 156, epoch: 78:  16%|█▌        | 158/1000 [01:02<05:29,  2.56it/s]\n# PTI :step: 157, epoch: 78:  16%|█▌        | 158/1000 [01:02<05:29,  2.56it/s]\n# PTI :step: 157, epoch: 78:  16%|█▌        | 159/1000 [01:02<05:27,  2.57it/s]\n# PTI :step: 158, epoch: 79:  16%|█▌        | 159/1000 [01:02<05:27,  2.57it/s]\n# PTI :step: 158, epoch: 79:  16%|█▌        | 160/1000 [01:02<05:29,  2.55it/s]\n# PTI :step: 159, epoch: 79:  16%|█▌        | 160/1000 [01:02<05:29,  2.55it/s]\n# PTI :step: 159, epoch: 79:  16%|█▌        | 161/1000 [01:03<05:25,  2.58it/s]\n# PTI :step: 160, epoch: 80:  16%|█▌        | 161/1000 [01:03<05:25,  2.58it/s]\n# PTI :step: 160, epoch: 80:  16%|█▌        | 162/1000 [01:03<05:27,  2.56it/s]\n# PTI :step: 161, epoch: 80:  16%|█▌        | 162/1000 [01:03<05:27,  2.56it/s]\n# PTI :step: 161, epoch: 80:  16%|█▋        | 163/1000 [01:03<05:23,  2.59it/s]\n# PTI :step: 162, epoch: 81:  16%|█▋        | 163/1000 [01:03<05:23,  2.59it/s]\n# PTI :step: 162, epoch: 81:  16%|█▋        | 164/1000 [01:04<05:25,  2.57it/s]\n# PTI :step: 163, epoch: 81:  16%|█▋        | 164/1000 [01:04<05:25,  2.57it/s]\n# PTI :step: 163, epoch: 81:  16%|█▋        | 165/1000 [01:04<05:27,  2.55it/s]\n# PTI :step: 164, epoch: 82:  16%|█▋        | 165/1000 [01:04<05:27,  2.55it/s]\n# PTI :step: 164, epoch: 82:  17%|█▋        | 166/1000 [01:05<05:28,  2.54it/s]\n# PTI :step: 165, epoch: 82:  17%|█▋        | 166/1000 [01:05<05:28,  2.54it/s]\n# PTI :step: 165, epoch: 82:  17%|█▋        | 167/1000 [01:05<05:24,  2.57it/s]\n# PTI :step: 166, epoch: 83:  17%|█▋        | 167/1000 [01:05<05:24,  2.57it/s]\n# PTI :step: 166, epoch: 83:  17%|█▋        | 168/1000 [01:05<05:25,  2.56it/s]\n# PTI :step: 167, epoch: 83:  17%|█▋        | 168/1000 [01:05<05:25,  2.56it/s]\n# PTI :step: 167, epoch: 83:  17%|█▋        | 169/1000 [01:06<05:21,  2.58it/s]\n# PTI :step: 168, epoch: 84:  17%|█▋        | 169/1000 [01:06<05:21,  2.58it/s]\n# PTI :step: 168, epoch: 84:  17%|█▋        | 170/1000 [01:06<05:26,  2.54it/s]\n# PTI :step: 169, epoch: 84:  17%|█▋        | 170/1000 [01:06<05:26,  2.54it/s]\n# PTI :step: 169, epoch: 84:  17%|█▋        | 171/1000 [01:07<05:22,  2.57it/s]\n# PTI :step: 170, epoch: 85:  17%|█▋        | 171/1000 [01:07<05:22,  2.57it/s]\n# PTI :step: 170, epoch: 85:  17%|█▋        | 172/1000 [01:07<05:24,  2.55it/s]\n# PTI :step: 171, epoch: 85:  17%|█▋        | 172/1000 [01:07<05:24,  2.55it/s]\n# PTI :step: 171, epoch: 85:  17%|█▋        | 173/1000 [01:07<05:19,  2.59it/s]\n# PTI :step: 172, epoch: 86:  17%|█▋        | 173/1000 [01:07<05:19,  2.59it/s]\n# PTI :step: 172, epoch: 86:  17%|█▋        | 174/1000 [01:08<05:21,  2.57it/s]\n# PTI :step: 173, epoch: 86:  17%|█▋        | 174/1000 [01:08<05:21,  2.57it/s]\n# PTI :step: 173, epoch: 86:  18%|█▊        | 175/1000 [01:08<05:19,  2.58it/s]\n# PTI :step: 174, epoch: 87:  18%|█▊        | 175/1000 [01:08<05:19,  2.58it/s]\n# PTI :step: 174, epoch: 87:  18%|█▊        | 176/1000 [01:09<05:21,  2.56it/s]\n# PTI :step: 175, epoch: 87:  18%|█▊        | 176/1000 [01:09<05:21,  2.56it/s]\n# PTI :step: 175, epoch: 87:  18%|█▊        | 177/1000 [01:09<05:21,  2.56it/s]\n# PTI :step: 176, epoch: 88:  18%|█▊        | 177/1000 [01:09<05:21,  2.56it/s]\n# PTI :step: 176, epoch: 88:  18%|█▊        | 178/1000 [01:09<05:24,  2.53it/s]\n# PTI :step: 177, epoch: 88:  18%|█▊        | 178/1000 [01:09<05:24,  2.53it/s]\n# PTI :step: 177, epoch: 88:  18%|█▊        | 179/1000 [01:10<05:20,  2.56it/s]\n# PTI :step: 178, epoch: 89:  18%|█▊        | 179/1000 [01:10<05:20,  2.56it/s]\n# PTI :step: 178, epoch: 89:  18%|█▊        | 180/1000 [01:10<05:24,  2.53it/s]\n# PTI :step: 179, epoch: 89:  18%|█▊        | 180/1000 [01:10<05:24,  2.53it/s]\n# PTI :step: 179, epoch: 89:  18%|█▊        | 181/1000 [01:11<05:19,  2.57it/s]\n# PTI :step: 180, epoch: 90:  18%|█▊        | 181/1000 [01:11<05:19,  2.57it/s]\n# PTI :step: 180, epoch: 90:  18%|█▊        | 182/1000 [01:11<05:20,  2.55it/s]\n# PTI :step: 181, epoch: 90:  18%|█▊        | 182/1000 [01:11<05:20,  2.55it/s]\n# PTI :step: 181, epoch: 90:  18%|█▊        | 183/1000 [01:11<05:17,  2.57it/s]\n# PTI :step: 182, epoch: 91:  18%|█▊        | 183/1000 [01:11<05:17,  2.57it/s]\n# PTI :step: 182, epoch: 91:  18%|█▊        | 184/1000 [01:12<05:19,  2.56it/s]\n# PTI :step: 183, epoch: 91:  18%|█▊        | 184/1000 [01:12<05:19,  2.56it/s]\n# PTI :step: 183, epoch: 91:  18%|█▊        | 185/1000 [01:12<05:15,  2.58it/s]\n# PTI :step: 184, epoch: 92:  18%|█▊        | 185/1000 [01:12<05:15,  2.58it/s]\n# PTI :step: 184, epoch: 92:  19%|█▊        | 186/1000 [01:12<05:17,  2.57it/s]\n# PTI :step: 185, epoch: 92:  19%|█▊        | 186/1000 [01:12<05:17,  2.57it/s]\n# PTI :step: 185, epoch: 92:  19%|█▊        | 187/1000 [01:13<05:13,  2.60it/s]\n# PTI :step: 186, epoch: 93:  19%|█▊        | 187/1000 [01:13<05:13,  2.60it/s]\n# PTI :step: 186, epoch: 93:  19%|█▉        | 188/1000 [01:13<05:18,  2.55it/s]\n# PTI :step: 187, epoch: 93:  19%|█▉        | 188/1000 [01:13<05:18,  2.55it/s]\n# PTI :step: 187, epoch: 93:  19%|█▉        | 189/1000 [01:14<05:14,  2.58it/s]\n# PTI :step: 188, epoch: 94:  19%|█▉        | 189/1000 [01:14<05:14,  2.58it/s]\n# PTI :step: 188, epoch: 94:  19%|█▉        | 190/1000 [01:14<05:16,  2.56it/s]\n# PTI :step: 189, epoch: 94:  19%|█▉        | 190/1000 [01:14<05:16,  2.56it/s]\n# PTI :step: 189, epoch: 94:  19%|█▉        | 191/1000 [01:14<05:12,  2.59it/s]\n# PTI :step: 190, epoch: 95:  19%|█▉        | 191/1000 [01:14<05:12,  2.59it/s]\n# PTI :step: 190, epoch: 95:  19%|█▉        | 192/1000 [01:15<05:15,  2.56it/s]\n# PTI :step: 191, epoch: 95:  19%|█▉        | 192/1000 [01:15<05:15,  2.56it/s]\n# PTI :step: 191, epoch: 95:  19%|█▉        | 193/1000 [01:15<05:13,  2.57it/s]\n# PTI :step: 192, epoch: 96:  19%|█▉        | 193/1000 [01:15<05:13,  2.57it/s]\n# PTI :step: 192, epoch: 96:  19%|█▉        | 194/1000 [01:16<05:15,  2.55it/s]\n# PTI :step: 193, epoch: 96:  19%|█▉        | 194/1000 [01:16<05:15,  2.55it/s]\n# PTI :step: 193, epoch: 96:  20%|█▉        | 195/1000 [01:16<05:15,  2.55it/s]\n# PTI :step: 194, epoch: 97:  20%|█▉        | 195/1000 [01:16<05:15,  2.55it/s]\n# PTI :step: 194, epoch: 97:  20%|█▉        | 196/1000 [01:16<05:17,  2.53it/s]\n# PTI :step: 195, epoch: 97:  20%|█▉        | 196/1000 [01:16<05:17,  2.53it/s]\n# PTI :step: 195, epoch: 97:  20%|█▉        | 197/1000 [01:17<05:12,  2.57it/s]\n# PTI :step: 196, epoch: 98:  20%|█▉        | 197/1000 [01:17<05:12,  2.57it/s]\n# PTI :step: 196, epoch: 98:  20%|█▉        | 198/1000 [01:17<05:16,  2.54it/s]\n# PTI :step: 197, epoch: 98:  20%|█▉        | 198/1000 [01:17<05:16,  2.54it/s]\n# PTI :step: 197, epoch: 98:  20%|█▉        | 199/1000 [01:18<05:12,  2.57it/s]\n# PTI :step: 198, epoch: 99:  20%|█▉        | 199/1000 [01:18<05:12,  2.57it/s]\n# PTI :step: 198, epoch: 99:  20%|██        | 200/1000 [01:18<05:13,  2.55it/s]\n# PTI :step: 199, epoch: 99:  20%|██        | 200/1000 [01:18<05:13,  2.55it/s]\n# PTI :step: 199, epoch: 99:  20%|██        | 201/1000 [01:18<05:10,  2.57it/s]\n# PTI :step: 200, epoch: 100:  20%|██        | 201/1000 [01:18<05:10,  2.57it/s]\n# PTI :step: 200, epoch: 100:  20%|██        | 202/1000 [01:19<05:12,  2.55it/s]\n# PTI :step: 201, epoch: 100:  20%|██        | 202/1000 [01:19<05:12,  2.55it/s]\n# PTI :step: 201, epoch: 100:  20%|██        | 203/1000 [01:19<05:11,  2.56it/s]\n# PTI :step: 202, epoch: 101:  20%|██        | 203/1000 [01:19<05:11,  2.56it/s]\n# PTI :step: 202, epoch: 101:  20%|██        | 204/1000 [01:19<05:12,  2.54it/s]\n# PTI :step: 203, epoch: 101:  20%|██        | 204/1000 [01:19<05:12,  2.54it/s]\n# PTI :step: 203, epoch: 101:  20%|██        | 205/1000 [01:20<05:08,  2.58it/s]\n# PTI :step: 204, epoch: 102:  20%|██        | 205/1000 [01:20<05:08,  2.58it/s]\n# PTI :step: 204, epoch: 102:  21%|██        | 206/1000 [01:20<05:13,  2.53it/s]\n# PTI :step: 205, epoch: 102:  21%|██        | 206/1000 [01:20<05:13,  2.53it/s]\n# PTI :step: 205, epoch: 102:  21%|██        | 207/1000 [01:21<05:09,  2.56it/s]\n# PTI :step: 206, epoch: 103:  21%|██        | 207/1000 [01:21<05:09,  2.56it/s]\n# PTI :step: 206, epoch: 103:  21%|██        | 208/1000 [01:21<05:11,  2.54it/s]\n# PTI :step: 207, epoch: 103:  21%|██        | 208/1000 [01:21<05:11,  2.54it/s]\n# PTI :step: 207, epoch: 103:  21%|██        | 209/1000 [01:21<05:07,  2.58it/s]\n# PTI :step: 208, epoch: 104:  21%|██        | 209/1000 [01:21<05:07,  2.58it/s]\n# PTI :step: 208, epoch: 104:  21%|██        | 210/1000 [01:22<05:08,  2.56it/s]\n# PTI :step: 209, epoch: 104:  21%|██        | 210/1000 [01:22<05:08,  2.56it/s]\n# PTI :step: 209, epoch: 104:  21%|██        | 211/1000 [01:22<05:06,  2.57it/s]\n# PTI :step: 210, epoch: 105:  21%|██        | 211/1000 [01:22<05:06,  2.57it/s]\n# PTI :step: 210, epoch: 105:  21%|██        | 212/1000 [01:23<05:09,  2.55it/s]\n# PTI :step: 211, epoch: 105:  21%|██        | 212/1000 [01:23<05:09,  2.55it/s]\n# PTI :step: 211, epoch: 105:  21%|██▏       | 213/1000 [01:23<05:06,  2.57it/s]\n# PTI :step: 212, epoch: 106:  21%|██▏       | 213/1000 [01:23<05:06,  2.57it/s]\n# PTI :step: 212, epoch: 106:  21%|██▏       | 214/1000 [01:23<05:09,  2.54it/s]\n# PTI :step: 213, epoch: 106:  21%|██▏       | 214/1000 [01:23<05:09,  2.54it/s]\n# PTI :step: 213, epoch: 106:  22%|██▏       | 215/1000 [01:24<05:05,  2.57it/s]\n# PTI :step: 214, epoch: 107:  22%|██▏       | 215/1000 [01:24<05:05,  2.57it/s]\n# PTI :step: 214, epoch: 107:  22%|██▏       | 216/1000 [01:24<05:07,  2.55it/s]\n# PTI :step: 215, epoch: 107:  22%|██▏       | 216/1000 [01:24<05:07,  2.55it/s]\n# PTI :step: 215, epoch: 107:  22%|██▏       | 217/1000 [01:25<05:03,  2.58it/s]\n# PTI :step: 216, epoch: 108:  22%|██▏       | 217/1000 [01:25<05:03,  2.58it/s]\n# PTI :step: 216, epoch: 108:  22%|██▏       | 218/1000 [01:25<05:06,  2.55it/s]\n# PTI :step: 217, epoch: 108:  22%|██▏       | 218/1000 [01:25<05:06,  2.55it/s]\n# PTI :step: 217, epoch: 108:  22%|██▏       | 219/1000 [01:25<05:08,  2.53it/s]\n# PTI :step: 218, epoch: 109:  22%|██▏       | 219/1000 [01:25<05:08,  2.53it/s]\n# PTI :step: 218, epoch: 109:  22%|██▏       | 220/1000 [01:26<05:09,  2.52it/s]\n# PTI :step: 219, epoch: 109:  22%|██▏       | 220/1000 [01:26<05:09,  2.52it/s]\n# PTI :step: 219, epoch: 109:  22%|██▏       | 221/1000 [01:26<05:07,  2.53it/s]\n# PTI :step: 220, epoch: 110:  22%|██▏       | 221/1000 [01:26<05:07,  2.53it/s]\n# PTI :step: 220, epoch: 110:  22%|██▏       | 222/1000 [01:27<05:08,  2.52it/s]\n# PTI :step: 221, epoch: 110:  22%|██▏       | 222/1000 [01:27<05:08,  2.52it/s]\n# PTI :step: 221, epoch: 110:  22%|██▏       | 223/1000 [01:27<05:04,  2.55it/s]\n# PTI :step: 222, epoch: 111:  22%|██▏       | 223/1000 [01:27<05:04,  2.55it/s]\n# PTI :step: 222, epoch: 111:  22%|██▏       | 224/1000 [01:27<05:06,  2.53it/s]\n# PTI :step: 223, epoch: 111:  22%|██▏       | 224/1000 [01:27<05:06,  2.53it/s]\n# PTI :step: 223, epoch: 111:  22%|██▎       | 225/1000 [01:28<05:04,  2.55it/s]\n# PTI :step: 224, epoch: 112:  22%|██▎       | 225/1000 [01:28<05:04,  2.55it/s]\n# PTI :step: 224, epoch: 112:  23%|██▎       | 226/1000 [01:28<05:06,  2.53it/s]\n# PTI :step: 225, epoch: 112:  23%|██▎       | 226/1000 [01:28<05:06,  2.53it/s]\n# PTI :step: 225, epoch: 112:  23%|██▎       | 227/1000 [01:29<05:01,  2.56it/s]\n# PTI :step: 226, epoch: 113:  23%|██▎       | 227/1000 [01:29<05:01,  2.56it/s]\n# PTI :step: 226, epoch: 113:  23%|██▎       | 228/1000 [01:29<05:03,  2.54it/s]\n# PTI :step: 227, epoch: 113:  23%|██▎       | 228/1000 [01:29<05:03,  2.54it/s]\n# PTI :step: 227, epoch: 113:  23%|██▎       | 229/1000 [01:29<05:00,  2.56it/s]\n# PTI :step: 228, epoch: 114:  23%|██▎       | 229/1000 [01:29<05:00,  2.56it/s]\n# PTI :step: 228, epoch: 114:  23%|██▎       | 230/1000 [01:30<05:02,  2.54it/s]\n# PTI :step: 229, epoch: 114:  23%|██▎       | 230/1000 [01:30<05:02,  2.54it/s]\n# PTI :step: 229, epoch: 114:  23%|██▎       | 231/1000 [01:30<05:02,  2.54it/s]\n# PTI :step: 230, epoch: 115:  23%|██▎       | 231/1000 [01:30<05:02,  2.54it/s]\n# PTI :step: 230, epoch: 115:  23%|██▎       | 232/1000 [01:30<05:05,  2.51it/s]\n# PTI :step: 231, epoch: 115:  23%|██▎       | 232/1000 [01:30<05:05,  2.51it/s]\n# PTI :step: 231, epoch: 115:  23%|██▎       | 233/1000 [01:31<05:02,  2.54it/s]\n# PTI :step: 232, epoch: 116:  23%|██▎       | 233/1000 [01:31<05:02,  2.54it/s]\n# PTI :step: 232, epoch: 116:  23%|██▎       | 234/1000 [01:31<05:03,  2.52it/s]\n# PTI :step: 233, epoch: 116:  23%|██▎       | 234/1000 [01:31<05:03,  2.52it/s]\n# PTI :step: 233, epoch: 116:  24%|██▎       | 235/1000 [01:32<04:59,  2.56it/s]\n# PTI :step: 234, epoch: 117:  24%|██▎       | 235/1000 [01:32<04:59,  2.56it/s]\n# PTI :step: 234, epoch: 117:  24%|██▎       | 236/1000 [01:32<05:00,  2.54it/s]\n# PTI :step: 235, epoch: 117:  24%|██▎       | 236/1000 [01:32<05:00,  2.54it/s]\n# PTI :step: 235, epoch: 117:  24%|██▎       | 237/1000 [01:32<04:56,  2.57it/s]\n# PTI :step: 236, epoch: 118:  24%|██▎       | 237/1000 [01:32<04:56,  2.57it/s]\n# PTI :step: 236, epoch: 118:  24%|██▍       | 238/1000 [01:33<04:58,  2.55it/s]\n# PTI :step: 237, epoch: 118:  24%|██▍       | 238/1000 [01:33<04:58,  2.55it/s]\n# PTI :step: 237, epoch: 118:  24%|██▍       | 239/1000 [01:33<04:56,  2.57it/s]\n# PTI :step: 238, epoch: 119:  24%|██▍       | 239/1000 [01:33<04:56,  2.57it/s]\n# PTI :step: 238, epoch: 119:  24%|██▍       | 240/1000 [01:34<04:58,  2.55it/s]\n# PTI :step: 239, epoch: 119:  24%|██▍       | 240/1000 [01:34<04:58,  2.55it/s]\n# PTI :step: 239, epoch: 119:  24%|██▍       | 241/1000 [01:34<04:55,  2.57it/s]\n# PTI :step: 240, epoch: 120:  24%|██▍       | 241/1000 [01:34<04:55,  2.57it/s]\n# PTI :step: 240, epoch: 120:  24%|██▍       | 242/1000 [01:34<04:56,  2.55it/s]\n# PTI :step: 241, epoch: 120:  24%|██▍       | 242/1000 [01:34<04:56,  2.55it/s]\n# PTI :step: 241, epoch: 120:  24%|██▍       | 243/1000 [01:35<04:53,  2.58it/s]\n# PTI :step: 242, epoch: 121:  24%|██▍       | 243/1000 [01:35<04:53,  2.58it/s]\n# PTI :step: 242, epoch: 121:  24%|██▍       | 244/1000 [01:35<04:56,  2.55it/s]\n# PTI :step: 243, epoch: 121:  24%|██▍       | 244/1000 [01:35<04:56,  2.55it/s]\n# PTI :step: 243, epoch: 121:  24%|██▍       | 245/1000 [01:36<04:53,  2.57it/s]\n# PTI :step: 244, epoch: 122:  24%|██▍       | 245/1000 [01:36<04:53,  2.57it/s]\n# PTI :step: 244, epoch: 122:  25%|██▍       | 246/1000 [01:36<04:55,  2.55it/s]\n# PTI :step: 245, epoch: 122:  25%|██▍       | 246/1000 [01:36<04:55,  2.55it/s]\n# PTI :step: 245, epoch: 122:  25%|██▍       | 247/1000 [01:36<04:52,  2.57it/s]\n# PTI :step: 246, epoch: 123:  25%|██▍       | 247/1000 [01:36<04:52,  2.57it/s]\n# PTI :step: 246, epoch: 123:  25%|██▍       | 248/1000 [01:37<04:54,  2.55it/s]\n# PTI :step: 247, epoch: 123:  25%|██▍       | 248/1000 [01:37<04:54,  2.55it/s]\n# PTI :step: 247, epoch: 123:  25%|██▍       | 249/1000 [01:37<04:52,  2.57it/s]\n# PTI :step: 248, epoch: 124:  25%|██▍       | 249/1000 [01:37<04:52,  2.57it/s]\n# PTI :step: 248, epoch: 124:  25%|██▌       | 250/1000 [01:38<04:53,  2.55it/s]\n# PTI :step: 249, epoch: 124:  25%|██▌       | 250/1000 [01:38<04:53,  2.55it/s]\n# PTI :step: 249, epoch: 124:  25%|██▌       | 251/1000 [01:38<04:51,  2.57it/s]\n# PTI :step: 250, epoch: 125:  25%|██▌       | 251/1000 [01:38<04:51,  2.57it/s]\n# PTI :step: 250, epoch: 125:  25%|██▌       | 252/1000 [01:38<04:53,  2.55it/s]\n# PTI :step: 251, epoch: 125:  25%|██▌       | 252/1000 [01:38<04:53,  2.55it/s]\n# PTI :step: 251, epoch: 125:  25%|██▌       | 253/1000 [01:39<04:50,  2.58it/s]\n# PTI :step: 252, epoch: 126:  25%|██▌       | 253/1000 [01:39<04:50,  2.58it/s]\n# PTI :step: 252, epoch: 126:  25%|██▌       | 254/1000 [01:39<04:52,  2.55it/s]\n# PTI :step: 253, epoch: 126:  25%|██▌       | 254/1000 [01:39<04:52,  2.55it/s]\n# PTI :step: 253, epoch: 126:  26%|██▌       | 255/1000 [01:39<04:49,  2.58it/s]\n# PTI :step: 254, epoch: 127:  26%|██▌       | 255/1000 [01:39<04:49,  2.58it/s]\n# PTI :step: 254, epoch: 127:  26%|██▌       | 256/1000 [01:40<04:51,  2.55it/s]\n# PTI :step: 255, epoch: 127:  26%|██▌       | 256/1000 [01:40<04:51,  2.55it/s]\n# PTI :step: 255, epoch: 127:  26%|██▌       | 257/1000 [01:40<04:49,  2.57it/s]\n# PTI :step: 256, epoch: 128:  26%|██▌       | 257/1000 [01:40<04:49,  2.57it/s]\n# PTI :step: 256, epoch: 128:  26%|██▌       | 258/1000 [01:41<04:51,  2.54it/s]\n# PTI :step: 257, epoch: 128:  26%|██▌       | 258/1000 [01:41<04:51,  2.54it/s]\n# PTI :step: 257, epoch: 128:  26%|██▌       | 259/1000 [01:41<04:51,  2.54it/s]\n# PTI :step: 258, epoch: 129:  26%|██▌       | 259/1000 [01:41<04:51,  2.54it/s]\n# PTI :step: 258, epoch: 129:  26%|██▌       | 260/1000 [01:41<04:52,  2.53it/s]\n# PTI :step: 259, epoch: 129:  26%|██▌       | 260/1000 [01:41<04:52,  2.53it/s]\n# PTI :step: 259, epoch: 129:  26%|██▌       | 261/1000 [01:42<04:48,  2.57it/s]\n# PTI :step: 260, epoch: 130:  26%|██▌       | 261/1000 [01:42<04:48,  2.57it/s]\n# PTI :step: 260, epoch: 130:  26%|██▌       | 262/1000 [01:42<04:50,  2.54it/s]\n# PTI :step: 261, epoch: 130:  26%|██▌       | 262/1000 [01:42<04:50,  2.54it/s]\n# PTI :step: 261, epoch: 130:  26%|██▋       | 263/1000 [01:43<04:47,  2.57it/s]\n# PTI :step: 262, epoch: 131:  26%|██▋       | 263/1000 [01:43<04:47,  2.57it/s]\n# PTI :step: 262, epoch: 131:  26%|██▋       | 264/1000 [01:43<04:49,  2.54it/s]\n# PTI :step: 263, epoch: 131:  26%|██▋       | 264/1000 [01:43<04:49,  2.54it/s]\n# PTI :step: 263, epoch: 131:  26%|██▋       | 265/1000 [01:43<04:45,  2.57it/s]\n# PTI :step: 264, epoch: 132:  26%|██▋       | 265/1000 [01:43<04:45,  2.57it/s]\n# PTI :step: 264, epoch: 132:  27%|██▋       | 266/1000 [01:44<04:47,  2.55it/s]\n# PTI :step: 265, epoch: 132:  27%|██▋       | 266/1000 [01:44<04:47,  2.55it/s]\n# PTI :step: 265, epoch: 132:  27%|██▋       | 267/1000 [01:44<04:45,  2.57it/s]\n# PTI :step: 266, epoch: 133:  27%|██▋       | 267/1000 [01:44<04:45,  2.57it/s]\n# PTI :step: 266, epoch: 133:  27%|██▋       | 268/1000 [01:45<04:46,  2.55it/s]\n# PTI :step: 267, epoch: 133:  27%|██▋       | 268/1000 [01:45<04:46,  2.55it/s]\n# PTI :step: 267, epoch: 133:  27%|██▋       | 269/1000 [01:45<04:43,  2.58it/s]\n# PTI :step: 268, epoch: 134:  27%|██▋       | 269/1000 [01:45<04:43,  2.58it/s]\n# PTI :step: 268, epoch: 134:  27%|██▋       | 270/1000 [01:45<04:47,  2.54it/s]\n# PTI :step: 269, epoch: 134:  27%|██▋       | 270/1000 [01:45<04:47,  2.54it/s]\n# PTI :step: 269, epoch: 134:  27%|██▋       | 271/1000 [01:46<04:43,  2.57it/s]\n# PTI :step: 270, epoch: 135:  27%|██▋       | 271/1000 [01:46<04:43,  2.57it/s]\n# PTI :step: 270, epoch: 135:  27%|██▋       | 272/1000 [01:46<04:46,  2.54it/s]\n# PTI :step: 271, epoch: 135:  27%|██▋       | 272/1000 [01:46<04:46,  2.54it/s]\n# PTI :step: 271, epoch: 135:  27%|██▋       | 273/1000 [01:47<04:43,  2.57it/s]\n# PTI :step: 272, epoch: 136:  27%|██▋       | 273/1000 [01:47<04:43,  2.57it/s]\n# PTI :step: 272, epoch: 136:  27%|██▋       | 274/1000 [01:47<04:44,  2.55it/s]\n# PTI :step: 273, epoch: 136:  27%|██▋       | 274/1000 [01:47<04:44,  2.55it/s]\n# PTI :step: 273, epoch: 136:  28%|██▊       | 275/1000 [01:47<04:43,  2.55it/s]\n# PTI :step: 274, epoch: 137:  28%|██▊       | 275/1000 [01:47<04:43,  2.55it/s]\n# PTI :step: 274, epoch: 137:  28%|██▊       | 276/1000 [01:48<04:45,  2.53it/s]\n# PTI :step: 275, epoch: 137:  28%|██▊       | 276/1000 [01:48<04:45,  2.53it/s]\n# PTI :step: 275, epoch: 137:  28%|██▊       | 277/1000 [01:48<04:42,  2.56it/s]\n# PTI :step: 276, epoch: 138:  28%|██▊       | 277/1000 [01:48<04:42,  2.56it/s]\n# PTI :step: 276, epoch: 138:  28%|██▊       | 278/1000 [01:48<04:43,  2.54it/s]\n# PTI :step: 277, epoch: 138:  28%|██▊       | 278/1000 [01:48<04:43,  2.54it/s]\n# PTI :step: 277, epoch: 138:  28%|██▊       | 279/1000 [01:49<04:40,  2.57it/s]\n# PTI :step: 278, epoch: 139:  28%|██▊       | 279/1000 [01:49<04:40,  2.57it/s]\n# PTI :step: 278, epoch: 139:  28%|██▊       | 280/1000 [01:49<04:42,  2.55it/s]\n# PTI :step: 279, epoch: 139:  28%|██▊       | 280/1000 [01:49<04:42,  2.55it/s]\n# PTI :step: 279, epoch: 139:  28%|██▊       | 281/1000 [01:50<04:39,  2.57it/s]\n# PTI :step: 280, epoch: 140:  28%|██▊       | 281/1000 [01:50<04:39,  2.57it/s]\n# PTI :step: 280, epoch: 140:  28%|██▊       | 282/1000 [01:50<04:41,  2.55it/s]\n# PTI :step: 281, epoch: 140:  28%|██▊       | 282/1000 [01:50<04:41,  2.55it/s]\n# PTI :step: 281, epoch: 140:  28%|██▊       | 283/1000 [01:50<04:38,  2.57it/s]\n# PTI :step: 282, epoch: 141:  28%|██▊       | 283/1000 [01:50<04:38,  2.57it/s]\n# PTI :step: 282, epoch: 141:  28%|██▊       | 284/1000 [01:51<04:40,  2.55it/s]\n# PTI :step: 283, epoch: 141:  28%|██▊       | 284/1000 [01:51<04:40,  2.55it/s]\n# PTI :step: 283, epoch: 141:  28%|██▊       | 285/1000 [01:51<04:38,  2.57it/s]\n# PTI :step: 284, epoch: 142:  28%|██▊       | 285/1000 [01:51<04:38,  2.57it/s]\n# PTI :step: 284, epoch: 142:  29%|██▊       | 286/1000 [01:52<04:39,  2.55it/s]\n# PTI :step: 285, epoch: 142:  29%|██▊       | 286/1000 [01:52<04:39,  2.55it/s]\n# PTI :step: 285, epoch: 142:  29%|██▊       | 287/1000 [01:52<04:37,  2.57it/s]\n# PTI :step: 286, epoch: 143:  29%|██▊       | 287/1000 [01:52<04:37,  2.57it/s]\n# PTI :step: 286, epoch: 143:  29%|██▉       | 288/1000 [01:52<04:38,  2.55it/s]\n# PTI :step: 287, epoch: 143:  29%|██▉       | 288/1000 [01:52<04:38,  2.55it/s]\n# PTI :step: 287, epoch: 143:  29%|██▉       | 289/1000 [01:53<04:35,  2.58it/s]\n# PTI :step: 288, epoch: 144:  29%|██▉       | 289/1000 [01:53<04:35,  2.58it/s]\n# PTI :step: 288, epoch: 144:  29%|██▉       | 290/1000 [01:53<04:38,  2.55it/s]\n# PTI :step: 289, epoch: 144:  29%|██▉       | 290/1000 [01:53<04:38,  2.55it/s]\n# PTI :step: 289, epoch: 144:  29%|██▉       | 291/1000 [01:54<04:35,  2.57it/s]\n# PTI :step: 290, epoch: 145:  29%|██▉       | 291/1000 [01:54<04:35,  2.57it/s]\n# PTI :step: 290, epoch: 145:  29%|██▉       | 292/1000 [01:54<04:37,  2.55it/s]\n# PTI :step: 291, epoch: 145:  29%|██▉       | 292/1000 [01:54<04:37,  2.55it/s]\n# PTI :step: 291, epoch: 145:  29%|██▉       | 293/1000 [01:54<04:37,  2.55it/s]\n# PTI :step: 292, epoch: 146:  29%|██▉       | 293/1000 [01:54<04:37,  2.55it/s]\n# PTI :step: 292, epoch: 146:  29%|██▉       | 294/1000 [01:55<04:38,  2.53it/s]\n# PTI :step: 293, epoch: 146:  29%|██▉       | 294/1000 [01:55<04:38,  2.53it/s]\n# PTI :step: 293, epoch: 146:  30%|██▉       | 295/1000 [01:55<04:37,  2.54it/s]\n# PTI :step: 294, epoch: 147:  30%|██▉       | 295/1000 [01:55<04:37,  2.54it/s]\n# PTI :step: 294, epoch: 147:  30%|██▉       | 296/1000 [01:56<04:39,  2.52it/s]\n# PTI :step: 295, epoch: 147:  30%|██▉       | 296/1000 [01:56<04:39,  2.52it/s]\n# PTI :step: 295, epoch: 147:  30%|██▉       | 297/1000 [01:56<05:01,  2.33it/s]\n# PTI :step: 296, epoch: 148:  30%|██▉       | 297/1000 [01:56<05:01,  2.33it/s]\n# PTI :step: 296, epoch: 148:  30%|██▉       | 298/1000 [01:56<04:55,  2.38it/s]\n# PTI :step: 297, epoch: 148:  30%|██▉       | 298/1000 [01:56<04:55,  2.38it/s]\n# PTI :step: 297, epoch: 148:  30%|██▉       | 299/1000 [01:57<04:45,  2.45it/s]\n# PTI :step: 298, epoch: 149:  30%|██▉       | 299/1000 [01:57<04:45,  2.45it/s]\n# PTI :step: 298, epoch: 149:  30%|███       | 300/1000 [01:57<04:44,  2.46it/s]\n# PTI :step: 299, epoch: 149:  30%|███       | 300/1000 [01:57<04:44,  2.46it/s]\n# PTI :step: 299, epoch: 149:  30%|███       | 301/1000 [01:58<04:37,  2.51it/s]\n# PTI :step: 300, epoch: 150:  30%|███       | 301/1000 [01:58<04:37,  2.51it/s]\n# PTI :step: 300, epoch: 150:  30%|███       | 302/1000 [01:58<04:38,  2.51it/s]\n# PTI :step: 301, epoch: 150:  30%|███       | 302/1000 [01:58<04:38,  2.51it/s]\n# PTI :step: 301, epoch: 150:  30%|███       | 303/1000 [01:58<04:33,  2.54it/s]\n# PTI :step: 302, epoch: 151:  30%|███       | 303/1000 [01:58<04:33,  2.54it/s]\n# PTI :step: 302, epoch: 151:  30%|███       | 304/1000 [01:59<04:34,  2.53it/s]\n# PTI :step: 303, epoch: 151:  30%|███       | 304/1000 [01:59<04:34,  2.53it/s]\n# PTI :step: 303, epoch: 151:  30%|███       | 305/1000 [01:59<04:31,  2.56it/s]\n# PTI :step: 304, epoch: 152:  30%|███       | 305/1000 [01:59<04:31,  2.56it/s]\n# PTI :step: 304, epoch: 152:  31%|███       | 306/1000 [02:00<04:33,  2.54it/s]\n# PTI :step: 305, epoch: 152:  31%|███       | 306/1000 [02:00<04:33,  2.54it/s]\n# PTI :step: 305, epoch: 152:  31%|███       | 307/1000 [02:00<04:30,  2.56it/s]\n# PTI :step: 306, epoch: 153:  31%|███       | 307/1000 [02:00<04:30,  2.56it/s]\n# PTI :step: 306, epoch: 153:  31%|███       | 308/1000 [02:00<04:31,  2.55it/s]\n# PTI :step: 307, epoch: 153:  31%|███       | 308/1000 [02:00<04:31,  2.55it/s]\n# PTI :step: 307, epoch: 153:  31%|███       | 309/1000 [02:01<04:30,  2.56it/s]\n# PTI :step: 308, epoch: 154:  31%|███       | 309/1000 [02:01<04:30,  2.56it/s]\n# PTI :step: 308, epoch: 154:  31%|███       | 310/1000 [02:01<04:31,  2.54it/s]\n# PTI :step: 309, epoch: 154:  31%|███       | 310/1000 [02:01<04:31,  2.54it/s]\n# PTI :step: 309, epoch: 154:  31%|███       | 311/1000 [02:01<04:28,  2.57it/s]\n# PTI :step: 310, epoch: 155:  31%|███       | 311/1000 [02:01<04:28,  2.57it/s]\n# PTI :step: 310, epoch: 155:  31%|███       | 312/1000 [02:02<04:31,  2.54it/s]\n# PTI :step: 311, epoch: 155:  31%|███       | 312/1000 [02:02<04:31,  2.54it/s]\n# PTI :step: 311, epoch: 155:  31%|███▏      | 313/1000 [02:02<04:28,  2.56it/s]\n# PTI :step: 312, epoch: 156:  31%|███▏      | 313/1000 [02:02<04:28,  2.56it/s]\n# PTI :step: 312, epoch: 156:  31%|███▏      | 314/1000 [02:03<04:30,  2.54it/s]\n# PTI :step: 313, epoch: 156:  31%|███▏      | 314/1000 [02:03<04:30,  2.54it/s]\n# PTI :step: 313, epoch: 156:  32%|███▏      | 315/1000 [02:03<04:27,  2.56it/s]\n# PTI :step: 314, epoch: 157:  32%|███▏      | 315/1000 [02:03<04:27,  2.56it/s]\n# PTI :step: 314, epoch: 157:  32%|███▏      | 316/1000 [02:03<04:28,  2.54it/s]\n# PTI :step: 315, epoch: 157:  32%|███▏      | 316/1000 [02:03<04:28,  2.54it/s]\n# PTI :step: 315, epoch: 157:  32%|███▏      | 317/1000 [02:04<04:25,  2.57it/s]\n# PTI :step: 316, epoch: 158:  32%|███▏      | 317/1000 [02:04<04:25,  2.57it/s]\n# PTI :step: 316, epoch: 158:  32%|███▏      | 318/1000 [02:04<04:27,  2.55it/s]\n# PTI :step: 317, epoch: 158:  32%|███▏      | 318/1000 [02:04<04:27,  2.55it/s]\n# PTI :step: 317, epoch: 158:  32%|███▏      | 319/1000 [02:05<04:24,  2.57it/s]\n# PTI :step: 318, epoch: 159:  32%|███▏      | 319/1000 [02:05<04:24,  2.57it/s]\n# PTI :step: 318, epoch: 159:  32%|███▏      | 320/1000 [02:05<04:26,  2.55it/s]\n# PTI :step: 319, epoch: 159:  32%|███▏      | 320/1000 [02:05<04:26,  2.55it/s]\n# PTI :step: 319, epoch: 159:  32%|███▏      | 321/1000 [02:05<04:24,  2.57it/s]\n# PTI :step: 320, epoch: 160:  32%|███▏      | 321/1000 [02:05<04:24,  2.57it/s]\n# PTI :step: 320, epoch: 160:  32%|███▏      | 322/1000 [02:06<04:26,  2.55it/s]\n# PTI :step: 321, epoch: 160:  32%|███▏      | 322/1000 [02:06<04:26,  2.55it/s]\n# PTI :step: 321, epoch: 160:  32%|███▏      | 323/1000 [02:06<04:23,  2.57it/s]\n# PTI :step: 322, epoch: 161:  32%|███▏      | 323/1000 [02:06<04:23,  2.57it/s]\n# PTI :step: 322, epoch: 161:  32%|███▏      | 324/1000 [02:07<04:25,  2.55it/s]\n# PTI :step: 323, epoch: 161:  32%|███▏      | 324/1000 [02:07<04:25,  2.55it/s]\n# PTI :step: 323, epoch: 161:  32%|███▎      | 325/1000 [02:07<04:22,  2.58it/s]\n# PTI :step: 324, epoch: 162:  32%|███▎      | 325/1000 [02:07<04:22,  2.58it/s]\n# PTI :step: 324, epoch: 162:  33%|███▎      | 326/1000 [02:07<04:23,  2.56it/s]\n# PTI :step: 325, epoch: 162:  33%|███▎      | 326/1000 [02:07<04:23,  2.56it/s]\n# PTI :step: 325, epoch: 162:  33%|███▎      | 327/1000 [02:08<04:20,  2.58it/s]\n# PTI :step: 326, epoch: 163:  33%|███▎      | 327/1000 [02:08<04:20,  2.58it/s]\n# PTI :step: 326, epoch: 163:  33%|███▎      | 328/1000 [02:08<04:22,  2.56it/s]\n# PTI :step: 327, epoch: 163:  33%|███▎      | 328/1000 [02:08<04:22,  2.56it/s]\n# PTI :step: 327, epoch: 163:  33%|███▎      | 329/1000 [02:09<04:20,  2.58it/s]\n# PTI :step: 328, epoch: 164:  33%|███▎      | 329/1000 [02:09<04:20,  2.58it/s]\n# PTI :step: 328, epoch: 164:  33%|███▎      | 330/1000 [02:09<04:22,  2.55it/s]\n# PTI :step: 329, epoch: 164:  33%|███▎      | 330/1000 [02:09<04:22,  2.55it/s]\n# PTI :step: 329, epoch: 164:  33%|███▎      | 331/1000 [02:09<04:20,  2.57it/s]\n# PTI :step: 330, epoch: 165:  33%|███▎      | 331/1000 [02:09<04:20,  2.57it/s]\n# PTI :step: 330, epoch: 165:  33%|███▎      | 332/1000 [02:10<04:23,  2.53it/s]\n# PTI :step: 331, epoch: 165:  33%|███▎      | 332/1000 [02:10<04:23,  2.53it/s]\n# PTI :step: 331, epoch: 165:  33%|███▎      | 333/1000 [02:10<04:20,  2.56it/s]\n# PTI :step: 332, epoch: 166:  33%|███▎      | 333/1000 [02:10<04:20,  2.56it/s]\n# PTI :step: 332, epoch: 166:  33%|███▎      | 334/1000 [02:10<04:22,  2.54it/s]\n# PTI :step: 333, epoch: 166:  33%|███▎      | 334/1000 [02:10<04:22,  2.54it/s]\n# PTI :step: 333, epoch: 166:  34%|███▎      | 335/1000 [02:11<04:18,  2.57it/s]\n# PTI :step: 334, epoch: 167:  34%|███▎      | 335/1000 [02:11<04:18,  2.57it/s]\n# PTI :step: 334, epoch: 167:  34%|███▎      | 336/1000 [02:11<04:20,  2.55it/s]\n# PTI :step: 335, epoch: 167:  34%|███▎      | 336/1000 [02:11<04:20,  2.55it/s]\n# PTI :step: 335, epoch: 167:  34%|███▎      | 337/1000 [02:12<04:19,  2.55it/s]\n# PTI :step: 336, epoch: 168:  34%|███▎      | 337/1000 [02:12<04:19,  2.55it/s]\n# PTI :step: 336, epoch: 168:  34%|███▍      | 338/1000 [02:12<04:20,  2.54it/s]\n# PTI :step: 337, epoch: 168:  34%|███▍      | 338/1000 [02:12<04:20,  2.54it/s]\n# PTI :step: 337, epoch: 168:  34%|███▍      | 339/1000 [02:12<04:17,  2.57it/s]\n# PTI :step: 338, epoch: 169:  34%|███▍      | 339/1000 [02:12<04:17,  2.57it/s]\n# PTI :step: 338, epoch: 169:  34%|███▍      | 340/1000 [02:13<04:19,  2.55it/s]\n# PTI :step: 339, epoch: 169:  34%|███▍      | 340/1000 [02:13<04:19,  2.55it/s]\n# PTI :step: 339, epoch: 169:  34%|███▍      | 341/1000 [02:13<04:16,  2.57it/s]\n# PTI :step: 340, epoch: 170:  34%|███▍      | 341/1000 [02:13<04:16,  2.57it/s]\n# PTI :step: 340, epoch: 170:  34%|███▍      | 342/1000 [02:14<04:18,  2.55it/s]\n# PTI :step: 341, epoch: 170:  34%|███▍      | 342/1000 [02:14<04:18,  2.55it/s]\n# PTI :step: 341, epoch: 170:  34%|███▍      | 343/1000 [02:14<04:15,  2.57it/s]\n# PTI :step: 342, epoch: 171:  34%|███▍      | 343/1000 [02:14<04:15,  2.57it/s]\n# PTI :step: 342, epoch: 171:  34%|███▍      | 344/1000 [02:14<04:17,  2.55it/s]\n# PTI :step: 343, epoch: 171:  34%|███▍      | 344/1000 [02:14<04:17,  2.55it/s]\n# PTI :step: 343, epoch: 171:  34%|███▍      | 345/1000 [02:15<04:14,  2.58it/s]\n# PTI :step: 344, epoch: 172:  34%|███▍      | 345/1000 [02:15<04:14,  2.58it/s]\n# PTI :step: 344, epoch: 172:  35%|███▍      | 346/1000 [02:15<04:16,  2.55it/s]\n# PTI :step: 345, epoch: 172:  35%|███▍      | 346/1000 [02:15<04:16,  2.55it/s]\n# PTI :step: 345, epoch: 172:  35%|███▍      | 347/1000 [02:16<04:13,  2.58it/s]\n# PTI :step: 346, epoch: 173:  35%|███▍      | 347/1000 [02:16<04:13,  2.58it/s]\n# PTI :step: 346, epoch: 173:  35%|███▍      | 348/1000 [02:16<04:15,  2.55it/s]\n# PTI :step: 347, epoch: 173:  35%|███▍      | 348/1000 [02:16<04:15,  2.55it/s]\n# PTI :step: 347, epoch: 173:  35%|███▍      | 349/1000 [02:16<04:13,  2.57it/s]\n# PTI :step: 348, epoch: 174:  35%|███▍      | 349/1000 [02:16<04:13,  2.57it/s]\n# PTI :step: 348, epoch: 174:  35%|███▌      | 350/1000 [02:17<04:15,  2.55it/s]\n# PTI :step: 349, epoch: 174:  35%|███▌      | 350/1000 [02:17<04:15,  2.55it/s]\n# PTI :step: 349, epoch: 174:  35%|███▌      | 351/1000 [02:17<04:12,  2.57it/s]\n# PTI :step: 350, epoch: 175:  35%|███▌      | 351/1000 [02:17<04:12,  2.57it/s]\n# PTI :step: 350, epoch: 175:  35%|███▌      | 352/1000 [02:18<04:14,  2.55it/s]\n# PTI :step: 351, epoch: 175:  35%|███▌      | 352/1000 [02:18<04:14,  2.55it/s]\n# PTI :step: 351, epoch: 175:  35%|███▌      | 353/1000 [02:18<04:11,  2.57it/s]\n# PTI :step: 352, epoch: 176:  35%|███▌      | 353/1000 [02:18<04:11,  2.57it/s]\n# PTI :step: 352, epoch: 176:  35%|███▌      | 354/1000 [02:18<04:13,  2.55it/s]\n# PTI :step: 353, epoch: 176:  35%|███▌      | 354/1000 [02:18<04:13,  2.55it/s]\n# PTI :step: 353, epoch: 176:  36%|███▌      | 355/1000 [02:19<04:12,  2.55it/s]\n# PTI :step: 354, epoch: 177:  36%|███▌      | 355/1000 [02:19<04:12,  2.55it/s]\n# PTI :step: 354, epoch: 177:  36%|███▌      | 356/1000 [02:19<04:13,  2.54it/s]\n# PTI :step: 355, epoch: 177:  36%|███▌      | 356/1000 [02:19<04:13,  2.54it/s]\n# PTI :step: 355, epoch: 177:  36%|███▌      | 357/1000 [02:19<04:10,  2.56it/s]\n# PTI :step: 356, epoch: 178:  36%|███▌      | 357/1000 [02:19<04:10,  2.56it/s]\n# PTI :step: 356, epoch: 178:  36%|███▌      | 358/1000 [02:20<04:12,  2.54it/s]\n# PTI :step: 357, epoch: 178:  36%|███▌      | 358/1000 [02:20<04:12,  2.54it/s]\n# PTI :step: 357, epoch: 178:  36%|███▌      | 359/1000 [02:20<04:09,  2.57it/s]\n# PTI :step: 358, epoch: 179:  36%|███▌      | 359/1000 [02:20<04:09,  2.57it/s]\n# PTI :step: 358, epoch: 179:  36%|███▌      | 360/1000 [02:21<04:11,  2.55it/s]\n# PTI :step: 359, epoch: 179:  36%|███▌      | 360/1000 [02:21<04:11,  2.55it/s]\n# PTI :step: 359, epoch: 179:  36%|███▌      | 361/1000 [02:21<04:09,  2.56it/s]\n# PTI :step: 360, epoch: 180:  36%|███▌      | 361/1000 [02:21<04:09,  2.56it/s]\n# PTI :step: 360, epoch: 180:  36%|███▌      | 362/1000 [02:21<04:10,  2.54it/s]\n# PTI :step: 361, epoch: 180:  36%|███▌      | 362/1000 [02:21<04:10,  2.54it/s]\n# PTI :step: 361, epoch: 180:  36%|███▋      | 363/1000 [02:22<04:07,  2.57it/s]\n# PTI :step: 362, epoch: 181:  36%|███▋      | 363/1000 [02:22<04:07,  2.57it/s]\n# PTI :step: 362, epoch: 181:  36%|███▋      | 364/1000 [02:22<04:09,  2.55it/s]\n# PTI :step: 363, epoch: 181:  36%|███▋      | 364/1000 [02:22<04:09,  2.55it/s]\n# PTI :step: 363, epoch: 181:  36%|███▋      | 365/1000 [02:23<04:06,  2.58it/s]\n# PTI :step: 364, epoch: 182:  36%|███▋      | 365/1000 [02:23<04:06,  2.58it/s]\n# PTI :step: 364, epoch: 182:  37%|███▋      | 366/1000 [02:23<04:08,  2.55it/s]\n# PTI :step: 365, epoch: 182:  37%|███▋      | 366/1000 [02:23<04:08,  2.55it/s]\n# PTI :step: 365, epoch: 182:  37%|███▋      | 367/1000 [02:23<04:09,  2.54it/s]\n# PTI :step: 366, epoch: 183:  37%|███▋      | 367/1000 [02:23<04:09,  2.54it/s]\n# PTI :step: 366, epoch: 183:  37%|███▋      | 368/1000 [02:24<04:10,  2.53it/s]\n# PTI :step: 367, epoch: 183:  37%|███▋      | 368/1000 [02:24<04:10,  2.53it/s]\n# PTI :step: 367, epoch: 183:  37%|███▋      | 369/1000 [02:24<04:06,  2.56it/s]\n# PTI :step: 368, epoch: 184:  37%|███▋      | 369/1000 [02:24<04:06,  2.56it/s]\n# PTI :step: 368, epoch: 184:  37%|███▋      | 370/1000 [02:25<04:07,  2.54it/s]\n# PTI :step: 369, epoch: 184:  37%|███▋      | 370/1000 [02:25<04:07,  2.54it/s]\n# PTI :step: 369, epoch: 184:  37%|███▋      | 371/1000 [02:25<04:07,  2.55it/s]\n# PTI :step: 370, epoch: 185:  37%|███▋      | 371/1000 [02:25<04:07,  2.55it/s]\n# PTI :step: 370, epoch: 185:  37%|███▋      | 372/1000 [02:25<04:08,  2.53it/s]\n# PTI :step: 371, epoch: 185:  37%|███▋      | 372/1000 [02:25<04:08,  2.53it/s]\n# PTI :step: 371, epoch: 185:  37%|███▋      | 373/1000 [02:26<04:04,  2.56it/s]\n# PTI :step: 372, epoch: 186:  37%|███▋      | 373/1000 [02:26<04:04,  2.56it/s]\n# PTI :step: 372, epoch: 186:  37%|███▋      | 374/1000 [02:26<04:06,  2.54it/s]\n# PTI :step: 373, epoch: 186:  37%|███▋      | 374/1000 [02:26<04:06,  2.54it/s]\n# PTI :step: 373, epoch: 186:  38%|███▊      | 375/1000 [02:27<04:03,  2.57it/s]\n# PTI :step: 374, epoch: 187:  38%|███▊      | 375/1000 [02:27<04:03,  2.57it/s]\n# PTI :step: 374, epoch: 187:  38%|███▊      | 376/1000 [02:27<04:05,  2.55it/s]\n# PTI :step: 375, epoch: 187:  38%|███▊      | 376/1000 [02:27<04:05,  2.55it/s]\n# PTI :step: 375, epoch: 187:  38%|███▊      | 377/1000 [02:27<04:02,  2.57it/s]\n# PTI :step: 376, epoch: 188:  38%|███▊      | 377/1000 [02:27<04:02,  2.57it/s]\n# PTI :step: 376, epoch: 188:  38%|███▊      | 378/1000 [02:28<04:03,  2.55it/s]\n# PTI :step: 377, epoch: 188:  38%|███▊      | 378/1000 [02:28<04:03,  2.55it/s]\n# PTI :step: 377, epoch: 188:  38%|███▊      | 379/1000 [02:28<04:01,  2.57it/s]\n# PTI :step: 378, epoch: 189:  38%|███▊      | 379/1000 [02:28<04:01,  2.57it/s]\n# PTI :step: 378, epoch: 189:  38%|███▊      | 380/1000 [02:28<04:03,  2.55it/s]\n# PTI :step: 379, epoch: 189:  38%|███▊      | 380/1000 [02:28<04:03,  2.55it/s]\n# PTI :step: 379, epoch: 189:  38%|███▊      | 381/1000 [02:29<03:59,  2.58it/s]\n# PTI :step: 380, epoch: 190:  38%|███▊      | 381/1000 [02:29<03:59,  2.58it/s]\n# PTI :step: 380, epoch: 190:  38%|███▊      | 382/1000 [02:29<04:02,  2.55it/s]\n# PTI :step: 381, epoch: 190:  38%|███▊      | 382/1000 [02:29<04:02,  2.55it/s]\n# PTI :step: 381, epoch: 190:  38%|███▊      | 383/1000 [02:30<03:59,  2.57it/s]\n# PTI :step: 382, epoch: 191:  38%|███▊      | 383/1000 [02:30<03:59,  2.57it/s]\n# PTI :step: 382, epoch: 191:  38%|███▊      | 384/1000 [02:30<04:01,  2.55it/s]\n# PTI :step: 383, epoch: 191:  38%|███▊      | 384/1000 [02:30<04:01,  2.55it/s]\n# PTI :step: 383, epoch: 191:  38%|███▊      | 385/1000 [02:30<03:58,  2.57it/s]\n# PTI :step: 384, epoch: 192:  38%|███▊      | 385/1000 [02:30<03:58,  2.57it/s]\n# PTI :step: 384, epoch: 192:  39%|███▊      | 386/1000 [02:31<04:00,  2.55it/s]\n# PTI :step: 385, epoch: 192:  39%|███▊      | 386/1000 [02:31<04:00,  2.55it/s]\n# PTI :step: 385, epoch: 192:  39%|███▊      | 387/1000 [02:31<03:58,  2.57it/s]\n# PTI :step: 386, epoch: 193:  39%|███▊      | 387/1000 [02:31<03:58,  2.57it/s]\n# PTI :step: 386, epoch: 193:  39%|███▉      | 388/1000 [02:32<03:59,  2.55it/s]\n# PTI :step: 387, epoch: 193:  39%|███▉      | 388/1000 [02:32<03:59,  2.55it/s]\n# PTI :step: 387, epoch: 193:  39%|███▉      | 389/1000 [02:32<03:58,  2.56it/s]\n# PTI :step: 388, epoch: 194:  39%|███▉      | 389/1000 [02:32<03:58,  2.56it/s]\n# PTI :step: 388, epoch: 194:  39%|███▉      | 390/1000 [02:32<03:59,  2.54it/s]\n# PTI :step: 389, epoch: 194:  39%|███▉      | 390/1000 [02:32<03:59,  2.54it/s]\n# PTI :step: 389, epoch: 194:  39%|███▉      | 391/1000 [02:33<03:57,  2.56it/s]\n# PTI :step: 390, epoch: 195:  39%|███▉      | 391/1000 [02:33<03:57,  2.56it/s]\n# PTI :step: 390, epoch: 195:  39%|███▉      | 392/1000 [02:33<03:59,  2.54it/s]\n# PTI :step: 391, epoch: 195:  39%|███▉      | 392/1000 [02:33<03:59,  2.54it/s]\n# PTI :step: 391, epoch: 195:  39%|███▉      | 393/1000 [02:34<03:56,  2.57it/s]\n# PTI :step: 392, epoch: 196:  39%|███▉      | 393/1000 [02:34<03:56,  2.57it/s]\n# PTI :step: 392, epoch: 196:  39%|███▉      | 394/1000 [02:34<03:57,  2.55it/s]\n# PTI :step: 393, epoch: 196:  39%|███▉      | 394/1000 [02:34<03:57,  2.55it/s]\n# PTI :step: 393, epoch: 196:  40%|███▉      | 395/1000 [02:34<03:55,  2.57it/s]\n# PTI :step: 394, epoch: 197:  40%|███▉      | 395/1000 [02:34<03:55,  2.57it/s]\n# PTI :step: 394, epoch: 197:  40%|███▉      | 396/1000 [02:35<03:56,  2.55it/s]\n# PTI :step: 395, epoch: 197:  40%|███▉      | 396/1000 [02:35<03:56,  2.55it/s]\n# PTI :step: 395, epoch: 197:  40%|███▉      | 397/1000 [02:35<03:55,  2.56it/s]\n# PTI :step: 396, epoch: 198:  40%|███▉      | 397/1000 [02:35<03:55,  2.56it/s]\n# PTI :step: 396, epoch: 198:  40%|███▉      | 398/1000 [02:36<03:57,  2.54it/s]\n# PTI :step: 397, epoch: 198:  40%|███▉      | 398/1000 [02:36<03:57,  2.54it/s]\n# PTI :step: 397, epoch: 198:  40%|███▉      | 399/1000 [02:36<03:54,  2.56it/s]\n# PTI :step: 398, epoch: 199:  40%|███▉      | 399/1000 [02:36<03:54,  2.56it/s]\n# PTI :step: 398, epoch: 199:  40%|████      | 400/1000 [02:36<04:17,  2.33it/s]\n# PTI :step: 399, epoch: 199:  40%|████      | 400/1000 [02:36<04:17,  2.33it/s]\n# PTI :step: 399, epoch: 199:  40%|████      | 401/1000 [02:37<04:08,  2.41it/s]\n# PTI :step: 400, epoch: 200:  40%|████      | 401/1000 [02:37<04:08,  2.41it/s]\n# PTI :step: 400, epoch: 200:  40%|████      | 402/1000 [02:37<04:05,  2.43it/s]\n# PTI :step: 401, epoch: 200:  40%|████      | 402/1000 [02:37<04:05,  2.43it/s]\n# PTI :step: 401, epoch: 200:  40%|████      | 403/1000 [02:38<03:59,  2.49it/s]\n# PTI :step: 402, epoch: 201:  40%|████      | 403/1000 [02:38<03:59,  2.49it/s]\n# PTI :step: 402, epoch: 201:  40%|████      | 404/1000 [02:38<03:59,  2.49it/s]\n# PTI :step: 403, epoch: 201:  40%|████      | 404/1000 [02:38<03:59,  2.49it/s]\n# PTI :step: 403, epoch: 201:  40%|████      | 405/1000 [02:38<03:54,  2.53it/s]\n# PTI :step: 404, epoch: 202:  40%|████      | 405/1000 [02:38<03:54,  2.53it/s]\n# PTI :step: 404, epoch: 202:  41%|████      | 406/1000 [02:39<03:55,  2.52it/s]\n# PTI :step: 405, epoch: 202:  41%|████      | 406/1000 [02:39<03:55,  2.52it/s]\n# PTI :step: 405, epoch: 202:  41%|████      | 407/1000 [02:39<03:52,  2.55it/s]\n# PTI :step: 406, epoch: 203:  41%|████      | 407/1000 [02:39<03:52,  2.55it/s]\n# PTI :step: 406, epoch: 203:  41%|████      | 408/1000 [02:40<03:54,  2.53it/s]\n# PTI :step: 407, epoch: 203:  41%|████      | 408/1000 [02:40<03:54,  2.53it/s]\n# PTI :step: 407, epoch: 203:  41%|████      | 409/1000 [02:40<03:51,  2.55it/s]\n# PTI :step: 408, epoch: 204:  41%|████      | 409/1000 [02:40<03:51,  2.55it/s]\n# PTI :step: 408, epoch: 204:  41%|████      | 410/1000 [02:40<03:52,  2.53it/s]\n# PTI :step: 409, epoch: 204:  41%|████      | 410/1000 [02:40<03:52,  2.53it/s]\n# PTI :step: 409, epoch: 204:  41%|████      | 411/1000 [02:41<03:49,  2.57it/s]\n# PTI :step: 410, epoch: 205:  41%|████      | 411/1000 [02:41<03:49,  2.57it/s]\n# PTI :step: 410, epoch: 205:  41%|████      | 412/1000 [02:41<03:51,  2.54it/s]\n# PTI :step: 411, epoch: 205:  41%|████      | 412/1000 [02:41<03:51,  2.54it/s]\n# PTI :step: 411, epoch: 205:  41%|████▏     | 413/1000 [02:42<03:48,  2.57it/s]\n# PTI :step: 412, epoch: 206:  41%|████▏     | 413/1000 [02:42<03:48,  2.57it/s]\n# PTI :step: 412, epoch: 206:  41%|████▏     | 414/1000 [02:42<03:50,  2.55it/s]\n# PTI :step: 413, epoch: 206:  41%|████▏     | 414/1000 [02:42<03:50,  2.55it/s]\n# PTI :step: 413, epoch: 206:  42%|████▏     | 415/1000 [02:42<03:49,  2.55it/s]\n# PTI :step: 414, epoch: 207:  42%|████▏     | 415/1000 [02:42<03:49,  2.55it/s]\n# PTI :step: 414, epoch: 207:  42%|████▏     | 416/1000 [02:43<03:50,  2.54it/s]\n# PTI :step: 415, epoch: 207:  42%|████▏     | 416/1000 [02:43<03:50,  2.54it/s]\n# PTI :step: 415, epoch: 207:  42%|████▏     | 417/1000 [02:43<03:49,  2.54it/s]\n# PTI :step: 416, epoch: 208:  42%|████▏     | 417/1000 [02:43<03:49,  2.54it/s]\n# PTI :step: 416, epoch: 208:  42%|████▏     | 418/1000 [02:44<03:51,  2.51it/s]\n# PTI :step: 417, epoch: 208:  42%|████▏     | 418/1000 [02:44<03:51,  2.51it/s]\n# PTI :step: 417, epoch: 208:  42%|████▏     | 419/1000 [02:44<03:47,  2.55it/s]\n# PTI :step: 418, epoch: 209:  42%|████▏     | 419/1000 [02:44<03:47,  2.55it/s]\n# PTI :step: 418, epoch: 209:  42%|████▏     | 420/1000 [02:44<03:49,  2.53it/s]\n# PTI :step: 419, epoch: 209:  42%|████▏     | 420/1000 [02:44<03:49,  2.53it/s]\n# PTI :step: 419, epoch: 209:  42%|████▏     | 421/1000 [02:45<03:49,  2.52it/s]\n# PTI :step: 420, epoch: 210:  42%|████▏     | 421/1000 [02:45<03:49,  2.52it/s]\n# PTI :step: 420, epoch: 210:  42%|████▏     | 422/1000 [02:45<03:50,  2.51it/s]\n# PTI :step: 421, epoch: 210:  42%|████▏     | 422/1000 [02:45<03:50,  2.51it/s]\n# PTI :step: 421, epoch: 210:  42%|████▏     | 423/1000 [02:45<03:47,  2.54it/s]\n# PTI :step: 422, epoch: 211:  42%|████▏     | 423/1000 [02:45<03:47,  2.54it/s]\n# PTI :step: 422, epoch: 211:  42%|████▏     | 424/1000 [02:46<03:47,  2.53it/s]\n# PTI :step: 423, epoch: 211:  42%|████▏     | 424/1000 [02:46<03:47,  2.53it/s]\n# PTI :step: 423, epoch: 211:  42%|████▎     | 425/1000 [02:46<03:44,  2.56it/s]\n# PTI :step: 424, epoch: 212:  42%|████▎     | 425/1000 [02:46<03:44,  2.56it/s]\n# PTI :step: 424, epoch: 212:  43%|████▎     | 426/1000 [02:47<03:47,  2.52it/s]\n# PTI :step: 425, epoch: 212:  43%|████▎     | 426/1000 [02:47<03:47,  2.52it/s]\n# PTI :step: 425, epoch: 212:  43%|████▎     | 427/1000 [02:47<03:46,  2.53it/s]\n# PTI :step: 426, epoch: 213:  43%|████▎     | 427/1000 [02:47<03:46,  2.53it/s]\n# PTI :step: 426, epoch: 213:  43%|████▎     | 428/1000 [02:47<03:46,  2.52it/s]\n# PTI :step: 427, epoch: 213:  43%|████▎     | 428/1000 [02:47<03:46,  2.52it/s]\n# PTI :step: 427, epoch: 213:  43%|████▎     | 429/1000 [02:48<03:43,  2.56it/s]\n# PTI :step: 428, epoch: 214:  43%|████▎     | 429/1000 [02:48<03:43,  2.56it/s]\n# PTI :step: 428, epoch: 214:  43%|████▎     | 430/1000 [02:48<03:44,  2.54it/s]\n# PTI :step: 429, epoch: 214:  43%|████▎     | 430/1000 [02:48<03:44,  2.54it/s]\n# PTI :step: 429, epoch: 214:  43%|████▎     | 431/1000 [02:49<03:41,  2.57it/s]\n# PTI :step: 430, epoch: 215:  43%|████▎     | 431/1000 [02:49<03:41,  2.57it/s]\n# PTI :step: 430, epoch: 215:  43%|████▎     | 432/1000 [02:49<03:43,  2.54it/s]\n# PTI :step: 431, epoch: 215:  43%|████▎     | 432/1000 [02:49<03:43,  2.54it/s]\n# PTI :step: 431, epoch: 215:  43%|████▎     | 433/1000 [02:49<03:40,  2.57it/s]\n# PTI :step: 432, epoch: 216:  43%|████▎     | 433/1000 [02:49<03:40,  2.57it/s]\n# PTI :step: 432, epoch: 216:  43%|████▎     | 434/1000 [02:50<03:41,  2.55it/s]\n# PTI :step: 433, epoch: 216:  43%|████▎     | 434/1000 [02:50<03:41,  2.55it/s]\n# PTI :step: 433, epoch: 216:  44%|████▎     | 435/1000 [02:50<03:39,  2.57it/s]\n# PTI :step: 434, epoch: 217:  44%|████▎     | 435/1000 [02:50<03:39,  2.57it/s]\n# PTI :step: 434, epoch: 217:  44%|████▎     | 436/1000 [02:51<03:41,  2.55it/s]\n# PTI :step: 435, epoch: 217:  44%|████▎     | 436/1000 [02:51<03:41,  2.55it/s]\n# PTI :step: 435, epoch: 217:  44%|████▎     | 437/1000 [02:51<03:38,  2.57it/s]\n# PTI :step: 436, epoch: 218:  44%|████▎     | 437/1000 [02:51<03:38,  2.57it/s]\n# PTI :step: 436, epoch: 218:  44%|████▍     | 438/1000 [02:51<03:40,  2.55it/s]\n# PTI :step: 437, epoch: 218:  44%|████▍     | 438/1000 [02:51<03:40,  2.55it/s]\n# PTI :step: 437, epoch: 218:  44%|████▍     | 439/1000 [02:52<03:37,  2.58it/s]\n# PTI :step: 438, epoch: 219:  44%|████▍     | 439/1000 [02:52<03:37,  2.58it/s]\n# PTI :step: 438, epoch: 219:  44%|████▍     | 440/1000 [02:52<03:39,  2.56it/s]\n# PTI :step: 439, epoch: 219:  44%|████▍     | 440/1000 [02:52<03:39,  2.56it/s]\n# PTI :step: 439, epoch: 219:  44%|████▍     | 441/1000 [02:53<03:36,  2.58it/s]\n# PTI :step: 440, epoch: 220:  44%|████▍     | 441/1000 [02:53<03:36,  2.58it/s]\n# PTI :step: 440, epoch: 220:  44%|████▍     | 442/1000 [02:53<03:38,  2.56it/s]\n# PTI :step: 441, epoch: 220:  44%|████▍     | 442/1000 [02:53<03:38,  2.56it/s]\n# PTI :step: 441, epoch: 220:  44%|████▍     | 443/1000 [02:53<03:36,  2.58it/s]\n# PTI :step: 442, epoch: 221:  44%|████▍     | 443/1000 [02:53<03:36,  2.58it/s]\n# PTI :step: 442, epoch: 221:  44%|████▍     | 444/1000 [02:54<03:37,  2.55it/s]\n# PTI :step: 443, epoch: 221:  44%|████▍     | 444/1000 [02:54<03:37,  2.55it/s]\n# PTI :step: 443, epoch: 221:  44%|████▍     | 445/1000 [02:54<03:35,  2.57it/s]\n# PTI :step: 444, epoch: 222:  44%|████▍     | 445/1000 [02:54<03:35,  2.57it/s]\n# PTI :step: 444, epoch: 222:  45%|████▍     | 446/1000 [02:54<03:37,  2.55it/s]\n# PTI :step: 445, epoch: 222:  45%|████▍     | 446/1000 [02:54<03:37,  2.55it/s]\n# PTI :step: 445, epoch: 222:  45%|████▍     | 447/1000 [02:55<03:34,  2.58it/s]\n# PTI :step: 446, epoch: 223:  45%|████▍     | 447/1000 [02:55<03:34,  2.58it/s]\n# PTI :step: 446, epoch: 223:  45%|████▍     | 448/1000 [02:55<03:37,  2.54it/s]\n# PTI :step: 447, epoch: 223:  45%|████▍     | 448/1000 [02:55<03:37,  2.54it/s]\n# PTI :step: 447, epoch: 223:  45%|████▍     | 449/1000 [02:56<03:34,  2.56it/s]\n# PTI :step: 448, epoch: 224:  45%|████▍     | 449/1000 [02:56<03:34,  2.56it/s]\n# PTI :step: 448, epoch: 224:  45%|████▌     | 450/1000 [02:56<03:36,  2.54it/s]\n# PTI :step: 449, epoch: 224:  45%|████▌     | 450/1000 [02:56<03:36,  2.54it/s]\n# PTI :step: 449, epoch: 224:  45%|████▌     | 451/1000 [02:56<03:34,  2.56it/s]\n# PTI :step: 450, epoch: 225:  45%|████▌     | 451/1000 [02:56<03:34,  2.56it/s]\n# PTI :step: 450, epoch: 225:  45%|████▌     | 452/1000 [02:57<03:35,  2.55it/s]\n# PTI :step: 451, epoch: 225:  45%|████▌     | 452/1000 [02:57<03:35,  2.55it/s]\n# PTI :step: 451, epoch: 225:  45%|████▌     | 453/1000 [02:57<03:33,  2.56it/s]\n# PTI :step: 452, epoch: 226:  45%|████▌     | 453/1000 [02:57<03:33,  2.56it/s]\n# PTI :step: 452, epoch: 226:  45%|████▌     | 454/1000 [02:58<03:34,  2.54it/s]\n# PTI :step: 453, epoch: 226:  45%|████▌     | 454/1000 [02:58<03:34,  2.54it/s]\n# PTI :step: 453, epoch: 226:  46%|████▌     | 455/1000 [02:58<03:32,  2.56it/s]\n# PTI :step: 454, epoch: 227:  46%|████▌     | 455/1000 [02:58<03:32,  2.56it/s]\n# PTI :step: 454, epoch: 227:  46%|████▌     | 456/1000 [02:58<03:33,  2.55it/s]\n# PTI :step: 455, epoch: 227:  46%|████▌     | 456/1000 [02:58<03:33,  2.55it/s]\n# PTI :step: 455, epoch: 227:  46%|████▌     | 457/1000 [02:59<03:30,  2.57it/s]\n# PTI :step: 456, epoch: 228:  46%|████▌     | 457/1000 [02:59<03:30,  2.57it/s]\n# PTI :step: 456, epoch: 228:  46%|████▌     | 458/1000 [02:59<03:32,  2.55it/s]\n# PTI :step: 457, epoch: 228:  46%|████▌     | 458/1000 [02:59<03:32,  2.55it/s]\n# PTI :step: 457, epoch: 228:  46%|████▌     | 459/1000 [03:00<03:30,  2.58it/s]\n# PTI :step: 458, epoch: 229:  46%|████▌     | 459/1000 [03:00<03:30,  2.58it/s]\n# PTI :step: 458, epoch: 229:  46%|████▌     | 460/1000 [03:00<03:31,  2.55it/s]\n# PTI :step: 459, epoch: 229:  46%|████▌     | 460/1000 [03:00<03:31,  2.55it/s]\n# PTI :step: 459, epoch: 229:  46%|████▌     | 461/1000 [03:00<03:29,  2.58it/s]\n# PTI :step: 460, epoch: 230:  46%|████▌     | 461/1000 [03:00<03:29,  2.58it/s]\n# PTI :step: 460, epoch: 230:  46%|████▌     | 462/1000 [03:01<03:30,  2.55it/s]\n# PTI :step: 461, epoch: 230:  46%|████▌     | 462/1000 [03:01<03:30,  2.55it/s]\n# PTI :step: 461, epoch: 230:  46%|████▋     | 463/1000 [03:01<03:29,  2.57it/s]\n# PTI :step: 462, epoch: 231:  46%|████▋     | 463/1000 [03:01<03:29,  2.57it/s]\n# PTI :step: 462, epoch: 231:  46%|████▋     | 464/1000 [03:02<03:30,  2.55it/s]\n# PTI :step: 463, epoch: 231:  46%|████▋     | 464/1000 [03:02<03:30,  2.55it/s]\n# PTI :step: 463, epoch: 231:  46%|████▋     | 465/1000 [03:02<03:27,  2.57it/s]\n# PTI :step: 464, epoch: 232:  46%|████▋     | 465/1000 [03:02<03:27,  2.57it/s]\n# PTI :step: 464, epoch: 232:  47%|████▋     | 466/1000 [03:02<03:29,  2.55it/s]\n# PTI :step: 465, epoch: 232:  47%|████▋     | 466/1000 [03:02<03:29,  2.55it/s]\n# PTI :step: 465, epoch: 232:  47%|████▋     | 467/1000 [03:03<03:28,  2.56it/s]\n# PTI :step: 466, epoch: 233:  47%|████▋     | 467/1000 [03:03<03:28,  2.56it/s]\n# PTI :step: 466, epoch: 233:  47%|████▋     | 468/1000 [03:03<03:29,  2.53it/s]\n# PTI :step: 467, epoch: 233:  47%|████▋     | 468/1000 [03:03<03:29,  2.53it/s]\n# PTI :step: 467, epoch: 233:  47%|████▋     | 469/1000 [03:03<03:27,  2.56it/s]\n# PTI :step: 468, epoch: 234:  47%|████▋     | 469/1000 [03:03<03:27,  2.56it/s]\n# PTI :step: 468, epoch: 234:  47%|████▋     | 470/1000 [03:04<03:28,  2.55it/s]\n# PTI :step: 469, epoch: 234:  47%|████▋     | 470/1000 [03:04<03:28,  2.55it/s]\n# PTI :step: 469, epoch: 234:  47%|████▋     | 471/1000 [03:04<03:45,  2.34it/s]\n# PTI :step: 470, epoch: 235:  47%|████▋     | 471/1000 [03:04<03:45,  2.34it/s]\n# PTI :step: 470, epoch: 235:  47%|████▋     | 472/1000 [03:05<03:41,  2.39it/s]\n# PTI :step: 471, epoch: 235:  47%|████▋     | 472/1000 [03:05<03:41,  2.39it/s]\n# PTI :step: 471, epoch: 235:  47%|████▋     | 473/1000 [03:05<03:35,  2.45it/s]\n# PTI :step: 472, epoch: 236:  47%|████▋     | 473/1000 [03:05<03:35,  2.45it/s]\n# PTI :step: 472, epoch: 236:  47%|████▋     | 474/1000 [03:06<03:34,  2.46it/s]\n# PTI :step: 473, epoch: 236:  47%|████▋     | 474/1000 [03:06<03:34,  2.46it/s]\n# PTI :step: 473, epoch: 236:  48%|████▊     | 475/1000 [03:06<03:30,  2.49it/s]\n# PTI :step: 474, epoch: 237:  48%|████▊     | 475/1000 [03:06<03:30,  2.49it/s]\n# PTI :step: 474, epoch: 237:  48%|████▊     | 476/1000 [03:06<03:29,  2.50it/s]\n# PTI :step: 475, epoch: 237:  48%|████▊     | 476/1000 [03:06<03:29,  2.50it/s]\n# PTI :step: 475, epoch: 237:  48%|████▊     | 477/1000 [03:07<03:25,  2.55it/s]\n# PTI :step: 476, epoch: 238:  48%|████▊     | 477/1000 [03:07<03:25,  2.55it/s]\n# PTI :step: 476, epoch: 238:  48%|████▊     | 478/1000 [03:07<03:26,  2.53it/s]\n# PTI :step: 477, epoch: 238:  48%|████▊     | 478/1000 [03:07<03:26,  2.53it/s]\n# PTI :step: 477, epoch: 238:  48%|████▊     | 479/1000 [03:07<03:23,  2.56it/s]\n# PTI :step: 478, epoch: 239:  48%|████▊     | 479/1000 [03:07<03:23,  2.56it/s]\n# PTI :step: 478, epoch: 239:  48%|████▊     | 480/1000 [03:08<03:25,  2.53it/s]\n# PTI :step: 479, epoch: 239:  48%|████▊     | 480/1000 [03:08<03:25,  2.53it/s]\n# PTI :step: 479, epoch: 239:  48%|████▊     | 481/1000 [03:08<03:23,  2.55it/s]\n# PTI :step: 480, epoch: 240:  48%|████▊     | 481/1000 [03:08<03:23,  2.55it/s]\n# PTI :step: 480, epoch: 240:  48%|████▊     | 482/1000 [03:09<03:24,  2.54it/s]\n# PTI :step: 481, epoch: 240:  48%|████▊     | 482/1000 [03:09<03:24,  2.54it/s]\n# PTI :step: 481, epoch: 240:  48%|████▊     | 483/1000 [03:09<03:21,  2.57it/s]\n# PTI :step: 482, epoch: 241:  48%|████▊     | 483/1000 [03:09<03:21,  2.57it/s]\n# PTI :step: 482, epoch: 241:  48%|████▊     | 484/1000 [03:09<03:22,  2.55it/s]\n# PTI :step: 483, epoch: 241:  48%|████▊     | 484/1000 [03:09<03:22,  2.55it/s]\n# PTI :step: 483, epoch: 241:  48%|████▊     | 485/1000 [03:10<03:19,  2.58it/s]\n# PTI :step: 484, epoch: 242:  48%|████▊     | 485/1000 [03:10<03:19,  2.58it/s]\n# PTI :step: 484, epoch: 242:  49%|████▊     | 486/1000 [03:10<03:23,  2.53it/s]\n# PTI :step: 485, epoch: 242:  49%|████▊     | 486/1000 [03:10<03:23,  2.53it/s]\n# PTI :step: 485, epoch: 242:  49%|████▊     | 487/1000 [03:11<03:20,  2.56it/s]\n# PTI :step: 486, epoch: 243:  49%|████▊     | 487/1000 [03:11<03:20,  2.56it/s]\n# PTI :step: 486, epoch: 243:  49%|████▉     | 488/1000 [03:11<03:20,  2.55it/s]\n# PTI :step: 487, epoch: 243:  49%|████▉     | 488/1000 [03:11<03:20,  2.55it/s]\n# PTI :step: 487, epoch: 243:  49%|████▉     | 489/1000 [03:11<03:17,  2.58it/s]\n# PTI :step: 488, epoch: 244:  49%|████▉     | 489/1000 [03:11<03:17,  2.58it/s]\n# PTI :step: 488, epoch: 244:  49%|████▉     | 490/1000 [03:12<03:18,  2.56it/s]\n# PTI :step: 489, epoch: 244:  49%|████▉     | 490/1000 [03:12<03:18,  2.56it/s]\n# PTI :step: 489, epoch: 244:  49%|████▉     | 491/1000 [03:12<03:17,  2.57it/s]\n# PTI :step: 490, epoch: 245:  49%|████▉     | 491/1000 [03:12<03:17,  2.57it/s]\n# PTI :step: 490, epoch: 245:  49%|████▉     | 492/1000 [03:13<03:19,  2.55it/s]\n# PTI :step: 491, epoch: 245:  49%|████▉     | 492/1000 [03:13<03:19,  2.55it/s]\n# PTI :step: 491, epoch: 245:  49%|████▉     | 493/1000 [03:13<03:16,  2.58it/s]\n# PTI :step: 492, epoch: 246:  49%|████▉     | 493/1000 [03:13<03:16,  2.58it/s]\n# PTI :step: 492, epoch: 246:  49%|████▉     | 494/1000 [03:13<03:17,  2.56it/s]\n# PTI :step: 493, epoch: 246:  49%|████▉     | 494/1000 [03:13<03:17,  2.56it/s]\n# PTI :step: 493, epoch: 246:  50%|████▉     | 495/1000 [03:14<03:15,  2.59it/s]\n# PTI :step: 494, epoch: 247:  50%|████▉     | 495/1000 [03:14<03:15,  2.59it/s]\n# PTI :step: 494, epoch: 247:  50%|████▉     | 496/1000 [03:14<03:16,  2.56it/s]\n# PTI :step: 495, epoch: 247:  50%|████▉     | 496/1000 [03:14<03:16,  2.56it/s]\n# PTI :step: 495, epoch: 247:  50%|████▉     | 497/1000 [03:15<03:14,  2.59it/s]\n# PTI :step: 496, epoch: 248:  50%|████▉     | 497/1000 [03:15<03:14,  2.59it/s]\n# PTI :step: 496, epoch: 248:  50%|████▉     | 498/1000 [03:15<03:16,  2.55it/s]\n# PTI :step: 497, epoch: 248:  50%|████▉     | 498/1000 [03:15<03:16,  2.55it/s]\n# PTI :step: 497, epoch: 248:  50%|████▉     | 499/1000 [03:15<03:16,  2.54it/s]\n# PTI :step: 498, epoch: 249:  50%|████▉     | 499/1000 [03:15<03:16,  2.54it/s]\n# PTI :step: 498, epoch: 249:  50%|█████     | 500/1000 [03:16<03:17,  2.53it/s]\n# PTI :  Pivot halfway\n# PTI :step: 499, epoch: 249:  50%|█████     | 500/1000 [03:16<03:17,  2.53it/s]\n# PTI :step: 499, epoch: 249:  50%|█████     | 501/1000 [03:16<03:15,  2.56it/s]\n# PTI :step: 500, epoch: 250:  50%|█████     | 501/1000 [03:16<03:15,  2.56it/s]\n# PTI :step: 500, epoch: 250:  50%|█████     | 502/1000 [03:17<03:23,  2.45it/s]\n# PTI :step: 501, epoch: 250:  50%|█████     | 502/1000 [03:17<03:23,  2.45it/s]\n# PTI :step: 501, epoch: 250:  50%|█████     | 503/1000 [03:17<03:18,  2.50it/s]\n# PTI :step: 502, epoch: 251:  50%|█████     | 503/1000 [03:17<03:18,  2.50it/s]\n# PTI :step: 502, epoch: 251:  50%|█████     | 504/1000 [03:17<03:17,  2.51it/s]\n# PTI :step: 503, epoch: 251:  50%|█████     | 504/1000 [03:17<03:17,  2.51it/s]\n# PTI :step: 503, epoch: 251:  50%|█████     | 505/1000 [03:18<03:14,  2.55it/s]\n# PTI :step: 504, epoch: 252:  50%|█████     | 505/1000 [03:18<03:14,  2.55it/s]\n# PTI :step: 504, epoch: 252:  51%|█████     | 506/1000 [03:18<03:14,  2.54it/s]\n# PTI :step: 505, epoch: 252:  51%|█████     | 506/1000 [03:18<03:14,  2.54it/s]\n# PTI :step: 505, epoch: 252:  51%|█████     | 507/1000 [03:18<03:10,  2.58it/s]\n# PTI :step: 506, epoch: 253:  51%|█████     | 507/1000 [03:18<03:10,  2.58it/s]\n# PTI :step: 506, epoch: 253:  51%|█████     | 508/1000 [03:19<03:11,  2.57it/s]\n# PTI :step: 507, epoch: 253:  51%|█████     | 508/1000 [03:19<03:11,  2.57it/s]\n# PTI :step: 507, epoch: 253:  51%|█████     | 509/1000 [03:19<03:09,  2.59it/s]\n# PTI :step: 508, epoch: 254:  51%|█████     | 509/1000 [03:19<03:09,  2.59it/s]\n# PTI :step: 508, epoch: 254:  51%|█████     | 510/1000 [03:20<03:10,  2.58it/s]\n# PTI :step: 509, epoch: 254:  51%|█████     | 510/1000 [03:20<03:10,  2.58it/s]\n# PTI :step: 509, epoch: 254:  51%|█████     | 511/1000 [03:20<03:09,  2.58it/s]\n# PTI :step: 510, epoch: 255:  51%|█████     | 511/1000 [03:20<03:09,  2.58it/s]\n# PTI :step: 510, epoch: 255:  51%|█████     | 512/1000 [03:20<03:10,  2.56it/s]\n# PTI :step: 511, epoch: 255:  51%|█████     | 512/1000 [03:20<03:10,  2.56it/s]\n# PTI :step: 511, epoch: 255:  51%|█████▏    | 513/1000 [03:21<03:08,  2.59it/s]\n# PTI :step: 512, epoch: 256:  51%|█████▏    | 513/1000 [03:21<03:08,  2.59it/s]\n# PTI :step: 512, epoch: 256:  51%|█████▏    | 514/1000 [03:21<03:10,  2.55it/s]\n# PTI :step: 513, epoch: 256:  51%|█████▏    | 514/1000 [03:21<03:10,  2.55it/s]\n# PTI :step: 513, epoch: 256:  52%|█████▏    | 515/1000 [03:22<03:08,  2.58it/s]\n# PTI :step: 514, epoch: 257:  52%|█████▏    | 515/1000 [03:22<03:08,  2.58it/s]\n# PTI :step: 514, epoch: 257:  52%|█████▏    | 516/1000 [03:22<03:08,  2.56it/s]\n# PTI :step: 515, epoch: 257:  52%|█████▏    | 516/1000 [03:22<03:08,  2.56it/s]\n# PTI :step: 515, epoch: 257:  52%|█████▏    | 517/1000 [03:22<03:06,  2.59it/s]\n# PTI :step: 516, epoch: 258:  52%|█████▏    | 517/1000 [03:22<03:06,  2.59it/s]\n# PTI :step: 516, epoch: 258:  52%|█████▏    | 518/1000 [03:23<03:06,  2.58it/s]\n# PTI :step: 517, epoch: 258:  52%|█████▏    | 518/1000 [03:23<03:06,  2.58it/s]\n# PTI :step: 517, epoch: 258:  52%|█████▏    | 519/1000 [03:23<03:06,  2.58it/s]\n# PTI :step: 518, epoch: 259:  52%|█████▏    | 519/1000 [03:23<03:06,  2.58it/s]\n# PTI :step: 518, epoch: 259:  52%|█████▏    | 520/1000 [03:24<03:07,  2.57it/s]\n# PTI :step: 519, epoch: 259:  52%|█████▏    | 520/1000 [03:24<03:07,  2.57it/s]\n# PTI :step: 519, epoch: 259:  52%|█████▏    | 521/1000 [03:24<03:04,  2.60it/s]\n# PTI :step: 520, epoch: 260:  52%|█████▏    | 521/1000 [03:24<03:04,  2.60it/s]\n# PTI :step: 520, epoch: 260:  52%|█████▏    | 522/1000 [03:24<03:07,  2.55it/s]\n# PTI :step: 521, epoch: 260:  52%|█████▏    | 522/1000 [03:24<03:07,  2.55it/s]\n# PTI :step: 521, epoch: 260:  52%|█████▏    | 523/1000 [03:25<03:04,  2.59it/s]\n# PTI :step: 522, epoch: 261:  52%|█████▏    | 523/1000 [03:25<03:04,  2.59it/s]\n# PTI :step: 522, epoch: 261:  52%|█████▏    | 524/1000 [03:25<03:04,  2.57it/s]\n# PTI :step: 523, epoch: 261:  52%|█████▏    | 524/1000 [03:25<03:04,  2.57it/s]\n# PTI :step: 523, epoch: 261:  52%|█████▎    | 525/1000 [03:25<03:02,  2.61it/s]\n# PTI :step: 524, epoch: 262:  52%|█████▎    | 525/1000 [03:25<03:02,  2.61it/s]\n# PTI :step: 524, epoch: 262:  53%|█████▎    | 526/1000 [03:26<03:03,  2.59it/s]\n# PTI :step: 525, epoch: 262:  53%|█████▎    | 526/1000 [03:26<03:03,  2.59it/s]\n# PTI :step: 525, epoch: 262:  53%|█████▎    | 527/1000 [03:26<03:02,  2.58it/s]\n# PTI :step: 526, epoch: 263:  53%|█████▎    | 527/1000 [03:26<03:02,  2.58it/s]\n# PTI :step: 526, epoch: 263:  53%|█████▎    | 528/1000 [03:27<03:03,  2.57it/s]\n# PTI :step: 527, epoch: 263:  53%|█████▎    | 528/1000 [03:27<03:03,  2.57it/s]\n# PTI :step: 527, epoch: 263:  53%|█████▎    | 529/1000 [03:27<03:01,  2.60it/s]\n# PTI :step: 528, epoch: 264:  53%|█████▎    | 529/1000 [03:27<03:01,  2.60it/s]\n# PTI :step: 528, epoch: 264:  53%|█████▎    | 530/1000 [03:27<03:01,  2.58it/s]\n# PTI :step: 529, epoch: 264:  53%|█████▎    | 530/1000 [03:27<03:01,  2.58it/s]\n# PTI :step: 529, epoch: 264:  53%|█████▎    | 531/1000 [03:28<02:59,  2.62it/s]\n# PTI :step: 530, epoch: 265:  53%|█████▎    | 531/1000 [03:28<02:59,  2.62it/s]\n# PTI :step: 530, epoch: 265:  53%|█████▎    | 532/1000 [03:28<03:01,  2.57it/s]\n# PTI :step: 531, epoch: 265:  53%|█████▎    | 532/1000 [03:28<03:01,  2.57it/s]\n# PTI :step: 531, epoch: 265:  53%|█████▎    | 533/1000 [03:29<02:59,  2.61it/s]\n# PTI :step: 532, epoch: 266:  53%|█████▎    | 533/1000 [03:29<02:59,  2.61it/s]\n# PTI :step: 532, epoch: 266:  53%|█████▎    | 534/1000 [03:29<03:00,  2.59it/s]\n# PTI :step: 533, epoch: 266:  53%|█████▎    | 534/1000 [03:29<03:00,  2.59it/s]\n# PTI :step: 533, epoch: 266:  54%|█████▎    | 535/1000 [03:29<02:59,  2.59it/s]\n# PTI :step: 534, epoch: 267:  54%|█████▎    | 535/1000 [03:29<02:59,  2.59it/s]\n# PTI :step: 534, epoch: 267:  54%|█████▎    | 536/1000 [03:30<02:59,  2.58it/s]\n# PTI :step: 535, epoch: 267:  54%|█████▎    | 536/1000 [03:30<02:59,  2.58it/s]\n# PTI :step: 535, epoch: 267:  54%|█████▎    | 537/1000 [03:30<02:58,  2.60it/s]\n# PTI :step: 536, epoch: 268:  54%|█████▎    | 537/1000 [03:30<02:58,  2.60it/s]\n# PTI :step: 536, epoch: 268:  54%|█████▍    | 538/1000 [03:30<02:59,  2.58it/s]\n# PTI :step: 537, epoch: 268:  54%|█████▍    | 538/1000 [03:30<02:59,  2.58it/s]\n# PTI :step: 537, epoch: 268:  54%|█████▍    | 539/1000 [03:31<02:56,  2.61it/s]\n# PTI :step: 538, epoch: 269:  54%|█████▍    | 539/1000 [03:31<02:56,  2.61it/s]\n# PTI :step: 538, epoch: 269:  54%|█████▍    | 540/1000 [03:31<02:59,  2.56it/s]\n# PTI :step: 539, epoch: 269:  54%|█████▍    | 540/1000 [03:31<02:59,  2.56it/s]\n# PTI :step: 539, epoch: 269:  54%|█████▍    | 541/1000 [03:32<02:56,  2.60it/s]\n# PTI :step: 540, epoch: 270:  54%|█████▍    | 541/1000 [03:32<02:56,  2.60it/s]\n# PTI :step: 540, epoch: 270:  54%|█████▍    | 542/1000 [03:32<02:57,  2.58it/s]\n# PTI :step: 541, epoch: 270:  54%|█████▍    | 542/1000 [03:32<02:57,  2.58it/s]\n# PTI :step: 541, epoch: 270:  54%|█████▍    | 543/1000 [03:32<02:55,  2.60it/s]\n# PTI :step: 542, epoch: 271:  54%|█████▍    | 543/1000 [03:32<02:55,  2.60it/s]\n# PTI :step: 542, epoch: 271:  54%|█████▍    | 544/1000 [03:33<02:56,  2.58it/s]\n# PTI :step: 543, epoch: 271:  54%|█████▍    | 544/1000 [03:33<02:56,  2.58it/s]\n# PTI :step: 543, epoch: 271:  55%|█████▍    | 545/1000 [03:33<02:55,  2.59it/s]\n# PTI :step: 544, epoch: 272:  55%|█████▍    | 545/1000 [03:33<02:55,  2.59it/s]\n# PTI :step: 544, epoch: 272:  55%|█████▍    | 546/1000 [03:34<02:56,  2.58it/s]\n# PTI :step: 545, epoch: 272:  55%|█████▍    | 546/1000 [03:34<02:56,  2.58it/s]\n# PTI :step: 545, epoch: 272:  55%|█████▍    | 547/1000 [03:34<02:54,  2.60it/s]\n# PTI :step: 546, epoch: 273:  55%|█████▍    | 547/1000 [03:34<02:54,  2.60it/s]\n# PTI :step: 546, epoch: 273:  55%|█████▍    | 548/1000 [03:34<02:55,  2.58it/s]\n# PTI :step: 547, epoch: 273:  55%|█████▍    | 548/1000 [03:34<02:55,  2.58it/s]\n# PTI :step: 547, epoch: 273:  55%|█████▍    | 549/1000 [03:35<02:52,  2.61it/s]\n# PTI :step: 548, epoch: 274:  55%|█████▍    | 549/1000 [03:35<02:52,  2.61it/s]\n# PTI :step: 548, epoch: 274:  55%|█████▌    | 550/1000 [03:35<02:54,  2.58it/s]\n# PTI :step: 549, epoch: 274:  55%|█████▌    | 550/1000 [03:35<02:54,  2.58it/s]\n# PTI :step: 549, epoch: 274:  55%|█████▌    | 551/1000 [03:35<02:52,  2.61it/s]\n# PTI :step: 550, epoch: 275:  55%|█████▌    | 551/1000 [03:35<02:52,  2.61it/s]\n# PTI :step: 550, epoch: 275:  55%|█████▌    | 552/1000 [03:36<02:52,  2.59it/s]\n# PTI :step: 551, epoch: 275:  55%|█████▌    | 552/1000 [03:36<02:52,  2.59it/s]\n# PTI :step: 551, epoch: 275:  55%|█████▌    | 553/1000 [03:36<02:53,  2.58it/s]\n# PTI :step: 552, epoch: 276:  55%|█████▌    | 553/1000 [03:36<02:53,  2.58it/s]\n# PTI :step: 552, epoch: 276:  55%|█████▌    | 554/1000 [03:37<02:54,  2.56it/s]\n# PTI :step: 553, epoch: 276:  55%|█████▌    | 554/1000 [03:37<02:54,  2.56it/s]\n# PTI :step: 553, epoch: 276:  56%|█████▌    | 555/1000 [03:37<02:52,  2.57it/s]\n# PTI :step: 554, epoch: 277:  56%|█████▌    | 555/1000 [03:37<02:52,  2.57it/s]\n# PTI :step: 554, epoch: 277:  56%|█████▌    | 556/1000 [03:37<02:52,  2.57it/s]\n# PTI :step: 555, epoch: 277:  56%|█████▌    | 556/1000 [03:37<02:52,  2.57it/s]\n# PTI :step: 555, epoch: 277:  56%|█████▌    | 557/1000 [03:38<02:50,  2.60it/s]\n# PTI :step: 556, epoch: 278:  56%|█████▌    | 557/1000 [03:38<02:50,  2.60it/s]\n# PTI :step: 556, epoch: 278:  56%|█████▌    | 558/1000 [03:38<02:52,  2.56it/s]\n# PTI :step: 557, epoch: 278:  56%|█████▌    | 558/1000 [03:38<02:52,  2.56it/s]\n# PTI :step: 557, epoch: 278:  56%|█████▌    | 559/1000 [03:39<02:49,  2.60it/s]\n# PTI :step: 558, epoch: 279:  56%|█████▌    | 559/1000 [03:39<02:49,  2.60it/s]\n# PTI :step: 558, epoch: 279:  56%|█████▌    | 560/1000 [03:39<02:50,  2.58it/s]\n# PTI :step: 559, epoch: 279:  56%|█████▌    | 560/1000 [03:39<02:50,  2.58it/s]\n# PTI :step: 559, epoch: 279:  56%|█████▌    | 561/1000 [03:39<02:48,  2.61it/s]\n# PTI :step: 560, epoch: 280:  56%|█████▌    | 561/1000 [03:39<02:48,  2.61it/s]\n# PTI :step: 560, epoch: 280:  56%|█████▌    | 562/1000 [03:40<02:49,  2.59it/s]\n# PTI :step: 561, epoch: 280:  56%|█████▌    | 562/1000 [03:40<02:49,  2.59it/s]\n# PTI :step: 561, epoch: 280:  56%|█████▋    | 563/1000 [03:40<02:48,  2.59it/s]\n# PTI :step: 562, epoch: 281:  56%|█████▋    | 563/1000 [03:40<02:48,  2.59it/s]\n# PTI :step: 562, epoch: 281:  56%|█████▋    | 564/1000 [03:41<02:49,  2.57it/s]\n# PTI :step: 563, epoch: 281:  56%|█████▋    | 564/1000 [03:41<02:49,  2.57it/s]\n# PTI :step: 563, epoch: 281:  56%|█████▋    | 565/1000 [03:41<02:47,  2.59it/s]\n# PTI :step: 564, epoch: 282:  56%|█████▋    | 565/1000 [03:41<02:47,  2.59it/s]\n# PTI :step: 564, epoch: 282:  57%|█████▋    | 566/1000 [03:41<02:49,  2.55it/s]\n# PTI :step: 565, epoch: 282:  57%|█████▋    | 566/1000 [03:41<02:49,  2.55it/s]\n# PTI :step: 565, epoch: 282:  57%|█████▋    | 567/1000 [03:42<02:47,  2.59it/s]\n# PTI :step: 566, epoch: 283:  57%|█████▋    | 567/1000 [03:42<02:47,  2.59it/s]\n# PTI :step: 566, epoch: 283:  57%|█████▋    | 568/1000 [03:42<02:47,  2.57it/s]\n# PTI :step: 567, epoch: 283:  57%|█████▋    | 568/1000 [03:42<02:47,  2.57it/s]\n# PTI :step: 567, epoch: 283:  57%|█████▋    | 569/1000 [03:42<02:45,  2.60it/s]\n# PTI :step: 568, epoch: 284:  57%|█████▋    | 569/1000 [03:42<02:45,  2.60it/s]\n# PTI :step: 568, epoch: 284:  57%|█████▋    | 570/1000 [03:43<02:46,  2.58it/s]\n# PTI :step: 569, epoch: 284:  57%|█████▋    | 570/1000 [03:43<02:46,  2.58it/s]\n# PTI :step: 569, epoch: 284:  57%|█████▋    | 571/1000 [03:43<02:46,  2.58it/s]\n# PTI :step: 570, epoch: 285:  57%|█████▋    | 571/1000 [03:43<02:46,  2.58it/s]\n# PTI :step: 570, epoch: 285:  57%|█████▋    | 572/1000 [03:44<02:47,  2.56it/s]\n# PTI :step: 571, epoch: 285:  57%|█████▋    | 572/1000 [03:44<02:47,  2.56it/s]\n# PTI :step: 571, epoch: 285:  57%|█████▋    | 573/1000 [03:44<02:45,  2.57it/s]\n# PTI :step: 572, epoch: 286:  57%|█████▋    | 573/1000 [03:44<02:45,  2.57it/s]\n# PTI :step: 572, epoch: 286:  57%|█████▋    | 574/1000 [03:44<02:46,  2.55it/s]\n# PTI :step: 573, epoch: 286:  57%|█████▋    | 574/1000 [03:44<02:46,  2.55it/s]\n# PTI :step: 573, epoch: 286:  57%|█████▊    | 575/1000 [03:45<02:44,  2.59it/s]\n# PTI :step: 574, epoch: 287:  57%|█████▊    | 575/1000 [03:45<02:44,  2.59it/s]\n# PTI :step: 574, epoch: 287:  58%|█████▊    | 576/1000 [03:45<02:46,  2.55it/s]\n# PTI :step: 575, epoch: 287:  58%|█████▊    | 576/1000 [03:45<02:46,  2.55it/s]\n# PTI :step: 575, epoch: 287:  58%|█████▊    | 577/1000 [03:46<02:43,  2.59it/s]\n# PTI :step: 576, epoch: 288:  58%|█████▊    | 577/1000 [03:46<02:43,  2.59it/s]\n# PTI :step: 576, epoch: 288:  58%|█████▊    | 578/1000 [03:46<02:57,  2.38it/s]\n# PTI :step: 577, epoch: 288:  58%|█████▊    | 578/1000 [03:46<02:57,  2.38it/s]\n# PTI :step: 577, epoch: 288:  58%|█████▊    | 579/1000 [03:46<02:52,  2.44it/s]\n# PTI :step: 578, epoch: 289:  58%|█████▊    | 579/1000 [03:46<02:52,  2.44it/s]\n# PTI :step: 578, epoch: 289:  58%|█████▊    | 580/1000 [03:47<02:49,  2.47it/s]\n# PTI :step: 579, epoch: 289:  58%|█████▊    | 580/1000 [03:47<02:49,  2.47it/s]\n# PTI :step: 579, epoch: 289:  58%|█████▊    | 581/1000 [03:47<02:46,  2.52it/s]\n# PTI :step: 580, epoch: 290:  58%|█████▊    | 581/1000 [03:47<02:46,  2.52it/s]\n# PTI :step: 580, epoch: 290:  58%|█████▊    | 582/1000 [03:48<02:45,  2.53it/s]\n# PTI :step: 581, epoch: 290:  58%|█████▊    | 582/1000 [03:48<02:45,  2.53it/s]\n# PTI :step: 581, epoch: 290:  58%|█████▊    | 583/1000 [03:48<02:42,  2.57it/s]\n# PTI :step: 582, epoch: 291:  58%|█████▊    | 583/1000 [03:48<02:42,  2.57it/s]\n# PTI :step: 582, epoch: 291:  58%|█████▊    | 584/1000 [03:48<02:42,  2.56it/s]\n# PTI :step: 583, epoch: 291:  58%|█████▊    | 584/1000 [03:48<02:42,  2.56it/s]\n# PTI :step: 583, epoch: 291:  58%|█████▊    | 585/1000 [03:49<02:39,  2.60it/s]\n# PTI :step: 584, epoch: 292:  58%|█████▊    | 585/1000 [03:49<02:39,  2.60it/s]\n# PTI :step: 584, epoch: 292:  59%|█████▊    | 586/1000 [03:49<02:40,  2.58it/s]\n# PTI :step: 585, epoch: 292:  59%|█████▊    | 586/1000 [03:49<02:40,  2.58it/s]\n# PTI :step: 585, epoch: 292:  59%|█████▊    | 587/1000 [03:50<02:39,  2.59it/s]\n# PTI :step: 586, epoch: 293:  59%|█████▊    | 587/1000 [03:50<02:39,  2.59it/s]\n# PTI :step: 586, epoch: 293:  59%|█████▉    | 588/1000 [03:50<02:40,  2.57it/s]\n# PTI :step: 587, epoch: 293:  59%|█████▉    | 588/1000 [03:50<02:40,  2.57it/s]\n# PTI :step: 587, epoch: 293:  59%|█████▉    | 589/1000 [03:50<02:39,  2.58it/s]\n# PTI :step: 588, epoch: 294:  59%|█████▉    | 589/1000 [03:50<02:39,  2.58it/s]\n# PTI :step: 588, epoch: 294:  59%|█████▉    | 590/1000 [03:51<02:39,  2.57it/s]\n# PTI :step: 589, epoch: 294:  59%|█████▉    | 590/1000 [03:51<02:39,  2.57it/s]\n# PTI :step: 589, epoch: 294:  59%|█████▉    | 591/1000 [03:51<02:39,  2.56it/s]\n# PTI :step: 590, epoch: 295:  59%|█████▉    | 591/1000 [03:51<02:39,  2.56it/s]\n# PTI :step: 590, epoch: 295:  59%|█████▉    | 592/1000 [03:51<02:39,  2.55it/s]\n# PTI :step: 591, epoch: 295:  59%|█████▉    | 592/1000 [03:51<02:39,  2.55it/s]\n# PTI :step: 591, epoch: 295:  59%|█████▉    | 593/1000 [03:52<02:37,  2.59it/s]\n# PTI :step: 592, epoch: 296:  59%|█████▉    | 593/1000 [03:52<02:37,  2.59it/s]\n# PTI :step: 592, epoch: 296:  59%|█████▉    | 594/1000 [03:52<02:39,  2.54it/s]\n# PTI :step: 593, epoch: 296:  59%|█████▉    | 594/1000 [03:52<02:39,  2.54it/s]\n# PTI :step: 593, epoch: 296:  60%|█████▉    | 595/1000 [03:53<02:36,  2.59it/s]\n# PTI :step: 594, epoch: 297:  60%|█████▉    | 595/1000 [03:53<02:36,  2.59it/s]\n# PTI :step: 594, epoch: 297:  60%|█████▉    | 596/1000 [03:53<02:36,  2.57it/s]\n# PTI :step: 595, epoch: 297:  60%|█████▉    | 596/1000 [03:53<02:36,  2.57it/s]\n# PTI :step: 595, epoch: 297:  60%|█████▉    | 597/1000 [03:53<02:34,  2.61it/s]\n# PTI :step: 596, epoch: 298:  60%|█████▉    | 597/1000 [03:53<02:34,  2.61it/s]\n# PTI :step: 596, epoch: 298:  60%|█████▉    | 598/1000 [03:54<02:35,  2.59it/s]\n# PTI :step: 597, epoch: 298:  60%|█████▉    | 598/1000 [03:54<02:35,  2.59it/s]\n# PTI :step: 597, epoch: 298:  60%|█████▉    | 599/1000 [03:54<02:35,  2.58it/s]\n# PTI :step: 598, epoch: 299:  60%|█████▉    | 599/1000 [03:54<02:35,  2.58it/s]\n# PTI :step: 598, epoch: 299:  60%|██████    | 600/1000 [03:55<02:35,  2.57it/s]\n# PTI :step: 599, epoch: 299:  60%|██████    | 600/1000 [03:55<02:35,  2.57it/s]\n# PTI :step: 599, epoch: 299:  60%|██████    | 601/1000 [03:55<02:33,  2.60it/s]\n# PTI :step: 600, epoch: 300:  60%|██████    | 601/1000 [03:55<02:33,  2.60it/s]\n# PTI :step: 600, epoch: 300:  60%|██████    | 602/1000 [03:55<02:35,  2.56it/s]\n# PTI :step: 601, epoch: 300:  60%|██████    | 602/1000 [03:55<02:35,  2.56it/s]\n# PTI :step: 601, epoch: 300:  60%|██████    | 603/1000 [03:56<02:32,  2.60it/s]\n# PTI :step: 602, epoch: 301:  60%|██████    | 603/1000 [03:56<02:32,  2.60it/s]\n# PTI :step: 602, epoch: 301:  60%|██████    | 604/1000 [03:56<02:34,  2.56it/s]\n# PTI :step: 603, epoch: 301:  60%|██████    | 604/1000 [03:56<02:34,  2.56it/s]\n# PTI :step: 603, epoch: 301:  60%|██████    | 605/1000 [03:57<02:32,  2.60it/s]\n# PTI :step: 604, epoch: 302:  60%|██████    | 605/1000 [03:57<02:32,  2.60it/s]\n# PTI :step: 604, epoch: 302:  61%|██████    | 606/1000 [03:57<02:32,  2.58it/s]\n# PTI :step: 605, epoch: 302:  61%|██████    | 606/1000 [03:57<02:32,  2.58it/s]\n# PTI :step: 605, epoch: 302:  61%|██████    | 607/1000 [03:57<02:31,  2.59it/s]\n# PTI :step: 606, epoch: 303:  61%|██████    | 607/1000 [03:57<02:31,  2.59it/s]\n# PTI :step: 606, epoch: 303:  61%|██████    | 608/1000 [03:58<02:32,  2.58it/s]\n# PTI :step: 607, epoch: 303:  61%|██████    | 608/1000 [03:58<02:32,  2.58it/s]\n# PTI :step: 607, epoch: 303:  61%|██████    | 609/1000 [03:58<02:29,  2.61it/s]\n# PTI :step: 608, epoch: 304:  61%|██████    | 609/1000 [03:58<02:29,  2.61it/s]\n# PTI :step: 608, epoch: 304:  61%|██████    | 610/1000 [03:58<02:30,  2.59it/s]\n# PTI :step: 609, epoch: 304:  61%|██████    | 610/1000 [03:58<02:30,  2.59it/s]\n# PTI :step: 609, epoch: 304:  61%|██████    | 611/1000 [03:59<02:29,  2.61it/s]\n# PTI :step: 610, epoch: 305:  61%|██████    | 611/1000 [03:59<02:29,  2.61it/s]\n# PTI :step: 610, epoch: 305:  61%|██████    | 612/1000 [03:59<02:31,  2.56it/s]\n# PTI :step: 611, epoch: 305:  61%|██████    | 612/1000 [03:59<02:31,  2.56it/s]\n# PTI :step: 611, epoch: 305:  61%|██████▏   | 613/1000 [04:00<02:30,  2.58it/s]\n# PTI :step: 612, epoch: 306:  61%|██████▏   | 613/1000 [04:00<02:30,  2.58it/s]\n# PTI :step: 612, epoch: 306:  61%|██████▏   | 614/1000 [04:00<02:30,  2.57it/s]\n# PTI :step: 613, epoch: 306:  61%|██████▏   | 614/1000 [04:00<02:30,  2.57it/s]\n# PTI :step: 613, epoch: 306:  62%|██████▏   | 615/1000 [04:00<02:29,  2.58it/s]\n# PTI :step: 614, epoch: 307:  62%|██████▏   | 615/1000 [04:00<02:29,  2.58it/s]\n# PTI :step: 614, epoch: 307:  62%|██████▏   | 616/1000 [04:01<02:29,  2.57it/s]\n# PTI :step: 615, epoch: 307:  62%|██████▏   | 616/1000 [04:01<02:29,  2.57it/s]\n# PTI :step: 615, epoch: 307:  62%|██████▏   | 617/1000 [04:01<02:29,  2.57it/s]\n# PTI :step: 616, epoch: 308:  62%|██████▏   | 617/1000 [04:01<02:29,  2.57it/s]\n# PTI :step: 616, epoch: 308:  62%|██████▏   | 618/1000 [04:02<02:29,  2.56it/s]\n# PTI :step: 617, epoch: 308:  62%|██████▏   | 618/1000 [04:02<02:29,  2.56it/s]\n# PTI :step: 617, epoch: 308:  62%|██████▏   | 619/1000 [04:02<02:27,  2.59it/s]\n# PTI :step: 618, epoch: 309:  62%|██████▏   | 619/1000 [04:02<02:27,  2.59it/s]\n# PTI :step: 618, epoch: 309:  62%|██████▏   | 620/1000 [04:02<02:29,  2.55it/s]\n# PTI :step: 619, epoch: 309:  62%|██████▏   | 620/1000 [04:02<02:29,  2.55it/s]\n# PTI :step: 619, epoch: 309:  62%|██████▏   | 621/1000 [04:03<02:27,  2.58it/s]\n# PTI :step: 620, epoch: 310:  62%|██████▏   | 621/1000 [04:03<02:27,  2.58it/s]\n# PTI :step: 620, epoch: 310:  62%|██████▏   | 622/1000 [04:03<02:29,  2.53it/s]\n# PTI :step: 621, epoch: 310:  62%|██████▏   | 622/1000 [04:03<02:29,  2.53it/s]\n# PTI :step: 621, epoch: 310:  62%|██████▏   | 623/1000 [04:04<02:28,  2.54it/s]\n# PTI :step: 622, epoch: 311:  62%|██████▏   | 623/1000 [04:04<02:28,  2.54it/s]\n# PTI :step: 622, epoch: 311:  62%|██████▏   | 624/1000 [04:04<02:29,  2.52it/s]\n# PTI :step: 623, epoch: 311:  62%|██████▏   | 624/1000 [04:04<02:29,  2.52it/s]\n# PTI :step: 623, epoch: 311:  62%|██████▎   | 625/1000 [04:04<02:29,  2.51it/s]\n# PTI :step: 624, epoch: 312:  62%|██████▎   | 625/1000 [04:04<02:29,  2.51it/s]\n# PTI :step: 624, epoch: 312:  63%|██████▎   | 626/1000 [04:05<02:29,  2.50it/s]\n# PTI :step: 625, epoch: 312:  63%|██████▎   | 626/1000 [04:05<02:29,  2.50it/s]\n# PTI :step: 625, epoch: 312:  63%|██████▎   | 627/1000 [04:05<02:30,  2.48it/s]\n# PTI :step: 626, epoch: 313:  63%|██████▎   | 627/1000 [04:05<02:30,  2.48it/s]\n# PTI :step: 626, epoch: 313:  63%|██████▎   | 628/1000 [04:06<02:29,  2.49it/s]\n# PTI :step: 627, epoch: 313:  63%|██████▎   | 628/1000 [04:06<02:29,  2.49it/s]\n# PTI :step: 627, epoch: 313:  63%|██████▎   | 629/1000 [04:06<02:27,  2.52it/s]\n# PTI :step: 628, epoch: 314:  63%|██████▎   | 629/1000 [04:06<02:27,  2.52it/s]\n# PTI :step: 628, epoch: 314:  63%|██████▎   | 630/1000 [04:06<02:27,  2.51it/s]\n# PTI :step: 629, epoch: 314:  63%|██████▎   | 630/1000 [04:06<02:27,  2.51it/s]\n# PTI :step: 629, epoch: 314:  63%|██████▎   | 631/1000 [04:07<02:25,  2.53it/s]\n# PTI :step: 630, epoch: 315:  63%|██████▎   | 631/1000 [04:07<02:25,  2.53it/s]\n# PTI :step: 630, epoch: 315:  63%|██████▎   | 632/1000 [04:07<02:26,  2.52it/s]\n# PTI :step: 631, epoch: 315:  63%|██████▎   | 632/1000 [04:07<02:26,  2.52it/s]\n# PTI :step: 631, epoch: 315:  63%|██████▎   | 633/1000 [04:08<02:23,  2.55it/s]\n# PTI :step: 632, epoch: 316:  63%|██████▎   | 633/1000 [04:08<02:23,  2.55it/s]\n# PTI :step: 632, epoch: 316:  63%|██████▎   | 634/1000 [04:08<02:24,  2.54it/s]\n# PTI :step: 633, epoch: 316:  63%|██████▎   | 634/1000 [04:08<02:24,  2.54it/s]\n# PTI :step: 633, epoch: 316:  64%|██████▎   | 635/1000 [04:08<02:21,  2.58it/s]\n# PTI :step: 634, epoch: 317:  64%|██████▎   | 635/1000 [04:08<02:21,  2.58it/s]\n# PTI :step: 634, epoch: 317:  64%|██████▎   | 636/1000 [04:09<02:21,  2.57it/s]\n# PTI :step: 635, epoch: 317:  64%|██████▎   | 636/1000 [04:09<02:21,  2.57it/s]\n# PTI :step: 635, epoch: 317:  64%|██████▎   | 637/1000 [04:09<02:20,  2.59it/s]\n# PTI :step: 636, epoch: 318:  64%|██████▎   | 637/1000 [04:09<02:20,  2.59it/s]\n# PTI :step: 636, epoch: 318:  64%|██████▍   | 638/1000 [04:09<02:20,  2.58it/s]\n# PTI :step: 637, epoch: 318:  64%|██████▍   | 638/1000 [04:09<02:20,  2.58it/s]\n# PTI :step: 637, epoch: 318:  64%|██████▍   | 639/1000 [04:10<02:18,  2.61it/s]\n# PTI :step: 638, epoch: 319:  64%|██████▍   | 639/1000 [04:10<02:18,  2.61it/s]\n# PTI :step: 638, epoch: 319:  64%|██████▍   | 640/1000 [04:10<02:19,  2.58it/s]\n# PTI :step: 639, epoch: 319:  64%|██████▍   | 640/1000 [04:10<02:19,  2.58it/s]\n# PTI :step: 639, epoch: 319:  64%|██████▍   | 641/1000 [04:11<02:18,  2.59it/s]\n# PTI :step: 640, epoch: 320:  64%|██████▍   | 641/1000 [04:11<02:18,  2.59it/s]\n# PTI :step: 640, epoch: 320:  64%|██████▍   | 642/1000 [04:11<02:19,  2.57it/s]\n# PTI :step: 641, epoch: 320:  64%|██████▍   | 642/1000 [04:11<02:19,  2.57it/s]\n# PTI :step: 641, epoch: 320:  64%|██████▍   | 643/1000 [04:11<02:18,  2.58it/s]\n# PTI :step: 642, epoch: 321:  64%|██████▍   | 643/1000 [04:11<02:18,  2.58it/s]\n# PTI :step: 642, epoch: 321:  64%|██████▍   | 644/1000 [04:12<02:19,  2.56it/s]\n# PTI :step: 643, epoch: 321:  64%|██████▍   | 644/1000 [04:12<02:19,  2.56it/s]\n# PTI :step: 643, epoch: 321:  64%|██████▍   | 645/1000 [04:12<02:17,  2.58it/s]\n# PTI :step: 644, epoch: 322:  64%|██████▍   | 645/1000 [04:12<02:17,  2.58it/s]\n# PTI :step: 644, epoch: 322:  65%|██████▍   | 646/1000 [04:13<02:17,  2.57it/s]\n# PTI :step: 645, epoch: 322:  65%|██████▍   | 646/1000 [04:13<02:17,  2.57it/s]\n# PTI :step: 645, epoch: 322:  65%|██████▍   | 647/1000 [04:13<02:15,  2.60it/s]\n# PTI :step: 646, epoch: 323:  65%|██████▍   | 647/1000 [04:13<02:15,  2.60it/s]\n# PTI :step: 646, epoch: 323:  65%|██████▍   | 648/1000 [04:13<02:16,  2.58it/s]\n# PTI :step: 647, epoch: 323:  65%|██████▍   | 648/1000 [04:13<02:16,  2.58it/s]\n# PTI :step: 647, epoch: 323:  65%|██████▍   | 649/1000 [04:14<02:14,  2.61it/s]\n# PTI :step: 648, epoch: 324:  65%|██████▍   | 649/1000 [04:14<02:14,  2.61it/s]\n# PTI :step: 648, epoch: 324:  65%|██████▌   | 650/1000 [04:14<02:15,  2.59it/s]\n# PTI :step: 649, epoch: 324:  65%|██████▌   | 650/1000 [04:14<02:15,  2.59it/s]\n# PTI :step: 649, epoch: 324:  65%|██████▌   | 651/1000 [04:14<02:13,  2.61it/s]\n# PTI :step: 650, epoch: 325:  65%|██████▌   | 651/1000 [04:14<02:13,  2.61it/s]\n# PTI :step: 650, epoch: 325:  65%|██████▌   | 652/1000 [04:15<02:14,  2.58it/s]\n# PTI :step: 651, epoch: 325:  65%|██████▌   | 652/1000 [04:15<02:14,  2.58it/s]\n# PTI :step: 651, epoch: 325:  65%|██████▌   | 653/1000 [04:15<02:15,  2.56it/s]\n# PTI :step: 652, epoch: 326:  65%|██████▌   | 653/1000 [04:15<02:15,  2.56it/s]\n# PTI :step: 652, epoch: 326:  65%|██████▌   | 654/1000 [04:16<02:15,  2.55it/s]\n# PTI :step: 653, epoch: 326:  65%|██████▌   | 654/1000 [04:16<02:15,  2.55it/s]\n# PTI :step: 653, epoch: 326:  66%|██████▌   | 655/1000 [04:16<02:13,  2.58it/s]\n# PTI :step: 654, epoch: 327:  66%|██████▌   | 655/1000 [04:16<02:13,  2.58it/s]\n# PTI :step: 654, epoch: 327:  66%|██████▌   | 656/1000 [04:16<02:14,  2.56it/s]\n# PTI :step: 655, epoch: 327:  66%|██████▌   | 656/1000 [04:16<02:14,  2.56it/s]\n# PTI :step: 655, epoch: 327:  66%|██████▌   | 657/1000 [04:17<02:12,  2.60it/s]\n# PTI :step: 656, epoch: 328:  66%|██████▌   | 657/1000 [04:17<02:12,  2.60it/s]\n# PTI :step: 656, epoch: 328:  66%|██████▌   | 658/1000 [04:17<02:13,  2.55it/s]\n# PTI :step: 657, epoch: 328:  66%|██████▌   | 658/1000 [04:17<02:13,  2.55it/s]\n# PTI :step: 657, epoch: 328:  66%|██████▌   | 659/1000 [04:18<02:14,  2.54it/s]\n# PTI :step: 658, epoch: 329:  66%|██████▌   | 659/1000 [04:18<02:14,  2.54it/s]\n# PTI :step: 658, epoch: 329:  66%|██████▌   | 660/1000 [04:18<02:14,  2.53it/s]\n# PTI :step: 659, epoch: 329:  66%|██████▌   | 660/1000 [04:18<02:14,  2.53it/s]\n# PTI :step: 659, epoch: 329:  66%|██████▌   | 661/1000 [04:18<02:11,  2.57it/s]\n# PTI :step: 660, epoch: 330:  66%|██████▌   | 661/1000 [04:18<02:11,  2.57it/s]\n# PTI :step: 660, epoch: 330:  66%|██████▌   | 662/1000 [04:19<02:12,  2.56it/s]\n# PTI :step: 661, epoch: 330:  66%|██████▌   | 662/1000 [04:19<02:12,  2.56it/s]\n# PTI :step: 661, epoch: 330:  66%|██████▋   | 663/1000 [04:19<02:11,  2.57it/s]\n# PTI :step: 662, epoch: 331:  66%|██████▋   | 663/1000 [04:19<02:11,  2.57it/s]\n# PTI :step: 662, epoch: 331:  66%|██████▋   | 664/1000 [04:20<02:11,  2.56it/s]\n# PTI :step: 663, epoch: 331:  66%|██████▋   | 664/1000 [04:20<02:11,  2.56it/s]\n# PTI :step: 663, epoch: 331:  66%|██████▋   | 665/1000 [04:20<02:10,  2.57it/s]\n# PTI :step: 664, epoch: 332:  66%|██████▋   | 665/1000 [04:20<02:10,  2.57it/s]\n# PTI :step: 664, epoch: 332:  67%|██████▋   | 666/1000 [04:20<02:10,  2.56it/s]\n# PTI :step: 665, epoch: 332:  67%|██████▋   | 666/1000 [04:20<02:10,  2.56it/s]\n# PTI :step: 665, epoch: 332:  67%|██████▋   | 667/1000 [04:21<02:08,  2.60it/s]\n# PTI :step: 666, epoch: 333:  67%|██████▋   | 667/1000 [04:21<02:08,  2.60it/s]\n# PTI :step: 666, epoch: 333:  67%|██████▋   | 668/1000 [04:21<02:08,  2.58it/s]\n# PTI :step: 667, epoch: 333:  67%|██████▋   | 668/1000 [04:21<02:08,  2.58it/s]\n# PTI :step: 667, epoch: 333:  67%|██████▋   | 669/1000 [04:21<02:06,  2.62it/s]\n# PTI :step: 668, epoch: 334:  67%|██████▋   | 669/1000 [04:21<02:06,  2.62it/s]\n# PTI :step: 668, epoch: 334:  67%|██████▋   | 670/1000 [04:22<02:06,  2.60it/s]\n# PTI :step: 669, epoch: 334:  67%|██████▋   | 670/1000 [04:22<02:06,  2.60it/s]\n# PTI :step: 669, epoch: 334:  67%|██████▋   | 671/1000 [04:22<02:05,  2.62it/s]\n# PTI :step: 670, epoch: 335:  67%|██████▋   | 671/1000 [04:22<02:05,  2.62it/s]\n# PTI :step: 670, epoch: 335:  67%|██████▋   | 672/1000 [04:23<02:06,  2.60it/s]\n# PTI :step: 671, epoch: 335:  67%|██████▋   | 672/1000 [04:23<02:06,  2.60it/s]\n# PTI :step: 671, epoch: 335:  67%|██████▋   | 673/1000 [04:23<02:05,  2.60it/s]\n# PTI :step: 672, epoch: 336:  67%|██████▋   | 673/1000 [04:23<02:05,  2.60it/s]\n# PTI :step: 672, epoch: 336:  67%|██████▋   | 674/1000 [04:23<02:05,  2.59it/s]\n# PTI :step: 673, epoch: 336:  67%|██████▋   | 674/1000 [04:23<02:05,  2.59it/s]\n# PTI :step: 673, epoch: 336:  68%|██████▊   | 675/1000 [04:24<02:04,  2.62it/s]\n# PTI :step: 674, epoch: 337:  68%|██████▊   | 675/1000 [04:24<02:04,  2.62it/s]\n# PTI :step: 674, epoch: 337:  68%|██████▊   | 676/1000 [04:24<02:04,  2.59it/s]\n# PTI :step: 675, epoch: 337:  68%|██████▊   | 676/1000 [04:24<02:04,  2.59it/s]\n# PTI :step: 675, epoch: 337:  68%|██████▊   | 677/1000 [04:25<02:03,  2.62it/s]\n# PTI :step: 676, epoch: 338:  68%|██████▊   | 677/1000 [04:25<02:03,  2.62it/s]\n# PTI :step: 676, epoch: 338:  68%|██████▊   | 678/1000 [04:25<02:04,  2.60it/s]\n# PTI :step: 677, epoch: 338:  68%|██████▊   | 678/1000 [04:25<02:04,  2.60it/s]\n# PTI :step: 677, epoch: 338:  68%|██████▊   | 679/1000 [04:25<02:05,  2.55it/s]\n# PTI :step: 678, epoch: 339:  68%|██████▊   | 679/1000 [04:25<02:05,  2.55it/s]\n# PTI :step: 678, epoch: 339:  68%|██████▊   | 680/1000 [04:26<02:05,  2.54it/s]\n# PTI :step: 679, epoch: 339:  68%|██████▊   | 680/1000 [04:26<02:05,  2.54it/s]\n# PTI :step: 679, epoch: 339:  68%|██████▊   | 681/1000 [04:26<02:04,  2.57it/s]\n# PTI :step: 680, epoch: 340:  68%|██████▊   | 681/1000 [04:26<02:04,  2.57it/s]\n# PTI :step: 680, epoch: 340:  68%|██████▊   | 682/1000 [04:26<02:04,  2.56it/s]\n# PTI :step: 681, epoch: 340:  68%|██████▊   | 682/1000 [04:26<02:04,  2.56it/s]\n# PTI :step: 681, epoch: 340:  68%|██████▊   | 683/1000 [04:27<02:15,  2.35it/s]\n# PTI :step: 682, epoch: 341:  68%|██████▊   | 683/1000 [04:27<02:15,  2.35it/s]\n# PTI :step: 682, epoch: 341:  68%|██████▊   | 684/1000 [04:27<02:11,  2.40it/s]\n# PTI :step: 683, epoch: 341:  68%|██████▊   | 684/1000 [04:27<02:11,  2.40it/s]\n# PTI :step: 683, epoch: 341:  68%|██████▊   | 685/1000 [04:28<02:07,  2.46it/s]\n# PTI :step: 684, epoch: 342:  68%|██████▊   | 685/1000 [04:28<02:07,  2.46it/s]\n# PTI :step: 684, epoch: 342:  69%|██████▊   | 686/1000 [04:28<02:06,  2.49it/s]\n# PTI :step: 685, epoch: 342:  69%|██████▊   | 686/1000 [04:28<02:06,  2.49it/s]\n# PTI :step: 685, epoch: 342:  69%|██████▊   | 687/1000 [04:29<02:02,  2.55it/s]\n# PTI :step: 686, epoch: 343:  69%|██████▊   | 687/1000 [04:29<02:02,  2.55it/s]\n# PTI :step: 686, epoch: 343:  69%|██████▉   | 688/1000 [04:29<02:03,  2.53it/s]\n# PTI :step: 687, epoch: 343:  69%|██████▉   | 688/1000 [04:29<02:03,  2.53it/s]\n# PTI :step: 687, epoch: 343:  69%|██████▉   | 689/1000 [04:29<02:00,  2.57it/s]\n# PTI :step: 688, epoch: 344:  69%|██████▉   | 689/1000 [04:29<02:00,  2.57it/s]\n# PTI :step: 688, epoch: 344:  69%|██████▉   | 690/1000 [04:30<02:00,  2.56it/s]\n# PTI :step: 689, epoch: 344:  69%|██████▉   | 690/1000 [04:30<02:00,  2.56it/s]\n# PTI :step: 689, epoch: 344:  69%|██████▉   | 691/1000 [04:30<01:59,  2.59it/s]\n# PTI :step: 690, epoch: 345:  69%|██████▉   | 691/1000 [04:30<01:59,  2.59it/s]\n# PTI :step: 690, epoch: 345:  69%|██████▉   | 692/1000 [04:30<01:59,  2.58it/s]\n# PTI :step: 691, epoch: 345:  69%|██████▉   | 692/1000 [04:30<01:59,  2.58it/s]\n# PTI :step: 691, epoch: 345:  69%|██████▉   | 693/1000 [04:31<01:57,  2.61it/s]\n# PTI :step: 692, epoch: 346:  69%|██████▉   | 693/1000 [04:31<01:57,  2.61it/s]\n# PTI :step: 692, epoch: 346:  69%|██████▉   | 694/1000 [04:31<01:59,  2.56it/s]\n# PTI :step: 693, epoch: 346:  69%|██████▉   | 694/1000 [04:31<01:59,  2.56it/s]\n# PTI :step: 693, epoch: 346:  70%|██████▉   | 695/1000 [04:32<01:57,  2.59it/s]\n# PTI :step: 694, epoch: 347:  70%|██████▉   | 695/1000 [04:32<01:57,  2.59it/s]\n# PTI :step: 694, epoch: 347:  70%|██████▉   | 696/1000 [04:32<01:58,  2.57it/s]\n# PTI :step: 695, epoch: 347:  70%|██████▉   | 696/1000 [04:32<01:58,  2.57it/s]\n# PTI :step: 695, epoch: 347:  70%|██████▉   | 697/1000 [04:32<01:56,  2.60it/s]\n# PTI :step: 696, epoch: 348:  70%|██████▉   | 697/1000 [04:32<01:56,  2.60it/s]\n# PTI :step: 696, epoch: 348:  70%|██████▉   | 698/1000 [04:33<01:56,  2.59it/s]\n# PTI :step: 697, epoch: 348:  70%|██████▉   | 698/1000 [04:33<01:56,  2.59it/s]\n# PTI :step: 697, epoch: 348:  70%|██████▉   | 699/1000 [04:33<01:56,  2.59it/s]\n# PTI :step: 698, epoch: 349:  70%|██████▉   | 699/1000 [04:33<01:56,  2.59it/s]\n# PTI :step: 698, epoch: 349:  70%|███████   | 700/1000 [04:34<01:56,  2.58it/s]\n# PTI :step: 699, epoch: 349:  70%|███████   | 700/1000 [04:34<01:56,  2.58it/s]\n# PTI :step: 699, epoch: 349:  70%|███████   | 701/1000 [04:34<01:54,  2.60it/s]\n# PTI :step: 700, epoch: 350:  70%|███████   | 701/1000 [04:34<01:54,  2.60it/s]\n# PTI :step: 700, epoch: 350:  70%|███████   | 702/1000 [04:34<01:55,  2.59it/s]\n# PTI :step: 701, epoch: 350:  70%|███████   | 702/1000 [04:34<01:55,  2.59it/s]\n# PTI :step: 701, epoch: 350:  70%|███████   | 703/1000 [04:35<01:53,  2.62it/s]\n# PTI :step: 702, epoch: 351:  70%|███████   | 703/1000 [04:35<01:53,  2.62it/s]\n# PTI :step: 702, epoch: 351:  70%|███████   | 704/1000 [04:35<01:54,  2.58it/s]\n# PTI :step: 703, epoch: 351:  70%|███████   | 704/1000 [04:35<01:54,  2.58it/s]\n# PTI :step: 703, epoch: 351:  70%|███████   | 705/1000 [04:35<01:53,  2.60it/s]\n# PTI :step: 704, epoch: 352:  70%|███████   | 705/1000 [04:35<01:53,  2.60it/s]\n# PTI :step: 704, epoch: 352:  71%|███████   | 706/1000 [04:36<01:54,  2.57it/s]\n# PTI :step: 705, epoch: 352:  71%|███████   | 706/1000 [04:36<01:54,  2.57it/s]\n# PTI :step: 705, epoch: 352:  71%|███████   | 707/1000 [04:36<01:53,  2.58it/s]\n# PTI :step: 706, epoch: 353:  71%|███████   | 707/1000 [04:36<01:53,  2.58it/s]\n# PTI :step: 706, epoch: 353:  71%|███████   | 708/1000 [04:37<01:53,  2.57it/s]\n# PTI :step: 707, epoch: 353:  71%|███████   | 708/1000 [04:37<01:53,  2.57it/s]\n# PTI :step: 707, epoch: 353:  71%|███████   | 709/1000 [04:37<01:52,  2.59it/s]\n# PTI :step: 708, epoch: 354:  71%|███████   | 709/1000 [04:37<01:52,  2.59it/s]\n# PTI :step: 708, epoch: 354:  71%|███████   | 710/1000 [04:37<01:52,  2.58it/s]\n# PTI :step: 709, epoch: 354:  71%|███████   | 710/1000 [04:37<01:52,  2.58it/s]\n# PTI :step: 709, epoch: 354:  71%|███████   | 711/1000 [04:38<01:51,  2.60it/s]\n# PTI :step: 710, epoch: 355:  71%|███████   | 711/1000 [04:38<01:51,  2.60it/s]\n# PTI :step: 710, epoch: 355:  71%|███████   | 712/1000 [04:38<01:51,  2.58it/s]\n# PTI :step: 711, epoch: 355:  71%|███████   | 712/1000 [04:38<01:51,  2.58it/s]\n# PTI :step: 711, epoch: 355:  71%|███████▏  | 713/1000 [04:39<01:50,  2.60it/s]\n# PTI :step: 712, epoch: 356:  71%|███████▏  | 713/1000 [04:39<01:50,  2.60it/s]\n# PTI :step: 712, epoch: 356:  71%|███████▏  | 714/1000 [04:39<01:50,  2.58it/s]\n# PTI :step: 713, epoch: 356:  71%|███████▏  | 714/1000 [04:39<01:50,  2.58it/s]\n# PTI :step: 713, epoch: 356:  72%|███████▏  | 715/1000 [04:39<01:49,  2.60it/s]\n# PTI :step: 714, epoch: 357:  72%|███████▏  | 715/1000 [04:39<01:49,  2.60it/s]\n# PTI :step: 714, epoch: 357:  72%|███████▏  | 716/1000 [04:40<01:49,  2.59it/s]\n# PTI :step: 715, epoch: 357:  72%|███████▏  | 716/1000 [04:40<01:49,  2.59it/s]\n# PTI :step: 715, epoch: 357:  72%|███████▏  | 717/1000 [04:40<01:49,  2.59it/s]\n# PTI :step: 716, epoch: 358:  72%|███████▏  | 717/1000 [04:40<01:49,  2.59it/s]\n# PTI :step: 716, epoch: 358:  72%|███████▏  | 718/1000 [04:41<01:49,  2.58it/s]\n# PTI :step: 717, epoch: 358:  72%|███████▏  | 718/1000 [04:41<01:49,  2.58it/s]\n# PTI :step: 717, epoch: 358:  72%|███████▏  | 719/1000 [04:41<01:48,  2.58it/s]\n# PTI :step: 718, epoch: 359:  72%|███████▏  | 719/1000 [04:41<01:48,  2.58it/s]\n# PTI :step: 718, epoch: 359:  72%|███████▏  | 720/1000 [04:41<01:49,  2.56it/s]\n# PTI :step: 719, epoch: 359:  72%|███████▏  | 720/1000 [04:41<01:49,  2.56it/s]\n# PTI :step: 719, epoch: 359:  72%|███████▏  | 721/1000 [04:42<01:47,  2.59it/s]\n# PTI :step: 720, epoch: 360:  72%|███████▏  | 721/1000 [04:42<01:47,  2.59it/s]\n# PTI :step: 720, epoch: 360:  72%|███████▏  | 722/1000 [04:42<01:47,  2.58it/s]\n# PTI :step: 721, epoch: 360:  72%|███████▏  | 722/1000 [04:42<01:47,  2.58it/s]\n# PTI :step: 721, epoch: 360:  72%|███████▏  | 723/1000 [04:42<01:46,  2.60it/s]\n# PTI :step: 722, epoch: 361:  72%|███████▏  | 723/1000 [04:42<01:46,  2.60it/s]\n# PTI :step: 722, epoch: 361:  72%|███████▏  | 724/1000 [04:43<01:46,  2.58it/s]\n# PTI :step: 723, epoch: 361:  72%|███████▏  | 724/1000 [04:43<01:46,  2.58it/s]\n# PTI :step: 723, epoch: 361:  72%|███████▎  | 725/1000 [04:43<01:45,  2.61it/s]\n# PTI :step: 724, epoch: 362:  72%|███████▎  | 725/1000 [04:43<01:45,  2.61it/s]\n# PTI :step: 724, epoch: 362:  73%|███████▎  | 726/1000 [04:44<01:45,  2.59it/s]\n# PTI :step: 725, epoch: 362:  73%|███████▎  | 726/1000 [04:44<01:45,  2.59it/s]\n# PTI :step: 725, epoch: 362:  73%|███████▎  | 727/1000 [04:44<01:44,  2.60it/s]\n# PTI :step: 726, epoch: 363:  73%|███████▎  | 727/1000 [04:44<01:44,  2.60it/s]\n# PTI :step: 726, epoch: 363:  73%|███████▎  | 728/1000 [04:44<01:45,  2.58it/s]\n# PTI :step: 727, epoch: 363:  73%|███████▎  | 728/1000 [04:44<01:45,  2.58it/s]\n# PTI :step: 727, epoch: 363:  73%|███████▎  | 729/1000 [04:45<01:44,  2.61it/s]\n# PTI :step: 728, epoch: 364:  73%|███████▎  | 729/1000 [04:45<01:44,  2.61it/s]\n# PTI :step: 728, epoch: 364:  73%|███████▎  | 730/1000 [04:45<01:44,  2.58it/s]\n# PTI :step: 729, epoch: 364:  73%|███████▎  | 730/1000 [04:45<01:44,  2.58it/s]\n# PTI :step: 729, epoch: 364:  73%|███████▎  | 731/1000 [04:46<01:43,  2.61it/s]\n# PTI :step: 730, epoch: 365:  73%|███████▎  | 731/1000 [04:46<01:43,  2.61it/s]\n# PTI :step: 730, epoch: 365:  73%|███████▎  | 732/1000 [04:46<01:43,  2.59it/s]\n# PTI :step: 731, epoch: 365:  73%|███████▎  | 732/1000 [04:46<01:43,  2.59it/s]\n# PTI :step: 731, epoch: 365:  73%|███████▎  | 733/1000 [04:46<01:42,  2.62it/s]\n# PTI :step: 732, epoch: 366:  73%|███████▎  | 733/1000 [04:46<01:42,  2.62it/s]\n# PTI :step: 732, epoch: 366:  73%|███████▎  | 734/1000 [04:47<01:42,  2.60it/s]\n# PTI :step: 733, epoch: 366:  73%|███████▎  | 734/1000 [04:47<01:42,  2.60it/s]\n# PTI :step: 733, epoch: 366:  74%|███████▎  | 735/1000 [04:47<01:41,  2.60it/s]\n# PTI :step: 734, epoch: 367:  74%|███████▎  | 735/1000 [04:47<01:41,  2.60it/s]\n# PTI :step: 734, epoch: 367:  74%|███████▎  | 736/1000 [04:47<01:42,  2.59it/s]\n# PTI :step: 735, epoch: 367:  74%|███████▎  | 736/1000 [04:47<01:42,  2.59it/s]\n# PTI :step: 735, epoch: 367:  74%|███████▎  | 737/1000 [04:48<01:40,  2.61it/s]\n# PTI :step: 736, epoch: 368:  74%|███████▎  | 737/1000 [04:48<01:40,  2.61it/s]\n# PTI :step: 736, epoch: 368:  74%|███████▍  | 738/1000 [04:48<01:42,  2.57it/s]\n# PTI :step: 737, epoch: 368:  74%|███████▍  | 738/1000 [04:48<01:42,  2.57it/s]\n# PTI :step: 737, epoch: 368:  74%|███████▍  | 739/1000 [04:49<01:41,  2.57it/s]\n# PTI :step: 738, epoch: 369:  74%|███████▍  | 739/1000 [04:49<01:41,  2.57it/s]\n# PTI :step: 738, epoch: 369:  74%|███████▍  | 740/1000 [04:49<01:41,  2.56it/s]\n# PTI :step: 739, epoch: 369:  74%|███████▍  | 740/1000 [04:49<01:41,  2.56it/s]\n# PTI :step: 739, epoch: 369:  74%|███████▍  | 741/1000 [04:49<01:39,  2.59it/s]\n# PTI :step: 740, epoch: 370:  74%|███████▍  | 741/1000 [04:49<01:39,  2.59it/s]\n# PTI :step: 740, epoch: 370:  74%|███████▍  | 742/1000 [04:50<01:40,  2.57it/s]\n# PTI :step: 741, epoch: 370:  74%|███████▍  | 742/1000 [04:50<01:40,  2.57it/s]\n# PTI :step: 741, epoch: 370:  74%|███████▍  | 743/1000 [04:50<01:39,  2.58it/s]\n# PTI :step: 742, epoch: 371:  74%|███████▍  | 743/1000 [04:50<01:39,  2.58it/s]\n# PTI :step: 742, epoch: 371:  74%|███████▍  | 744/1000 [04:51<01:39,  2.57it/s]\n# PTI :step: 743, epoch: 371:  74%|███████▍  | 744/1000 [04:51<01:39,  2.57it/s]\n# PTI :step: 743, epoch: 371:  74%|███████▍  | 745/1000 [04:51<01:38,  2.60it/s]\n# PTI :step: 744, epoch: 372:  74%|███████▍  | 745/1000 [04:51<01:38,  2.60it/s]\n# PTI :step: 744, epoch: 372:  75%|███████▍  | 746/1000 [04:51<01:38,  2.58it/s]\n# PTI :step: 745, epoch: 372:  75%|███████▍  | 746/1000 [04:51<01:38,  2.58it/s]\n# PTI :step: 745, epoch: 372:  75%|███████▍  | 747/1000 [04:52<01:37,  2.59it/s]\n# PTI :step: 746, epoch: 373:  75%|███████▍  | 747/1000 [04:52<01:37,  2.59it/s]\n# PTI :step: 746, epoch: 373:  75%|███████▍  | 748/1000 [04:52<01:38,  2.56it/s]\n# PTI :step: 747, epoch: 373:  75%|███████▍  | 748/1000 [04:52<01:38,  2.56it/s]\n# PTI :step: 747, epoch: 373:  75%|███████▍  | 749/1000 [04:53<01:36,  2.59it/s]\n# PTI :step: 748, epoch: 374:  75%|███████▍  | 749/1000 [04:53<01:36,  2.59it/s]\n# PTI :step: 748, epoch: 374:  75%|███████▌  | 750/1000 [04:53<01:37,  2.57it/s]\n# PTI :step: 749, epoch: 374:  75%|███████▌  | 750/1000 [04:53<01:37,  2.57it/s]\n# PTI :step: 749, epoch: 374:  75%|███████▌  | 751/1000 [04:53<01:35,  2.61it/s]\n# PTI :step: 750, epoch: 375:  75%|███████▌  | 751/1000 [04:53<01:35,  2.61it/s]\n# PTI :step: 750, epoch: 375:  75%|███████▌  | 752/1000 [04:54<01:35,  2.59it/s]\n# PTI :step: 751, epoch: 375:  75%|███████▌  | 752/1000 [04:54<01:35,  2.59it/s]\n# PTI :step: 751, epoch: 375:  75%|███████▌  | 753/1000 [04:54<01:34,  2.61it/s]\n# PTI :step: 752, epoch: 376:  75%|███████▌  | 753/1000 [04:54<01:34,  2.61it/s]\n# PTI :step: 752, epoch: 376:  75%|███████▌  | 754/1000 [04:54<01:34,  2.59it/s]\n# PTI :step: 753, epoch: 376:  75%|███████▌  | 754/1000 [04:54<01:34,  2.59it/s]\n# PTI :step: 753, epoch: 376:  76%|███████▌  | 755/1000 [04:55<01:41,  2.41it/s]\n# PTI :step: 754, epoch: 377:  76%|███████▌  | 755/1000 [04:55<01:41,  2.41it/s]\n# PTI :step: 754, epoch: 377:  76%|███████▌  | 756/1000 [04:55<01:40,  2.44it/s]\n# PTI :step: 755, epoch: 377:  76%|███████▌  | 756/1000 [04:55<01:40,  2.44it/s]\n# PTI :step: 755, epoch: 377:  76%|███████▌  | 757/1000 [04:56<01:36,  2.51it/s]\n# PTI :step: 756, epoch: 378:  76%|███████▌  | 757/1000 [04:56<01:36,  2.51it/s]\n# PTI :step: 756, epoch: 378:  76%|███████▌  | 758/1000 [04:56<01:36,  2.52it/s]\n# PTI :step: 757, epoch: 378:  76%|███████▌  | 758/1000 [04:56<01:36,  2.52it/s]\n# PTI :step: 757, epoch: 378:  76%|███████▌  | 759/1000 [04:56<01:33,  2.57it/s]\n# PTI :step: 758, epoch: 379:  76%|███████▌  | 759/1000 [04:56<01:33,  2.57it/s]\n# PTI :step: 758, epoch: 379:  76%|███████▌  | 760/1000 [04:57<01:33,  2.56it/s]\n# PTI :step: 759, epoch: 379:  76%|███████▌  | 760/1000 [04:57<01:33,  2.56it/s]\n# PTI :step: 759, epoch: 379:  76%|███████▌  | 761/1000 [04:57<01:33,  2.56it/s]\n# PTI :step: 760, epoch: 380:  76%|███████▌  | 761/1000 [04:57<01:33,  2.56it/s]\n# PTI :step: 760, epoch: 380:  76%|███████▌  | 762/1000 [04:58<01:33,  2.56it/s]\n# PTI :step: 761, epoch: 380:  76%|███████▌  | 762/1000 [04:58<01:33,  2.56it/s]\n# PTI :step: 761, epoch: 380:  76%|███████▋  | 763/1000 [04:58<01:31,  2.59it/s]\n# PTI :step: 762, epoch: 381:  76%|███████▋  | 763/1000 [04:58<01:31,  2.59it/s]\n# PTI :step: 762, epoch: 381:  76%|███████▋  | 764/1000 [04:58<01:31,  2.58it/s]\n# PTI :step: 763, epoch: 381:  76%|███████▋  | 764/1000 [04:58<01:31,  2.58it/s]\n# PTI :step: 763, epoch: 381:  76%|███████▋  | 765/1000 [04:59<01:29,  2.61it/s]\n# PTI :step: 764, epoch: 382:  76%|███████▋  | 765/1000 [04:59<01:29,  2.61it/s]\n# PTI :step: 764, epoch: 382:  77%|███████▋  | 766/1000 [04:59<01:31,  2.57it/s]\n# PTI :step: 765, epoch: 382:  77%|███████▋  | 766/1000 [04:59<01:31,  2.57it/s]\n# PTI :step: 765, epoch: 382:  77%|███████▋  | 767/1000 [05:00<01:29,  2.60it/s]\n# PTI :step: 766, epoch: 383:  77%|███████▋  | 767/1000 [05:00<01:29,  2.60it/s]\n# PTI :step: 766, epoch: 383:  77%|███████▋  | 768/1000 [05:00<01:29,  2.58it/s]\n# PTI :step: 767, epoch: 383:  77%|███████▋  | 768/1000 [05:00<01:29,  2.58it/s]\n# PTI :step: 767, epoch: 383:  77%|███████▋  | 769/1000 [05:00<01:28,  2.60it/s]\n# PTI :step: 768, epoch: 384:  77%|███████▋  | 769/1000 [05:00<01:28,  2.60it/s]\n# PTI :step: 768, epoch: 384:  77%|███████▋  | 770/1000 [05:01<01:29,  2.57it/s]\n# PTI :step: 769, epoch: 384:  77%|███████▋  | 770/1000 [05:01<01:29,  2.57it/s]\n# PTI :step: 769, epoch: 384:  77%|███████▋  | 771/1000 [05:01<01:29,  2.57it/s]\n# PTI :step: 770, epoch: 385:  77%|███████▋  | 771/1000 [05:01<01:29,  2.57it/s]\n# PTI :step: 770, epoch: 385:  77%|███████▋  | 772/1000 [05:01<01:28,  2.57it/s]\n# PTI :step: 771, epoch: 385:  77%|███████▋  | 772/1000 [05:01<01:28,  2.57it/s]\n# PTI :step: 771, epoch: 385:  77%|███████▋  | 773/1000 [05:02<01:27,  2.60it/s]\n# PTI :step: 772, epoch: 386:  77%|███████▋  | 773/1000 [05:02<01:27,  2.60it/s]\n# PTI :step: 772, epoch: 386:  77%|███████▋  | 774/1000 [05:02<01:28,  2.56it/s]\n# PTI :step: 773, epoch: 386:  77%|███████▋  | 774/1000 [05:02<01:28,  2.56it/s]\n# PTI :step: 773, epoch: 386:  78%|███████▊  | 775/1000 [05:03<01:27,  2.58it/s]\n# PTI :step: 774, epoch: 387:  78%|███████▊  | 775/1000 [05:03<01:27,  2.58it/s]\n# PTI :step: 774, epoch: 387:  78%|███████▊  | 776/1000 [05:03<01:27,  2.57it/s]\n# PTI :step: 775, epoch: 387:  78%|███████▊  | 776/1000 [05:03<01:27,  2.57it/s]\n# PTI :step: 775, epoch: 387:  78%|███████▊  | 777/1000 [05:03<01:25,  2.60it/s]\n# PTI :step: 776, epoch: 388:  78%|███████▊  | 777/1000 [05:03<01:25,  2.60it/s]\n# PTI :step: 776, epoch: 388:  78%|███████▊  | 778/1000 [05:04<01:26,  2.58it/s]\n# PTI :step: 777, epoch: 388:  78%|███████▊  | 778/1000 [05:04<01:26,  2.58it/s]\n# PTI :step: 777, epoch: 388:  78%|███████▊  | 779/1000 [05:04<01:25,  2.58it/s]\n# PTI :step: 778, epoch: 389:  78%|███████▊  | 779/1000 [05:04<01:25,  2.58it/s]\n# PTI :step: 778, epoch: 389:  78%|███████▊  | 780/1000 [05:05<01:25,  2.57it/s]\n# PTI :step: 779, epoch: 389:  78%|███████▊  | 780/1000 [05:05<01:25,  2.57it/s]\n# PTI :step: 779, epoch: 389:  78%|███████▊  | 781/1000 [05:05<01:24,  2.60it/s]\n# PTI :step: 780, epoch: 390:  78%|███████▊  | 781/1000 [05:05<01:24,  2.60it/s]\n# PTI :step: 780, epoch: 390:  78%|███████▊  | 782/1000 [05:05<01:24,  2.58it/s]\n# PTI :step: 781, epoch: 390:  78%|███████▊  | 782/1000 [05:05<01:24,  2.58it/s]\n# PTI :step: 781, epoch: 390:  78%|███████▊  | 783/1000 [05:06<01:22,  2.61it/s]\n# PTI :step: 782, epoch: 391:  78%|███████▊  | 783/1000 [05:06<01:22,  2.61it/s]\n# PTI :step: 782, epoch: 391:  78%|███████▊  | 784/1000 [05:06<01:23,  2.59it/s]\n# PTI :step: 783, epoch: 391:  78%|███████▊  | 784/1000 [05:06<01:23,  2.59it/s]\n# PTI :step: 783, epoch: 391:  78%|███████▊  | 785/1000 [05:07<01:22,  2.61it/s]\n# PTI :step: 784, epoch: 392:  78%|███████▊  | 785/1000 [05:07<01:22,  2.61it/s]\n# PTI :step: 784, epoch: 392:  79%|███████▊  | 786/1000 [05:07<01:23,  2.57it/s]\n# PTI :step: 785, epoch: 392:  79%|███████▊  | 786/1000 [05:07<01:23,  2.57it/s]\n# PTI :step: 785, epoch: 392:  79%|███████▊  | 787/1000 [05:07<01:22,  2.57it/s]\n# PTI :step: 786, epoch: 393:  79%|███████▊  | 787/1000 [05:07<01:22,  2.57it/s]\n# PTI :step: 786, epoch: 393:  79%|███████▉  | 788/1000 [05:08<01:23,  2.55it/s]\n# PTI :step: 787, epoch: 393:  79%|███████▉  | 788/1000 [05:08<01:23,  2.55it/s]\n# PTI :step: 787, epoch: 393:  79%|███████▉  | 789/1000 [05:08<01:22,  2.56it/s]\n# PTI :step: 788, epoch: 394:  79%|███████▉  | 789/1000 [05:08<01:22,  2.56it/s]\n# PTI :step: 788, epoch: 394:  79%|███████▉  | 790/1000 [05:08<01:22,  2.56it/s]\n# PTI :step: 789, epoch: 394:  79%|███████▉  | 790/1000 [05:08<01:22,  2.56it/s]\n# PTI :step: 789, epoch: 394:  79%|███████▉  | 791/1000 [05:09<01:20,  2.59it/s]\n# PTI :step: 790, epoch: 395:  79%|███████▉  | 791/1000 [05:09<01:20,  2.59it/s]\n# PTI :step: 790, epoch: 395:  79%|███████▉  | 792/1000 [05:09<01:20,  2.57it/s]\n# PTI :step: 791, epoch: 395:  79%|███████▉  | 792/1000 [05:09<01:20,  2.57it/s]\n# PTI :step: 791, epoch: 395:  79%|███████▉  | 793/1000 [05:10<01:19,  2.61it/s]\n# PTI :step: 792, epoch: 396:  79%|███████▉  | 793/1000 [05:10<01:19,  2.61it/s]\n# PTI :step: 792, epoch: 396:  79%|███████▉  | 794/1000 [05:10<01:19,  2.59it/s]\n# PTI :step: 793, epoch: 396:  79%|███████▉  | 794/1000 [05:10<01:19,  2.59it/s]\n# PTI :step: 793, epoch: 396:  80%|███████▉  | 795/1000 [05:10<01:18,  2.61it/s]\n# PTI :step: 794, epoch: 397:  80%|███████▉  | 795/1000 [05:10<01:18,  2.61it/s]\n# PTI :step: 794, epoch: 397:  80%|███████▉  | 796/1000 [05:11<01:18,  2.59it/s]\n# PTI :step: 795, epoch: 397:  80%|███████▉  | 796/1000 [05:11<01:18,  2.59it/s]\n# PTI :step: 795, epoch: 397:  80%|███████▉  | 797/1000 [05:11<01:18,  2.59it/s]\n# PTI :step: 796, epoch: 398:  80%|███████▉  | 797/1000 [05:11<01:18,  2.59it/s]\n# PTI :step: 796, epoch: 398:  80%|███████▉  | 798/1000 [05:12<01:18,  2.58it/s]\n# PTI :step: 797, epoch: 398:  80%|███████▉  | 798/1000 [05:12<01:18,  2.58it/s]\n# PTI :step: 797, epoch: 398:  80%|███████▉  | 799/1000 [05:12<01:17,  2.60it/s]\n# PTI :step: 798, epoch: 399:  80%|███████▉  | 799/1000 [05:12<01:17,  2.60it/s]\n# PTI :step: 798, epoch: 399:  80%|████████  | 800/1000 [05:12<01:17,  2.58it/s]\n# PTI :step: 799, epoch: 399:  80%|████████  | 800/1000 [05:12<01:17,  2.58it/s]\n# PTI :step: 799, epoch: 399:  80%|████████  | 801/1000 [05:13<01:16,  2.61it/s]\n# PTI :step: 800, epoch: 400:  80%|████████  | 801/1000 [05:13<01:16,  2.61it/s]\n# PTI :step: 800, epoch: 400:  80%|████████  | 802/1000 [05:13<01:16,  2.59it/s]\n# PTI :step: 801, epoch: 400:  80%|████████  | 802/1000 [05:13<01:16,  2.59it/s]\n# PTI :step: 801, epoch: 400:  80%|████████  | 803/1000 [05:13<01:15,  2.62it/s]\n# PTI :step: 802, epoch: 401:  80%|████████  | 803/1000 [05:13<01:15,  2.62it/s]\n# PTI :step: 802, epoch: 401:  80%|████████  | 804/1000 [05:14<01:15,  2.60it/s]\n# PTI :step: 803, epoch: 401:  80%|████████  | 804/1000 [05:14<01:15,  2.60it/s]\n# PTI :step: 803, epoch: 401:  80%|████████  | 805/1000 [05:14<01:14,  2.62it/s]\n# PTI :step: 804, epoch: 402:  80%|████████  | 805/1000 [05:14<01:14,  2.62it/s]\n# PTI :step: 804, epoch: 402:  81%|████████  | 806/1000 [05:15<01:14,  2.60it/s]\n# PTI :step: 805, epoch: 402:  81%|████████  | 806/1000 [05:15<01:14,  2.60it/s]\n# PTI :step: 805, epoch: 402:  81%|████████  | 807/1000 [05:15<01:13,  2.62it/s]\n# PTI :step: 806, epoch: 403:  81%|████████  | 807/1000 [05:15<01:13,  2.62it/s]\n# PTI :step: 806, epoch: 403:  81%|████████  | 808/1000 [05:15<01:14,  2.59it/s]\n# PTI :step: 807, epoch: 403:  81%|████████  | 808/1000 [05:15<01:14,  2.59it/s]\n# PTI :step: 807, epoch: 403:  81%|████████  | 809/1000 [05:16<01:13,  2.61it/s]\n# PTI :step: 808, epoch: 404:  81%|████████  | 809/1000 [05:16<01:13,  2.61it/s]\n# PTI :step: 808, epoch: 404:  81%|████████  | 810/1000 [05:16<01:19,  2.39it/s]\n# PTI :step: 809, epoch: 404:  81%|████████  | 810/1000 [05:16<01:19,  2.39it/s]\n# PTI :step: 809, epoch: 404:  81%|████████  | 811/1000 [05:17<01:16,  2.47it/s]\n# PTI :step: 810, epoch: 405:  81%|████████  | 811/1000 [05:17<01:16,  2.47it/s]\n# PTI :step: 810, epoch: 405:  81%|████████  | 812/1000 [05:17<01:15,  2.49it/s]\n# PTI :step: 811, epoch: 405:  81%|████████  | 812/1000 [05:17<01:15,  2.49it/s]\n# PTI :step: 811, epoch: 405:  81%|████████▏ | 813/1000 [05:17<01:13,  2.54it/s]\n# PTI :step: 812, epoch: 406:  81%|████████▏ | 813/1000 [05:17<01:13,  2.54it/s]\n# PTI :step: 812, epoch: 406:  81%|████████▏ | 814/1000 [05:18<01:13,  2.54it/s]\n# PTI :step: 813, epoch: 406:  81%|████████▏ | 814/1000 [05:18<01:13,  2.54it/s]\n# PTI :step: 813, epoch: 406:  82%|████████▏ | 815/1000 [05:18<01:12,  2.55it/s]\n# PTI :step: 814, epoch: 407:  82%|████████▏ | 815/1000 [05:18<01:12,  2.55it/s]\n# PTI :step: 814, epoch: 407:  82%|████████▏ | 816/1000 [05:19<01:12,  2.52it/s]\n# PTI :step: 815, epoch: 407:  82%|████████▏ | 816/1000 [05:19<01:12,  2.52it/s]\n# PTI :step: 815, epoch: 407:  82%|████████▏ | 817/1000 [05:19<01:11,  2.56it/s]\n# PTI :step: 816, epoch: 408:  82%|████████▏ | 817/1000 [05:19<01:11,  2.56it/s]\n# PTI :step: 816, epoch: 408:  82%|████████▏ | 818/1000 [05:19<01:11,  2.56it/s]\n# PTI :step: 817, epoch: 408:  82%|████████▏ | 818/1000 [05:19<01:11,  2.56it/s]\n# PTI :step: 817, epoch: 408:  82%|████████▏ | 819/1000 [05:20<01:09,  2.59it/s]\n# PTI :step: 818, epoch: 409:  82%|████████▏ | 819/1000 [05:20<01:09,  2.59it/s]\n# PTI :step: 818, epoch: 409:  82%|████████▏ | 820/1000 [05:20<01:10,  2.57it/s]\n# PTI :step: 819, epoch: 409:  82%|████████▏ | 820/1000 [05:20<01:10,  2.57it/s]\n# PTI :step: 819, epoch: 409:  82%|████████▏ | 821/1000 [05:21<01:08,  2.60it/s]\n# PTI :step: 820, epoch: 410:  82%|████████▏ | 821/1000 [05:21<01:08,  2.60it/s]\n# PTI :step: 820, epoch: 410:  82%|████████▏ | 822/1000 [05:21<01:09,  2.57it/s]\n# PTI :step: 821, epoch: 410:  82%|████████▏ | 822/1000 [05:21<01:09,  2.57it/s]\n# PTI :step: 821, epoch: 410:  82%|████████▏ | 823/1000 [05:21<01:08,  2.60it/s]\n# PTI :step: 822, epoch: 411:  82%|████████▏ | 823/1000 [05:21<01:08,  2.60it/s]\n# PTI :step: 822, epoch: 411:  82%|████████▏ | 824/1000 [05:22<01:08,  2.58it/s]\n# PTI :step: 823, epoch: 411:  82%|████████▏ | 824/1000 [05:22<01:08,  2.58it/s]\n# PTI :step: 823, epoch: 411:  82%|████████▎ | 825/1000 [05:22<01:07,  2.61it/s]\n# PTI :step: 824, epoch: 412:  82%|████████▎ | 825/1000 [05:22<01:07,  2.61it/s]\n# PTI :step: 824, epoch: 412:  83%|████████▎ | 826/1000 [05:22<01:07,  2.59it/s]\n# PTI :step: 825, epoch: 412:  83%|████████▎ | 826/1000 [05:22<01:07,  2.59it/s]\n# PTI :step: 825, epoch: 412:  83%|████████▎ | 827/1000 [05:23<01:06,  2.62it/s]\n# PTI :step: 826, epoch: 413:  83%|████████▎ | 827/1000 [05:23<01:06,  2.62it/s]\n# PTI :step: 826, epoch: 413:  83%|████████▎ | 828/1000 [05:23<01:06,  2.59it/s]\n# PTI :step: 827, epoch: 413:  83%|████████▎ | 828/1000 [05:23<01:06,  2.59it/s]\n# PTI :step: 827, epoch: 413:  83%|████████▎ | 829/1000 [05:24<01:05,  2.62it/s]\n# PTI :step: 828, epoch: 414:  83%|████████▎ | 829/1000 [05:24<01:05,  2.62it/s]\n# PTI :step: 828, epoch: 414:  83%|████████▎ | 830/1000 [05:24<01:05,  2.60it/s]\n# PTI :step: 829, epoch: 414:  83%|████████▎ | 830/1000 [05:24<01:05,  2.60it/s]\n# PTI :step: 829, epoch: 414:  83%|████████▎ | 831/1000 [05:24<01:04,  2.62it/s]\n# PTI :step: 830, epoch: 415:  83%|████████▎ | 831/1000 [05:24<01:04,  2.62it/s]\n# PTI :step: 830, epoch: 415:  83%|████████▎ | 832/1000 [05:25<01:04,  2.60it/s]\n# PTI :step: 831, epoch: 415:  83%|████████▎ | 832/1000 [05:25<01:04,  2.60it/s]\n# PTI :step: 831, epoch: 415:  83%|████████▎ | 833/1000 [05:25<01:04,  2.60it/s]\n# PTI :step: 832, epoch: 416:  83%|████████▎ | 833/1000 [05:25<01:04,  2.60it/s]\n# PTI :step: 832, epoch: 416:  83%|████████▎ | 834/1000 [05:26<01:04,  2.59it/s]\n# PTI :step: 833, epoch: 416:  83%|████████▎ | 834/1000 [05:26<01:04,  2.59it/s]\n# PTI :step: 833, epoch: 416:  84%|████████▎ | 835/1000 [05:26<01:03,  2.61it/s]\n# PTI :step: 834, epoch: 417:  84%|████████▎ | 835/1000 [05:26<01:03,  2.61it/s]\n# PTI :step: 834, epoch: 417:  84%|████████▎ | 836/1000 [05:26<01:03,  2.59it/s]\n# PTI :step: 835, epoch: 417:  84%|████████▎ | 836/1000 [05:26<01:03,  2.59it/s]\n# PTI :step: 835, epoch: 417:  84%|████████▎ | 837/1000 [05:27<01:02,  2.62it/s]\n# PTI :step: 836, epoch: 418:  84%|████████▎ | 837/1000 [05:27<01:02,  2.62it/s]\n# PTI :step: 836, epoch: 418:  84%|████████▍ | 838/1000 [05:27<01:02,  2.59it/s]\n# PTI :step: 837, epoch: 418:  84%|████████▍ | 838/1000 [05:27<01:02,  2.59it/s]\n# PTI :step: 837, epoch: 418:  84%|████████▍ | 839/1000 [05:27<01:01,  2.62it/s]\n# PTI :step: 838, epoch: 419:  84%|████████▍ | 839/1000 [05:27<01:01,  2.62it/s]\n# PTI :step: 838, epoch: 419:  84%|████████▍ | 840/1000 [05:28<01:01,  2.60it/s]\n# PTI :step: 839, epoch: 419:  84%|████████▍ | 840/1000 [05:28<01:01,  2.60it/s]\n# PTI :step: 839, epoch: 419:  84%|████████▍ | 841/1000 [05:28<01:00,  2.61it/s]\n# PTI :step: 840, epoch: 420:  84%|████████▍ | 841/1000 [05:28<01:00,  2.61it/s]\n# PTI :step: 840, epoch: 420:  84%|████████▍ | 842/1000 [05:29<01:01,  2.59it/s]\n# PTI :step: 841, epoch: 420:  84%|████████▍ | 842/1000 [05:29<01:01,  2.59it/s]\n# PTI :step: 841, epoch: 420:  84%|████████▍ | 843/1000 [05:29<01:00,  2.60it/s]\n# PTI :step: 842, epoch: 421:  84%|████████▍ | 843/1000 [05:29<01:00,  2.60it/s]\n# PTI :step: 842, epoch: 421:  84%|████████▍ | 844/1000 [05:29<01:00,  2.58it/s]\n# PTI :step: 843, epoch: 421:  84%|████████▍ | 844/1000 [05:29<01:00,  2.58it/s]\n# PTI :step: 843, epoch: 421:  84%|████████▍ | 845/1000 [05:30<00:59,  2.60it/s]\n# PTI :step: 844, epoch: 422:  84%|████████▍ | 845/1000 [05:30<00:59,  2.60it/s]\n# PTI :step: 844, epoch: 422:  85%|████████▍ | 846/1000 [05:30<00:59,  2.58it/s]\n# PTI :step: 845, epoch: 422:  85%|████████▍ | 846/1000 [05:30<00:59,  2.58it/s]\n# PTI :step: 845, epoch: 422:  85%|████████▍ | 847/1000 [05:31<00:58,  2.61it/s]\n# PTI :step: 846, epoch: 423:  85%|████████▍ | 847/1000 [05:31<00:58,  2.61it/s]\n# PTI :step: 846, epoch: 423:  85%|████████▍ | 848/1000 [05:31<00:58,  2.59it/s]\n# PTI :step: 847, epoch: 423:  85%|████████▍ | 848/1000 [05:31<00:58,  2.59it/s]\n# PTI :step: 847, epoch: 423:  85%|████████▍ | 849/1000 [05:31<00:58,  2.58it/s]\n# PTI :step: 848, epoch: 424:  85%|████████▍ | 849/1000 [05:31<00:58,  2.58it/s]\n# PTI :step: 848, epoch: 424:  85%|████████▌ | 850/1000 [05:32<00:58,  2.55it/s]\n# PTI :step: 849, epoch: 424:  85%|████████▌ | 850/1000 [05:32<00:58,  2.55it/s]\n# PTI :step: 849, epoch: 424:  85%|████████▌ | 851/1000 [05:32<00:57,  2.58it/s]\n# PTI :step: 850, epoch: 425:  85%|████████▌ | 851/1000 [05:32<00:57,  2.58it/s]\n# PTI :step: 850, epoch: 425:  85%|████████▌ | 852/1000 [05:32<00:57,  2.57it/s]\n# PTI :step: 851, epoch: 425:  85%|████████▌ | 852/1000 [05:32<00:57,  2.57it/s]\n# PTI :step: 851, epoch: 425:  85%|████████▌ | 853/1000 [05:33<00:56,  2.60it/s]\n# PTI :step: 852, epoch: 426:  85%|████████▌ | 853/1000 [05:33<00:56,  2.60it/s]\n# PTI :step: 852, epoch: 426:  85%|████████▌ | 854/1000 [05:33<00:56,  2.56it/s]\n# PTI :step: 853, epoch: 426:  85%|████████▌ | 854/1000 [05:33<00:56,  2.56it/s]\n# PTI :step: 853, epoch: 426:  86%|████████▌ | 855/1000 [05:34<00:55,  2.59it/s]\n# PTI :step: 854, epoch: 427:  86%|████████▌ | 855/1000 [05:34<00:55,  2.59it/s]\n# PTI :step: 854, epoch: 427:  86%|████████▌ | 856/1000 [05:34<00:55,  2.57it/s]\n# PTI :step: 855, epoch: 427:  86%|████████▌ | 856/1000 [05:34<00:55,  2.57it/s]\n# PTI :step: 855, epoch: 427:  86%|████████▌ | 857/1000 [05:34<00:55,  2.60it/s]\n# PTI :step: 856, epoch: 428:  86%|████████▌ | 857/1000 [05:34<00:55,  2.60it/s]\n# PTI :step: 856, epoch: 428:  86%|████████▌ | 858/1000 [05:35<00:54,  2.58it/s]\n# PTI :step: 857, epoch: 428:  86%|████████▌ | 858/1000 [05:35<00:54,  2.58it/s]\n# PTI :step: 857, epoch: 428:  86%|████████▌ | 859/1000 [05:35<00:54,  2.57it/s]\n# PTI :step: 858, epoch: 429:  86%|████████▌ | 859/1000 [05:35<00:54,  2.57it/s]\n# PTI :step: 858, epoch: 429:  86%|████████▌ | 860/1000 [05:36<00:54,  2.56it/s]\n# PTI :step: 859, epoch: 429:  86%|████████▌ | 860/1000 [05:36<00:54,  2.56it/s]\n# PTI :step: 859, epoch: 429:  86%|████████▌ | 861/1000 [05:36<00:53,  2.59it/s]\n# PTI :step: 860, epoch: 430:  86%|████████▌ | 861/1000 [05:36<00:53,  2.59it/s]\n# PTI :step: 860, epoch: 430:  86%|████████▌ | 862/1000 [05:36<00:53,  2.58it/s]\n# PTI :step: 861, epoch: 430:  86%|████████▌ | 862/1000 [05:36<00:53,  2.58it/s]\n# PTI :step: 861, epoch: 430:  86%|████████▋ | 863/1000 [05:37<00:52,  2.60it/s]\n# PTI :step: 862, epoch: 431:  86%|████████▋ | 863/1000 [05:37<00:52,  2.60it/s]\n# PTI :step: 862, epoch: 431:  86%|████████▋ | 864/1000 [05:37<00:52,  2.58it/s]\n# PTI :step: 863, epoch: 431:  86%|████████▋ | 864/1000 [05:37<00:52,  2.58it/s]\n# PTI :step: 863, epoch: 431:  86%|████████▋ | 865/1000 [05:37<00:51,  2.61it/s]\n# PTI :step: 864, epoch: 432:  86%|████████▋ | 865/1000 [05:37<00:51,  2.61it/s]\n# PTI :step: 864, epoch: 432:  87%|████████▋ | 866/1000 [05:38<00:51,  2.60it/s]\n# PTI :step: 865, epoch: 432:  87%|████████▋ | 866/1000 [05:38<00:51,  2.60it/s]\n# PTI :step: 865, epoch: 432:  87%|████████▋ | 867/1000 [05:38<00:50,  2.61it/s]\n# PTI :step: 866, epoch: 433:  87%|████████▋ | 867/1000 [05:38<00:50,  2.61it/s]\n# PTI :step: 866, epoch: 433:  87%|████████▋ | 868/1000 [05:39<00:51,  2.59it/s]\n# PTI :step: 867, epoch: 433:  87%|████████▋ | 868/1000 [05:39<00:51,  2.59it/s]\n# PTI :step: 867, epoch: 433:  87%|████████▋ | 869/1000 [05:39<00:50,  2.58it/s]\n# PTI :step: 868, epoch: 434:  87%|████████▋ | 869/1000 [05:39<00:50,  2.58it/s]\n# PTI :step: 868, epoch: 434:  87%|████████▋ | 870/1000 [05:39<00:50,  2.57it/s]\n# PTI :step: 869, epoch: 434:  87%|████████▋ | 870/1000 [05:39<00:50,  2.57it/s]\n# PTI :step: 869, epoch: 434:  87%|████████▋ | 871/1000 [05:40<00:49,  2.60it/s]\n# PTI :step: 870, epoch: 435:  87%|████████▋ | 871/1000 [05:40<00:49,  2.60it/s]\n# PTI :step: 870, epoch: 435:  87%|████████▋ | 872/1000 [05:40<00:49,  2.58it/s]\n# PTI :step: 871, epoch: 435:  87%|████████▋ | 872/1000 [05:40<00:49,  2.58it/s]\n# PTI :step: 871, epoch: 435:  87%|████████▋ | 873/1000 [05:41<00:48,  2.61it/s]\n# PTI :step: 872, epoch: 436:  87%|████████▋ | 873/1000 [05:41<00:48,  2.61it/s]\n# PTI :step: 872, epoch: 436:  87%|████████▋ | 874/1000 [05:41<00:48,  2.58it/s]\n# PTI :step: 873, epoch: 436:  87%|████████▋ | 874/1000 [05:41<00:48,  2.58it/s]\n# PTI :step: 873, epoch: 436:  88%|████████▊ | 875/1000 [05:41<00:48,  2.58it/s]\n# PTI :step: 874, epoch: 437:  88%|████████▊ | 875/1000 [05:41<00:48,  2.58it/s]\n# PTI :step: 874, epoch: 437:  88%|████████▊ | 876/1000 [05:42<00:48,  2.56it/s]\n# PTI :step: 875, epoch: 437:  88%|████████▊ | 876/1000 [05:42<00:48,  2.56it/s]\n# PTI :step: 875, epoch: 437:  88%|████████▊ | 877/1000 [05:42<00:47,  2.58it/s]\n# PTI :step: 876, epoch: 438:  88%|████████▊ | 877/1000 [05:42<00:47,  2.58it/s]\n# PTI :step: 876, epoch: 438:  88%|████████▊ | 878/1000 [05:43<00:47,  2.57it/s]\n# PTI :step: 877, epoch: 438:  88%|████████▊ | 878/1000 [05:43<00:47,  2.57it/s]\n# PTI :step: 877, epoch: 438:  88%|████████▊ | 879/1000 [05:43<00:46,  2.60it/s]\n# PTI :step: 878, epoch: 439:  88%|████████▊ | 879/1000 [05:43<00:46,  2.60it/s]\n# PTI :step: 878, epoch: 439:  88%|████████▊ | 880/1000 [05:43<00:46,  2.58it/s]\n# PTI :step: 879, epoch: 439:  88%|████████▊ | 880/1000 [05:43<00:46,  2.58it/s]\n# PTI :step: 879, epoch: 439:  88%|████████▊ | 881/1000 [05:44<00:45,  2.60it/s]\n# PTI :step: 880, epoch: 440:  88%|████████▊ | 881/1000 [05:44<00:45,  2.60it/s]\n# PTI :step: 880, epoch: 440:  88%|████████▊ | 882/1000 [05:44<00:45,  2.58it/s]\n# PTI :step: 881, epoch: 440:  88%|████████▊ | 882/1000 [05:44<00:45,  2.58it/s]\n# PTI :step: 881, epoch: 440:  88%|████████▊ | 883/1000 [05:44<00:44,  2.60it/s]\n# PTI :step: 882, epoch: 441:  88%|████████▊ | 883/1000 [05:44<00:44,  2.60it/s]\n# PTI :step: 882, epoch: 441:  88%|████████▊ | 884/1000 [05:45<00:44,  2.58it/s]\n# PTI :step: 883, epoch: 441:  88%|████████▊ | 884/1000 [05:45<00:44,  2.58it/s]\n# PTI :step: 883, epoch: 441:  88%|████████▊ | 885/1000 [05:45<00:44,  2.59it/s]\n# PTI :step: 884, epoch: 442:  88%|████████▊ | 885/1000 [05:45<00:44,  2.59it/s]\n# PTI :step: 884, epoch: 442:  89%|████████▊ | 886/1000 [05:46<00:44,  2.58it/s]\n# PTI :step: 885, epoch: 442:  89%|████████▊ | 886/1000 [05:46<00:44,  2.58it/s]\n# PTI :step: 885, epoch: 442:  89%|████████▊ | 887/1000 [05:46<00:43,  2.59it/s]\n# PTI :step: 886, epoch: 443:  89%|████████▊ | 887/1000 [05:46<00:43,  2.59it/s]\n# PTI :step: 886, epoch: 443:  89%|████████▉ | 888/1000 [05:46<00:43,  2.58it/s]\n# PTI :step: 887, epoch: 443:  89%|████████▉ | 888/1000 [05:46<00:43,  2.58it/s]\n# PTI :step: 887, epoch: 443:  89%|████████▉ | 889/1000 [05:47<00:42,  2.60it/s]\n# PTI :step: 888, epoch: 444:  89%|████████▉ | 889/1000 [05:47<00:42,  2.60it/s]\n# PTI :step: 888, epoch: 444:  89%|████████▉ | 890/1000 [05:47<00:42,  2.58it/s]\n# PTI :step: 889, epoch: 444:  89%|████████▉ | 890/1000 [05:47<00:42,  2.58it/s]\n# PTI :step: 889, epoch: 444:  89%|████████▉ | 891/1000 [05:48<00:41,  2.61it/s]\n# PTI :step: 890, epoch: 445:  89%|████████▉ | 891/1000 [05:48<00:41,  2.61it/s]\n# PTI :step: 890, epoch: 445:  89%|████████▉ | 892/1000 [05:48<00:41,  2.58it/s]\n# PTI :step: 891, epoch: 445:  89%|████████▉ | 892/1000 [05:48<00:41,  2.58it/s]\n# PTI :step: 891, epoch: 445:  89%|████████▉ | 893/1000 [05:48<00:41,  2.61it/s]\n# PTI :step: 892, epoch: 446:  89%|████████▉ | 893/1000 [05:48<00:41,  2.61it/s]\n# PTI :step: 892, epoch: 446:  89%|████████▉ | 894/1000 [05:49<00:40,  2.59it/s]\n# PTI :step: 893, epoch: 446:  89%|████████▉ | 894/1000 [05:49<00:40,  2.59it/s]\n# PTI :step: 893, epoch: 446:  90%|████████▉ | 895/1000 [05:49<00:40,  2.58it/s]\n# PTI :step: 894, epoch: 447:  90%|████████▉ | 895/1000 [05:49<00:40,  2.58it/s]\n# PTI :step: 894, epoch: 447:  90%|████████▉ | 896/1000 [05:49<00:40,  2.57it/s]\n# PTI :step: 895, epoch: 447:  90%|████████▉ | 896/1000 [05:49<00:40,  2.57it/s]\n# PTI :step: 895, epoch: 447:  90%|████████▉ | 897/1000 [05:50<00:39,  2.60it/s]\n# PTI :step: 896, epoch: 448:  90%|████████▉ | 897/1000 [05:50<00:39,  2.60it/s]\n# PTI :step: 896, epoch: 448:  90%|████████▉ | 898/1000 [05:50<00:39,  2.56it/s]\n# PTI :step: 897, epoch: 448:  90%|████████▉ | 898/1000 [05:50<00:39,  2.56it/s]\n# PTI :step: 897, epoch: 448:  90%|████████▉ | 899/1000 [05:51<00:39,  2.56it/s]\n# PTI :step: 898, epoch: 449:  90%|████████▉ | 899/1000 [05:51<00:39,  2.56it/s]\n# PTI :step: 898, epoch: 449:  90%|█████████ | 900/1000 [05:51<00:39,  2.53it/s]\n# PTI :step: 899, epoch: 449:  90%|█████████ | 900/1000 [05:51<00:39,  2.53it/s]\n# PTI :step: 899, epoch: 449:  90%|█████████ | 901/1000 [05:51<00:38,  2.56it/s]\n# PTI :step: 900, epoch: 450:  90%|█████████ | 901/1000 [05:51<00:38,  2.56it/s]\n# PTI :step: 900, epoch: 450:  90%|█████████ | 902/1000 [05:52<00:38,  2.53it/s]\n# PTI :step: 901, epoch: 450:  90%|█████████ | 902/1000 [05:52<00:38,  2.53it/s]\n# PTI :step: 901, epoch: 450:  90%|█████████ | 903/1000 [05:52<00:37,  2.57it/s]\n# PTI :step: 902, epoch: 451:  90%|█████████ | 903/1000 [05:52<00:37,  2.57it/s]\n# PTI :step: 902, epoch: 451:  90%|█████████ | 904/1000 [05:53<00:37,  2.56it/s]\n# PTI :step: 903, epoch: 451:  90%|█████████ | 904/1000 [05:53<00:37,  2.56it/s]\n# PTI :step: 903, epoch: 451:  90%|█████████ | 905/1000 [05:53<00:36,  2.58it/s]\n# PTI :step: 904, epoch: 452:  90%|█████████ | 905/1000 [05:53<00:36,  2.58it/s]\n# PTI :step: 904, epoch: 452:  91%|█████████ | 906/1000 [05:53<00:36,  2.57it/s]\n# PTI :step: 905, epoch: 452:  91%|█████████ | 906/1000 [05:53<00:36,  2.57it/s]\n# PTI :step: 905, epoch: 452:  91%|█████████ | 907/1000 [05:54<00:35,  2.59it/s]\n# PTI :step: 906, epoch: 453:  91%|█████████ | 907/1000 [05:54<00:35,  2.59it/s]\n# PTI :step: 906, epoch: 453:  91%|█████████ | 908/1000 [05:54<00:35,  2.57it/s]\n# PTI :step: 907, epoch: 453:  91%|█████████ | 908/1000 [05:54<00:35,  2.57it/s]\n# PTI :step: 907, epoch: 453:  91%|█████████ | 909/1000 [05:55<00:35,  2.57it/s]\n# PTI :step: 908, epoch: 454:  91%|█████████ | 909/1000 [05:55<00:35,  2.57it/s]\n# PTI :step: 908, epoch: 454:  91%|█████████ | 910/1000 [05:55<00:35,  2.56it/s]\n# PTI :step: 909, epoch: 454:  91%|█████████ | 910/1000 [05:55<00:35,  2.56it/s]\n# PTI :step: 909, epoch: 454:  91%|█████████ | 911/1000 [05:55<00:34,  2.59it/s]\n# PTI :step: 910, epoch: 455:  91%|█████████ | 911/1000 [05:55<00:34,  2.59it/s]\n# PTI :step: 910, epoch: 455:  91%|█████████ | 912/1000 [05:56<00:34,  2.58it/s]\n# PTI :step: 911, epoch: 455:  91%|█████████ | 912/1000 [05:56<00:34,  2.58it/s]\n# PTI :step: 911, epoch: 455:  91%|█████████▏| 913/1000 [05:56<00:34,  2.55it/s]\n# PTI :step: 912, epoch: 456:  91%|█████████▏| 913/1000 [05:56<00:34,  2.55it/s]\n# PTI :step: 912, epoch: 456:  91%|█████████▏| 914/1000 [05:57<00:33,  2.55it/s]\n# PTI :step: 913, epoch: 456:  91%|█████████▏| 914/1000 [05:57<00:33,  2.55it/s]\n# PTI :step: 913, epoch: 456:  92%|█████████▏| 915/1000 [05:57<00:33,  2.57it/s]\n# PTI :step: 914, epoch: 457:  92%|█████████▏| 915/1000 [05:57<00:33,  2.57it/s]\n# PTI :step: 914, epoch: 457:  92%|█████████▏| 916/1000 [05:57<00:32,  2.56it/s]\n# PTI :step: 915, epoch: 457:  92%|█████████▏| 916/1000 [05:57<00:32,  2.56it/s]\n# PTI :step: 915, epoch: 457:  92%|█████████▏| 917/1000 [05:58<00:32,  2.59it/s]\n# PTI :step: 916, epoch: 458:  92%|█████████▏| 917/1000 [05:58<00:32,  2.59it/s]\n# PTI :step: 916, epoch: 458:  92%|█████████▏| 918/1000 [05:58<00:31,  2.58it/s]\n# PTI :step: 917, epoch: 458:  92%|█████████▏| 918/1000 [05:58<00:31,  2.58it/s]\n# PTI :step: 917, epoch: 458:  92%|█████████▏| 919/1000 [05:58<00:31,  2.61it/s]\n# PTI :step: 918, epoch: 459:  92%|█████████▏| 919/1000 [05:58<00:31,  2.61it/s]\n# PTI :step: 918, epoch: 459:  92%|█████████▏| 920/1000 [05:59<00:30,  2.59it/s]\n# PTI :step: 919, epoch: 459:  92%|█████████▏| 920/1000 [05:59<00:30,  2.59it/s]\n# PTI :step: 919, epoch: 459:  92%|█████████▏| 921/1000 [05:59<00:30,  2.58it/s]\n# PTI :step: 920, epoch: 460:  92%|█████████▏| 921/1000 [05:59<00:30,  2.58it/s]\n# PTI :step: 920, epoch: 460:  92%|█████████▏| 922/1000 [06:00<00:30,  2.57it/s]\n# PTI :step: 921, epoch: 460:  92%|█████████▏| 922/1000 [06:00<00:30,  2.57it/s]\n# PTI :step: 921, epoch: 460:  92%|█████████▏| 923/1000 [06:00<00:29,  2.59it/s]\n# PTI :step: 922, epoch: 461:  92%|█████████▏| 923/1000 [06:00<00:29,  2.59it/s]\n# PTI :step: 922, epoch: 461:  92%|█████████▏| 924/1000 [06:00<00:29,  2.55it/s]\n# PTI :step: 923, epoch: 461:  92%|█████████▏| 924/1000 [06:00<00:29,  2.55it/s]\n# PTI :step: 923, epoch: 461:  92%|█████████▎| 925/1000 [06:01<00:29,  2.59it/s]\n# PTI :step: 924, epoch: 462:  92%|█████████▎| 925/1000 [06:01<00:29,  2.59it/s]\n# PTI :step: 924, epoch: 462:  93%|█████████▎| 926/1000 [06:01<00:28,  2.57it/s]\n# PTI :step: 925, epoch: 462:  93%|█████████▎| 926/1000 [06:01<00:28,  2.57it/s]\n# PTI :step: 925, epoch: 462:  93%|█████████▎| 927/1000 [06:02<00:28,  2.60it/s]\n# PTI :step: 926, epoch: 463:  93%|█████████▎| 927/1000 [06:02<00:28,  2.60it/s]\n# PTI :step: 926, epoch: 463:  93%|█████████▎| 928/1000 [06:02<00:28,  2.56it/s]\n# PTI :step: 927, epoch: 463:  93%|█████████▎| 928/1000 [06:02<00:28,  2.56it/s]\n# PTI :step: 927, epoch: 463:  93%|█████████▎| 929/1000 [06:02<00:27,  2.59it/s]\n# PTI :step: 928, epoch: 464:  93%|█████████▎| 929/1000 [06:02<00:27,  2.59it/s]\n# PTI :step: 928, epoch: 464:  93%|█████████▎| 930/1000 [06:03<00:27,  2.58it/s]\n# PTI :step: 929, epoch: 464:  93%|█████████▎| 930/1000 [06:03<00:27,  2.58it/s]\n# PTI :step: 929, epoch: 464:  93%|█████████▎| 931/1000 [06:03<00:26,  2.58it/s]\n# PTI :step: 930, epoch: 465:  93%|█████████▎| 931/1000 [06:03<00:26,  2.58it/s]\n# PTI :step: 930, epoch: 465:  93%|█████████▎| 932/1000 [06:03<00:26,  2.57it/s]\n# PTI :step: 931, epoch: 465:  93%|█████████▎| 932/1000 [06:03<00:26,  2.57it/s]\n# PTI :step: 931, epoch: 465:  93%|█████████▎| 933/1000 [06:04<00:25,  2.60it/s]\n# PTI :step: 932, epoch: 466:  93%|█████████▎| 933/1000 [06:04<00:25,  2.60it/s]\n# PTI :step: 932, epoch: 466:  93%|█████████▎| 934/1000 [06:04<00:25,  2.59it/s]\n# PTI :step: 933, epoch: 466:  93%|█████████▎| 934/1000 [06:04<00:25,  2.59it/s]\n# PTI :step: 933, epoch: 466:  94%|█████████▎| 935/1000 [06:05<00:24,  2.61it/s]\n# PTI :step: 934, epoch: 467:  94%|█████████▎| 935/1000 [06:05<00:24,  2.61it/s]\n# PTI :step: 934, epoch: 467:  94%|█████████▎| 936/1000 [06:05<00:25,  2.56it/s]\n# PTI :step: 935, epoch: 467:  94%|█████████▎| 936/1000 [06:05<00:25,  2.56it/s]\n# PTI :step: 935, epoch: 467:  94%|█████████▎| 937/1000 [06:05<00:24,  2.58it/s]\n# PTI :step: 936, epoch: 468:  94%|█████████▎| 937/1000 [06:05<00:24,  2.58it/s]\n# PTI :step: 936, epoch: 468:  94%|█████████▍| 938/1000 [06:06<00:24,  2.56it/s]\n# PTI :step: 937, epoch: 468:  94%|█████████▍| 938/1000 [06:06<00:24,  2.56it/s]\n# PTI :step: 937, epoch: 468:  94%|█████████▍| 939/1000 [06:06<00:23,  2.57it/s]\n# PTI :step: 938, epoch: 469:  94%|█████████▍| 939/1000 [06:06<00:23,  2.57it/s]\n# PTI :step: 938, epoch: 469:  94%|█████████▍| 940/1000 [06:07<00:23,  2.56it/s]\n# PTI :step: 939, epoch: 469:  94%|█████████▍| 940/1000 [06:07<00:23,  2.56it/s]\n# PTI :step: 939, epoch: 469:  94%|█████████▍| 941/1000 [06:07<00:22,  2.59it/s]\n# PTI :step: 940, epoch: 470:  94%|█████████▍| 941/1000 [06:07<00:22,  2.59it/s]\n# PTI :step: 940, epoch: 470:  94%|█████████▍| 942/1000 [06:07<00:22,  2.57it/s]\n# PTI :step: 941, epoch: 470:  94%|█████████▍| 942/1000 [06:07<00:22,  2.57it/s]\n# PTI :step: 941, epoch: 470:  94%|█████████▍| 943/1000 [06:08<00:21,  2.60it/s]\n# PTI :step: 942, epoch: 471:  94%|█████████▍| 943/1000 [06:08<00:21,  2.60it/s]\n# PTI :step: 942, epoch: 471:  94%|█████████▍| 944/1000 [06:08<00:21,  2.58it/s]\n# PTI :step: 943, epoch: 471:  94%|█████████▍| 944/1000 [06:08<00:21,  2.58it/s]\n# PTI :step: 943, epoch: 471:  94%|█████████▍| 945/1000 [06:08<00:21,  2.60it/s]\n# PTI :step: 944, epoch: 472:  94%|█████████▍| 945/1000 [06:08<00:21,  2.60it/s]\n# PTI :step: 944, epoch: 472:  95%|█████████▍| 946/1000 [06:09<00:21,  2.57it/s]\n# PTI :step: 945, epoch: 472:  95%|█████████▍| 946/1000 [06:09<00:21,  2.57it/s]\n# PTI :step: 945, epoch: 472:  95%|█████████▍| 947/1000 [06:09<00:20,  2.60it/s]\n# PTI :step: 946, epoch: 473:  95%|█████████▍| 947/1000 [06:09<00:20,  2.60it/s]\n# PTI :step: 946, epoch: 473:  95%|█████████▍| 948/1000 [06:10<00:20,  2.57it/s]\n# PTI :step: 947, epoch: 473:  95%|█████████▍| 948/1000 [06:10<00:20,  2.57it/s]\n# PTI :step: 947, epoch: 473:  95%|█████████▍| 949/1000 [06:10<00:19,  2.57it/s]\n# PTI :step: 948, epoch: 474:  95%|█████████▍| 949/1000 [06:10<00:19,  2.57it/s]\n# PTI :step: 948, epoch: 474:  95%|█████████▌| 950/1000 [06:10<00:19,  2.56it/s]\n# PTI :step: 949, epoch: 474:  95%|█████████▌| 950/1000 [06:10<00:19,  2.56it/s]\n# PTI :step: 949, epoch: 474:  95%|█████████▌| 951/1000 [06:11<00:18,  2.60it/s]\n# PTI :step: 950, epoch: 475:  95%|█████████▌| 951/1000 [06:11<00:18,  2.60it/s]\n# PTI :step: 950, epoch: 475:  95%|█████████▌| 952/1000 [06:11<00:18,  2.56it/s]\n# PTI :step: 951, epoch: 475:  95%|█████████▌| 952/1000 [06:11<00:18,  2.56it/s]\n# PTI :step: 951, epoch: 475:  95%|█████████▌| 953/1000 [06:12<00:18,  2.60it/s]\n# PTI :step: 952, epoch: 476:  95%|█████████▌| 953/1000 [06:12<00:18,  2.60it/s]\n# PTI :step: 952, epoch: 476:  95%|█████████▌| 954/1000 [06:12<00:17,  2.58it/s]\n# PTI :step: 953, epoch: 476:  95%|█████████▌| 954/1000 [06:12<00:17,  2.58it/s]\n# PTI :step: 953, epoch: 476:  96%|█████████▌| 955/1000 [06:12<00:17,  2.60it/s]\n# PTI :step: 954, epoch: 477:  96%|█████████▌| 955/1000 [06:12<00:17,  2.60it/s]\n# PTI :step: 954, epoch: 477:  96%|█████████▌| 956/1000 [06:13<00:17,  2.58it/s]\n# PTI :step: 955, epoch: 477:  96%|█████████▌| 956/1000 [06:13<00:17,  2.58it/s]\n# PTI :step: 955, epoch: 477:  96%|█████████▌| 957/1000 [06:13<00:16,  2.55it/s]\n# PTI :step: 956, epoch: 478:  96%|█████████▌| 957/1000 [06:13<00:16,  2.55it/s]\n# PTI :step: 956, epoch: 478:  96%|█████████▌| 958/1000 [06:14<00:16,  2.54it/s]\n# PTI :step: 957, epoch: 478:  96%|█████████▌| 958/1000 [06:14<00:16,  2.54it/s]\n# PTI :step: 957, epoch: 478:  96%|█████████▌| 959/1000 [06:14<00:15,  2.56it/s]\n# PTI :step: 958, epoch: 479:  96%|█████████▌| 959/1000 [06:14<00:15,  2.56it/s]\n# PTI :step: 958, epoch: 479:  96%|█████████▌| 960/1000 [06:14<00:15,  2.56it/s]\n# PTI :step: 959, epoch: 479:  96%|█████████▌| 960/1000 [06:14<00:15,  2.56it/s]\n# PTI :step: 959, epoch: 479:  96%|█████████▌| 961/1000 [06:15<00:15,  2.59it/s]\n# PTI :step: 960, epoch: 480:  96%|█████████▌| 961/1000 [06:15<00:15,  2.59it/s]\n# PTI :step: 960, epoch: 480:  96%|█████████▌| 962/1000 [06:15<00:14,  2.57it/s]\n# PTI :step: 961, epoch: 480:  96%|█████████▌| 962/1000 [06:15<00:14,  2.57it/s]\n# PTI :step: 961, epoch: 480:  96%|█████████▋| 963/1000 [06:15<00:14,  2.57it/s]\n# PTI :step: 962, epoch: 481:  96%|█████████▋| 963/1000 [06:15<00:14,  2.57it/s]\n# PTI :step: 962, epoch: 481:  96%|█████████▋| 964/1000 [06:16<00:14,  2.56it/s]\n# PTI :step: 963, epoch: 481:  96%|█████████▋| 964/1000 [06:16<00:14,  2.56it/s]\n# PTI :step: 963, epoch: 481:  96%|█████████▋| 965/1000 [06:16<00:13,  2.59it/s]\n# PTI :step: 964, epoch: 482:  96%|█████████▋| 965/1000 [06:16<00:13,  2.59it/s]\n# PTI :step: 964, epoch: 482:  97%|█████████▋| 966/1000 [06:17<00:13,  2.57it/s]\n# PTI :step: 965, epoch: 482:  97%|█████████▋| 966/1000 [06:17<00:13,  2.57it/s]\n# PTI :step: 965, epoch: 482:  97%|█████████▋| 967/1000 [06:17<00:12,  2.60it/s]\n# PTI :step: 966, epoch: 483:  97%|█████████▋| 967/1000 [06:17<00:12,  2.60it/s]\n# PTI :step: 966, epoch: 483:  97%|█████████▋| 968/1000 [06:17<00:12,  2.58it/s]\n# PTI :step: 967, epoch: 483:  97%|█████████▋| 968/1000 [06:17<00:12,  2.58it/s]\n# PTI :step: 967, epoch: 483:  97%|█████████▋| 969/1000 [06:18<00:11,  2.61it/s]\n# PTI :step: 968, epoch: 484:  97%|█████████▋| 969/1000 [06:18<00:11,  2.61it/s]\n# PTI :step: 968, epoch: 484:  97%|█████████▋| 970/1000 [06:18<00:11,  2.58it/s]\n# PTI :step: 969, epoch: 484:  97%|█████████▋| 970/1000 [06:18<00:11,  2.58it/s]\n# PTI :step: 969, epoch: 484:  97%|█████████▋| 971/1000 [06:19<00:11,  2.61it/s]\n# PTI :step: 970, epoch: 485:  97%|█████████▋| 971/1000 [06:19<00:11,  2.61it/s]\n# PTI :step: 970, epoch: 485:  97%|█████████▋| 972/1000 [06:19<00:10,  2.59it/s]\n# PTI :step: 971, epoch: 485:  97%|█████████▋| 972/1000 [06:19<00:10,  2.59it/s]\n# PTI :step: 971, epoch: 485:  97%|█████████▋| 973/1000 [06:19<00:10,  2.61it/s]\n# PTI :step: 972, epoch: 486:  97%|█████████▋| 973/1000 [06:19<00:10,  2.61it/s]\n# PTI :step: 972, epoch: 486:  97%|█████████▋| 974/1000 [06:20<00:10,  2.58it/s]\n# PTI :step: 973, epoch: 486:  97%|█████████▋| 974/1000 [06:20<00:10,  2.58it/s]\n# PTI :step: 973, epoch: 486:  98%|█████████▊| 975/1000 [06:20<00:09,  2.60it/s]\n# PTI :step: 974, epoch: 487:  98%|█████████▊| 975/1000 [06:20<00:09,  2.60it/s]\n# PTI :step: 974, epoch: 487:  98%|█████████▊| 976/1000 [06:21<00:09,  2.58it/s]\n# PTI :step: 975, epoch: 487:  98%|█████████▊| 976/1000 [06:21<00:09,  2.58it/s]\n# PTI :step: 975, epoch: 487:  98%|█████████▊| 977/1000 [06:21<00:08,  2.59it/s]\n# PTI :step: 976, epoch: 488:  98%|█████████▊| 977/1000 [06:21<00:08,  2.59it/s]\n# PTI :step: 976, epoch: 488:  98%|█████████▊| 978/1000 [06:21<00:08,  2.57it/s]\n# PTI :step: 977, epoch: 488:  98%|█████████▊| 978/1000 [06:21<00:08,  2.57it/s]\n# PTI :step: 977, epoch: 488:  98%|█████████▊| 979/1000 [06:22<00:08,  2.60it/s]\n# PTI :step: 978, epoch: 489:  98%|█████████▊| 979/1000 [06:22<00:08,  2.60it/s]\n# PTI :step: 978, epoch: 489:  98%|█████████▊| 980/1000 [06:22<00:07,  2.57it/s]\n# PTI :step: 979, epoch: 489:  98%|█████████▊| 980/1000 [06:22<00:07,  2.57it/s]\n# PTI :step: 979, epoch: 489:  98%|█████████▊| 981/1000 [06:22<00:07,  2.58it/s]\n# PTI :step: 980, epoch: 490:  98%|█████████▊| 981/1000 [06:22<00:07,  2.58it/s]\n# PTI :step: 980, epoch: 490:  98%|█████████▊| 982/1000 [06:23<00:07,  2.56it/s]\n# PTI :step: 981, epoch: 490:  98%|█████████▊| 982/1000 [06:23<00:07,  2.56it/s]\n# PTI :step: 981, epoch: 490:  98%|█████████▊| 983/1000 [06:23<00:06,  2.59it/s]\n# PTI :step: 982, epoch: 491:  98%|█████████▊| 983/1000 [06:23<00:06,  2.59it/s]\n# PTI :step: 982, epoch: 491:  98%|█████████▊| 984/1000 [06:24<00:06,  2.57it/s]\n# PTI :step: 983, epoch: 491:  98%|█████████▊| 984/1000 [06:24<00:06,  2.57it/s]\n# PTI :step: 983, epoch: 491:  98%|█████████▊| 985/1000 [06:24<00:05,  2.60it/s]\n# PTI :step: 984, epoch: 492:  98%|█████████▊| 985/1000 [06:24<00:05,  2.60it/s]\n# PTI :step: 984, epoch: 492:  99%|█████████▊| 986/1000 [06:24<00:05,  2.58it/s]\n# PTI :step: 985, epoch: 492:  99%|█████████▊| 986/1000 [06:24<00:05,  2.58it/s]\n# PTI :step: 985, epoch: 492:  99%|█████████▊| 987/1000 [06:25<00:05,  2.60it/s]\n# PTI :step: 986, epoch: 493:  99%|█████████▊| 987/1000 [06:25<00:05,  2.60it/s]\n# PTI :step: 986, epoch: 493:  99%|█████████▉| 988/1000 [06:25<00:04,  2.58it/s]\n# PTI :step: 987, epoch: 493:  99%|█████████▉| 988/1000 [06:25<00:04,  2.58it/s]\n# PTI :step: 987, epoch: 493:  99%|█████████▉| 989/1000 [06:26<00:04,  2.60it/s]\n# PTI :step: 988, epoch: 494:  99%|█████████▉| 989/1000 [06:26<00:04,  2.60it/s]\n# PTI :step: 988, epoch: 494:  99%|█████████▉| 990/1000 [06:26<00:03,  2.58it/s]\n# PTI :step: 989, epoch: 494:  99%|█████████▉| 990/1000 [06:26<00:03,  2.58it/s]\n# PTI :step: 989, epoch: 494:  99%|█████████▉| 991/1000 [06:26<00:03,  2.61it/s]\n# PTI :step: 990, epoch: 495:  99%|█████████▉| 991/1000 [06:26<00:03,  2.61it/s]\n# PTI :step: 990, epoch: 495:  99%|█████████▉| 992/1000 [06:27<00:03,  2.58it/s]\n# PTI :step: 991, epoch: 495:  99%|█████████▉| 992/1000 [06:27<00:03,  2.58it/s]\n# PTI :step: 991, epoch: 495:  99%|█████████▉| 993/1000 [06:27<00:02,  2.60it/s]\n# PTI :step: 992, epoch: 496:  99%|█████████▉| 993/1000 [06:27<00:02,  2.60it/s]\n# PTI :step: 992, epoch: 496:  99%|█████████▉| 994/1000 [06:27<00:02,  2.58it/s]\n# PTI :step: 993, epoch: 496:  99%|█████████▉| 994/1000 [06:27<00:02,  2.58it/s]\n# PTI :step: 993, epoch: 496: 100%|█████████▉| 995/1000 [06:28<00:01,  2.60it/s]\n# PTI :step: 994, epoch: 497: 100%|█████████▉| 995/1000 [06:28<00:01,  2.60it/s]\n# PTI :step: 994, epoch: 497: 100%|█████████▉| 996/1000 [06:28<00:01,  2.57it/s]\n# PTI :step: 995, epoch: 497: 100%|█████████▉| 996/1000 [06:28<00:01,  2.57it/s]\n# PTI :step: 995, epoch: 497: 100%|█████████▉| 997/1000 [06:29<00:01,  2.60it/s]\n# PTI :step: 996, epoch: 498: 100%|█████████▉| 997/1000 [06:29<00:01,  2.60it/s]\n# PTI :step: 996, epoch: 498: 100%|█████████▉| 998/1000 [06:29<00:00,  2.58it/s]\n# PTI :step: 997, epoch: 498: 100%|█████████▉| 998/1000 [06:29<00:00,  2.58it/s]\n# PTI :step: 997, epoch: 498: 100%|█████████▉| 999/1000 [06:29<00:00,  2.58it/s]\n# PTI :step: 998, epoch: 499: 100%|█████████▉| 999/1000 [06:29<00:00,  2.58it/s]\n# PTI :step: 998, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00,  2.57it/s]\nSaving final model for return\n# PTI :step: 999, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00,  2.57it/s]\n# PTI :step: 999, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00,  2.56it/s]\ntraining_out/lora.safetensors\ntraining_out/embeddings.pti\ntraining_out/special_params.json",
  "metrics": {
    "predict_time": 423.738454,
    "total_time": 425.890142
  },
  "output": "https://replicate.delivery/pbxt/aEt6InPOlTpZJZ9Y1664pLuWBf5ZdIKdjDK4FmHVB2EA47tIA/trained_model.tar",
  "started_at": "2023-08-20T08:01:32.964051Z",
  "status": "succeeded",
  "urls": {
    "get": "https://api.replicate.com/v1/predictions/5jgdk6tbddz5rcgpphbiinilea",
    "cancel": "https://api.replicate.com/v1/predictions/5jgdk6tbddz5rcgpphbiinilea/cancel"
  },
  "version": "a4eefb9bbc944eaefc56d67acba982ab73d85ec449de6606cf48b13f1483a495"
}

Generated in

7 minutes

Tweak it ShareReport

['./temp_in/BAR-00238.jpg', './temp_in/Margot-Robbie-Barbie-750x422.jpg', './temp_in/_methode_sundaytimes_prod_web_bin_f173c0a2-1825-11ee-87bf-4c05f9202e96.jpg', './temp_in/imago0257930673h-768x432.jpg', './temp_in/margot-robbie-barbie-event-seoul-070323-1-21a1fad7406b4901bb5b7628beb0c551.jpg', './temp_in/rev-1-BAR-00362HighResJPEG-161c750-bf849b2-e1690197084134.jpg']
Generating 6 captions...
Input captioning text: a photo of TOK,
TOK
a photo of tok, a blonde haired woman in a pink car
  0%|          | 0/6 [00:00<?, ?it/s]
TOK
a photo of tok, a very pretty, young lady in a pink dress
 17%|█▋        | 1/6 [00:02<00:11,  2.22s/it]
TOK
a photo of tok, who is currently a actress, is also one of the stars in a film
 33%|███▎      | 2/6 [00:02<00:04,  1.02s/it]
TOK
a photo of tok, a pretty blond in a pink hat
 50%|█████     | 3/6 [00:02<00:01,  1.50it/s]
TOK
a photo of tok, a woman in a pink suit and white hat, holding a cell phone
 67%|██████▋   | 4/6 [00:02<00:00,  2.19it/s]
TOK
a photo of tok, blonde, dress, pink, girl, fashion
Generated captions ['a photo of tok, a blonde haired woman in a pink car', 'a photo of tok, a very pretty, young lady in a pink dress', 'a photo of tok, who is currently a actress, is also one of the stars in a film', 'a photo of tok, a pretty blond in a pink hat', 'a photo of tok, a woman in a pink suit and white hat, holding a cell phone', 'a photo of tok, blonde, dress, pink, girl, fashion']
 83%|████████▎ | 5/6 [00:03<00:00,  2.66it/s]
100%|██████████| 6/6 [00:03<00:00,  3.30it/s]
100%|██████████| 6/6 [00:03<00:00,  1.89it/s]
Generating 6 masks...
INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
  0%|          | 0/6 [00:00<?, ?it/s]
 83%|████████▎ | 5/6 [00:00<00:00, 43.49it/s]
100%|██████████| 6/6 [00:00<00:00, 45.12it/s]
Upscaling 6 images...
Downloading (…)lve/main/config.json:   0%|          | 0.00/772 [00:00<?, ?B/s]
Downloading (…)lve/main/config.json: 100%|██████████| 772/772 [00:00<00:00, 3.76MB/s]
Downloading pytorch_model.bin:   0%|          | 0.00/48.5M [00:00<?, ?B/s]
Downloading pytorch_model.bin:  22%|██▏       | 10.5M/48.5M [00:00<00:01, 23.9MB/s]
Downloading pytorch_model.bin:  87%|████████▋ | 41.9M/48.5M [00:00<00:00, 88.9MB/s]
Downloading pytorch_model.bin: 100%|██████████| 48.5M/48.5M [00:00<00:00, 82.0MB/s]
  0%|          | 0/6 [00:00<?, ?it/s]
 33%|███▎      | 2/6 [00:01<00:02,  1.75it/s]
 67%|██████▋   | 4/6 [00:02<00:01,  1.68it/s]
100%|██████████| 6/6 [00:05<00:00,  1.06it/s]
100%|██████████| 6/6 [00:05<00:00,  1.18it/s]
Using seed 3860335812
You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
You are using a model of type clip_text_model to instantiate a model of type . This is not supported for all configurations of models and can yield errors.
# PTI : Loaded models
0 text encodedr's std_token_embedding: 0.01531982421875
torch.Size([49410])
1 text encodedr's std_token_embedding: 0.01446533203125
torch.Size([49410])
text_model.embeddings.token_embedding.weight
text_model.embeddings.token_embedding.weight
# PTI : Loading dataset, do_cache True
Captions to train on:
a photo of <s0><s1>, a blonde haired woman in a pink car
a photo of <s0><s1>, a very pretty, young lady in a pink dress
a photo of <s0><s1>, who is currently a actress, is also one of the stars in a film
a photo of <s0><s1>, a pretty blond in a pink hat
a photo of <s0><s1>, a woman in a pink suit and white hat, holding a cell phone
a photo of <s0><s1>, blonde, dress, pink, girl, fashion
# PTI : Loaded dataset
# PTI :  Running training
# PTI :  Num examples = 6
# PTI :  Num batches each epoch = 2
# PTI :  Num Epochs = 500
# PTI :  Instantaneous batch size per device = 4
Total train batch size (w. parallel, distributed & accumulation) = 4
# PTI :  Gradient Accumulation steps = 1
# PTI :  Total optimization steps = 1000
  0%|          | 0/1000 [00:00<?, ?it/s]
# PTI :step: 0, epoch: 0:   0%|          | 1/1000 [00:00<00:14, 71.11it/s]
# PTI :step: 0, epoch: 0:   0%|          | 2/1000 [00:00<06:55,  2.40it/s]
# PTI :step: 1, epoch: 0:   0%|          | 2/1000 [00:00<06:55,  2.40it/s]
# PTI :step: 1, epoch: 0:   0%|          | 3/1000 [00:01<07:23,  2.25it/s]
# PTI :step: 2, epoch: 1:   0%|          | 3/1000 [00:01<07:23,  2.25it/s]
# PTI :step: 2, epoch: 1:   0%|          | 4/1000 [00:01<07:09,  2.32it/s]
# PTI :step: 3, epoch: 1:   0%|          | 4/1000 [00:01<07:09,  2.32it/s]
# PTI :step: 3, epoch: 1:   0%|          | 5/1000 [00:02<06:49,  2.43it/s]
# PTI :step: 4, epoch: 2:   0%|          | 5/1000 [00:02<06:49,  2.43it/s]
# PTI :step: 4, epoch: 2:   1%|          | 6/1000 [00:02<06:43,  2.46it/s]
# PTI :step: 5, epoch: 2:   1%|          | 6/1000 [00:02<06:43,  2.46it/s]
# PTI :step: 5, epoch: 2:   1%|          | 7/1000 [00:02<06:33,  2.52it/s]
# PTI :step: 6, epoch: 3:   1%|          | 7/1000 [00:02<06:33,  2.52it/s]
# PTI :step: 6, epoch: 3:   1%|          | 8/1000 [00:03<06:33,  2.52it/s]
# PTI :step: 7, epoch: 3:   1%|          | 8/1000 [00:03<06:33,  2.52it/s]
# PTI :step: 7, epoch: 3:   1%|          | 9/1000 [00:03<06:29,  2.54it/s]
# PTI :step: 8, epoch: 4:   1%|          | 9/1000 [00:03<06:29,  2.54it/s]
# PTI :step: 8, epoch: 4:   1%|          | 10/1000 [00:04<06:30,  2.54it/s]
# PTI :step: 9, epoch: 4:   1%|          | 10/1000 [00:04<06:30,  2.54it/s]
# PTI :step: 9, epoch: 4:   1%|          | 11/1000 [00:04<06:26,  2.56it/s]
# PTI :step: 10, epoch: 5:   1%|          | 11/1000 [00:04<06:26,  2.56it/s]
# PTI :step: 10, epoch: 5:   1%|          | 12/1000 [00:04<06:27,  2.55it/s]
# PTI :step: 11, epoch: 5:   1%|          | 12/1000 [00:04<06:27,  2.55it/s]
# PTI :step: 11, epoch: 5:   1%|▏         | 13/1000 [00:05<06:24,  2.57it/s]
# PTI :step: 12, epoch: 6:   1%|▏         | 13/1000 [00:05<06:24,  2.57it/s]
# PTI :step: 12, epoch: 6:   1%|▏         | 14/1000 [00:05<06:28,  2.54it/s]
# PTI :step: 13, epoch: 6:   1%|▏         | 14/1000 [00:05<06:28,  2.54it/s]
# PTI :step: 13, epoch: 6:   2%|▏         | 15/1000 [00:05<06:22,  2.57it/s]
# PTI :step: 14, epoch: 7:   2%|▏         | 15/1000 [00:05<06:22,  2.57it/s]
# PTI :step: 14, epoch: 7:   2%|▏         | 16/1000 [00:06<06:24,  2.56it/s]
# PTI :step: 15, epoch: 7:   2%|▏         | 16/1000 [00:06<06:24,  2.56it/s]
# PTI :step: 15, epoch: 7:   2%|▏         | 17/1000 [00:06<06:24,  2.56it/s]
# PTI :step: 16, epoch: 8:   2%|▏         | 17/1000 [00:06<06:24,  2.56it/s]
# PTI :step: 16, epoch: 8:   2%|▏         | 18/1000 [00:07<06:25,  2.55it/s]
# PTI :step: 17, epoch: 8:   2%|▏         | 18/1000 [00:07<06:25,  2.55it/s]
# PTI :step: 17, epoch: 8:   2%|▏         | 19/1000 [00:07<06:22,  2.56it/s]
# PTI :step: 18, epoch: 9:   2%|▏         | 19/1000 [00:07<06:22,  2.56it/s]
# PTI :step: 18, epoch: 9:   2%|▏         | 20/1000 [00:07<06:23,  2.55it/s]
# PTI :step: 19, epoch: 9:   2%|▏         | 20/1000 [00:07<06:23,  2.55it/s]
# PTI :step: 19, epoch: 9:   2%|▏         | 21/1000 [00:08<06:17,  2.59it/s]
# PTI :step: 20, epoch: 10:   2%|▏         | 21/1000 [00:08<06:17,  2.59it/s]
# PTI :step: 20, epoch: 10:   2%|▏         | 22/1000 [00:08<06:24,  2.55it/s]
# PTI :step: 21, epoch: 10:   2%|▏         | 22/1000 [00:08<06:24,  2.55it/s]
# PTI :step: 21, epoch: 10:   2%|▏         | 23/1000 [00:09<06:19,  2.58it/s]
# PTI :step: 22, epoch: 11:   2%|▏         | 23/1000 [00:09<06:19,  2.58it/s]
# PTI :step: 22, epoch: 11:   2%|▏         | 24/1000 [00:09<06:20,  2.56it/s]
# PTI :step: 23, epoch: 11:   2%|▏         | 24/1000 [00:09<06:20,  2.56it/s]
# PTI :step: 23, epoch: 11:   2%|▎         | 25/1000 [00:09<06:16,  2.59it/s]
# PTI :step: 24, epoch: 12:   2%|▎         | 25/1000 [00:09<06:16,  2.59it/s]
# PTI :step: 24, epoch: 12:   3%|▎         | 26/1000 [00:10<06:19,  2.57it/s]
# PTI :step: 25, epoch: 12:   3%|▎         | 26/1000 [00:10<06:19,  2.57it/s]
# PTI :step: 25, epoch: 12:   3%|▎         | 27/1000 [00:10<06:17,  2.58it/s]
# PTI :step: 26, epoch: 13:   3%|▎         | 27/1000 [00:10<06:17,  2.58it/s]
# PTI :step: 26, epoch: 13:   3%|▎         | 28/1000 [00:11<06:19,  2.56it/s]
# PTI :step: 27, epoch: 13:   3%|▎         | 28/1000 [00:11<06:19,  2.56it/s]
# PTI :step: 27, epoch: 13:   3%|▎         | 29/1000 [00:11<06:15,  2.59it/s]
# PTI :step: 28, epoch: 14:   3%|▎         | 29/1000 [00:11<06:15,  2.59it/s]
# PTI :step: 28, epoch: 14:   3%|▎         | 30/1000 [00:11<06:17,  2.57it/s]
# PTI :step: 29, epoch: 14:   3%|▎         | 30/1000 [00:11<06:17,  2.57it/s]
# PTI :step: 29, epoch: 14:   3%|▎         | 31/1000 [00:12<06:14,  2.59it/s]
# PTI :step: 30, epoch: 15:   3%|▎         | 31/1000 [00:12<06:14,  2.59it/s]
# PTI :step: 30, epoch: 15:   3%|▎         | 32/1000 [00:12<06:16,  2.57it/s]
# PTI :step: 31, epoch: 15:   3%|▎         | 32/1000 [00:12<06:16,  2.57it/s]
# PTI :step: 31, epoch: 15:   3%|▎         | 33/1000 [00:12<06:12,  2.59it/s]
# PTI :step: 32, epoch: 16:   3%|▎         | 33/1000 [00:12<06:12,  2.59it/s]
# PTI :step: 32, epoch: 16:   3%|▎         | 34/1000 [00:13<06:15,  2.57it/s]
# PTI :step: 33, epoch: 16:   3%|▎         | 34/1000 [00:13<06:15,  2.57it/s]
# PTI :step: 33, epoch: 16:   4%|▎         | 35/1000 [00:13<06:12,  2.59it/s]
# PTI :step: 34, epoch: 17:   4%|▎         | 35/1000 [00:13<06:12,  2.59it/s]
# PTI :step: 34, epoch: 17:   4%|▎         | 36/1000 [00:14<06:15,  2.57it/s]
# PTI :step: 35, epoch: 17:   4%|▎         | 36/1000 [00:14<06:15,  2.57it/s]
# PTI :step: 35, epoch: 17:   4%|▎         | 37/1000 [00:14<06:13,  2.58it/s]
# PTI :step: 36, epoch: 18:   4%|▎         | 37/1000 [00:14<06:13,  2.58it/s]
# PTI :step: 36, epoch: 18:   4%|▍         | 38/1000 [00:14<06:15,  2.56it/s]
# PTI :step: 37, epoch: 18:   4%|▍         | 38/1000 [00:14<06:15,  2.56it/s]
# PTI :step: 37, epoch: 18:   4%|▍         | 39/1000 [00:15<06:10,  2.59it/s]
# PTI :step: 38, epoch: 19:   4%|▍         | 39/1000 [00:15<06:10,  2.59it/s]
# PTI :step: 38, epoch: 19:   4%|▍         | 40/1000 [00:15<06:17,  2.54it/s]
# PTI :step: 39, epoch: 19:   4%|▍         | 40/1000 [00:15<06:17,  2.54it/s]
# PTI :step: 39, epoch: 19:   4%|▍         | 41/1000 [00:16<06:13,  2.57it/s]
# PTI :step: 40, epoch: 20:   4%|▍         | 41/1000 [00:16<06:13,  2.57it/s]
# PTI :step: 40, epoch: 20:   4%|▍         | 42/1000 [00:16<06:15,  2.55it/s]
# PTI :step: 41, epoch: 20:   4%|▍         | 42/1000 [00:16<06:15,  2.55it/s]
# PTI :step: 41, epoch: 20:   4%|▍         | 43/1000 [00:16<06:10,  2.58it/s]
# PTI :step: 42, epoch: 21:   4%|▍         | 43/1000 [00:16<06:10,  2.58it/s]
# PTI :step: 42, epoch: 21:   4%|▍         | 44/1000 [00:17<06:13,  2.56it/s]
# PTI :step: 43, epoch: 21:   4%|▍         | 44/1000 [00:17<06:13,  2.56it/s]
# PTI :step: 43, epoch: 21:   4%|▍         | 45/1000 [00:17<06:10,  2.58it/s]
# PTI :step: 44, epoch: 22:   4%|▍         | 45/1000 [00:17<06:10,  2.58it/s]
# PTI :step: 44, epoch: 22:   5%|▍         | 46/1000 [00:18<06:41,  2.38it/s]
# PTI :step: 45, epoch: 22:   5%|▍         | 46/1000 [00:18<06:41,  2.38it/s]
# PTI :step: 45, epoch: 22:   5%|▍         | 47/1000 [00:18<06:29,  2.45it/s]
# PTI :step: 46, epoch: 23:   5%|▍         | 47/1000 [00:18<06:29,  2.45it/s]
# PTI :step: 46, epoch: 23:   5%|▍         | 48/1000 [00:18<06:26,  2.47it/s]
# PTI :step: 47, epoch: 23:   5%|▍         | 48/1000 [00:18<06:26,  2.47it/s]
# PTI :step: 47, epoch: 23:   5%|▍         | 49/1000 [00:19<06:18,  2.51it/s]
# PTI :step: 48, epoch: 24:   5%|▍         | 49/1000 [00:19<06:18,  2.51it/s]
# PTI :step: 48, epoch: 24:   5%|▌         | 50/1000 [00:19<06:18,  2.51it/s]
# PTI :step: 49, epoch: 24:   5%|▌         | 50/1000 [00:19<06:18,  2.51it/s]
# PTI :step: 49, epoch: 24:   5%|▌         | 51/1000 [00:20<06:11,  2.55it/s]
# PTI :step: 50, epoch: 25:   5%|▌         | 51/1000 [00:20<06:11,  2.55it/s]
# PTI :step: 50, epoch: 25:   5%|▌         | 52/1000 [00:20<06:12,  2.54it/s]
# PTI :step: 51, epoch: 25:   5%|▌         | 52/1000 [00:20<06:12,  2.54it/s]
# PTI :step: 51, epoch: 25:   5%|▌         | 53/1000 [00:20<06:07,  2.58it/s]
# PTI :step: 52, epoch: 26:   5%|▌         | 53/1000 [00:20<06:07,  2.58it/s]
# PTI :step: 52, epoch: 26:   5%|▌         | 54/1000 [00:21<06:09,  2.56it/s]
# PTI :step: 53, epoch: 26:   5%|▌         | 54/1000 [00:21<06:09,  2.56it/s]
# PTI :step: 53, epoch: 26:   6%|▌         | 55/1000 [00:21<06:08,  2.56it/s]
# PTI :step: 54, epoch: 27:   6%|▌         | 55/1000 [00:21<06:08,  2.56it/s]
# PTI :step: 54, epoch: 27:   6%|▌         | 56/1000 [00:22<06:11,  2.54it/s]
# PTI :step: 55, epoch: 27:   6%|▌         | 56/1000 [00:22<06:11,  2.54it/s]
# PTI :step: 55, epoch: 27:   6%|▌         | 57/1000 [00:22<06:09,  2.55it/s]
# PTI :step: 56, epoch: 28:   6%|▌         | 57/1000 [00:22<06:09,  2.55it/s]
# PTI :step: 56, epoch: 28:   6%|▌         | 58/1000 [00:22<06:10,  2.54it/s]
# PTI :step: 57, epoch: 28:   6%|▌         | 58/1000 [00:22<06:10,  2.54it/s]
# PTI :step: 57, epoch: 28:   6%|▌         | 59/1000 [00:23<06:05,  2.58it/s]
# PTI :step: 58, epoch: 29:   6%|▌         | 59/1000 [00:23<06:05,  2.58it/s]
# PTI :step: 58, epoch: 29:   6%|▌         | 60/1000 [00:23<06:09,  2.55it/s]
# PTI :step: 59, epoch: 29:   6%|▌         | 60/1000 [00:23<06:09,  2.55it/s]
# PTI :step: 59, epoch: 29:   6%|▌         | 61/1000 [00:23<06:04,  2.58it/s]
# PTI :step: 60, epoch: 30:   6%|▌         | 61/1000 [00:23<06:04,  2.58it/s]
# PTI :step: 60, epoch: 30:   6%|▌         | 62/1000 [00:24<06:11,  2.53it/s]
# PTI :step: 61, epoch: 30:   6%|▌         | 62/1000 [00:24<06:11,  2.53it/s]
# PTI :step: 61, epoch: 30:   6%|▋         | 63/1000 [00:24<06:06,  2.56it/s]
# PTI :step: 62, epoch: 31:   6%|▋         | 63/1000 [00:24<06:06,  2.56it/s]
# PTI :step: 62, epoch: 31:   6%|▋         | 64/1000 [00:25<06:07,  2.55it/s]
# PTI :step: 63, epoch: 31:   6%|▋         | 64/1000 [00:25<06:07,  2.55it/s]
# PTI :step: 63, epoch: 31:   6%|▋         | 65/1000 [00:25<06:04,  2.56it/s]
# PTI :step: 64, epoch: 32:   6%|▋         | 65/1000 [00:25<06:04,  2.56it/s]
# PTI :step: 64, epoch: 32:   7%|▋         | 66/1000 [00:25<06:06,  2.55it/s]
# PTI :step: 65, epoch: 32:   7%|▋         | 66/1000 [00:25<06:06,  2.55it/s]
# PTI :step: 65, epoch: 32:   7%|▋         | 67/1000 [00:26<06:01,  2.58it/s]
# PTI :step: 66, epoch: 33:   7%|▋         | 67/1000 [00:26<06:01,  2.58it/s]
# PTI :step: 66, epoch: 33:   7%|▋         | 68/1000 [00:26<06:04,  2.56it/s]
# PTI :step: 67, epoch: 33:   7%|▋         | 68/1000 [00:26<06:04,  2.56it/s]
# PTI :step: 67, epoch: 33:   7%|▋         | 69/1000 [00:27<05:59,  2.59it/s]
# PTI :step: 68, epoch: 34:   7%|▋         | 69/1000 [00:27<05:59,  2.59it/s]
# PTI :step: 68, epoch: 34:   7%|▋         | 70/1000 [00:27<06:02,  2.57it/s]
# PTI :step: 69, epoch: 34:   7%|▋         | 70/1000 [00:27<06:02,  2.57it/s]
# PTI :step: 69, epoch: 34:   7%|▋         | 71/1000 [00:27<05:58,  2.59it/s]
# PTI :step: 70, epoch: 35:   7%|▋         | 71/1000 [00:27<05:58,  2.59it/s]
# PTI :step: 70, epoch: 35:   7%|▋         | 72/1000 [00:28<06:01,  2.57it/s]
# PTI :step: 71, epoch: 35:   7%|▋         | 72/1000 [00:28<06:01,  2.57it/s]
# PTI :step: 71, epoch: 35:   7%|▋         | 73/1000 [00:28<06:00,  2.57it/s]
# PTI :step: 72, epoch: 36:   7%|▋         | 73/1000 [00:28<06:00,  2.57it/s]
# PTI :step: 72, epoch: 36:   7%|▋         | 74/1000 [00:29<06:02,  2.55it/s]
# PTI :step: 73, epoch: 36:   7%|▋         | 74/1000 [00:29<06:02,  2.55it/s]
# PTI :step: 73, epoch: 36:   8%|▊         | 75/1000 [00:29<06:02,  2.55it/s]
# PTI :step: 74, epoch: 37:   8%|▊         | 75/1000 [00:29<06:02,  2.55it/s]
# PTI :step: 74, epoch: 37:   8%|▊         | 76/1000 [00:29<06:03,  2.54it/s]
# PTI :step: 75, epoch: 37:   8%|▊         | 76/1000 [00:29<06:03,  2.54it/s]
# PTI :step: 75, epoch: 37:   8%|▊         | 77/1000 [00:30<05:57,  2.58it/s]
# PTI :step: 76, epoch: 38:   8%|▊         | 77/1000 [00:30<05:57,  2.58it/s]
# PTI :step: 76, epoch: 38:   8%|▊         | 78/1000 [00:30<06:02,  2.55it/s]
# PTI :step: 77, epoch: 38:   8%|▊         | 78/1000 [00:30<06:02,  2.55it/s]
# PTI :step: 77, epoch: 38:   8%|▊         | 79/1000 [00:31<05:59,  2.56it/s]
# PTI :step: 78, epoch: 39:   8%|▊         | 79/1000 [00:31<05:59,  2.56it/s]
# PTI :step: 78, epoch: 39:   8%|▊         | 80/1000 [00:31<06:01,  2.54it/s]
# PTI :step: 79, epoch: 39:   8%|▊         | 80/1000 [00:31<06:01,  2.54it/s]
# PTI :step: 79, epoch: 39:   8%|▊         | 81/1000 [00:31<05:56,  2.58it/s]
# PTI :step: 80, epoch: 40:   8%|▊         | 81/1000 [00:31<05:56,  2.58it/s]
# PTI :step: 80, epoch: 40:   8%|▊         | 82/1000 [00:32<05:58,  2.56it/s]
# PTI :step: 81, epoch: 40:   8%|▊         | 82/1000 [00:32<05:58,  2.56it/s]
# PTI :step: 81, epoch: 40:   8%|▊         | 83/1000 [00:32<05:56,  2.57it/s]
# PTI :step: 82, epoch: 41:   8%|▊         | 83/1000 [00:32<05:56,  2.57it/s]
# PTI :step: 82, epoch: 41:   8%|▊         | 84/1000 [00:32<06:00,  2.54it/s]
# PTI :step: 83, epoch: 41:   8%|▊         | 84/1000 [00:32<06:00,  2.54it/s]
# PTI :step: 83, epoch: 41:   8%|▊         | 85/1000 [00:33<05:55,  2.58it/s]
# PTI :step: 84, epoch: 42:   8%|▊         | 85/1000 [00:33<05:55,  2.58it/s]
# PTI :step: 84, epoch: 42:   9%|▊         | 86/1000 [00:33<06:01,  2.53it/s]
# PTI :step: 85, epoch: 42:   9%|▊         | 86/1000 [00:33<06:01,  2.53it/s]
# PTI :step: 85, epoch: 42:   9%|▊         | 87/1000 [00:34<05:56,  2.56it/s]
# PTI :step: 86, epoch: 43:   9%|▊         | 87/1000 [00:34<05:56,  2.56it/s]
# PTI :step: 86, epoch: 43:   9%|▉         | 88/1000 [00:34<05:57,  2.55it/s]
# PTI :step: 87, epoch: 43:   9%|▉         | 88/1000 [00:34<05:57,  2.55it/s]
# PTI :step: 87, epoch: 43:   9%|▉         | 89/1000 [00:34<05:52,  2.58it/s]
# PTI :step: 88, epoch: 44:   9%|▉         | 89/1000 [00:34<05:52,  2.58it/s]
# PTI :step: 88, epoch: 44:   9%|▉         | 90/1000 [00:35<05:54,  2.57it/s]
# PTI :step: 89, epoch: 44:   9%|▉         | 90/1000 [00:35<05:54,  2.57it/s]
# PTI :step: 89, epoch: 44:   9%|▉         | 91/1000 [00:35<05:54,  2.56it/s]
# PTI :step: 90, epoch: 45:   9%|▉         | 91/1000 [00:35<05:54,  2.56it/s]
# PTI :step: 90, epoch: 45:   9%|▉         | 92/1000 [00:36<05:56,  2.55it/s]
# PTI :step: 91, epoch: 45:   9%|▉         | 92/1000 [00:36<05:56,  2.55it/s]
# PTI :step: 91, epoch: 45:   9%|▉         | 93/1000 [00:36<05:53,  2.56it/s]
# PTI :step: 92, epoch: 46:   9%|▉         | 93/1000 [00:36<05:53,  2.56it/s]
# PTI :step: 92, epoch: 46:   9%|▉         | 94/1000 [00:36<05:56,  2.54it/s]
# PTI :step: 93, epoch: 46:   9%|▉         | 94/1000 [00:36<05:56,  2.54it/s]
# PTI :step: 93, epoch: 46:  10%|▉         | 95/1000 [00:37<05:51,  2.58it/s]
# PTI :step: 94, epoch: 47:  10%|▉         | 95/1000 [00:37<05:51,  2.58it/s]
# PTI :step: 94, epoch: 47:  10%|▉         | 96/1000 [00:37<05:56,  2.54it/s]
# PTI :step: 95, epoch: 47:  10%|▉         | 96/1000 [00:37<05:56,  2.54it/s]
# PTI :step: 95, epoch: 47:  10%|▉         | 97/1000 [00:38<05:51,  2.57it/s]
# PTI :step: 96, epoch: 48:  10%|▉         | 97/1000 [00:38<05:51,  2.57it/s]
# PTI :step: 96, epoch: 48:  10%|▉         | 98/1000 [00:38<05:52,  2.56it/s]
# PTI :step: 97, epoch: 48:  10%|▉         | 98/1000 [00:38<05:52,  2.56it/s]
# PTI :step: 97, epoch: 48:  10%|▉         | 99/1000 [00:38<05:50,  2.57it/s]
# PTI :step: 98, epoch: 49:  10%|▉         | 99/1000 [00:38<05:50,  2.57it/s]
# PTI :step: 98, epoch: 49:  10%|█         | 100/1000 [00:39<06:25,  2.33it/s]
# PTI :step: 99, epoch: 49:  10%|█         | 100/1000 [00:39<06:25,  2.33it/s]
# PTI :step: 99, epoch: 49:  10%|█         | 101/1000 [00:39<06:15,  2.39it/s]
# PTI :step: 100, epoch: 50:  10%|█         | 101/1000 [00:39<06:15,  2.39it/s]
# PTI :step: 100, epoch: 50:  10%|█         | 102/1000 [00:40<06:09,  2.43it/s]
# PTI :step: 101, epoch: 50:  10%|█         | 102/1000 [00:40<06:09,  2.43it/s]
# PTI :step: 101, epoch: 50:  10%|█         | 103/1000 [00:40<06:00,  2.49it/s]
# PTI :step: 102, epoch: 51:  10%|█         | 103/1000 [00:40<06:00,  2.49it/s]
# PTI :step: 102, epoch: 51:  10%|█         | 104/1000 [00:40<05:58,  2.50it/s]
# PTI :step: 103, epoch: 51:  10%|█         | 104/1000 [00:40<05:58,  2.50it/s]
# PTI :step: 103, epoch: 51:  10%|█         | 105/1000 [00:41<05:52,  2.54it/s]
# PTI :step: 104, epoch: 52:  10%|█         | 105/1000 [00:41<05:52,  2.54it/s]
# PTI :step: 104, epoch: 52:  11%|█         | 106/1000 [00:41<05:56,  2.51it/s]
# PTI :step: 105, epoch: 52:  11%|█         | 106/1000 [00:41<05:56,  2.51it/s]
# PTI :step: 105, epoch: 52:  11%|█         | 107/1000 [00:42<05:50,  2.55it/s]
# PTI :step: 106, epoch: 53:  11%|█         | 107/1000 [00:42<05:50,  2.55it/s]
# PTI :step: 106, epoch: 53:  11%|█         | 108/1000 [00:42<05:51,  2.54it/s]
# PTI :step: 107, epoch: 53:  11%|█         | 108/1000 [00:42<05:51,  2.54it/s]
# PTI :step: 107, epoch: 53:  11%|█         | 109/1000 [00:42<05:45,  2.58it/s]
# PTI :step: 108, epoch: 54:  11%|█         | 109/1000 [00:42<05:45,  2.58it/s]
# PTI :step: 108, epoch: 54:  11%|█         | 110/1000 [00:43<05:47,  2.56it/s]
# PTI :step: 109, epoch: 54:  11%|█         | 110/1000 [00:43<05:47,  2.56it/s]
# PTI :step: 109, epoch: 54:  11%|█         | 111/1000 [00:43<05:46,  2.57it/s]
# PTI :step: 110, epoch: 55:  11%|█         | 111/1000 [00:43<05:46,  2.57it/s]
# PTI :step: 110, epoch: 55:  11%|█         | 112/1000 [00:44<05:48,  2.55it/s]
# PTI :step: 111, epoch: 55:  11%|█         | 112/1000 [00:44<05:48,  2.55it/s]
# PTI :step: 111, epoch: 55:  11%|█▏        | 113/1000 [00:44<05:43,  2.58it/s]
# PTI :step: 112, epoch: 56:  11%|█▏        | 113/1000 [00:44<05:43,  2.58it/s]
# PTI :step: 112, epoch: 56:  11%|█▏        | 114/1000 [00:44<05:46,  2.56it/s]
# PTI :step: 113, epoch: 56:  11%|█▏        | 114/1000 [00:44<05:46,  2.56it/s]
# PTI :step: 113, epoch: 56:  12%|█▏        | 115/1000 [00:45<05:42,  2.58it/s]
# PTI :step: 114, epoch: 57:  12%|█▏        | 115/1000 [00:45<05:42,  2.58it/s]
# PTI :step: 114, epoch: 57:  12%|█▏        | 116/1000 [00:45<05:45,  2.56it/s]
# PTI :step: 115, epoch: 57:  12%|█▏        | 116/1000 [00:45<05:45,  2.56it/s]
# PTI :step: 115, epoch: 57:  12%|█▏        | 117/1000 [00:45<05:42,  2.58it/s]
# PTI :step: 116, epoch: 58:  12%|█▏        | 117/1000 [00:45<05:42,  2.58it/s]
# PTI :step: 116, epoch: 58:  12%|█▏        | 118/1000 [00:46<05:43,  2.57it/s]
# PTI :step: 117, epoch: 58:  12%|█▏        | 118/1000 [00:46<05:43,  2.57it/s]
# PTI :step: 117, epoch: 58:  12%|█▏        | 119/1000 [00:46<05:42,  2.57it/s]
# PTI :step: 118, epoch: 59:  12%|█▏        | 119/1000 [00:46<05:42,  2.57it/s]
# PTI :step: 118, epoch: 59:  12%|█▏        | 120/1000 [00:47<05:44,  2.55it/s]
# PTI :step: 119, epoch: 59:  12%|█▏        | 120/1000 [00:47<05:44,  2.55it/s]
# PTI :step: 119, epoch: 59:  12%|█▏        | 121/1000 [00:47<05:41,  2.58it/s]
# PTI :step: 120, epoch: 60:  12%|█▏        | 121/1000 [00:47<05:41,  2.58it/s]
# PTI :step: 120, epoch: 60:  12%|█▏        | 122/1000 [00:47<05:43,  2.55it/s]
# PTI :step: 121, epoch: 60:  12%|█▏        | 122/1000 [00:47<05:43,  2.55it/s]
# PTI :step: 121, epoch: 60:  12%|█▏        | 123/1000 [00:48<05:39,  2.58it/s]
# PTI :step: 122, epoch: 61:  12%|█▏        | 123/1000 [00:48<05:39,  2.58it/s]
# PTI :step: 122, epoch: 61:  12%|█▏        | 124/1000 [00:48<05:45,  2.54it/s]
# PTI :step: 123, epoch: 61:  12%|█▏        | 124/1000 [00:48<05:45,  2.54it/s]
# PTI :step: 123, epoch: 61:  12%|█▎        | 125/1000 [00:49<05:40,  2.57it/s]
# PTI :step: 124, epoch: 62:  12%|█▎        | 125/1000 [00:49<05:40,  2.57it/s]
# PTI :step: 124, epoch: 62:  13%|█▎        | 126/1000 [00:49<05:42,  2.55it/s]
# PTI :step: 125, epoch: 62:  13%|█▎        | 126/1000 [00:49<05:42,  2.55it/s]
# PTI :step: 125, epoch: 62:  13%|█▎        | 127/1000 [00:49<05:39,  2.57it/s]
# PTI :step: 126, epoch: 63:  13%|█▎        | 127/1000 [00:49<05:39,  2.57it/s]
# PTI :step: 126, epoch: 63:  13%|█▎        | 128/1000 [00:50<05:41,  2.56it/s]
# PTI :step: 127, epoch: 63:  13%|█▎        | 128/1000 [00:50<05:41,  2.56it/s]
# PTI :step: 127, epoch: 63:  13%|█▎        | 129/1000 [00:50<05:39,  2.56it/s]
# PTI :step: 128, epoch: 64:  13%|█▎        | 129/1000 [00:50<05:39,  2.56it/s]
# PTI :step: 128, epoch: 64:  13%|█▎        | 130/1000 [00:51<05:41,  2.55it/s]
# PTI :step: 129, epoch: 64:  13%|█▎        | 130/1000 [00:51<05:41,  2.55it/s]
# PTI :step: 129, epoch: 64:  13%|█▎        | 131/1000 [00:51<05:37,  2.58it/s]
# PTI :step: 130, epoch: 65:  13%|█▎        | 131/1000 [00:51<05:37,  2.58it/s]
# PTI :step: 130, epoch: 65:  13%|█▎        | 132/1000 [00:51<05:41,  2.54it/s]
# PTI :step: 131, epoch: 65:  13%|█▎        | 132/1000 [00:51<05:41,  2.54it/s]
# PTI :step: 131, epoch: 65:  13%|█▎        | 133/1000 [00:52<05:38,  2.56it/s]
# PTI :step: 132, epoch: 66:  13%|█▎        | 133/1000 [00:52<05:38,  2.56it/s]
# PTI :step: 132, epoch: 66:  13%|█▎        | 134/1000 [00:52<05:40,  2.54it/s]
# PTI :step: 133, epoch: 66:  13%|█▎        | 134/1000 [00:52<05:40,  2.54it/s]
# PTI :step: 133, epoch: 66:  14%|█▎        | 135/1000 [00:53<05:35,  2.58it/s]
# PTI :step: 134, epoch: 67:  14%|█▎        | 135/1000 [00:53<05:35,  2.58it/s]
# PTI :step: 134, epoch: 67:  14%|█▎        | 136/1000 [00:53<05:38,  2.55it/s]
# PTI :step: 135, epoch: 67:  14%|█▎        | 136/1000 [00:53<05:38,  2.55it/s]
# PTI :step: 135, epoch: 67:  14%|█▎        | 137/1000 [00:53<05:37,  2.56it/s]
# PTI :step: 136, epoch: 68:  14%|█▎        | 137/1000 [00:53<05:37,  2.56it/s]
# PTI :step: 136, epoch: 68:  14%|█▍        | 138/1000 [00:54<05:38,  2.54it/s]
# PTI :step: 137, epoch: 68:  14%|█▍        | 138/1000 [00:54<05:38,  2.54it/s]
# PTI :step: 137, epoch: 68:  14%|█▍        | 139/1000 [00:54<05:35,  2.57it/s]
# PTI :step: 138, epoch: 69:  14%|█▍        | 139/1000 [00:54<05:35,  2.57it/s]
# PTI :step: 138, epoch: 69:  14%|█▍        | 140/1000 [00:54<05:37,  2.54it/s]
# PTI :step: 139, epoch: 69:  14%|█▍        | 140/1000 [00:54<05:37,  2.54it/s]
# PTI :step: 139, epoch: 69:  14%|█▍        | 141/1000 [00:55<05:33,  2.57it/s]
# PTI :step: 140, epoch: 70:  14%|█▍        | 141/1000 [00:55<05:33,  2.57it/s]
# PTI :step: 140, epoch: 70:  14%|█▍        | 142/1000 [00:55<05:36,  2.55it/s]
# PTI :step: 141, epoch: 70:  14%|█▍        | 142/1000 [00:55<05:36,  2.55it/s]
# PTI :step: 141, epoch: 70:  14%|█▍        | 143/1000 [00:56<05:34,  2.56it/s]
# PTI :step: 142, epoch: 71:  14%|█▍        | 143/1000 [00:56<05:34,  2.56it/s]
# PTI :step: 142, epoch: 71:  14%|█▍        | 144/1000 [00:56<05:36,  2.54it/s]
# PTI :step: 143, epoch: 71:  14%|█▍        | 144/1000 [00:56<05:36,  2.54it/s]
# PTI :step: 143, epoch: 71:  14%|█▍        | 145/1000 [00:56<05:35,  2.55it/s]
# PTI :step: 144, epoch: 72:  14%|█▍        | 145/1000 [00:56<05:35,  2.55it/s]
# PTI :step: 144, epoch: 72:  15%|█▍        | 146/1000 [00:57<05:39,  2.52it/s]
# PTI :step: 145, epoch: 72:  15%|█▍        | 146/1000 [00:57<05:39,  2.52it/s]
# PTI :step: 145, epoch: 72:  15%|█▍        | 147/1000 [00:57<05:34,  2.55it/s]
# PTI :step: 146, epoch: 73:  15%|█▍        | 147/1000 [00:57<05:34,  2.55it/s]
# PTI :step: 146, epoch: 73:  15%|█▍        | 148/1000 [00:58<05:36,  2.53it/s]
# PTI :step: 147, epoch: 73:  15%|█▍        | 148/1000 [00:58<05:36,  2.53it/s]
# PTI :step: 147, epoch: 73:  15%|█▍        | 149/1000 [00:58<05:35,  2.53it/s]
# PTI :step: 148, epoch: 74:  15%|█▍        | 149/1000 [00:58<05:35,  2.53it/s]
# PTI :step: 148, epoch: 74:  15%|█▌        | 150/1000 [00:58<05:36,  2.53it/s]
# PTI :step: 149, epoch: 74:  15%|█▌        | 150/1000 [00:58<05:36,  2.53it/s]
# PTI :step: 149, epoch: 74:  15%|█▌        | 151/1000 [00:59<05:31,  2.56it/s]
# PTI :step: 150, epoch: 75:  15%|█▌        | 151/1000 [00:59<05:31,  2.56it/s]
# PTI :step: 150, epoch: 75:  15%|█▌        | 152/1000 [00:59<05:33,  2.54it/s]
# PTI :step: 151, epoch: 75:  15%|█▌        | 152/1000 [00:59<05:33,  2.54it/s]
# PTI :step: 151, epoch: 75:  15%|█▌        | 153/1000 [01:00<05:29,  2.57it/s]
# PTI :step: 152, epoch: 76:  15%|█▌        | 153/1000 [01:00<05:29,  2.57it/s]
# PTI :step: 152, epoch: 76:  15%|█▌        | 154/1000 [01:00<05:31,  2.55it/s]
# PTI :step: 153, epoch: 76:  15%|█▌        | 154/1000 [01:00<05:31,  2.55it/s]
# PTI :step: 153, epoch: 76:  16%|█▌        | 155/1000 [01:00<05:27,  2.58it/s]
# PTI :step: 154, epoch: 77:  16%|█▌        | 155/1000 [01:00<05:27,  2.58it/s]
# PTI :step: 154, epoch: 77:  16%|█▌        | 156/1000 [01:01<05:29,  2.56it/s]
# PTI :step: 155, epoch: 77:  16%|█▌        | 156/1000 [01:01<05:29,  2.56it/s]
# PTI :step: 155, epoch: 77:  16%|█▌        | 157/1000 [01:01<05:26,  2.58it/s]
# PTI :step: 156, epoch: 78:  16%|█▌        | 157/1000 [01:01<05:26,  2.58it/s]
# PTI :step: 156, epoch: 78:  16%|█▌        | 158/1000 [01:02<05:29,  2.56it/s]
# PTI :step: 157, epoch: 78:  16%|█▌        | 158/1000 [01:02<05:29,  2.56it/s]
# PTI :step: 157, epoch: 78:  16%|█▌        | 159/1000 [01:02<05:27,  2.57it/s]
# PTI :step: 158, epoch: 79:  16%|█▌        | 159/1000 [01:02<05:27,  2.57it/s]
# PTI :step: 158, epoch: 79:  16%|█▌        | 160/1000 [01:02<05:29,  2.55it/s]
# PTI :step: 159, epoch: 79:  16%|█▌        | 160/1000 [01:02<05:29,  2.55it/s]
# PTI :step: 159, epoch: 79:  16%|█▌        | 161/1000 [01:03<05:25,  2.58it/s]
# PTI :step: 160, epoch: 80:  16%|█▌        | 161/1000 [01:03<05:25,  2.58it/s]
# PTI :step: 160, epoch: 80:  16%|█▌        | 162/1000 [01:03<05:27,  2.56it/s]
# PTI :step: 161, epoch: 80:  16%|█▌        | 162/1000 [01:03<05:27,  2.56it/s]
# PTI :step: 161, epoch: 80:  16%|█▋        | 163/1000 [01:03<05:23,  2.59it/s]
# PTI :step: 162, epoch: 81:  16%|█▋        | 163/1000 [01:03<05:23,  2.59it/s]
# PTI :step: 162, epoch: 81:  16%|█▋        | 164/1000 [01:04<05:25,  2.57it/s]
# PTI :step: 163, epoch: 81:  16%|█▋        | 164/1000 [01:04<05:25,  2.57it/s]
# PTI :step: 163, epoch: 81:  16%|█▋        | 165/1000 [01:04<05:27,  2.55it/s]
# PTI :step: 164, epoch: 82:  16%|█▋        | 165/1000 [01:04<05:27,  2.55it/s]
# PTI :step: 164, epoch: 82:  17%|█▋        | 166/1000 [01:05<05:28,  2.54it/s]
# PTI :step: 165, epoch: 82:  17%|█▋        | 166/1000 [01:05<05:28,  2.54it/s]
# PTI :step: 165, epoch: 82:  17%|█▋        | 167/1000 [01:05<05:24,  2.57it/s]
# PTI :step: 166, epoch: 83:  17%|█▋        | 167/1000 [01:05<05:24,  2.57it/s]
# PTI :step: 166, epoch: 83:  17%|█▋        | 168/1000 [01:05<05:25,  2.56it/s]
# PTI :step: 167, epoch: 83:  17%|█▋        | 168/1000 [01:05<05:25,  2.56it/s]
# PTI :step: 167, epoch: 83:  17%|█▋        | 169/1000 [01:06<05:21,  2.58it/s]
# PTI :step: 168, epoch: 84:  17%|█▋        | 169/1000 [01:06<05:21,  2.58it/s]
# PTI :step: 168, epoch: 84:  17%|█▋        | 170/1000 [01:06<05:26,  2.54it/s]
# PTI :step: 169, epoch: 84:  17%|█▋        | 170/1000 [01:06<05:26,  2.54it/s]
# PTI :step: 169, epoch: 84:  17%|█▋        | 171/1000 [01:07<05:22,  2.57it/s]
# PTI :step: 170, epoch: 85:  17%|█▋        | 171/1000 [01:07<05:22,  2.57it/s]
# PTI :step: 170, epoch: 85:  17%|█▋        | 172/1000 [01:07<05:24,  2.55it/s]
# PTI :step: 171, epoch: 85:  17%|█▋        | 172/1000 [01:07<05:24,  2.55it/s]
# PTI :step: 171, epoch: 85:  17%|█▋        | 173/1000 [01:07<05:19,  2.59it/s]
# PTI :step: 172, epoch: 86:  17%|█▋        | 173/1000 [01:07<05:19,  2.59it/s]
# PTI :step: 172, epoch: 86:  17%|█▋        | 174/1000 [01:08<05:21,  2.57it/s]
# PTI :step: 173, epoch: 86:  17%|█▋        | 174/1000 [01:08<05:21,  2.57it/s]
# PTI :step: 173, epoch: 86:  18%|█▊        | 175/1000 [01:08<05:19,  2.58it/s]
# PTI :step: 174, epoch: 87:  18%|█▊        | 175/1000 [01:08<05:19,  2.58it/s]
# PTI :step: 174, epoch: 87:  18%|█▊        | 176/1000 [01:09<05:21,  2.56it/s]
# PTI :step: 175, epoch: 87:  18%|█▊        | 176/1000 [01:09<05:21,  2.56it/s]
# PTI :step: 175, epoch: 87:  18%|█▊        | 177/1000 [01:09<05:21,  2.56it/s]
# PTI :step: 176, epoch: 88:  18%|█▊        | 177/1000 [01:09<05:21,  2.56it/s]
# PTI :step: 176, epoch: 88:  18%|█▊        | 178/1000 [01:09<05:24,  2.53it/s]
# PTI :step: 177, epoch: 88:  18%|█▊        | 178/1000 [01:09<05:24,  2.53it/s]
# PTI :step: 177, epoch: 88:  18%|█▊        | 179/1000 [01:10<05:20,  2.56it/s]
# PTI :step: 178, epoch: 89:  18%|█▊        | 179/1000 [01:10<05:20,  2.56it/s]
# PTI :step: 178, epoch: 89:  18%|█▊        | 180/1000 [01:10<05:24,  2.53it/s]
# PTI :step: 179, epoch: 89:  18%|█▊        | 180/1000 [01:10<05:24,  2.53it/s]
# PTI :step: 179, epoch: 89:  18%|█▊        | 181/1000 [01:11<05:19,  2.57it/s]
# PTI :step: 180, epoch: 90:  18%|█▊        | 181/1000 [01:11<05:19,  2.57it/s]
# PTI :step: 180, epoch: 90:  18%|█▊        | 182/1000 [01:11<05:20,  2.55it/s]
# PTI :step: 181, epoch: 90:  18%|█▊        | 182/1000 [01:11<05:20,  2.55it/s]
# PTI :step: 181, epoch: 90:  18%|█▊        | 183/1000 [01:11<05:17,  2.57it/s]
# PTI :step: 182, epoch: 91:  18%|█▊        | 183/1000 [01:11<05:17,  2.57it/s]
# PTI :step: 182, epoch: 91:  18%|█▊        | 184/1000 [01:12<05:19,  2.56it/s]
# PTI :step: 183, epoch: 91:  18%|█▊        | 184/1000 [01:12<05:19,  2.56it/s]
# PTI :step: 183, epoch: 91:  18%|█▊        | 185/1000 [01:12<05:15,  2.58it/s]
# PTI :step: 184, epoch: 92:  18%|█▊        | 185/1000 [01:12<05:15,  2.58it/s]
# PTI :step: 184, epoch: 92:  19%|█▊        | 186/1000 [01:12<05:17,  2.57it/s]
# PTI :step: 185, epoch: 92:  19%|█▊        | 186/1000 [01:12<05:17,  2.57it/s]
# PTI :step: 185, epoch: 92:  19%|█▊        | 187/1000 [01:13<05:13,  2.60it/s]
# PTI :step: 186, epoch: 93:  19%|█▊        | 187/1000 [01:13<05:13,  2.60it/s]
# PTI :step: 186, epoch: 93:  19%|█▉        | 188/1000 [01:13<05:18,  2.55it/s]
# PTI :step: 187, epoch: 93:  19%|█▉        | 188/1000 [01:13<05:18,  2.55it/s]
# PTI :step: 187, epoch: 93:  19%|█▉        | 189/1000 [01:14<05:14,  2.58it/s]
# PTI :step: 188, epoch: 94:  19%|█▉        | 189/1000 [01:14<05:14,  2.58it/s]
# PTI :step: 188, epoch: 94:  19%|█▉        | 190/1000 [01:14<05:16,  2.56it/s]
# PTI :step: 189, epoch: 94:  19%|█▉        | 190/1000 [01:14<05:16,  2.56it/s]
# PTI :step: 189, epoch: 94:  19%|█▉        | 191/1000 [01:14<05:12,  2.59it/s]
# PTI :step: 190, epoch: 95:  19%|█▉        | 191/1000 [01:14<05:12,  2.59it/s]
# PTI :step: 190, epoch: 95:  19%|█▉        | 192/1000 [01:15<05:15,  2.56it/s]
# PTI :step: 191, epoch: 95:  19%|█▉        | 192/1000 [01:15<05:15,  2.56it/s]
# PTI :step: 191, epoch: 95:  19%|█▉        | 193/1000 [01:15<05:13,  2.57it/s]
# PTI :step: 192, epoch: 96:  19%|█▉        | 193/1000 [01:15<05:13,  2.57it/s]
# PTI :step: 192, epoch: 96:  19%|█▉        | 194/1000 [01:16<05:15,  2.55it/s]
# PTI :step: 193, epoch: 96:  19%|█▉        | 194/1000 [01:16<05:15,  2.55it/s]
# PTI :step: 193, epoch: 96:  20%|█▉        | 195/1000 [01:16<05:15,  2.55it/s]
# PTI :step: 194, epoch: 97:  20%|█▉        | 195/1000 [01:16<05:15,  2.55it/s]
# PTI :step: 194, epoch: 97:  20%|█▉        | 196/1000 [01:16<05:17,  2.53it/s]
# PTI :step: 195, epoch: 97:  20%|█▉        | 196/1000 [01:16<05:17,  2.53it/s]
# PTI :step: 195, epoch: 97:  20%|█▉        | 197/1000 [01:17<05:12,  2.57it/s]
# PTI :step: 196, epoch: 98:  20%|█▉        | 197/1000 [01:17<05:12,  2.57it/s]
# PTI :step: 196, epoch: 98:  20%|█▉        | 198/1000 [01:17<05:16,  2.54it/s]
# PTI :step: 197, epoch: 98:  20%|█▉        | 198/1000 [01:17<05:16,  2.54it/s]
# PTI :step: 197, epoch: 98:  20%|█▉        | 199/1000 [01:18<05:12,  2.57it/s]
# PTI :step: 198, epoch: 99:  20%|█▉        | 199/1000 [01:18<05:12,  2.57it/s]
# PTI :step: 198, epoch: 99:  20%|██        | 200/1000 [01:18<05:13,  2.55it/s]
# PTI :step: 199, epoch: 99:  20%|██        | 200/1000 [01:18<05:13,  2.55it/s]
# PTI :step: 199, epoch: 99:  20%|██        | 201/1000 [01:18<05:10,  2.57it/s]
# PTI :step: 200, epoch: 100:  20%|██        | 201/1000 [01:18<05:10,  2.57it/s]
# PTI :step: 200, epoch: 100:  20%|██        | 202/1000 [01:19<05:12,  2.55it/s]
# PTI :step: 201, epoch: 100:  20%|██        | 202/1000 [01:19<05:12,  2.55it/s]
# PTI :step: 201, epoch: 100:  20%|██        | 203/1000 [01:19<05:11,  2.56it/s]
# PTI :step: 202, epoch: 101:  20%|██        | 203/1000 [01:19<05:11,  2.56it/s]
# PTI :step: 202, epoch: 101:  20%|██        | 204/1000 [01:19<05:12,  2.54it/s]
# PTI :step: 203, epoch: 101:  20%|██        | 204/1000 [01:19<05:12,  2.54it/s]
# PTI :step: 203, epoch: 101:  20%|██        | 205/1000 [01:20<05:08,  2.58it/s]
# PTI :step: 204, epoch: 102:  20%|██        | 205/1000 [01:20<05:08,  2.58it/s]
# PTI :step: 204, epoch: 102:  21%|██        | 206/1000 [01:20<05:13,  2.53it/s]
# PTI :step: 205, epoch: 102:  21%|██        | 206/1000 [01:20<05:13,  2.53it/s]
# PTI :step: 205, epoch: 102:  21%|██        | 207/1000 [01:21<05:09,  2.56it/s]
# PTI :step: 206, epoch: 103:  21%|██        | 207/1000 [01:21<05:09,  2.56it/s]
# PTI :step: 206, epoch: 103:  21%|██        | 208/1000 [01:21<05:11,  2.54it/s]
# PTI :step: 207, epoch: 103:  21%|██        | 208/1000 [01:21<05:11,  2.54it/s]
# PTI :step: 207, epoch: 103:  21%|██        | 209/1000 [01:21<05:07,  2.58it/s]
# PTI :step: 208, epoch: 104:  21%|██        | 209/1000 [01:21<05:07,  2.58it/s]
# PTI :step: 208, epoch: 104:  21%|██        | 210/1000 [01:22<05:08,  2.56it/s]
# PTI :step: 209, epoch: 104:  21%|██        | 210/1000 [01:22<05:08,  2.56it/s]
# PTI :step: 209, epoch: 104:  21%|██        | 211/1000 [01:22<05:06,  2.57it/s]
# PTI :step: 210, epoch: 105:  21%|██        | 211/1000 [01:22<05:06,  2.57it/s]
# PTI :step: 210, epoch: 105:  21%|██        | 212/1000 [01:23<05:09,  2.55it/s]
# PTI :step: 211, epoch: 105:  21%|██        | 212/1000 [01:23<05:09,  2.55it/s]
# PTI :step: 211, epoch: 105:  21%|██▏       | 213/1000 [01:23<05:06,  2.57it/s]
# PTI :step: 212, epoch: 106:  21%|██▏       | 213/1000 [01:23<05:06,  2.57it/s]
# PTI :step: 212, epoch: 106:  21%|██▏       | 214/1000 [01:23<05:09,  2.54it/s]
# PTI :step: 213, epoch: 106:  21%|██▏       | 214/1000 [01:23<05:09,  2.54it/s]
# PTI :step: 213, epoch: 106:  22%|██▏       | 215/1000 [01:24<05:05,  2.57it/s]
# PTI :step: 214, epoch: 107:  22%|██▏       | 215/1000 [01:24<05:05,  2.57it/s]
# PTI :step: 214, epoch: 107:  22%|██▏       | 216/1000 [01:24<05:07,  2.55it/s]
# PTI :step: 215, epoch: 107:  22%|██▏       | 216/1000 [01:24<05:07,  2.55it/s]
# PTI :step: 215, epoch: 107:  22%|██▏       | 217/1000 [01:25<05:03,  2.58it/s]
# PTI :step: 216, epoch: 108:  22%|██▏       | 217/1000 [01:25<05:03,  2.58it/s]
# PTI :step: 216, epoch: 108:  22%|██▏       | 218/1000 [01:25<05:06,  2.55it/s]
# PTI :step: 217, epoch: 108:  22%|██▏       | 218/1000 [01:25<05:06,  2.55it/s]
# PTI :step: 217, epoch: 108:  22%|██▏       | 219/1000 [01:25<05:08,  2.53it/s]
# PTI :step: 218, epoch: 109:  22%|██▏       | 219/1000 [01:25<05:08,  2.53it/s]
# PTI :step: 218, epoch: 109:  22%|██▏       | 220/1000 [01:26<05:09,  2.52it/s]
# PTI :step: 219, epoch: 109:  22%|██▏       | 220/1000 [01:26<05:09,  2.52it/s]
# PTI :step: 219, epoch: 109:  22%|██▏       | 221/1000 [01:26<05:07,  2.53it/s]
# PTI :step: 220, epoch: 110:  22%|██▏       | 221/1000 [01:26<05:07,  2.53it/s]
# PTI :step: 220, epoch: 110:  22%|██▏       | 222/1000 [01:27<05:08,  2.52it/s]
# PTI :step: 221, epoch: 110:  22%|██▏       | 222/1000 [01:27<05:08,  2.52it/s]
# PTI :step: 221, epoch: 110:  22%|██▏       | 223/1000 [01:27<05:04,  2.55it/s]
# PTI :step: 222, epoch: 111:  22%|██▏       | 223/1000 [01:27<05:04,  2.55it/s]
# PTI :step: 222, epoch: 111:  22%|██▏       | 224/1000 [01:27<05:06,  2.53it/s]
# PTI :step: 223, epoch: 111:  22%|██▏       | 224/1000 [01:27<05:06,  2.53it/s]
# PTI :step: 223, epoch: 111:  22%|██▎       | 225/1000 [01:28<05:04,  2.55it/s]
# PTI :step: 224, epoch: 112:  22%|██▎       | 225/1000 [01:28<05:04,  2.55it/s]
# PTI :step: 224, epoch: 112:  23%|██▎       | 226/1000 [01:28<05:06,  2.53it/s]
# PTI :step: 225, epoch: 112:  23%|██▎       | 226/1000 [01:28<05:06,  2.53it/s]
# PTI :step: 225, epoch: 112:  23%|██▎       | 227/1000 [01:29<05:01,  2.56it/s]
# PTI :step: 226, epoch: 113:  23%|██▎       | 227/1000 [01:29<05:01,  2.56it/s]
# PTI :step: 226, epoch: 113:  23%|██▎       | 228/1000 [01:29<05:03,  2.54it/s]
# PTI :step: 227, epoch: 113:  23%|██▎       | 228/1000 [01:29<05:03,  2.54it/s]
# PTI :step: 227, epoch: 113:  23%|██▎       | 229/1000 [01:29<05:00,  2.56it/s]
# PTI :step: 228, epoch: 114:  23%|██▎       | 229/1000 [01:29<05:00,  2.56it/s]
# PTI :step: 228, epoch: 114:  23%|██▎       | 230/1000 [01:30<05:02,  2.54it/s]
# PTI :step: 229, epoch: 114:  23%|██▎       | 230/1000 [01:30<05:02,  2.54it/s]
# PTI :step: 229, epoch: 114:  23%|██▎       | 231/1000 [01:30<05:02,  2.54it/s]
# PTI :step: 230, epoch: 115:  23%|██▎       | 231/1000 [01:30<05:02,  2.54it/s]
# PTI :step: 230, epoch: 115:  23%|██▎       | 232/1000 [01:30<05:05,  2.51it/s]
# PTI :step: 231, epoch: 115:  23%|██▎       | 232/1000 [01:30<05:05,  2.51it/s]
# PTI :step: 231, epoch: 115:  23%|██▎       | 233/1000 [01:31<05:02,  2.54it/s]
# PTI :step: 232, epoch: 116:  23%|██▎       | 233/1000 [01:31<05:02,  2.54it/s]
# PTI :step: 232, epoch: 116:  23%|██▎       | 234/1000 [01:31<05:03,  2.52it/s]
# PTI :step: 233, epoch: 116:  23%|██▎       | 234/1000 [01:31<05:03,  2.52it/s]
# PTI :step: 233, epoch: 116:  24%|██▎       | 235/1000 [01:32<04:59,  2.56it/s]
# PTI :step: 234, epoch: 117:  24%|██▎       | 235/1000 [01:32<04:59,  2.56it/s]
# PTI :step: 234, epoch: 117:  24%|██▎       | 236/1000 [01:32<05:00,  2.54it/s]
# PTI :step: 235, epoch: 117:  24%|██▎       | 236/1000 [01:32<05:00,  2.54it/s]
# PTI :step: 235, epoch: 117:  24%|██▎       | 237/1000 [01:32<04:56,  2.57it/s]
# PTI :step: 236, epoch: 118:  24%|██▎       | 237/1000 [01:32<04:56,  2.57it/s]
# PTI :step: 236, epoch: 118:  24%|██▍       | 238/1000 [01:33<04:58,  2.55it/s]
# PTI :step: 237, epoch: 118:  24%|██▍       | 238/1000 [01:33<04:58,  2.55it/s]
# PTI :step: 237, epoch: 118:  24%|██▍       | 239/1000 [01:33<04:56,  2.57it/s]
# PTI :step: 238, epoch: 119:  24%|██▍       | 239/1000 [01:33<04:56,  2.57it/s]
# PTI :step: 238, epoch: 119:  24%|██▍       | 240/1000 [01:34<04:58,  2.55it/s]
# PTI :step: 239, epoch: 119:  24%|██▍       | 240/1000 [01:34<04:58,  2.55it/s]
# PTI :step: 239, epoch: 119:  24%|██▍       | 241/1000 [01:34<04:55,  2.57it/s]
# PTI :step: 240, epoch: 120:  24%|██▍       | 241/1000 [01:34<04:55,  2.57it/s]
# PTI :step: 240, epoch: 120:  24%|██▍       | 242/1000 [01:34<04:56,  2.55it/s]
# PTI :step: 241, epoch: 120:  24%|██▍       | 242/1000 [01:34<04:56,  2.55it/s]
# PTI :step: 241, epoch: 120:  24%|██▍       | 243/1000 [01:35<04:53,  2.58it/s]
# PTI :step: 242, epoch: 121:  24%|██▍       | 243/1000 [01:35<04:53,  2.58it/s]
# PTI :step: 242, epoch: 121:  24%|██▍       | 244/1000 [01:35<04:56,  2.55it/s]
# PTI :step: 243, epoch: 121:  24%|██▍       | 244/1000 [01:35<04:56,  2.55it/s]
# PTI :step: 243, epoch: 121:  24%|██▍       | 245/1000 [01:36<04:53,  2.57it/s]
# PTI :step: 244, epoch: 122:  24%|██▍       | 245/1000 [01:36<04:53,  2.57it/s]
# PTI :step: 244, epoch: 122:  25%|██▍       | 246/1000 [01:36<04:55,  2.55it/s]
# PTI :step: 245, epoch: 122:  25%|██▍       | 246/1000 [01:36<04:55,  2.55it/s]
# PTI :step: 245, epoch: 122:  25%|██▍       | 247/1000 [01:36<04:52,  2.57it/s]
# PTI :step: 246, epoch: 123:  25%|██▍       | 247/1000 [01:36<04:52,  2.57it/s]
# PTI :step: 246, epoch: 123:  25%|██▍       | 248/1000 [01:37<04:54,  2.55it/s]
# PTI :step: 247, epoch: 123:  25%|██▍       | 248/1000 [01:37<04:54,  2.55it/s]
# PTI :step: 247, epoch: 123:  25%|██▍       | 249/1000 [01:37<04:52,  2.57it/s]
# PTI :step: 248, epoch: 124:  25%|██▍       | 249/1000 [01:37<04:52,  2.57it/s]
# PTI :step: 248, epoch: 124:  25%|██▌       | 250/1000 [01:38<04:53,  2.55it/s]
# PTI :step: 249, epoch: 124:  25%|██▌       | 250/1000 [01:38<04:53,  2.55it/s]
# PTI :step: 249, epoch: 124:  25%|██▌       | 251/1000 [01:38<04:51,  2.57it/s]
# PTI :step: 250, epoch: 125:  25%|██▌       | 251/1000 [01:38<04:51,  2.57it/s]
# PTI :step: 250, epoch: 125:  25%|██▌       | 252/1000 [01:38<04:53,  2.55it/s]
# PTI :step: 251, epoch: 125:  25%|██▌       | 252/1000 [01:38<04:53,  2.55it/s]
# PTI :step: 251, epoch: 125:  25%|██▌       | 253/1000 [01:39<04:50,  2.58it/s]
# PTI :step: 252, epoch: 126:  25%|██▌       | 253/1000 [01:39<04:50,  2.58it/s]
# PTI :step: 252, epoch: 126:  25%|██▌       | 254/1000 [01:39<04:52,  2.55it/s]
# PTI :step: 253, epoch: 126:  25%|██▌       | 254/1000 [01:39<04:52,  2.55it/s]
# PTI :step: 253, epoch: 126:  26%|██▌       | 255/1000 [01:39<04:49,  2.58it/s]
# PTI :step: 254, epoch: 127:  26%|██▌       | 255/1000 [01:39<04:49,  2.58it/s]
# PTI :step: 254, epoch: 127:  26%|██▌       | 256/1000 [01:40<04:51,  2.55it/s]
# PTI :step: 255, epoch: 127:  26%|██▌       | 256/1000 [01:40<04:51,  2.55it/s]
# PTI :step: 255, epoch: 127:  26%|██▌       | 257/1000 [01:40<04:49,  2.57it/s]
# PTI :step: 256, epoch: 128:  26%|██▌       | 257/1000 [01:40<04:49,  2.57it/s]
# PTI :step: 256, epoch: 128:  26%|██▌       | 258/1000 [01:41<04:51,  2.54it/s]
# PTI :step: 257, epoch: 128:  26%|██▌       | 258/1000 [01:41<04:51,  2.54it/s]
# PTI :step: 257, epoch: 128:  26%|██▌       | 259/1000 [01:41<04:51,  2.54it/s]
# PTI :step: 258, epoch: 129:  26%|██▌       | 259/1000 [01:41<04:51,  2.54it/s]
# PTI :step: 258, epoch: 129:  26%|██▌       | 260/1000 [01:41<04:52,  2.53it/s]
# PTI :step: 259, epoch: 129:  26%|██▌       | 260/1000 [01:41<04:52,  2.53it/s]
# PTI :step: 259, epoch: 129:  26%|██▌       | 261/1000 [01:42<04:48,  2.57it/s]
# PTI :step: 260, epoch: 130:  26%|██▌       | 261/1000 [01:42<04:48,  2.57it/s]
# PTI :step: 260, epoch: 130:  26%|██▌       | 262/1000 [01:42<04:50,  2.54it/s]
# PTI :step: 261, epoch: 130:  26%|██▌       | 262/1000 [01:42<04:50,  2.54it/s]
# PTI :step: 261, epoch: 130:  26%|██▋       | 263/1000 [01:43<04:47,  2.57it/s]
# PTI :step: 262, epoch: 131:  26%|██▋       | 263/1000 [01:43<04:47,  2.57it/s]
# PTI :step: 262, epoch: 131:  26%|██▋       | 264/1000 [01:43<04:49,  2.54it/s]
# PTI :step: 263, epoch: 131:  26%|██▋       | 264/1000 [01:43<04:49,  2.54it/s]
# PTI :step: 263, epoch: 131:  26%|██▋       | 265/1000 [01:43<04:45,  2.57it/s]
# PTI :step: 264, epoch: 132:  26%|██▋       | 265/1000 [01:43<04:45,  2.57it/s]
# PTI :step: 264, epoch: 132:  27%|██▋       | 266/1000 [01:44<04:47,  2.55it/s]
# PTI :step: 265, epoch: 132:  27%|██▋       | 266/1000 [01:44<04:47,  2.55it/s]
# PTI :step: 265, epoch: 132:  27%|██▋       | 267/1000 [01:44<04:45,  2.57it/s]
# PTI :step: 266, epoch: 133:  27%|██▋       | 267/1000 [01:44<04:45,  2.57it/s]
# PTI :step: 266, epoch: 133:  27%|██▋       | 268/1000 [01:45<04:46,  2.55it/s]
# PTI :step: 267, epoch: 133:  27%|██▋       | 268/1000 [01:45<04:46,  2.55it/s]
# PTI :step: 267, epoch: 133:  27%|██▋       | 269/1000 [01:45<04:43,  2.58it/s]
# PTI :step: 268, epoch: 134:  27%|██▋       | 269/1000 [01:45<04:43,  2.58it/s]
# PTI :step: 268, epoch: 134:  27%|██▋       | 270/1000 [01:45<04:47,  2.54it/s]
# PTI :step: 269, epoch: 134:  27%|██▋       | 270/1000 [01:45<04:47,  2.54it/s]
# PTI :step: 269, epoch: 134:  27%|██▋       | 271/1000 [01:46<04:43,  2.57it/s]
# PTI :step: 270, epoch: 135:  27%|██▋       | 271/1000 [01:46<04:43,  2.57it/s]
# PTI :step: 270, epoch: 135:  27%|██▋       | 272/1000 [01:46<04:46,  2.54it/s]
# PTI :step: 271, epoch: 135:  27%|██▋       | 272/1000 [01:46<04:46,  2.54it/s]
# PTI :step: 271, epoch: 135:  27%|██▋       | 273/1000 [01:47<04:43,  2.57it/s]
# PTI :step: 272, epoch: 136:  27%|██▋       | 273/1000 [01:47<04:43,  2.57it/s]
# PTI :step: 272, epoch: 136:  27%|██▋       | 274/1000 [01:47<04:44,  2.55it/s]
# PTI :step: 273, epoch: 136:  27%|██▋       | 274/1000 [01:47<04:44,  2.55it/s]
# PTI :step: 273, epoch: 136:  28%|██▊       | 275/1000 [01:47<04:43,  2.55it/s]
# PTI :step: 274, epoch: 137:  28%|██▊       | 275/1000 [01:47<04:43,  2.55it/s]
# PTI :step: 274, epoch: 137:  28%|██▊       | 276/1000 [01:48<04:45,  2.53it/s]
# PTI :step: 275, epoch: 137:  28%|██▊       | 276/1000 [01:48<04:45,  2.53it/s]
# PTI :step: 275, epoch: 137:  28%|██▊       | 277/1000 [01:48<04:42,  2.56it/s]
# PTI :step: 276, epoch: 138:  28%|██▊       | 277/1000 [01:48<04:42,  2.56it/s]
# PTI :step: 276, epoch: 138:  28%|██▊       | 278/1000 [01:48<04:43,  2.54it/s]
# PTI :step: 277, epoch: 138:  28%|██▊       | 278/1000 [01:48<04:43,  2.54it/s]
# PTI :step: 277, epoch: 138:  28%|██▊       | 279/1000 [01:49<04:40,  2.57it/s]
# PTI :step: 278, epoch: 139:  28%|██▊       | 279/1000 [01:49<04:40,  2.57it/s]
# PTI :step: 278, epoch: 139:  28%|██▊       | 280/1000 [01:49<04:42,  2.55it/s]
# PTI :step: 279, epoch: 139:  28%|██▊       | 280/1000 [01:49<04:42,  2.55it/s]
# PTI :step: 279, epoch: 139:  28%|██▊       | 281/1000 [01:50<04:39,  2.57it/s]
# PTI :step: 280, epoch: 140:  28%|██▊       | 281/1000 [01:50<04:39,  2.57it/s]
# PTI :step: 280, epoch: 140:  28%|██▊       | 282/1000 [01:50<04:41,  2.55it/s]
# PTI :step: 281, epoch: 140:  28%|██▊       | 282/1000 [01:50<04:41,  2.55it/s]
# PTI :step: 281, epoch: 140:  28%|██▊       | 283/1000 [01:50<04:38,  2.57it/s]
# PTI :step: 282, epoch: 141:  28%|██▊       | 283/1000 [01:50<04:38,  2.57it/s]
# PTI :step: 282, epoch: 141:  28%|██▊       | 284/1000 [01:51<04:40,  2.55it/s]
# PTI :step: 283, epoch: 141:  28%|██▊       | 284/1000 [01:51<04:40,  2.55it/s]
# PTI :step: 283, epoch: 141:  28%|██▊       | 285/1000 [01:51<04:38,  2.57it/s]
# PTI :step: 284, epoch: 142:  28%|██▊       | 285/1000 [01:51<04:38,  2.57it/s]
# PTI :step: 284, epoch: 142:  29%|██▊       | 286/1000 [01:52<04:39,  2.55it/s]
# PTI :step: 285, epoch: 142:  29%|██▊       | 286/1000 [01:52<04:39,  2.55it/s]
# PTI :step: 285, epoch: 142:  29%|██▊       | 287/1000 [01:52<04:37,  2.57it/s]
# PTI :step: 286, epoch: 143:  29%|██▊       | 287/1000 [01:52<04:37,  2.57it/s]
# PTI :step: 286, epoch: 143:  29%|██▉       | 288/1000 [01:52<04:38,  2.55it/s]
# PTI :step: 287, epoch: 143:  29%|██▉       | 288/1000 [01:52<04:38,  2.55it/s]
# PTI :step: 287, epoch: 143:  29%|██▉       | 289/1000 [01:53<04:35,  2.58it/s]
# PTI :step: 288, epoch: 144:  29%|██▉       | 289/1000 [01:53<04:35,  2.58it/s]
# PTI :step: 288, epoch: 144:  29%|██▉       | 290/1000 [01:53<04:38,  2.55it/s]
# PTI :step: 289, epoch: 144:  29%|██▉       | 290/1000 [01:53<04:38,  2.55it/s]
# PTI :step: 289, epoch: 144:  29%|██▉       | 291/1000 [01:54<04:35,  2.57it/s]
# PTI :step: 290, epoch: 145:  29%|██▉       | 291/1000 [01:54<04:35,  2.57it/s]
# PTI :step: 290, epoch: 145:  29%|██▉       | 292/1000 [01:54<04:37,  2.55it/s]
# PTI :step: 291, epoch: 145:  29%|██▉       | 292/1000 [01:54<04:37,  2.55it/s]
# PTI :step: 291, epoch: 145:  29%|██▉       | 293/1000 [01:54<04:37,  2.55it/s]
# PTI :step: 292, epoch: 146:  29%|██▉       | 293/1000 [01:54<04:37,  2.55it/s]
# PTI :step: 292, epoch: 146:  29%|██▉       | 294/1000 [01:55<04:38,  2.53it/s]
# PTI :step: 293, epoch: 146:  29%|██▉       | 294/1000 [01:55<04:38,  2.53it/s]
# PTI :step: 293, epoch: 146:  30%|██▉       | 295/1000 [01:55<04:37,  2.54it/s]
# PTI :step: 294, epoch: 147:  30%|██▉       | 295/1000 [01:55<04:37,  2.54it/s]
# PTI :step: 294, epoch: 147:  30%|██▉       | 296/1000 [01:56<04:39,  2.52it/s]
# PTI :step: 295, epoch: 147:  30%|██▉       | 296/1000 [01:56<04:39,  2.52it/s]
# PTI :step: 295, epoch: 147:  30%|██▉       | 297/1000 [01:56<05:01,  2.33it/s]
# PTI :step: 296, epoch: 148:  30%|██▉       | 297/1000 [01:56<05:01,  2.33it/s]
# PTI :step: 296, epoch: 148:  30%|██▉       | 298/1000 [01:56<04:55,  2.38it/s]
# PTI :step: 297, epoch: 148:  30%|██▉       | 298/1000 [01:56<04:55,  2.38it/s]
# PTI :step: 297, epoch: 148:  30%|██▉       | 299/1000 [01:57<04:45,  2.45it/s]
# PTI :step: 298, epoch: 149:  30%|██▉       | 299/1000 [01:57<04:45,  2.45it/s]
# PTI :step: 298, epoch: 149:  30%|███       | 300/1000 [01:57<04:44,  2.46it/s]
# PTI :step: 299, epoch: 149:  30%|███       | 300/1000 [01:57<04:44,  2.46it/s]
# PTI :step: 299, epoch: 149:  30%|███       | 301/1000 [01:58<04:37,  2.51it/s]
# PTI :step: 300, epoch: 150:  30%|███       | 301/1000 [01:58<04:37,  2.51it/s]
# PTI :step: 300, epoch: 150:  30%|███       | 302/1000 [01:58<04:38,  2.51it/s]
# PTI :step: 301, epoch: 150:  30%|███       | 302/1000 [01:58<04:38,  2.51it/s]
# PTI :step: 301, epoch: 150:  30%|███       | 303/1000 [01:58<04:33,  2.54it/s]
# PTI :step: 302, epoch: 151:  30%|███       | 303/1000 [01:58<04:33,  2.54it/s]
# PTI :step: 302, epoch: 151:  30%|███       | 304/1000 [01:59<04:34,  2.53it/s]
# PTI :step: 303, epoch: 151:  30%|███       | 304/1000 [01:59<04:34,  2.53it/s]
# PTI :step: 303, epoch: 151:  30%|███       | 305/1000 [01:59<04:31,  2.56it/s]
# PTI :step: 304, epoch: 152:  30%|███       | 305/1000 [01:59<04:31,  2.56it/s]
# PTI :step: 304, epoch: 152:  31%|███       | 306/1000 [02:00<04:33,  2.54it/s]
# PTI :step: 305, epoch: 152:  31%|███       | 306/1000 [02:00<04:33,  2.54it/s]
# PTI :step: 305, epoch: 152:  31%|███       | 307/1000 [02:00<04:30,  2.56it/s]
# PTI :step: 306, epoch: 153:  31%|███       | 307/1000 [02:00<04:30,  2.56it/s]
# PTI :step: 306, epoch: 153:  31%|███       | 308/1000 [02:00<04:31,  2.55it/s]
# PTI :step: 307, epoch: 153:  31%|███       | 308/1000 [02:00<04:31,  2.55it/s]
# PTI :step: 307, epoch: 153:  31%|███       | 309/1000 [02:01<04:30,  2.56it/s]
# PTI :step: 308, epoch: 154:  31%|███       | 309/1000 [02:01<04:30,  2.56it/s]
# PTI :step: 308, epoch: 154:  31%|███       | 310/1000 [02:01<04:31,  2.54it/s]
# PTI :step: 309, epoch: 154:  31%|███       | 310/1000 [02:01<04:31,  2.54it/s]
# PTI :step: 309, epoch: 154:  31%|███       | 311/1000 [02:01<04:28,  2.57it/s]
# PTI :step: 310, epoch: 155:  31%|███       | 311/1000 [02:01<04:28,  2.57it/s]
# PTI :step: 310, epoch: 155:  31%|███       | 312/1000 [02:02<04:31,  2.54it/s]
# PTI :step: 311, epoch: 155:  31%|███       | 312/1000 [02:02<04:31,  2.54it/s]
# PTI :step: 311, epoch: 155:  31%|███▏      | 313/1000 [02:02<04:28,  2.56it/s]
# PTI :step: 312, epoch: 156:  31%|███▏      | 313/1000 [02:02<04:28,  2.56it/s]
# PTI :step: 312, epoch: 156:  31%|███▏      | 314/1000 [02:03<04:30,  2.54it/s]
# PTI :step: 313, epoch: 156:  31%|███▏      | 314/1000 [02:03<04:30,  2.54it/s]
# PTI :step: 313, epoch: 156:  32%|███▏      | 315/1000 [02:03<04:27,  2.56it/s]
# PTI :step: 314, epoch: 157:  32%|███▏      | 315/1000 [02:03<04:27,  2.56it/s]
# PTI :step: 314, epoch: 157:  32%|███▏      | 316/1000 [02:03<04:28,  2.54it/s]
# PTI :step: 315, epoch: 157:  32%|███▏      | 316/1000 [02:03<04:28,  2.54it/s]
# PTI :step: 315, epoch: 157:  32%|███▏      | 317/1000 [02:04<04:25,  2.57it/s]
# PTI :step: 316, epoch: 158:  32%|███▏      | 317/1000 [02:04<04:25,  2.57it/s]
# PTI :step: 316, epoch: 158:  32%|███▏      | 318/1000 [02:04<04:27,  2.55it/s]
# PTI :step: 317, epoch: 158:  32%|███▏      | 318/1000 [02:04<04:27,  2.55it/s]
# PTI :step: 317, epoch: 158:  32%|███▏      | 319/1000 [02:05<04:24,  2.57it/s]
# PTI :step: 318, epoch: 159:  32%|███▏      | 319/1000 [02:05<04:24,  2.57it/s]
# PTI :step: 318, epoch: 159:  32%|███▏      | 320/1000 [02:05<04:26,  2.55it/s]
# PTI :step: 319, epoch: 159:  32%|███▏      | 320/1000 [02:05<04:26,  2.55it/s]
# PTI :step: 319, epoch: 159:  32%|███▏      | 321/1000 [02:05<04:24,  2.57it/s]
# PTI :step: 320, epoch: 160:  32%|███▏      | 321/1000 [02:05<04:24,  2.57it/s]
# PTI :step: 320, epoch: 160:  32%|███▏      | 322/1000 [02:06<04:26,  2.55it/s]
# PTI :step: 321, epoch: 160:  32%|███▏      | 322/1000 [02:06<04:26,  2.55it/s]
# PTI :step: 321, epoch: 160:  32%|███▏      | 323/1000 [02:06<04:23,  2.57it/s]
# PTI :step: 322, epoch: 161:  32%|███▏      | 323/1000 [02:06<04:23,  2.57it/s]
# PTI :step: 322, epoch: 161:  32%|███▏      | 324/1000 [02:07<04:25,  2.55it/s]
# PTI :step: 323, epoch: 161:  32%|███▏      | 324/1000 [02:07<04:25,  2.55it/s]
# PTI :step: 323, epoch: 161:  32%|███▎      | 325/1000 [02:07<04:22,  2.58it/s]
# PTI :step: 324, epoch: 162:  32%|███▎      | 325/1000 [02:07<04:22,  2.58it/s]
# PTI :step: 324, epoch: 162:  33%|███▎      | 326/1000 [02:07<04:23,  2.56it/s]
# PTI :step: 325, epoch: 162:  33%|███▎      | 326/1000 [02:07<04:23,  2.56it/s]
# PTI :step: 325, epoch: 162:  33%|███▎      | 327/1000 [02:08<04:20,  2.58it/s]
# PTI :step: 326, epoch: 163:  33%|███▎      | 327/1000 [02:08<04:20,  2.58it/s]
# PTI :step: 326, epoch: 163:  33%|███▎      | 328/1000 [02:08<04:22,  2.56it/s]
# PTI :step: 327, epoch: 163:  33%|███▎      | 328/1000 [02:08<04:22,  2.56it/s]
# PTI :step: 327, epoch: 163:  33%|███▎      | 329/1000 [02:09<04:20,  2.58it/s]
# PTI :step: 328, epoch: 164:  33%|███▎      | 329/1000 [02:09<04:20,  2.58it/s]
# PTI :step: 328, epoch: 164:  33%|███▎      | 330/1000 [02:09<04:22,  2.55it/s]
# PTI :step: 329, epoch: 164:  33%|███▎      | 330/1000 [02:09<04:22,  2.55it/s]
# PTI :step: 329, epoch: 164:  33%|███▎      | 331/1000 [02:09<04:20,  2.57it/s]
# PTI :step: 330, epoch: 165:  33%|███▎      | 331/1000 [02:09<04:20,  2.57it/s]
# PTI :step: 330, epoch: 165:  33%|███▎      | 332/1000 [02:10<04:23,  2.53it/s]
# PTI :step: 331, epoch: 165:  33%|███▎      | 332/1000 [02:10<04:23,  2.53it/s]
# PTI :step: 331, epoch: 165:  33%|███▎      | 333/1000 [02:10<04:20,  2.56it/s]
# PTI :step: 332, epoch: 166:  33%|███▎      | 333/1000 [02:10<04:20,  2.56it/s]
# PTI :step: 332, epoch: 166:  33%|███▎      | 334/1000 [02:10<04:22,  2.54it/s]
# PTI :step: 333, epoch: 166:  33%|███▎      | 334/1000 [02:10<04:22,  2.54it/s]
# PTI :step: 333, epoch: 166:  34%|███▎      | 335/1000 [02:11<04:18,  2.57it/s]
# PTI :step: 334, epoch: 167:  34%|███▎      | 335/1000 [02:11<04:18,  2.57it/s]
# PTI :step: 334, epoch: 167:  34%|███▎      | 336/1000 [02:11<04:20,  2.55it/s]
# PTI :step: 335, epoch: 167:  34%|███▎      | 336/1000 [02:11<04:20,  2.55it/s]
# PTI :step: 335, epoch: 167:  34%|███▎      | 337/1000 [02:12<04:19,  2.55it/s]
# PTI :step: 336, epoch: 168:  34%|███▎      | 337/1000 [02:12<04:19,  2.55it/s]
# PTI :step: 336, epoch: 168:  34%|███▍      | 338/1000 [02:12<04:20,  2.54it/s]
# PTI :step: 337, epoch: 168:  34%|███▍      | 338/1000 [02:12<04:20,  2.54it/s]
# PTI :step: 337, epoch: 168:  34%|███▍      | 339/1000 [02:12<04:17,  2.57it/s]
# PTI :step: 338, epoch: 169:  34%|███▍      | 339/1000 [02:12<04:17,  2.57it/s]
# PTI :step: 338, epoch: 169:  34%|███▍      | 340/1000 [02:13<04:19,  2.55it/s]
# PTI :step: 339, epoch: 169:  34%|███▍      | 340/1000 [02:13<04:19,  2.55it/s]
# PTI :step: 339, epoch: 169:  34%|███▍      | 341/1000 [02:13<04:16,  2.57it/s]
# PTI :step: 340, epoch: 170:  34%|███▍      | 341/1000 [02:13<04:16,  2.57it/s]
# PTI :step: 340, epoch: 170:  34%|███▍      | 342/1000 [02:14<04:18,  2.55it/s]
# PTI :step: 341, epoch: 170:  34%|███▍      | 342/1000 [02:14<04:18,  2.55it/s]
# PTI :step: 341, epoch: 170:  34%|███▍      | 343/1000 [02:14<04:15,  2.57it/s]
# PTI :step: 342, epoch: 171:  34%|███▍      | 343/1000 [02:14<04:15,  2.57it/s]
# PTI :step: 342, epoch: 171:  34%|███▍      | 344/1000 [02:14<04:17,  2.55it/s]
# PTI :step: 343, epoch: 171:  34%|███▍      | 344/1000 [02:14<04:17,  2.55it/s]
# PTI :step: 343, epoch: 171:  34%|███▍      | 345/1000 [02:15<04:14,  2.58it/s]
# PTI :step: 344, epoch: 172:  34%|███▍      | 345/1000 [02:15<04:14,  2.58it/s]
# PTI :step: 344, epoch: 172:  35%|███▍      | 346/1000 [02:15<04:16,  2.55it/s]
# PTI :step: 345, epoch: 172:  35%|███▍      | 346/1000 [02:15<04:16,  2.55it/s]
# PTI :step: 345, epoch: 172:  35%|███▍      | 347/1000 [02:16<04:13,  2.58it/s]
# PTI :step: 346, epoch: 173:  35%|███▍      | 347/1000 [02:16<04:13,  2.58it/s]
# PTI :step: 346, epoch: 173:  35%|███▍      | 348/1000 [02:16<04:15,  2.55it/s]
# PTI :step: 347, epoch: 173:  35%|███▍      | 348/1000 [02:16<04:15,  2.55it/s]
# PTI :step: 347, epoch: 173:  35%|███▍      | 349/1000 [02:16<04:13,  2.57it/s]
# PTI :step: 348, epoch: 174:  35%|███▍      | 349/1000 [02:16<04:13,  2.57it/s]
# PTI :step: 348, epoch: 174:  35%|███▌      | 350/1000 [02:17<04:15,  2.55it/s]
# PTI :step: 349, epoch: 174:  35%|███▌      | 350/1000 [02:17<04:15,  2.55it/s]
# PTI :step: 349, epoch: 174:  35%|███▌      | 351/1000 [02:17<04:12,  2.57it/s]
# PTI :step: 350, epoch: 175:  35%|███▌      | 351/1000 [02:17<04:12,  2.57it/s]
# PTI :step: 350, epoch: 175:  35%|███▌      | 352/1000 [02:18<04:14,  2.55it/s]
# PTI :step: 351, epoch: 175:  35%|███▌      | 352/1000 [02:18<04:14,  2.55it/s]
# PTI :step: 351, epoch: 175:  35%|███▌      | 353/1000 [02:18<04:11,  2.57it/s]
# PTI :step: 352, epoch: 176:  35%|███▌      | 353/1000 [02:18<04:11,  2.57it/s]
# PTI :step: 352, epoch: 176:  35%|███▌      | 354/1000 [02:18<04:13,  2.55it/s]
# PTI :step: 353, epoch: 176:  35%|███▌      | 354/1000 [02:18<04:13,  2.55it/s]
# PTI :step: 353, epoch: 176:  36%|███▌      | 355/1000 [02:19<04:12,  2.55it/s]
# PTI :step: 354, epoch: 177:  36%|███▌      | 355/1000 [02:19<04:12,  2.55it/s]
# PTI :step: 354, epoch: 177:  36%|███▌      | 356/1000 [02:19<04:13,  2.54it/s]
# PTI :step: 355, epoch: 177:  36%|███▌      | 356/1000 [02:19<04:13,  2.54it/s]
# PTI :step: 355, epoch: 177:  36%|███▌      | 357/1000 [02:19<04:10,  2.56it/s]
# PTI :step: 356, epoch: 178:  36%|███▌      | 357/1000 [02:19<04:10,  2.56it/s]
# PTI :step: 356, epoch: 178:  36%|███▌      | 358/1000 [02:20<04:12,  2.54it/s]
# PTI :step: 357, epoch: 178:  36%|███▌      | 358/1000 [02:20<04:12,  2.54it/s]
# PTI :step: 357, epoch: 178:  36%|███▌      | 359/1000 [02:20<04:09,  2.57it/s]
# PTI :step: 358, epoch: 179:  36%|███▌      | 359/1000 [02:20<04:09,  2.57it/s]
# PTI :step: 358, epoch: 179:  36%|███▌      | 360/1000 [02:21<04:11,  2.55it/s]
# PTI :step: 359, epoch: 179:  36%|███▌      | 360/1000 [02:21<04:11,  2.55it/s]
# PTI :step: 359, epoch: 179:  36%|███▌      | 361/1000 [02:21<04:09,  2.56it/s]
# PTI :step: 360, epoch: 180:  36%|███▌      | 361/1000 [02:21<04:09,  2.56it/s]
# PTI :step: 360, epoch: 180:  36%|███▌      | 362/1000 [02:21<04:10,  2.54it/s]
# PTI :step: 361, epoch: 180:  36%|███▌      | 362/1000 [02:21<04:10,  2.54it/s]
# PTI :step: 361, epoch: 180:  36%|███▋      | 363/1000 [02:22<04:07,  2.57it/s]
# PTI :step: 362, epoch: 181:  36%|███▋      | 363/1000 [02:22<04:07,  2.57it/s]
# PTI :step: 362, epoch: 181:  36%|███▋      | 364/1000 [02:22<04:09,  2.55it/s]
# PTI :step: 363, epoch: 181:  36%|███▋      | 364/1000 [02:22<04:09,  2.55it/s]
# PTI :step: 363, epoch: 181:  36%|███▋      | 365/1000 [02:23<04:06,  2.58it/s]
# PTI :step: 364, epoch: 182:  36%|███▋      | 365/1000 [02:23<04:06,  2.58it/s]
# PTI :step: 364, epoch: 182:  37%|███▋      | 366/1000 [02:23<04:08,  2.55it/s]
# PTI :step: 365, epoch: 182:  37%|███▋      | 366/1000 [02:23<04:08,  2.55it/s]
# PTI :step: 365, epoch: 182:  37%|███▋      | 367/1000 [02:23<04:09,  2.54it/s]
# PTI :step: 366, epoch: 183:  37%|███▋      | 367/1000 [02:23<04:09,  2.54it/s]
# PTI :step: 366, epoch: 183:  37%|███▋      | 368/1000 [02:24<04:10,  2.53it/s]
# PTI :step: 367, epoch: 183:  37%|███▋      | 368/1000 [02:24<04:10,  2.53it/s]
# PTI :step: 367, epoch: 183:  37%|███▋      | 369/1000 [02:24<04:06,  2.56it/s]
# PTI :step: 368, epoch: 184:  37%|███▋      | 369/1000 [02:24<04:06,  2.56it/s]
# PTI :step: 368, epoch: 184:  37%|███▋      | 370/1000 [02:25<04:07,  2.54it/s]
# PTI :step: 369, epoch: 184:  37%|███▋      | 370/1000 [02:25<04:07,  2.54it/s]
# PTI :step: 369, epoch: 184:  37%|███▋      | 371/1000 [02:25<04:07,  2.55it/s]
# PTI :step: 370, epoch: 185:  37%|███▋      | 371/1000 [02:25<04:07,  2.55it/s]
# PTI :step: 370, epoch: 185:  37%|███▋      | 372/1000 [02:25<04:08,  2.53it/s]
# PTI :step: 371, epoch: 185:  37%|███▋      | 372/1000 [02:25<04:08,  2.53it/s]
# PTI :step: 371, epoch: 185:  37%|███▋      | 373/1000 [02:26<04:04,  2.56it/s]
# PTI :step: 372, epoch: 186:  37%|███▋      | 373/1000 [02:26<04:04,  2.56it/s]
# PTI :step: 372, epoch: 186:  37%|███▋      | 374/1000 [02:26<04:06,  2.54it/s]
# PTI :step: 373, epoch: 186:  37%|███▋      | 374/1000 [02:26<04:06,  2.54it/s]
# PTI :step: 373, epoch: 186:  38%|███▊      | 375/1000 [02:27<04:03,  2.57it/s]
# PTI :step: 374, epoch: 187:  38%|███▊      | 375/1000 [02:27<04:03,  2.57it/s]
# PTI :step: 374, epoch: 187:  38%|███▊      | 376/1000 [02:27<04:05,  2.55it/s]
# PTI :step: 375, epoch: 187:  38%|███▊      | 376/1000 [02:27<04:05,  2.55it/s]
# PTI :step: 375, epoch: 187:  38%|███▊      | 377/1000 [02:27<04:02,  2.57it/s]
# PTI :step: 376, epoch: 188:  38%|███▊      | 377/1000 [02:27<04:02,  2.57it/s]
# PTI :step: 376, epoch: 188:  38%|███▊      | 378/1000 [02:28<04:03,  2.55it/s]
# PTI :step: 377, epoch: 188:  38%|███▊      | 378/1000 [02:28<04:03,  2.55it/s]
# PTI :step: 377, epoch: 188:  38%|███▊      | 379/1000 [02:28<04:01,  2.57it/s]
# PTI :step: 378, epoch: 189:  38%|███▊      | 379/1000 [02:28<04:01,  2.57it/s]
# PTI :step: 378, epoch: 189:  38%|███▊      | 380/1000 [02:28<04:03,  2.55it/s]
# PTI :step: 379, epoch: 189:  38%|███▊      | 380/1000 [02:28<04:03,  2.55it/s]
# PTI :step: 379, epoch: 189:  38%|███▊      | 381/1000 [02:29<03:59,  2.58it/s]
# PTI :step: 380, epoch: 190:  38%|███▊      | 381/1000 [02:29<03:59,  2.58it/s]
# PTI :step: 380, epoch: 190:  38%|███▊      | 382/1000 [02:29<04:02,  2.55it/s]
# PTI :step: 381, epoch: 190:  38%|███▊      | 382/1000 [02:29<04:02,  2.55it/s]
# PTI :step: 381, epoch: 190:  38%|███▊      | 383/1000 [02:30<03:59,  2.57it/s]
# PTI :step: 382, epoch: 191:  38%|███▊      | 383/1000 [02:30<03:59,  2.57it/s]
# PTI :step: 382, epoch: 191:  38%|███▊      | 384/1000 [02:30<04:01,  2.55it/s]
# PTI :step: 383, epoch: 191:  38%|███▊      | 384/1000 [02:30<04:01,  2.55it/s]
# PTI :step: 383, epoch: 191:  38%|███▊      | 385/1000 [02:30<03:58,  2.57it/s]
# PTI :step: 384, epoch: 192:  38%|███▊      | 385/1000 [02:30<03:58,  2.57it/s]
# PTI :step: 384, epoch: 192:  39%|███▊      | 386/1000 [02:31<04:00,  2.55it/s]
# PTI :step: 385, epoch: 192:  39%|███▊      | 386/1000 [02:31<04:00,  2.55it/s]
# PTI :step: 385, epoch: 192:  39%|███▊      | 387/1000 [02:31<03:58,  2.57it/s]
# PTI :step: 386, epoch: 193:  39%|███▊      | 387/1000 [02:31<03:58,  2.57it/s]
# PTI :step: 386, epoch: 193:  39%|███▉      | 388/1000 [02:32<03:59,  2.55it/s]
# PTI :step: 387, epoch: 193:  39%|███▉      | 388/1000 [02:32<03:59,  2.55it/s]
# PTI :step: 387, epoch: 193:  39%|███▉      | 389/1000 [02:32<03:58,  2.56it/s]
# PTI :step: 388, epoch: 194:  39%|███▉      | 389/1000 [02:32<03:58,  2.56it/s]
# PTI :step: 388, epoch: 194:  39%|███▉      | 390/1000 [02:32<03:59,  2.54it/s]
# PTI :step: 389, epoch: 194:  39%|███▉      | 390/1000 [02:32<03:59,  2.54it/s]
# PTI :step: 389, epoch: 194:  39%|███▉      | 391/1000 [02:33<03:57,  2.56it/s]
# PTI :step: 390, epoch: 195:  39%|███▉      | 391/1000 [02:33<03:57,  2.56it/s]
# PTI :step: 390, epoch: 195:  39%|███▉      | 392/1000 [02:33<03:59,  2.54it/s]
# PTI :step: 391, epoch: 195:  39%|███▉      | 392/1000 [02:33<03:59,  2.54it/s]
# PTI :step: 391, epoch: 195:  39%|███▉      | 393/1000 [02:34<03:56,  2.57it/s]
# PTI :step: 392, epoch: 196:  39%|███▉      | 393/1000 [02:34<03:56,  2.57it/s]
# PTI :step: 392, epoch: 196:  39%|███▉      | 394/1000 [02:34<03:57,  2.55it/s]
# PTI :step: 393, epoch: 196:  39%|███▉      | 394/1000 [02:34<03:57,  2.55it/s]
# PTI :step: 393, epoch: 196:  40%|███▉      | 395/1000 [02:34<03:55,  2.57it/s]
# PTI :step: 394, epoch: 197:  40%|███▉      | 395/1000 [02:34<03:55,  2.57it/s]
# PTI :step: 394, epoch: 197:  40%|███▉      | 396/1000 [02:35<03:56,  2.55it/s]
# PTI :step: 395, epoch: 197:  40%|███▉      | 396/1000 [02:35<03:56,  2.55it/s]
# PTI :step: 395, epoch: 197:  40%|███▉      | 397/1000 [02:35<03:55,  2.56it/s]
# PTI :step: 396, epoch: 198:  40%|███▉      | 397/1000 [02:35<03:55,  2.56it/s]
# PTI :step: 396, epoch: 198:  40%|███▉      | 398/1000 [02:36<03:57,  2.54it/s]
# PTI :step: 397, epoch: 198:  40%|███▉      | 398/1000 [02:36<03:57,  2.54it/s]
# PTI :step: 397, epoch: 198:  40%|███▉      | 399/1000 [02:36<03:54,  2.56it/s]
# PTI :step: 398, epoch: 199:  40%|███▉      | 399/1000 [02:36<03:54,  2.56it/s]
# PTI :step: 398, epoch: 199:  40%|████      | 400/1000 [02:36<04:17,  2.33it/s]
# PTI :step: 399, epoch: 199:  40%|████      | 400/1000 [02:36<04:17,  2.33it/s]
# PTI :step: 399, epoch: 199:  40%|████      | 401/1000 [02:37<04:08,  2.41it/s]
# PTI :step: 400, epoch: 200:  40%|████      | 401/1000 [02:37<04:08,  2.41it/s]
# PTI :step: 400, epoch: 200:  40%|████      | 402/1000 [02:37<04:05,  2.43it/s]
# PTI :step: 401, epoch: 200:  40%|████      | 402/1000 [02:37<04:05,  2.43it/s]
# PTI :step: 401, epoch: 200:  40%|████      | 403/1000 [02:38<03:59,  2.49it/s]
# PTI :step: 402, epoch: 201:  40%|████      | 403/1000 [02:38<03:59,  2.49it/s]
# PTI :step: 402, epoch: 201:  40%|████      | 404/1000 [02:38<03:59,  2.49it/s]
# PTI :step: 403, epoch: 201:  40%|████      | 404/1000 [02:38<03:59,  2.49it/s]
# PTI :step: 403, epoch: 201:  40%|████      | 405/1000 [02:38<03:54,  2.53it/s]
# PTI :step: 404, epoch: 202:  40%|████      | 405/1000 [02:38<03:54,  2.53it/s]
# PTI :step: 404, epoch: 202:  41%|████      | 406/1000 [02:39<03:55,  2.52it/s]
# PTI :step: 405, epoch: 202:  41%|████      | 406/1000 [02:39<03:55,  2.52it/s]
# PTI :step: 405, epoch: 202:  41%|████      | 407/1000 [02:39<03:52,  2.55it/s]
# PTI :step: 406, epoch: 203:  41%|████      | 407/1000 [02:39<03:52,  2.55it/s]
# PTI :step: 406, epoch: 203:  41%|████      | 408/1000 [02:40<03:54,  2.53it/s]
# PTI :step: 407, epoch: 203:  41%|████      | 408/1000 [02:40<03:54,  2.53it/s]
# PTI :step: 407, epoch: 203:  41%|████      | 409/1000 [02:40<03:51,  2.55it/s]
# PTI :step: 408, epoch: 204:  41%|████      | 409/1000 [02:40<03:51,  2.55it/s]
# PTI :step: 408, epoch: 204:  41%|████      | 410/1000 [02:40<03:52,  2.53it/s]
# PTI :step: 409, epoch: 204:  41%|████      | 410/1000 [02:40<03:52,  2.53it/s]
# PTI :step: 409, epoch: 204:  41%|████      | 411/1000 [02:41<03:49,  2.57it/s]
# PTI :step: 410, epoch: 205:  41%|████      | 411/1000 [02:41<03:49,  2.57it/s]
# PTI :step: 410, epoch: 205:  41%|████      | 412/1000 [02:41<03:51,  2.54it/s]
# PTI :step: 411, epoch: 205:  41%|████      | 412/1000 [02:41<03:51,  2.54it/s]
# PTI :step: 411, epoch: 205:  41%|████▏     | 413/1000 [02:42<03:48,  2.57it/s]
# PTI :step: 412, epoch: 206:  41%|████▏     | 413/1000 [02:42<03:48,  2.57it/s]
# PTI :step: 412, epoch: 206:  41%|████▏     | 414/1000 [02:42<03:50,  2.55it/s]
# PTI :step: 413, epoch: 206:  41%|████▏     | 414/1000 [02:42<03:50,  2.55it/s]
# PTI :step: 413, epoch: 206:  42%|████▏     | 415/1000 [02:42<03:49,  2.55it/s]
# PTI :step: 414, epoch: 207:  42%|████▏     | 415/1000 [02:42<03:49,  2.55it/s]
# PTI :step: 414, epoch: 207:  42%|████▏     | 416/1000 [02:43<03:50,  2.54it/s]
# PTI :step: 415, epoch: 207:  42%|████▏     | 416/1000 [02:43<03:50,  2.54it/s]
# PTI :step: 415, epoch: 207:  42%|████▏     | 417/1000 [02:43<03:49,  2.54it/s]
# PTI :step: 416, epoch: 208:  42%|████▏     | 417/1000 [02:43<03:49,  2.54it/s]
# PTI :step: 416, epoch: 208:  42%|████▏     | 418/1000 [02:44<03:51,  2.51it/s]
# PTI :step: 417, epoch: 208:  42%|████▏     | 418/1000 [02:44<03:51,  2.51it/s]
# PTI :step: 417, epoch: 208:  42%|████▏     | 419/1000 [02:44<03:47,  2.55it/s]
# PTI :step: 418, epoch: 209:  42%|████▏     | 419/1000 [02:44<03:47,  2.55it/s]
# PTI :step: 418, epoch: 209:  42%|████▏     | 420/1000 [02:44<03:49,  2.53it/s]
# PTI :step: 419, epoch: 209:  42%|████▏     | 420/1000 [02:44<03:49,  2.53it/s]
# PTI :step: 419, epoch: 209:  42%|████▏     | 421/1000 [02:45<03:49,  2.52it/s]
# PTI :step: 420, epoch: 210:  42%|████▏     | 421/1000 [02:45<03:49,  2.52it/s]
# PTI :step: 420, epoch: 210:  42%|████▏     | 422/1000 [02:45<03:50,  2.51it/s]
# PTI :step: 421, epoch: 210:  42%|████▏     | 422/1000 [02:45<03:50,  2.51it/s]
# PTI :step: 421, epoch: 210:  42%|████▏     | 423/1000 [02:45<03:47,  2.54it/s]
# PTI :step: 422, epoch: 211:  42%|████▏     | 423/1000 [02:45<03:47,  2.54it/s]
# PTI :step: 422, epoch: 211:  42%|████▏     | 424/1000 [02:46<03:47,  2.53it/s]
# PTI :step: 423, epoch: 211:  42%|████▏     | 424/1000 [02:46<03:47,  2.53it/s]
# PTI :step: 423, epoch: 211:  42%|████▎     | 425/1000 [02:46<03:44,  2.56it/s]
# PTI :step: 424, epoch: 212:  42%|████▎     | 425/1000 [02:46<03:44,  2.56it/s]
# PTI :step: 424, epoch: 212:  43%|████▎     | 426/1000 [02:47<03:47,  2.52it/s]
# PTI :step: 425, epoch: 212:  43%|████▎     | 426/1000 [02:47<03:47,  2.52it/s]
# PTI :step: 425, epoch: 212:  43%|████▎     | 427/1000 [02:47<03:46,  2.53it/s]
# PTI :step: 426, epoch: 213:  43%|████▎     | 427/1000 [02:47<03:46,  2.53it/s]
# PTI :step: 426, epoch: 213:  43%|████▎     | 428/1000 [02:47<03:46,  2.52it/s]
# PTI :step: 427, epoch: 213:  43%|████▎     | 428/1000 [02:47<03:46,  2.52it/s]
# PTI :step: 427, epoch: 213:  43%|████▎     | 429/1000 [02:48<03:43,  2.56it/s]
# PTI :step: 428, epoch: 214:  43%|████▎     | 429/1000 [02:48<03:43,  2.56it/s]
# PTI :step: 428, epoch: 214:  43%|████▎     | 430/1000 [02:48<03:44,  2.54it/s]
# PTI :step: 429, epoch: 214:  43%|████▎     | 430/1000 [02:48<03:44,  2.54it/s]
# PTI :step: 429, epoch: 214:  43%|████▎     | 431/1000 [02:49<03:41,  2.57it/s]
# PTI :step: 430, epoch: 215:  43%|████▎     | 431/1000 [02:49<03:41,  2.57it/s]
# PTI :step: 430, epoch: 215:  43%|████▎     | 432/1000 [02:49<03:43,  2.54it/s]
# PTI :step: 431, epoch: 215:  43%|████▎     | 432/1000 [02:49<03:43,  2.54it/s]
# PTI :step: 431, epoch: 215:  43%|████▎     | 433/1000 [02:49<03:40,  2.57it/s]
# PTI :step: 432, epoch: 216:  43%|████▎     | 433/1000 [02:49<03:40,  2.57it/s]
# PTI :step: 432, epoch: 216:  43%|████▎     | 434/1000 [02:50<03:41,  2.55it/s]
# PTI :step: 433, epoch: 216:  43%|████▎     | 434/1000 [02:50<03:41,  2.55it/s]
# PTI :step: 433, epoch: 216:  44%|████▎     | 435/1000 [02:50<03:39,  2.57it/s]
# PTI :step: 434, epoch: 217:  44%|████▎     | 435/1000 [02:50<03:39,  2.57it/s]
# PTI :step: 434, epoch: 217:  44%|████▎     | 436/1000 [02:51<03:41,  2.55it/s]
# PTI :step: 435, epoch: 217:  44%|████▎     | 436/1000 [02:51<03:41,  2.55it/s]
# PTI :step: 435, epoch: 217:  44%|████▎     | 437/1000 [02:51<03:38,  2.57it/s]
# PTI :step: 436, epoch: 218:  44%|████▎     | 437/1000 [02:51<03:38,  2.57it/s]
# PTI :step: 436, epoch: 218:  44%|████▍     | 438/1000 [02:51<03:40,  2.55it/s]
# PTI :step: 437, epoch: 218:  44%|████▍     | 438/1000 [02:51<03:40,  2.55it/s]
# PTI :step: 437, epoch: 218:  44%|████▍     | 439/1000 [02:52<03:37,  2.58it/s]
# PTI :step: 438, epoch: 219:  44%|████▍     | 439/1000 [02:52<03:37,  2.58it/s]
# PTI :step: 438, epoch: 219:  44%|████▍     | 440/1000 [02:52<03:39,  2.56it/s]
# PTI :step: 439, epoch: 219:  44%|████▍     | 440/1000 [02:52<03:39,  2.56it/s]
# PTI :step: 439, epoch: 219:  44%|████▍     | 441/1000 [02:53<03:36,  2.58it/s]
# PTI :step: 440, epoch: 220:  44%|████▍     | 441/1000 [02:53<03:36,  2.58it/s]
# PTI :step: 440, epoch: 220:  44%|████▍     | 442/1000 [02:53<03:38,  2.56it/s]
# PTI :step: 441, epoch: 220:  44%|████▍     | 442/1000 [02:53<03:38,  2.56it/s]
# PTI :step: 441, epoch: 220:  44%|████▍     | 443/1000 [02:53<03:36,  2.58it/s]
# PTI :step: 442, epoch: 221:  44%|████▍     | 443/1000 [02:53<03:36,  2.58it/s]
# PTI :step: 442, epoch: 221:  44%|████▍     | 444/1000 [02:54<03:37,  2.55it/s]
# PTI :step: 443, epoch: 221:  44%|████▍     | 444/1000 [02:54<03:37,  2.55it/s]
# PTI :step: 443, epoch: 221:  44%|████▍     | 445/1000 [02:54<03:35,  2.57it/s]
# PTI :step: 444, epoch: 222:  44%|████▍     | 445/1000 [02:54<03:35,  2.57it/s]
# PTI :step: 444, epoch: 222:  45%|████▍     | 446/1000 [02:54<03:37,  2.55it/s]
# PTI :step: 445, epoch: 222:  45%|████▍     | 446/1000 [02:54<03:37,  2.55it/s]
# PTI :step: 445, epoch: 222:  45%|████▍     | 447/1000 [02:55<03:34,  2.58it/s]
# PTI :step: 446, epoch: 223:  45%|████▍     | 447/1000 [02:55<03:34,  2.58it/s]
# PTI :step: 446, epoch: 223:  45%|████▍     | 448/1000 [02:55<03:37,  2.54it/s]
# PTI :step: 447, epoch: 223:  45%|████▍     | 448/1000 [02:55<03:37,  2.54it/s]
# PTI :step: 447, epoch: 223:  45%|████▍     | 449/1000 [02:56<03:34,  2.56it/s]
# PTI :step: 448, epoch: 224:  45%|████▍     | 449/1000 [02:56<03:34,  2.56it/s]
# PTI :step: 448, epoch: 224:  45%|████▌     | 450/1000 [02:56<03:36,  2.54it/s]
# PTI :step: 449, epoch: 224:  45%|████▌     | 450/1000 [02:56<03:36,  2.54it/s]
# PTI :step: 449, epoch: 224:  45%|████▌     | 451/1000 [02:56<03:34,  2.56it/s]
# PTI :step: 450, epoch: 225:  45%|████▌     | 451/1000 [02:56<03:34,  2.56it/s]
# PTI :step: 450, epoch: 225:  45%|████▌     | 452/1000 [02:57<03:35,  2.55it/s]
# PTI :step: 451, epoch: 225:  45%|████▌     | 452/1000 [02:57<03:35,  2.55it/s]
# PTI :step: 451, epoch: 225:  45%|████▌     | 453/1000 [02:57<03:33,  2.56it/s]
# PTI :step: 452, epoch: 226:  45%|████▌     | 453/1000 [02:57<03:33,  2.56it/s]
# PTI :step: 452, epoch: 226:  45%|████▌     | 454/1000 [02:58<03:34,  2.54it/s]
# PTI :step: 453, epoch: 226:  45%|████▌     | 454/1000 [02:58<03:34,  2.54it/s]
# PTI :step: 453, epoch: 226:  46%|████▌     | 455/1000 [02:58<03:32,  2.56it/s]
# PTI :step: 454, epoch: 227:  46%|████▌     | 455/1000 [02:58<03:32,  2.56it/s]
# PTI :step: 454, epoch: 227:  46%|████▌     | 456/1000 [02:58<03:33,  2.55it/s]
# PTI :step: 455, epoch: 227:  46%|████▌     | 456/1000 [02:58<03:33,  2.55it/s]
# PTI :step: 455, epoch: 227:  46%|████▌     | 457/1000 [02:59<03:30,  2.57it/s]
# PTI :step: 456, epoch: 228:  46%|████▌     | 457/1000 [02:59<03:30,  2.57it/s]
# PTI :step: 456, epoch: 228:  46%|████▌     | 458/1000 [02:59<03:32,  2.55it/s]
# PTI :step: 457, epoch: 228:  46%|████▌     | 458/1000 [02:59<03:32,  2.55it/s]
# PTI :step: 457, epoch: 228:  46%|████▌     | 459/1000 [03:00<03:30,  2.58it/s]
# PTI :step: 458, epoch: 229:  46%|████▌     | 459/1000 [03:00<03:30,  2.58it/s]
# PTI :step: 458, epoch: 229:  46%|████▌     | 460/1000 [03:00<03:31,  2.55it/s]
# PTI :step: 459, epoch: 229:  46%|████▌     | 460/1000 [03:00<03:31,  2.55it/s]
# PTI :step: 459, epoch: 229:  46%|████▌     | 461/1000 [03:00<03:29,  2.58it/s]
# PTI :step: 460, epoch: 230:  46%|████▌     | 461/1000 [03:00<03:29,  2.58it/s]
# PTI :step: 460, epoch: 230:  46%|████▌     | 462/1000 [03:01<03:30,  2.55it/s]
# PTI :step: 461, epoch: 230:  46%|████▌     | 462/1000 [03:01<03:30,  2.55it/s]
# PTI :step: 461, epoch: 230:  46%|████▋     | 463/1000 [03:01<03:29,  2.57it/s]
# PTI :step: 462, epoch: 231:  46%|████▋     | 463/1000 [03:01<03:29,  2.57it/s]
# PTI :step: 462, epoch: 231:  46%|████▋     | 464/1000 [03:02<03:30,  2.55it/s]
# PTI :step: 463, epoch: 231:  46%|████▋     | 464/1000 [03:02<03:30,  2.55it/s]
# PTI :step: 463, epoch: 231:  46%|████▋     | 465/1000 [03:02<03:27,  2.57it/s]
# PTI :step: 464, epoch: 232:  46%|████▋     | 465/1000 [03:02<03:27,  2.57it/s]
# PTI :step: 464, epoch: 232:  47%|████▋     | 466/1000 [03:02<03:29,  2.55it/s]
# PTI :step: 465, epoch: 232:  47%|████▋     | 466/1000 [03:02<03:29,  2.55it/s]
# PTI :step: 465, epoch: 232:  47%|████▋     | 467/1000 [03:03<03:28,  2.56it/s]
# PTI :step: 466, epoch: 233:  47%|████▋     | 467/1000 [03:03<03:28,  2.56it/s]
# PTI :step: 466, epoch: 233:  47%|████▋     | 468/1000 [03:03<03:29,  2.53it/s]
# PTI :step: 467, epoch: 233:  47%|████▋     | 468/1000 [03:03<03:29,  2.53it/s]
# PTI :step: 467, epoch: 233:  47%|████▋     | 469/1000 [03:03<03:27,  2.56it/s]
# PTI :step: 468, epoch: 234:  47%|████▋     | 469/1000 [03:03<03:27,  2.56it/s]
# PTI :step: 468, epoch: 234:  47%|████▋     | 470/1000 [03:04<03:28,  2.55it/s]
# PTI :step: 469, epoch: 234:  47%|████▋     | 470/1000 [03:04<03:28,  2.55it/s]
# PTI :step: 469, epoch: 234:  47%|████▋     | 471/1000 [03:04<03:45,  2.34it/s]
# PTI :step: 470, epoch: 235:  47%|████▋     | 471/1000 [03:04<03:45,  2.34it/s]
# PTI :step: 470, epoch: 235:  47%|████▋     | 472/1000 [03:05<03:41,  2.39it/s]
# PTI :step: 471, epoch: 235:  47%|████▋     | 472/1000 [03:05<03:41,  2.39it/s]
# PTI :step: 471, epoch: 235:  47%|████▋     | 473/1000 [03:05<03:35,  2.45it/s]
# PTI :step: 472, epoch: 236:  47%|████▋     | 473/1000 [03:05<03:35,  2.45it/s]
# PTI :step: 472, epoch: 236:  47%|████▋     | 474/1000 [03:06<03:34,  2.46it/s]
# PTI :step: 473, epoch: 236:  47%|████▋     | 474/1000 [03:06<03:34,  2.46it/s]
# PTI :step: 473, epoch: 236:  48%|████▊     | 475/1000 [03:06<03:30,  2.49it/s]
# PTI :step: 474, epoch: 237:  48%|████▊     | 475/1000 [03:06<03:30,  2.49it/s]
# PTI :step: 474, epoch: 237:  48%|████▊     | 476/1000 [03:06<03:29,  2.50it/s]
# PTI :step: 475, epoch: 237:  48%|████▊     | 476/1000 [03:06<03:29,  2.50it/s]
# PTI :step: 475, epoch: 237:  48%|████▊     | 477/1000 [03:07<03:25,  2.55it/s]
# PTI :step: 476, epoch: 238:  48%|████▊     | 477/1000 [03:07<03:25,  2.55it/s]
# PTI :step: 476, epoch: 238:  48%|████▊     | 478/1000 [03:07<03:26,  2.53it/s]
# PTI :step: 477, epoch: 238:  48%|████▊     | 478/1000 [03:07<03:26,  2.53it/s]
# PTI :step: 477, epoch: 238:  48%|████▊     | 479/1000 [03:07<03:23,  2.56it/s]
# PTI :step: 478, epoch: 239:  48%|████▊     | 479/1000 [03:07<03:23,  2.56it/s]
# PTI :step: 478, epoch: 239:  48%|████▊     | 480/1000 [03:08<03:25,  2.53it/s]
# PTI :step: 479, epoch: 239:  48%|████▊     | 480/1000 [03:08<03:25,  2.53it/s]
# PTI :step: 479, epoch: 239:  48%|████▊     | 481/1000 [03:08<03:23,  2.55it/s]
# PTI :step: 480, epoch: 240:  48%|████▊     | 481/1000 [03:08<03:23,  2.55it/s]
# PTI :step: 480, epoch: 240:  48%|████▊     | 482/1000 [03:09<03:24,  2.54it/s]
# PTI :step: 481, epoch: 240:  48%|████▊     | 482/1000 [03:09<03:24,  2.54it/s]
# PTI :step: 481, epoch: 240:  48%|████▊     | 483/1000 [03:09<03:21,  2.57it/s]
# PTI :step: 482, epoch: 241:  48%|████▊     | 483/1000 [03:09<03:21,  2.57it/s]
# PTI :step: 482, epoch: 241:  48%|████▊     | 484/1000 [03:09<03:22,  2.55it/s]
# PTI :step: 483, epoch: 241:  48%|████▊     | 484/1000 [03:09<03:22,  2.55it/s]
# PTI :step: 483, epoch: 241:  48%|████▊     | 485/1000 [03:10<03:19,  2.58it/s]
# PTI :step: 484, epoch: 242:  48%|████▊     | 485/1000 [03:10<03:19,  2.58it/s]
# PTI :step: 484, epoch: 242:  49%|████▊     | 486/1000 [03:10<03:23,  2.53it/s]
# PTI :step: 485, epoch: 242:  49%|████▊     | 486/1000 [03:10<03:23,  2.53it/s]
# PTI :step: 485, epoch: 242:  49%|████▊     | 487/1000 [03:11<03:20,  2.56it/s]
# PTI :step: 486, epoch: 243:  49%|████▊     | 487/1000 [03:11<03:20,  2.56it/s]
# PTI :step: 486, epoch: 243:  49%|████▉     | 488/1000 [03:11<03:20,  2.55it/s]
# PTI :step: 487, epoch: 243:  49%|████▉     | 488/1000 [03:11<03:20,  2.55it/s]
# PTI :step: 487, epoch: 243:  49%|████▉     | 489/1000 [03:11<03:17,  2.58it/s]
# PTI :step: 488, epoch: 244:  49%|████▉     | 489/1000 [03:11<03:17,  2.58it/s]
# PTI :step: 488, epoch: 244:  49%|████▉     | 490/1000 [03:12<03:18,  2.56it/s]
# PTI :step: 489, epoch: 244:  49%|████▉     | 490/1000 [03:12<03:18,  2.56it/s]
# PTI :step: 489, epoch: 244:  49%|████▉     | 491/1000 [03:12<03:17,  2.57it/s]
# PTI :step: 490, epoch: 245:  49%|████▉     | 491/1000 [03:12<03:17,  2.57it/s]
# PTI :step: 490, epoch: 245:  49%|████▉     | 492/1000 [03:13<03:19,  2.55it/s]
# PTI :step: 491, epoch: 245:  49%|████▉     | 492/1000 [03:13<03:19,  2.55it/s]
# PTI :step: 491, epoch: 245:  49%|████▉     | 493/1000 [03:13<03:16,  2.58it/s]
# PTI :step: 492, epoch: 246:  49%|████▉     | 493/1000 [03:13<03:16,  2.58it/s]
# PTI :step: 492, epoch: 246:  49%|████▉     | 494/1000 [03:13<03:17,  2.56it/s]
# PTI :step: 493, epoch: 246:  49%|████▉     | 494/1000 [03:13<03:17,  2.56it/s]
# PTI :step: 493, epoch: 246:  50%|████▉     | 495/1000 [03:14<03:15,  2.59it/s]
# PTI :step: 494, epoch: 247:  50%|████▉     | 495/1000 [03:14<03:15,  2.59it/s]
# PTI :step: 494, epoch: 247:  50%|████▉     | 496/1000 [03:14<03:16,  2.56it/s]
# PTI :step: 495, epoch: 247:  50%|████▉     | 496/1000 [03:14<03:16,  2.56it/s]
# PTI :step: 495, epoch: 247:  50%|████▉     | 497/1000 [03:15<03:14,  2.59it/s]
# PTI :step: 496, epoch: 248:  50%|████▉     | 497/1000 [03:15<03:14,  2.59it/s]
# PTI :step: 496, epoch: 248:  50%|████▉     | 498/1000 [03:15<03:16,  2.55it/s]
# PTI :step: 497, epoch: 248:  50%|████▉     | 498/1000 [03:15<03:16,  2.55it/s]
# PTI :step: 497, epoch: 248:  50%|████▉     | 499/1000 [03:15<03:16,  2.54it/s]
# PTI :step: 498, epoch: 249:  50%|████▉     | 499/1000 [03:15<03:16,  2.54it/s]
# PTI :step: 498, epoch: 249:  50%|█████     | 500/1000 [03:16<03:17,  2.53it/s]
# PTI :  Pivot halfway
# PTI :step: 499, epoch: 249:  50%|█████     | 500/1000 [03:16<03:17,  2.53it/s]
# PTI :step: 499, epoch: 249:  50%|█████     | 501/1000 [03:16<03:15,  2.56it/s]
# PTI :step: 500, epoch: 250:  50%|█████     | 501/1000 [03:16<03:15,  2.56it/s]
# PTI :step: 500, epoch: 250:  50%|█████     | 502/1000 [03:17<03:23,  2.45it/s]
# PTI :step: 501, epoch: 250:  50%|█████     | 502/1000 [03:17<03:23,  2.45it/s]
# PTI :step: 501, epoch: 250:  50%|█████     | 503/1000 [03:17<03:18,  2.50it/s]
# PTI :step: 502, epoch: 251:  50%|█████     | 503/1000 [03:17<03:18,  2.50it/s]
# PTI :step: 502, epoch: 251:  50%|█████     | 504/1000 [03:17<03:17,  2.51it/s]
# PTI :step: 503, epoch: 251:  50%|█████     | 504/1000 [03:17<03:17,  2.51it/s]
# PTI :step: 503, epoch: 251:  50%|█████     | 505/1000 [03:18<03:14,  2.55it/s]
# PTI :step: 504, epoch: 252:  50%|█████     | 505/1000 [03:18<03:14,  2.55it/s]
# PTI :step: 504, epoch: 252:  51%|█████     | 506/1000 [03:18<03:14,  2.54it/s]
# PTI :step: 505, epoch: 252:  51%|█████     | 506/1000 [03:18<03:14,  2.54it/s]
# PTI :step: 505, epoch: 252:  51%|█████     | 507/1000 [03:18<03:10,  2.58it/s]
# PTI :step: 506, epoch: 253:  51%|█████     | 507/1000 [03:18<03:10,  2.58it/s]
# PTI :step: 506, epoch: 253:  51%|█████     | 508/1000 [03:19<03:11,  2.57it/s]
# PTI :step: 507, epoch: 253:  51%|█████     | 508/1000 [03:19<03:11,  2.57it/s]
# PTI :step: 507, epoch: 253:  51%|█████     | 509/1000 [03:19<03:09,  2.59it/s]
# PTI :step: 508, epoch: 254:  51%|█████     | 509/1000 [03:19<03:09,  2.59it/s]
# PTI :step: 508, epoch: 254:  51%|█████     | 510/1000 [03:20<03:10,  2.58it/s]
# PTI :step: 509, epoch: 254:  51%|█████     | 510/1000 [03:20<03:10,  2.58it/s]
# PTI :step: 509, epoch: 254:  51%|█████     | 511/1000 [03:20<03:09,  2.58it/s]
# PTI :step: 510, epoch: 255:  51%|█████     | 511/1000 [03:20<03:09,  2.58it/s]
# PTI :step: 510, epoch: 255:  51%|█████     | 512/1000 [03:20<03:10,  2.56it/s]
# PTI :step: 511, epoch: 255:  51%|█████     | 512/1000 [03:20<03:10,  2.56it/s]
# PTI :step: 511, epoch: 255:  51%|█████▏    | 513/1000 [03:21<03:08,  2.59it/s]
# PTI :step: 512, epoch: 256:  51%|█████▏    | 513/1000 [03:21<03:08,  2.59it/s]
# PTI :step: 512, epoch: 256:  51%|█████▏    | 514/1000 [03:21<03:10,  2.55it/s]
# PTI :step: 513, epoch: 256:  51%|█████▏    | 514/1000 [03:21<03:10,  2.55it/s]
# PTI :step: 513, epoch: 256:  52%|█████▏    | 515/1000 [03:22<03:08,  2.58it/s]
# PTI :step: 514, epoch: 257:  52%|█████▏    | 515/1000 [03:22<03:08,  2.58it/s]
# PTI :step: 514, epoch: 257:  52%|█████▏    | 516/1000 [03:22<03:08,  2.56it/s]
# PTI :step: 515, epoch: 257:  52%|█████▏    | 516/1000 [03:22<03:08,  2.56it/s]
# PTI :step: 515, epoch: 257:  52%|█████▏    | 517/1000 [03:22<03:06,  2.59it/s]
# PTI :step: 516, epoch: 258:  52%|█████▏    | 517/1000 [03:22<03:06,  2.59it/s]
# PTI :step: 516, epoch: 258:  52%|█████▏    | 518/1000 [03:23<03:06,  2.58it/s]
# PTI :step: 517, epoch: 258:  52%|█████▏    | 518/1000 [03:23<03:06,  2.58it/s]
# PTI :step: 517, epoch: 258:  52%|█████▏    | 519/1000 [03:23<03:06,  2.58it/s]
# PTI :step: 518, epoch: 259:  52%|█████▏    | 519/1000 [03:23<03:06,  2.58it/s]
# PTI :step: 518, epoch: 259:  52%|█████▏    | 520/1000 [03:24<03:07,  2.57it/s]
# PTI :step: 519, epoch: 259:  52%|█████▏    | 520/1000 [03:24<03:07,  2.57it/s]
# PTI :step: 519, epoch: 259:  52%|█████▏    | 521/1000 [03:24<03:04,  2.60it/s]
# PTI :step: 520, epoch: 260:  52%|█████▏    | 521/1000 [03:24<03:04,  2.60it/s]
# PTI :step: 520, epoch: 260:  52%|█████▏    | 522/1000 [03:24<03:07,  2.55it/s]
# PTI :step: 521, epoch: 260:  52%|█████▏    | 522/1000 [03:24<03:07,  2.55it/s]
# PTI :step: 521, epoch: 260:  52%|█████▏    | 523/1000 [03:25<03:04,  2.59it/s]
# PTI :step: 522, epoch: 261:  52%|█████▏    | 523/1000 [03:25<03:04,  2.59it/s]
# PTI :step: 522, epoch: 261:  52%|█████▏    | 524/1000 [03:25<03:04,  2.57it/s]
# PTI :step: 523, epoch: 261:  52%|█████▏    | 524/1000 [03:25<03:04,  2.57it/s]
# PTI :step: 523, epoch: 261:  52%|█████▎    | 525/1000 [03:25<03:02,  2.61it/s]
# PTI :step: 524, epoch: 262:  52%|█████▎    | 525/1000 [03:25<03:02,  2.61it/s]
# PTI :step: 524, epoch: 262:  53%|█████▎    | 526/1000 [03:26<03:03,  2.59it/s]
# PTI :step: 525, epoch: 262:  53%|█████▎    | 526/1000 [03:26<03:03,  2.59it/s]
# PTI :step: 525, epoch: 262:  53%|█████▎    | 527/1000 [03:26<03:02,  2.58it/s]
# PTI :step: 526, epoch: 263:  53%|█████▎    | 527/1000 [03:26<03:02,  2.58it/s]
# PTI :step: 526, epoch: 263:  53%|█████▎    | 528/1000 [03:27<03:03,  2.57it/s]
# PTI :step: 527, epoch: 263:  53%|█████▎    | 528/1000 [03:27<03:03,  2.57it/s]
# PTI :step: 527, epoch: 263:  53%|█████▎    | 529/1000 [03:27<03:01,  2.60it/s]
# PTI :step: 528, epoch: 264:  53%|█████▎    | 529/1000 [03:27<03:01,  2.60it/s]
# PTI :step: 528, epoch: 264:  53%|█████▎    | 530/1000 [03:27<03:01,  2.58it/s]
# PTI :step: 529, epoch: 264:  53%|█████▎    | 530/1000 [03:27<03:01,  2.58it/s]
# PTI :step: 529, epoch: 264:  53%|█████▎    | 531/1000 [03:28<02:59,  2.62it/s]
# PTI :step: 530, epoch: 265:  53%|█████▎    | 531/1000 [03:28<02:59,  2.62it/s]
# PTI :step: 530, epoch: 265:  53%|█████▎    | 532/1000 [03:28<03:01,  2.57it/s]
# PTI :step: 531, epoch: 265:  53%|█████▎    | 532/1000 [03:28<03:01,  2.57it/s]
# PTI :step: 531, epoch: 265:  53%|█████▎    | 533/1000 [03:29<02:59,  2.61it/s]
# PTI :step: 532, epoch: 266:  53%|█████▎    | 533/1000 [03:29<02:59,  2.61it/s]
# PTI :step: 532, epoch: 266:  53%|█████▎    | 534/1000 [03:29<03:00,  2.59it/s]
# PTI :step: 533, epoch: 266:  53%|█████▎    | 534/1000 [03:29<03:00,  2.59it/s]
# PTI :step: 533, epoch: 266:  54%|█████▎    | 535/1000 [03:29<02:59,  2.59it/s]
# PTI :step: 534, epoch: 267:  54%|█████▎    | 535/1000 [03:29<02:59,  2.59it/s]
# PTI :step: 534, epoch: 267:  54%|█████▎    | 536/1000 [03:30<02:59,  2.58it/s]
# PTI :step: 535, epoch: 267:  54%|█████▎    | 536/1000 [03:30<02:59,  2.58it/s]
# PTI :step: 535, epoch: 267:  54%|█████▎    | 537/1000 [03:30<02:58,  2.60it/s]
# PTI :step: 536, epoch: 268:  54%|█████▎    | 537/1000 [03:30<02:58,  2.60it/s]
# PTI :step: 536, epoch: 268:  54%|█████▍    | 538/1000 [03:30<02:59,  2.58it/s]
# PTI :step: 537, epoch: 268:  54%|█████▍    | 538/1000 [03:30<02:59,  2.58it/s]
# PTI :step: 537, epoch: 268:  54%|█████▍    | 539/1000 [03:31<02:56,  2.61it/s]
# PTI :step: 538, epoch: 269:  54%|█████▍    | 539/1000 [03:31<02:56,  2.61it/s]
# PTI :step: 538, epoch: 269:  54%|█████▍    | 540/1000 [03:31<02:59,  2.56it/s]
# PTI :step: 539, epoch: 269:  54%|█████▍    | 540/1000 [03:31<02:59,  2.56it/s]
# PTI :step: 539, epoch: 269:  54%|█████▍    | 541/1000 [03:32<02:56,  2.60it/s]
# PTI :step: 540, epoch: 270:  54%|█████▍    | 541/1000 [03:32<02:56,  2.60it/s]
# PTI :step: 540, epoch: 270:  54%|█████▍    | 542/1000 [03:32<02:57,  2.58it/s]
# PTI :step: 541, epoch: 270:  54%|█████▍    | 542/1000 [03:32<02:57,  2.58it/s]
# PTI :step: 541, epoch: 270:  54%|█████▍    | 543/1000 [03:32<02:55,  2.60it/s]
# PTI :step: 542, epoch: 271:  54%|█████▍    | 543/1000 [03:32<02:55,  2.60it/s]
# PTI :step: 542, epoch: 271:  54%|█████▍    | 544/1000 [03:33<02:56,  2.58it/s]
# PTI :step: 543, epoch: 271:  54%|█████▍    | 544/1000 [03:33<02:56,  2.58it/s]
# PTI :step: 543, epoch: 271:  55%|█████▍    | 545/1000 [03:33<02:55,  2.59it/s]
# PTI :step: 544, epoch: 272:  55%|█████▍    | 545/1000 [03:33<02:55,  2.59it/s]
# PTI :step: 544, epoch: 272:  55%|█████▍    | 546/1000 [03:34<02:56,  2.58it/s]
# PTI :step: 545, epoch: 272:  55%|█████▍    | 546/1000 [03:34<02:56,  2.58it/s]
# PTI :step: 545, epoch: 272:  55%|█████▍    | 547/1000 [03:34<02:54,  2.60it/s]
# PTI :step: 546, epoch: 273:  55%|█████▍    | 547/1000 [03:34<02:54,  2.60it/s]
# PTI :step: 546, epoch: 273:  55%|█████▍    | 548/1000 [03:34<02:55,  2.58it/s]
# PTI :step: 547, epoch: 273:  55%|█████▍    | 548/1000 [03:34<02:55,  2.58it/s]
# PTI :step: 547, epoch: 273:  55%|█████▍    | 549/1000 [03:35<02:52,  2.61it/s]
# PTI :step: 548, epoch: 274:  55%|█████▍    | 549/1000 [03:35<02:52,  2.61it/s]
# PTI :step: 548, epoch: 274:  55%|█████▌    | 550/1000 [03:35<02:54,  2.58it/s]
# PTI :step: 549, epoch: 274:  55%|█████▌    | 550/1000 [03:35<02:54,  2.58it/s]
# PTI :step: 549, epoch: 274:  55%|█████▌    | 551/1000 [03:35<02:52,  2.61it/s]
# PTI :step: 550, epoch: 275:  55%|█████▌    | 551/1000 [03:35<02:52,  2.61it/s]
# PTI :step: 550, epoch: 275:  55%|█████▌    | 552/1000 [03:36<02:52,  2.59it/s]
# PTI :step: 551, epoch: 275:  55%|█████▌    | 552/1000 [03:36<02:52,  2.59it/s]
# PTI :step: 551, epoch: 275:  55%|█████▌    | 553/1000 [03:36<02:53,  2.58it/s]
# PTI :step: 552, epoch: 276:  55%|█████▌    | 553/1000 [03:36<02:53,  2.58it/s]
# PTI :step: 552, epoch: 276:  55%|█████▌    | 554/1000 [03:37<02:54,  2.56it/s]
# PTI :step: 553, epoch: 276:  55%|█████▌    | 554/1000 [03:37<02:54,  2.56it/s]
# PTI :step: 553, epoch: 276:  56%|█████▌    | 555/1000 [03:37<02:52,  2.57it/s]
# PTI :step: 554, epoch: 277:  56%|█████▌    | 555/1000 [03:37<02:52,  2.57it/s]
# PTI :step: 554, epoch: 277:  56%|█████▌    | 556/1000 [03:37<02:52,  2.57it/s]
# PTI :step: 555, epoch: 277:  56%|█████▌    | 556/1000 [03:37<02:52,  2.57it/s]
# PTI :step: 555, epoch: 277:  56%|█████▌    | 557/1000 [03:38<02:50,  2.60it/s]
# PTI :step: 556, epoch: 278:  56%|█████▌    | 557/1000 [03:38<02:50,  2.60it/s]
# PTI :step: 556, epoch: 278:  56%|█████▌    | 558/1000 [03:38<02:52,  2.56it/s]
# PTI :step: 557, epoch: 278:  56%|█████▌    | 558/1000 [03:38<02:52,  2.56it/s]
# PTI :step: 557, epoch: 278:  56%|█████▌    | 559/1000 [03:39<02:49,  2.60it/s]
# PTI :step: 558, epoch: 279:  56%|█████▌    | 559/1000 [03:39<02:49,  2.60it/s]
# PTI :step: 558, epoch: 279:  56%|█████▌    | 560/1000 [03:39<02:50,  2.58it/s]
# PTI :step: 559, epoch: 279:  56%|█████▌    | 560/1000 [03:39<02:50,  2.58it/s]
# PTI :step: 559, epoch: 279:  56%|█████▌    | 561/1000 [03:39<02:48,  2.61it/s]
# PTI :step: 560, epoch: 280:  56%|█████▌    | 561/1000 [03:39<02:48,  2.61it/s]
# PTI :step: 560, epoch: 280:  56%|█████▌    | 562/1000 [03:40<02:49,  2.59it/s]
# PTI :step: 561, epoch: 280:  56%|█████▌    | 562/1000 [03:40<02:49,  2.59it/s]
# PTI :step: 561, epoch: 280:  56%|█████▋    | 563/1000 [03:40<02:48,  2.59it/s]
# PTI :step: 562, epoch: 281:  56%|█████▋    | 563/1000 [03:40<02:48,  2.59it/s]
# PTI :step: 562, epoch: 281:  56%|█████▋    | 564/1000 [03:41<02:49,  2.57it/s]
# PTI :step: 563, epoch: 281:  56%|█████▋    | 564/1000 [03:41<02:49,  2.57it/s]
# PTI :step: 563, epoch: 281:  56%|█████▋    | 565/1000 [03:41<02:47,  2.59it/s]
# PTI :step: 564, epoch: 282:  56%|█████▋    | 565/1000 [03:41<02:47,  2.59it/s]
# PTI :step: 564, epoch: 282:  57%|█████▋    | 566/1000 [03:41<02:49,  2.55it/s]
# PTI :step: 565, epoch: 282:  57%|█████▋    | 566/1000 [03:41<02:49,  2.55it/s]
# PTI :step: 565, epoch: 282:  57%|█████▋    | 567/1000 [03:42<02:47,  2.59it/s]
# PTI :step: 566, epoch: 283:  57%|█████▋    | 567/1000 [03:42<02:47,  2.59it/s]
# PTI :step: 566, epoch: 283:  57%|█████▋    | 568/1000 [03:42<02:47,  2.57it/s]
# PTI :step: 567, epoch: 283:  57%|█████▋    | 568/1000 [03:42<02:47,  2.57it/s]
# PTI :step: 567, epoch: 283:  57%|█████▋    | 569/1000 [03:42<02:45,  2.60it/s]
# PTI :step: 568, epoch: 284:  57%|█████▋    | 569/1000 [03:42<02:45,  2.60it/s]
# PTI :step: 568, epoch: 284:  57%|█████▋    | 570/1000 [03:43<02:46,  2.58it/s]
# PTI :step: 569, epoch: 284:  57%|█████▋    | 570/1000 [03:43<02:46,  2.58it/s]
# PTI :step: 569, epoch: 284:  57%|█████▋    | 571/1000 [03:43<02:46,  2.58it/s]
# PTI :step: 570, epoch: 285:  57%|█████▋    | 571/1000 [03:43<02:46,  2.58it/s]
# PTI :step: 570, epoch: 285:  57%|█████▋    | 572/1000 [03:44<02:47,  2.56it/s]
# PTI :step: 571, epoch: 285:  57%|█████▋    | 572/1000 [03:44<02:47,  2.56it/s]
# PTI :step: 571, epoch: 285:  57%|█████▋    | 573/1000 [03:44<02:45,  2.57it/s]
# PTI :step: 572, epoch: 286:  57%|█████▋    | 573/1000 [03:44<02:45,  2.57it/s]
# PTI :step: 572, epoch: 286:  57%|█████▋    | 574/1000 [03:44<02:46,  2.55it/s]
# PTI :step: 573, epoch: 286:  57%|█████▋    | 574/1000 [03:44<02:46,  2.55it/s]
# PTI :step: 573, epoch: 286:  57%|█████▊    | 575/1000 [03:45<02:44,  2.59it/s]
# PTI :step: 574, epoch: 287:  57%|█████▊    | 575/1000 [03:45<02:44,  2.59it/s]
# PTI :step: 574, epoch: 287:  58%|█████▊    | 576/1000 [03:45<02:46,  2.55it/s]
# PTI :step: 575, epoch: 287:  58%|█████▊    | 576/1000 [03:45<02:46,  2.55it/s]
# PTI :step: 575, epoch: 287:  58%|█████▊    | 577/1000 [03:46<02:43,  2.59it/s]
# PTI :step: 576, epoch: 288:  58%|█████▊    | 577/1000 [03:46<02:43,  2.59it/s]
# PTI :step: 576, epoch: 288:  58%|█████▊    | 578/1000 [03:46<02:57,  2.38it/s]
# PTI :step: 577, epoch: 288:  58%|█████▊    | 578/1000 [03:46<02:57,  2.38it/s]
# PTI :step: 577, epoch: 288:  58%|█████▊    | 579/1000 [03:46<02:52,  2.44it/s]
# PTI :step: 578, epoch: 289:  58%|█████▊    | 579/1000 [03:46<02:52,  2.44it/s]
# PTI :step: 578, epoch: 289:  58%|█████▊    | 580/1000 [03:47<02:49,  2.47it/s]
# PTI :step: 579, epoch: 289:  58%|█████▊    | 580/1000 [03:47<02:49,  2.47it/s]
# PTI :step: 579, epoch: 289:  58%|█████▊    | 581/1000 [03:47<02:46,  2.52it/s]
# PTI :step: 580, epoch: 290:  58%|█████▊    | 581/1000 [03:47<02:46,  2.52it/s]
# PTI :step: 580, epoch: 290:  58%|█████▊    | 582/1000 [03:48<02:45,  2.53it/s]
# PTI :step: 581, epoch: 290:  58%|█████▊    | 582/1000 [03:48<02:45,  2.53it/s]
# PTI :step: 581, epoch: 290:  58%|█████▊    | 583/1000 [03:48<02:42,  2.57it/s]
# PTI :step: 582, epoch: 291:  58%|█████▊    | 583/1000 [03:48<02:42,  2.57it/s]
# PTI :step: 582, epoch: 291:  58%|█████▊    | 584/1000 [03:48<02:42,  2.56it/s]
# PTI :step: 583, epoch: 291:  58%|█████▊    | 584/1000 [03:48<02:42,  2.56it/s]
# PTI :step: 583, epoch: 291:  58%|█████▊    | 585/1000 [03:49<02:39,  2.60it/s]
# PTI :step: 584, epoch: 292:  58%|█████▊    | 585/1000 [03:49<02:39,  2.60it/s]
# PTI :step: 584, epoch: 292:  59%|█████▊    | 586/1000 [03:49<02:40,  2.58it/s]
# PTI :step: 585, epoch: 292:  59%|█████▊    | 586/1000 [03:49<02:40,  2.58it/s]
# PTI :step: 585, epoch: 292:  59%|█████▊    | 587/1000 [03:50<02:39,  2.59it/s]
# PTI :step: 586, epoch: 293:  59%|█████▊    | 587/1000 [03:50<02:39,  2.59it/s]
# PTI :step: 586, epoch: 293:  59%|█████▉    | 588/1000 [03:50<02:40,  2.57it/s]
# PTI :step: 587, epoch: 293:  59%|█████▉    | 588/1000 [03:50<02:40,  2.57it/s]
# PTI :step: 587, epoch: 293:  59%|█████▉    | 589/1000 [03:50<02:39,  2.58it/s]
# PTI :step: 588, epoch: 294:  59%|█████▉    | 589/1000 [03:50<02:39,  2.58it/s]
# PTI :step: 588, epoch: 294:  59%|█████▉    | 590/1000 [03:51<02:39,  2.57it/s]
# PTI :step: 589, epoch: 294:  59%|█████▉    | 590/1000 [03:51<02:39,  2.57it/s]
# PTI :step: 589, epoch: 294:  59%|█████▉    | 591/1000 [03:51<02:39,  2.56it/s]
# PTI :step: 590, epoch: 295:  59%|█████▉    | 591/1000 [03:51<02:39,  2.56it/s]
# PTI :step: 590, epoch: 295:  59%|█████▉    | 592/1000 [03:51<02:39,  2.55it/s]
# PTI :step: 591, epoch: 295:  59%|█████▉    | 592/1000 [03:51<02:39,  2.55it/s]
# PTI :step: 591, epoch: 295:  59%|█████▉    | 593/1000 [03:52<02:37,  2.59it/s]
# PTI :step: 592, epoch: 296:  59%|█████▉    | 593/1000 [03:52<02:37,  2.59it/s]
# PTI :step: 592, epoch: 296:  59%|█████▉    | 594/1000 [03:52<02:39,  2.54it/s]
# PTI :step: 593, epoch: 296:  59%|█████▉    | 594/1000 [03:52<02:39,  2.54it/s]
# PTI :step: 593, epoch: 296:  60%|█████▉    | 595/1000 [03:53<02:36,  2.59it/s]
# PTI :step: 594, epoch: 297:  60%|█████▉    | 595/1000 [03:53<02:36,  2.59it/s]
# PTI :step: 594, epoch: 297:  60%|█████▉    | 596/1000 [03:53<02:36,  2.57it/s]
# PTI :step: 595, epoch: 297:  60%|█████▉    | 596/1000 [03:53<02:36,  2.57it/s]
# PTI :step: 595, epoch: 297:  60%|█████▉    | 597/1000 [03:53<02:34,  2.61it/s]
# PTI :step: 596, epoch: 298:  60%|█████▉    | 597/1000 [03:53<02:34,  2.61it/s]
# PTI :step: 596, epoch: 298:  60%|█████▉    | 598/1000 [03:54<02:35,  2.59it/s]
# PTI :step: 597, epoch: 298:  60%|█████▉    | 598/1000 [03:54<02:35,  2.59it/s]
# PTI :step: 597, epoch: 298:  60%|█████▉    | 599/1000 [03:54<02:35,  2.58it/s]
# PTI :step: 598, epoch: 299:  60%|█████▉    | 599/1000 [03:54<02:35,  2.58it/s]
# PTI :step: 598, epoch: 299:  60%|██████    | 600/1000 [03:55<02:35,  2.57it/s]
# PTI :step: 599, epoch: 299:  60%|██████    | 600/1000 [03:55<02:35,  2.57it/s]
# PTI :step: 599, epoch: 299:  60%|██████    | 601/1000 [03:55<02:33,  2.60it/s]
# PTI :step: 600, epoch: 300:  60%|██████    | 601/1000 [03:55<02:33,  2.60it/s]
# PTI :step: 600, epoch: 300:  60%|██████    | 602/1000 [03:55<02:35,  2.56it/s]
# PTI :step: 601, epoch: 300:  60%|██████    | 602/1000 [03:55<02:35,  2.56it/s]
# PTI :step: 601, epoch: 300:  60%|██████    | 603/1000 [03:56<02:32,  2.60it/s]
# PTI :step: 602, epoch: 301:  60%|██████    | 603/1000 [03:56<02:32,  2.60it/s]
# PTI :step: 602, epoch: 301:  60%|██████    | 604/1000 [03:56<02:34,  2.56it/s]
# PTI :step: 603, epoch: 301:  60%|██████    | 604/1000 [03:56<02:34,  2.56it/s]
# PTI :step: 603, epoch: 301:  60%|██████    | 605/1000 [03:57<02:32,  2.60it/s]
# PTI :step: 604, epoch: 302:  60%|██████    | 605/1000 [03:57<02:32,  2.60it/s]
# PTI :step: 604, epoch: 302:  61%|██████    | 606/1000 [03:57<02:32,  2.58it/s]
# PTI :step: 605, epoch: 302:  61%|██████    | 606/1000 [03:57<02:32,  2.58it/s]
# PTI :step: 605, epoch: 302:  61%|██████    | 607/1000 [03:57<02:31,  2.59it/s]
# PTI :step: 606, epoch: 303:  61%|██████    | 607/1000 [03:57<02:31,  2.59it/s]
# PTI :step: 606, epoch: 303:  61%|██████    | 608/1000 [03:58<02:32,  2.58it/s]
# PTI :step: 607, epoch: 303:  61%|██████    | 608/1000 [03:58<02:32,  2.58it/s]
# PTI :step: 607, epoch: 303:  61%|██████    | 609/1000 [03:58<02:29,  2.61it/s]
# PTI :step: 608, epoch: 304:  61%|██████    | 609/1000 [03:58<02:29,  2.61it/s]
# PTI :step: 608, epoch: 304:  61%|██████    | 610/1000 [03:58<02:30,  2.59it/s]
# PTI :step: 609, epoch: 304:  61%|██████    | 610/1000 [03:58<02:30,  2.59it/s]
# PTI :step: 609, epoch: 304:  61%|██████    | 611/1000 [03:59<02:29,  2.61it/s]
# PTI :step: 610, epoch: 305:  61%|██████    | 611/1000 [03:59<02:29,  2.61it/s]
# PTI :step: 610, epoch: 305:  61%|██████    | 612/1000 [03:59<02:31,  2.56it/s]
# PTI :step: 611, epoch: 305:  61%|██████    | 612/1000 [03:59<02:31,  2.56it/s]
# PTI :step: 611, epoch: 305:  61%|██████▏   | 613/1000 [04:00<02:30,  2.58it/s]
# PTI :step: 612, epoch: 306:  61%|██████▏   | 613/1000 [04:00<02:30,  2.58it/s]
# PTI :step: 612, epoch: 306:  61%|██████▏   | 614/1000 [04:00<02:30,  2.57it/s]
# PTI :step: 613, epoch: 306:  61%|██████▏   | 614/1000 [04:00<02:30,  2.57it/s]
# PTI :step: 613, epoch: 306:  62%|██████▏   | 615/1000 [04:00<02:29,  2.58it/s]
# PTI :step: 614, epoch: 307:  62%|██████▏   | 615/1000 [04:00<02:29,  2.58it/s]
# PTI :step: 614, epoch: 307:  62%|██████▏   | 616/1000 [04:01<02:29,  2.57it/s]
# PTI :step: 615, epoch: 307:  62%|██████▏   | 616/1000 [04:01<02:29,  2.57it/s]
# PTI :step: 615, epoch: 307:  62%|██████▏   | 617/1000 [04:01<02:29,  2.57it/s]
# PTI :step: 616, epoch: 308:  62%|██████▏   | 617/1000 [04:01<02:29,  2.57it/s]
# PTI :step: 616, epoch: 308:  62%|██████▏   | 618/1000 [04:02<02:29,  2.56it/s]
# PTI :step: 617, epoch: 308:  62%|██████▏   | 618/1000 [04:02<02:29,  2.56it/s]
# PTI :step: 617, epoch: 308:  62%|██████▏   | 619/1000 [04:02<02:27,  2.59it/s]
# PTI :step: 618, epoch: 309:  62%|██████▏   | 619/1000 [04:02<02:27,  2.59it/s]
# PTI :step: 618, epoch: 309:  62%|██████▏   | 620/1000 [04:02<02:29,  2.55it/s]
# PTI :step: 619, epoch: 309:  62%|██████▏   | 620/1000 [04:02<02:29,  2.55it/s]
# PTI :step: 619, epoch: 309:  62%|██████▏   | 621/1000 [04:03<02:27,  2.58it/s]
# PTI :step: 620, epoch: 310:  62%|██████▏   | 621/1000 [04:03<02:27,  2.58it/s]
# PTI :step: 620, epoch: 310:  62%|██████▏   | 622/1000 [04:03<02:29,  2.53it/s]
# PTI :step: 621, epoch: 310:  62%|██████▏   | 622/1000 [04:03<02:29,  2.53it/s]
# PTI :step: 621, epoch: 310:  62%|██████▏   | 623/1000 [04:04<02:28,  2.54it/s]
# PTI :step: 622, epoch: 311:  62%|██████▏   | 623/1000 [04:04<02:28,  2.54it/s]
# PTI :step: 622, epoch: 311:  62%|██████▏   | 624/1000 [04:04<02:29,  2.52it/s]
# PTI :step: 623, epoch: 311:  62%|██████▏   | 624/1000 [04:04<02:29,  2.52it/s]
# PTI :step: 623, epoch: 311:  62%|██████▎   | 625/1000 [04:04<02:29,  2.51it/s]
# PTI :step: 624, epoch: 312:  62%|██████▎   | 625/1000 [04:04<02:29,  2.51it/s]
# PTI :step: 624, epoch: 312:  63%|██████▎   | 626/1000 [04:05<02:29,  2.50it/s]
# PTI :step: 625, epoch: 312:  63%|██████▎   | 626/1000 [04:05<02:29,  2.50it/s]
# PTI :step: 625, epoch: 312:  63%|██████▎   | 627/1000 [04:05<02:30,  2.48it/s]
# PTI :step: 626, epoch: 313:  63%|██████▎   | 627/1000 [04:05<02:30,  2.48it/s]
# PTI :step: 626, epoch: 313:  63%|██████▎   | 628/1000 [04:06<02:29,  2.49it/s]
# PTI :step: 627, epoch: 313:  63%|██████▎   | 628/1000 [04:06<02:29,  2.49it/s]
# PTI :step: 627, epoch: 313:  63%|██████▎   | 629/1000 [04:06<02:27,  2.52it/s]
# PTI :step: 628, epoch: 314:  63%|██████▎   | 629/1000 [04:06<02:27,  2.52it/s]
# PTI :step: 628, epoch: 314:  63%|██████▎   | 630/1000 [04:06<02:27,  2.51it/s]
# PTI :step: 629, epoch: 314:  63%|██████▎   | 630/1000 [04:06<02:27,  2.51it/s]
# PTI :step: 629, epoch: 314:  63%|██████▎   | 631/1000 [04:07<02:25,  2.53it/s]
# PTI :step: 630, epoch: 315:  63%|██████▎   | 631/1000 [04:07<02:25,  2.53it/s]
# PTI :step: 630, epoch: 315:  63%|██████▎   | 632/1000 [04:07<02:26,  2.52it/s]
# PTI :step: 631, epoch: 315:  63%|██████▎   | 632/1000 [04:07<02:26,  2.52it/s]
# PTI :step: 631, epoch: 315:  63%|██████▎   | 633/1000 [04:08<02:23,  2.55it/s]
# PTI :step: 632, epoch: 316:  63%|██████▎   | 633/1000 [04:08<02:23,  2.55it/s]
# PTI :step: 632, epoch: 316:  63%|██████▎   | 634/1000 [04:08<02:24,  2.54it/s]
# PTI :step: 633, epoch: 316:  63%|██████▎   | 634/1000 [04:08<02:24,  2.54it/s]
# PTI :step: 633, epoch: 316:  64%|██████▎   | 635/1000 [04:08<02:21,  2.58it/s]
# PTI :step: 634, epoch: 317:  64%|██████▎   | 635/1000 [04:08<02:21,  2.58it/s]
# PTI :step: 634, epoch: 317:  64%|██████▎   | 636/1000 [04:09<02:21,  2.57it/s]
# PTI :step: 635, epoch: 317:  64%|██████▎   | 636/1000 [04:09<02:21,  2.57it/s]
# PTI :step: 635, epoch: 317:  64%|██████▎   | 637/1000 [04:09<02:20,  2.59it/s]
# PTI :step: 636, epoch: 318:  64%|██████▎   | 637/1000 [04:09<02:20,  2.59it/s]
# PTI :step: 636, epoch: 318:  64%|██████▍   | 638/1000 [04:09<02:20,  2.58it/s]
# PTI :step: 637, epoch: 318:  64%|██████▍   | 638/1000 [04:09<02:20,  2.58it/s]
# PTI :step: 637, epoch: 318:  64%|██████▍   | 639/1000 [04:10<02:18,  2.61it/s]
# PTI :step: 638, epoch: 319:  64%|██████▍   | 639/1000 [04:10<02:18,  2.61it/s]
# PTI :step: 638, epoch: 319:  64%|██████▍   | 640/1000 [04:10<02:19,  2.58it/s]
# PTI :step: 639, epoch: 319:  64%|██████▍   | 640/1000 [04:10<02:19,  2.58it/s]
# PTI :step: 639, epoch: 319:  64%|██████▍   | 641/1000 [04:11<02:18,  2.59it/s]
# PTI :step: 640, epoch: 320:  64%|██████▍   | 641/1000 [04:11<02:18,  2.59it/s]
# PTI :step: 640, epoch: 320:  64%|██████▍   | 642/1000 [04:11<02:19,  2.57it/s]
# PTI :step: 641, epoch: 320:  64%|██████▍   | 642/1000 [04:11<02:19,  2.57it/s]
# PTI :step: 641, epoch: 320:  64%|██████▍   | 643/1000 [04:11<02:18,  2.58it/s]
# PTI :step: 642, epoch: 321:  64%|██████▍   | 643/1000 [04:11<02:18,  2.58it/s]
# PTI :step: 642, epoch: 321:  64%|██████▍   | 644/1000 [04:12<02:19,  2.56it/s]
# PTI :step: 643, epoch: 321:  64%|██████▍   | 644/1000 [04:12<02:19,  2.56it/s]
# PTI :step: 643, epoch: 321:  64%|██████▍   | 645/1000 [04:12<02:17,  2.58it/s]
# PTI :step: 644, epoch: 322:  64%|██████▍   | 645/1000 [04:12<02:17,  2.58it/s]
# PTI :step: 644, epoch: 322:  65%|██████▍   | 646/1000 [04:13<02:17,  2.57it/s]
# PTI :step: 645, epoch: 322:  65%|██████▍   | 646/1000 [04:13<02:17,  2.57it/s]
# PTI :step: 645, epoch: 322:  65%|██████▍   | 647/1000 [04:13<02:15,  2.60it/s]
# PTI :step: 646, epoch: 323:  65%|██████▍   | 647/1000 [04:13<02:15,  2.60it/s]
# PTI :step: 646, epoch: 323:  65%|██████▍   | 648/1000 [04:13<02:16,  2.58it/s]
# PTI :step: 647, epoch: 323:  65%|██████▍   | 648/1000 [04:13<02:16,  2.58it/s]
# PTI :step: 647, epoch: 323:  65%|██████▍   | 649/1000 [04:14<02:14,  2.61it/s]
# PTI :step: 648, epoch: 324:  65%|██████▍   | 649/1000 [04:14<02:14,  2.61it/s]
# PTI :step: 648, epoch: 324:  65%|██████▌   | 650/1000 [04:14<02:15,  2.59it/s]
# PTI :step: 649, epoch: 324:  65%|██████▌   | 650/1000 [04:14<02:15,  2.59it/s]
# PTI :step: 649, epoch: 324:  65%|██████▌   | 651/1000 [04:14<02:13,  2.61it/s]
# PTI :step: 650, epoch: 325:  65%|██████▌   | 651/1000 [04:14<02:13,  2.61it/s]
# PTI :step: 650, epoch: 325:  65%|██████▌   | 652/1000 [04:15<02:14,  2.58it/s]
# PTI :step: 651, epoch: 325:  65%|██████▌   | 652/1000 [04:15<02:14,  2.58it/s]
# PTI :step: 651, epoch: 325:  65%|██████▌   | 653/1000 [04:15<02:15,  2.56it/s]
# PTI :step: 652, epoch: 326:  65%|██████▌   | 653/1000 [04:15<02:15,  2.56it/s]
# PTI :step: 652, epoch: 326:  65%|██████▌   | 654/1000 [04:16<02:15,  2.55it/s]
# PTI :step: 653, epoch: 326:  65%|██████▌   | 654/1000 [04:16<02:15,  2.55it/s]
# PTI :step: 653, epoch: 326:  66%|██████▌   | 655/1000 [04:16<02:13,  2.58it/s]
# PTI :step: 654, epoch: 327:  66%|██████▌   | 655/1000 [04:16<02:13,  2.58it/s]
# PTI :step: 654, epoch: 327:  66%|██████▌   | 656/1000 [04:16<02:14,  2.56it/s]
# PTI :step: 655, epoch: 327:  66%|██████▌   | 656/1000 [04:16<02:14,  2.56it/s]
# PTI :step: 655, epoch: 327:  66%|██████▌   | 657/1000 [04:17<02:12,  2.60it/s]
# PTI :step: 656, epoch: 328:  66%|██████▌   | 657/1000 [04:17<02:12,  2.60it/s]
# PTI :step: 656, epoch: 328:  66%|██████▌   | 658/1000 [04:17<02:13,  2.55it/s]
# PTI :step: 657, epoch: 328:  66%|██████▌   | 658/1000 [04:17<02:13,  2.55it/s]
# PTI :step: 657, epoch: 328:  66%|██████▌   | 659/1000 [04:18<02:14,  2.54it/s]
# PTI :step: 658, epoch: 329:  66%|██████▌   | 659/1000 [04:18<02:14,  2.54it/s]
# PTI :step: 658, epoch: 329:  66%|██████▌   | 660/1000 [04:18<02:14,  2.53it/s]
# PTI :step: 659, epoch: 329:  66%|██████▌   | 660/1000 [04:18<02:14,  2.53it/s]
# PTI :step: 659, epoch: 329:  66%|██████▌   | 661/1000 [04:18<02:11,  2.57it/s]
# PTI :step: 660, epoch: 330:  66%|██████▌   | 661/1000 [04:18<02:11,  2.57it/s]
# PTI :step: 660, epoch: 330:  66%|██████▌   | 662/1000 [04:19<02:12,  2.56it/s]
# PTI :step: 661, epoch: 330:  66%|██████▌   | 662/1000 [04:19<02:12,  2.56it/s]
# PTI :step: 661, epoch: 330:  66%|██████▋   | 663/1000 [04:19<02:11,  2.57it/s]
# PTI :step: 662, epoch: 331:  66%|██████▋   | 663/1000 [04:19<02:11,  2.57it/s]
# PTI :step: 662, epoch: 331:  66%|██████▋   | 664/1000 [04:20<02:11,  2.56it/s]
# PTI :step: 663, epoch: 331:  66%|██████▋   | 664/1000 [04:20<02:11,  2.56it/s]
# PTI :step: 663, epoch: 331:  66%|██████▋   | 665/1000 [04:20<02:10,  2.57it/s]
# PTI :step: 664, epoch: 332:  66%|██████▋   | 665/1000 [04:20<02:10,  2.57it/s]
# PTI :step: 664, epoch: 332:  67%|██████▋   | 666/1000 [04:20<02:10,  2.56it/s]
# PTI :step: 665, epoch: 332:  67%|██████▋   | 666/1000 [04:20<02:10,  2.56it/s]
# PTI :step: 665, epoch: 332:  67%|██████▋   | 667/1000 [04:21<02:08,  2.60it/s]
# PTI :step: 666, epoch: 333:  67%|██████▋   | 667/1000 [04:21<02:08,  2.60it/s]
# PTI :step: 666, epoch: 333:  67%|██████▋   | 668/1000 [04:21<02:08,  2.58it/s]
# PTI :step: 667, epoch: 333:  67%|██████▋   | 668/1000 [04:21<02:08,  2.58it/s]
# PTI :step: 667, epoch: 333:  67%|██████▋   | 669/1000 [04:21<02:06,  2.62it/s]
# PTI :step: 668, epoch: 334:  67%|██████▋   | 669/1000 [04:21<02:06,  2.62it/s]
# PTI :step: 668, epoch: 334:  67%|██████▋   | 670/1000 [04:22<02:06,  2.60it/s]
# PTI :step: 669, epoch: 334:  67%|██████▋   | 670/1000 [04:22<02:06,  2.60it/s]
# PTI :step: 669, epoch: 334:  67%|██████▋   | 671/1000 [04:22<02:05,  2.62it/s]
# PTI :step: 670, epoch: 335:  67%|██████▋   | 671/1000 [04:22<02:05,  2.62it/s]
# PTI :step: 670, epoch: 335:  67%|██████▋   | 672/1000 [04:23<02:06,  2.60it/s]
# PTI :step: 671, epoch: 335:  67%|██████▋   | 672/1000 [04:23<02:06,  2.60it/s]
# PTI :step: 671, epoch: 335:  67%|██████▋   | 673/1000 [04:23<02:05,  2.60it/s]
# PTI :step: 672, epoch: 336:  67%|██████▋   | 673/1000 [04:23<02:05,  2.60it/s]
# PTI :step: 672, epoch: 336:  67%|██████▋   | 674/1000 [04:23<02:05,  2.59it/s]
# PTI :step: 673, epoch: 336:  67%|██████▋   | 674/1000 [04:23<02:05,  2.59it/s]
# PTI :step: 673, epoch: 336:  68%|██████▊   | 675/1000 [04:24<02:04,  2.62it/s]
# PTI :step: 674, epoch: 337:  68%|██████▊   | 675/1000 [04:24<02:04,  2.62it/s]
# PTI :step: 674, epoch: 337:  68%|██████▊   | 676/1000 [04:24<02:04,  2.59it/s]
# PTI :step: 675, epoch: 337:  68%|██████▊   | 676/1000 [04:24<02:04,  2.59it/s]
# PTI :step: 675, epoch: 337:  68%|██████▊   | 677/1000 [04:25<02:03,  2.62it/s]
# PTI :step: 676, epoch: 338:  68%|██████▊   | 677/1000 [04:25<02:03,  2.62it/s]
# PTI :step: 676, epoch: 338:  68%|██████▊   | 678/1000 [04:25<02:04,  2.60it/s]
# PTI :step: 677, epoch: 338:  68%|██████▊   | 678/1000 [04:25<02:04,  2.60it/s]
# PTI :step: 677, epoch: 338:  68%|██████▊   | 679/1000 [04:25<02:05,  2.55it/s]
# PTI :step: 678, epoch: 339:  68%|██████▊   | 679/1000 [04:25<02:05,  2.55it/s]
# PTI :step: 678, epoch: 339:  68%|██████▊   | 680/1000 [04:26<02:05,  2.54it/s]
# PTI :step: 679, epoch: 339:  68%|██████▊   | 680/1000 [04:26<02:05,  2.54it/s]
# PTI :step: 679, epoch: 339:  68%|██████▊   | 681/1000 [04:26<02:04,  2.57it/s]
# PTI :step: 680, epoch: 340:  68%|██████▊   | 681/1000 [04:26<02:04,  2.57it/s]
# PTI :step: 680, epoch: 340:  68%|██████▊   | 682/1000 [04:26<02:04,  2.56it/s]
# PTI :step: 681, epoch: 340:  68%|██████▊   | 682/1000 [04:26<02:04,  2.56it/s]
# PTI :step: 681, epoch: 340:  68%|██████▊   | 683/1000 [04:27<02:15,  2.35it/s]
# PTI :step: 682, epoch: 341:  68%|██████▊   | 683/1000 [04:27<02:15,  2.35it/s]
# PTI :step: 682, epoch: 341:  68%|██████▊   | 684/1000 [04:27<02:11,  2.40it/s]
# PTI :step: 683, epoch: 341:  68%|██████▊   | 684/1000 [04:27<02:11,  2.40it/s]
# PTI :step: 683, epoch: 341:  68%|██████▊   | 685/1000 [04:28<02:07,  2.46it/s]
# PTI :step: 684, epoch: 342:  68%|██████▊   | 685/1000 [04:28<02:07,  2.46it/s]
# PTI :step: 684, epoch: 342:  69%|██████▊   | 686/1000 [04:28<02:06,  2.49it/s]
# PTI :step: 685, epoch: 342:  69%|██████▊   | 686/1000 [04:28<02:06,  2.49it/s]
# PTI :step: 685, epoch: 342:  69%|██████▊   | 687/1000 [04:29<02:02,  2.55it/s]
# PTI :step: 686, epoch: 343:  69%|██████▊   | 687/1000 [04:29<02:02,  2.55it/s]
# PTI :step: 686, epoch: 343:  69%|██████▉   | 688/1000 [04:29<02:03,  2.53it/s]
# PTI :step: 687, epoch: 343:  69%|██████▉   | 688/1000 [04:29<02:03,  2.53it/s]
# PTI :step: 687, epoch: 343:  69%|██████▉   | 689/1000 [04:29<02:00,  2.57it/s]
# PTI :step: 688, epoch: 344:  69%|██████▉   | 689/1000 [04:29<02:00,  2.57it/s]
# PTI :step: 688, epoch: 344:  69%|██████▉   | 690/1000 [04:30<02:00,  2.56it/s]
# PTI :step: 689, epoch: 344:  69%|██████▉   | 690/1000 [04:30<02:00,  2.56it/s]
# PTI :step: 689, epoch: 344:  69%|██████▉   | 691/1000 [04:30<01:59,  2.59it/s]
# PTI :step: 690, epoch: 345:  69%|██████▉   | 691/1000 [04:30<01:59,  2.59it/s]
# PTI :step: 690, epoch: 345:  69%|██████▉   | 692/1000 [04:30<01:59,  2.58it/s]
# PTI :step: 691, epoch: 345:  69%|██████▉   | 692/1000 [04:30<01:59,  2.58it/s]
# PTI :step: 691, epoch: 345:  69%|██████▉   | 693/1000 [04:31<01:57,  2.61it/s]
# PTI :step: 692, epoch: 346:  69%|██████▉   | 693/1000 [04:31<01:57,  2.61it/s]
# PTI :step: 692, epoch: 346:  69%|██████▉   | 694/1000 [04:31<01:59,  2.56it/s]
# PTI :step: 693, epoch: 346:  69%|██████▉   | 694/1000 [04:31<01:59,  2.56it/s]
# PTI :step: 693, epoch: 346:  70%|██████▉   | 695/1000 [04:32<01:57,  2.59it/s]
# PTI :step: 694, epoch: 347:  70%|██████▉   | 695/1000 [04:32<01:57,  2.59it/s]
# PTI :step: 694, epoch: 347:  70%|██████▉   | 696/1000 [04:32<01:58,  2.57it/s]
# PTI :step: 695, epoch: 347:  70%|██████▉   | 696/1000 [04:32<01:58,  2.57it/s]
# PTI :step: 695, epoch: 347:  70%|██████▉   | 697/1000 [04:32<01:56,  2.60it/s]
# PTI :step: 696, epoch: 348:  70%|██████▉   | 697/1000 [04:32<01:56,  2.60it/s]
# PTI :step: 696, epoch: 348:  70%|██████▉   | 698/1000 [04:33<01:56,  2.59it/s]
# PTI :step: 697, epoch: 348:  70%|██████▉   | 698/1000 [04:33<01:56,  2.59it/s]
# PTI :step: 697, epoch: 348:  70%|██████▉   | 699/1000 [04:33<01:56,  2.59it/s]
# PTI :step: 698, epoch: 349:  70%|██████▉   | 699/1000 [04:33<01:56,  2.59it/s]
# PTI :step: 698, epoch: 349:  70%|███████   | 700/1000 [04:34<01:56,  2.58it/s]
# PTI :step: 699, epoch: 349:  70%|███████   | 700/1000 [04:34<01:56,  2.58it/s]
# PTI :step: 699, epoch: 349:  70%|███████   | 701/1000 [04:34<01:54,  2.60it/s]
# PTI :step: 700, epoch: 350:  70%|███████   | 701/1000 [04:34<01:54,  2.60it/s]
# PTI :step: 700, epoch: 350:  70%|███████   | 702/1000 [04:34<01:55,  2.59it/s]
# PTI :step: 701, epoch: 350:  70%|███████   | 702/1000 [04:34<01:55,  2.59it/s]
# PTI :step: 701, epoch: 350:  70%|███████   | 703/1000 [04:35<01:53,  2.62it/s]
# PTI :step: 702, epoch: 351:  70%|███████   | 703/1000 [04:35<01:53,  2.62it/s]
# PTI :step: 702, epoch: 351:  70%|███████   | 704/1000 [04:35<01:54,  2.58it/s]
# PTI :step: 703, epoch: 351:  70%|███████   | 704/1000 [04:35<01:54,  2.58it/s]
# PTI :step: 703, epoch: 351:  70%|███████   | 705/1000 [04:35<01:53,  2.60it/s]
# PTI :step: 704, epoch: 352:  70%|███████   | 705/1000 [04:35<01:53,  2.60it/s]
# PTI :step: 704, epoch: 352:  71%|███████   | 706/1000 [04:36<01:54,  2.57it/s]
# PTI :step: 705, epoch: 352:  71%|███████   | 706/1000 [04:36<01:54,  2.57it/s]
# PTI :step: 705, epoch: 352:  71%|███████   | 707/1000 [04:36<01:53,  2.58it/s]
# PTI :step: 706, epoch: 353:  71%|███████   | 707/1000 [04:36<01:53,  2.58it/s]
# PTI :step: 706, epoch: 353:  71%|███████   | 708/1000 [04:37<01:53,  2.57it/s]
# PTI :step: 707, epoch: 353:  71%|███████   | 708/1000 [04:37<01:53,  2.57it/s]
# PTI :step: 707, epoch: 353:  71%|███████   | 709/1000 [04:37<01:52,  2.59it/s]
# PTI :step: 708, epoch: 354:  71%|███████   | 709/1000 [04:37<01:52,  2.59it/s]
# PTI :step: 708, epoch: 354:  71%|███████   | 710/1000 [04:37<01:52,  2.58it/s]
# PTI :step: 709, epoch: 354:  71%|███████   | 710/1000 [04:37<01:52,  2.58it/s]
# PTI :step: 709, epoch: 354:  71%|███████   | 711/1000 [04:38<01:51,  2.60it/s]
# PTI :step: 710, epoch: 355:  71%|███████   | 711/1000 [04:38<01:51,  2.60it/s]
# PTI :step: 710, epoch: 355:  71%|███████   | 712/1000 [04:38<01:51,  2.58it/s]
# PTI :step: 711, epoch: 355:  71%|███████   | 712/1000 [04:38<01:51,  2.58it/s]
# PTI :step: 711, epoch: 355:  71%|███████▏  | 713/1000 [04:39<01:50,  2.60it/s]
# PTI :step: 712, epoch: 356:  71%|███████▏  | 713/1000 [04:39<01:50,  2.60it/s]
# PTI :step: 712, epoch: 356:  71%|███████▏  | 714/1000 [04:39<01:50,  2.58it/s]
# PTI :step: 713, epoch: 356:  71%|███████▏  | 714/1000 [04:39<01:50,  2.58it/s]
# PTI :step: 713, epoch: 356:  72%|███████▏  | 715/1000 [04:39<01:49,  2.60it/s]
# PTI :step: 714, epoch: 357:  72%|███████▏  | 715/1000 [04:39<01:49,  2.60it/s]
# PTI :step: 714, epoch: 357:  72%|███████▏  | 716/1000 [04:40<01:49,  2.59it/s]
# PTI :step: 715, epoch: 357:  72%|███████▏  | 716/1000 [04:40<01:49,  2.59it/s]
# PTI :step: 715, epoch: 357:  72%|███████▏  | 717/1000 [04:40<01:49,  2.59it/s]
# PTI :step: 716, epoch: 358:  72%|███████▏  | 717/1000 [04:40<01:49,  2.59it/s]
# PTI :step: 716, epoch: 358:  72%|███████▏  | 718/1000 [04:41<01:49,  2.58it/s]
# PTI :step: 717, epoch: 358:  72%|███████▏  | 718/1000 [04:41<01:49,  2.58it/s]
# PTI :step: 717, epoch: 358:  72%|███████▏  | 719/1000 [04:41<01:48,  2.58it/s]
# PTI :step: 718, epoch: 359:  72%|███████▏  | 719/1000 [04:41<01:48,  2.58it/s]
# PTI :step: 718, epoch: 359:  72%|███████▏  | 720/1000 [04:41<01:49,  2.56it/s]
# PTI :step: 719, epoch: 359:  72%|███████▏  | 720/1000 [04:41<01:49,  2.56it/s]
# PTI :step: 719, epoch: 359:  72%|███████▏  | 721/1000 [04:42<01:47,  2.59it/s]
# PTI :step: 720, epoch: 360:  72%|███████▏  | 721/1000 [04:42<01:47,  2.59it/s]
# PTI :step: 720, epoch: 360:  72%|███████▏  | 722/1000 [04:42<01:47,  2.58it/s]
# PTI :step: 721, epoch: 360:  72%|███████▏  | 722/1000 [04:42<01:47,  2.58it/s]
# PTI :step: 721, epoch: 360:  72%|███████▏  | 723/1000 [04:42<01:46,  2.60it/s]
# PTI :step: 722, epoch: 361:  72%|███████▏  | 723/1000 [04:42<01:46,  2.60it/s]
# PTI :step: 722, epoch: 361:  72%|███████▏  | 724/1000 [04:43<01:46,  2.58it/s]
# PTI :step: 723, epoch: 361:  72%|███████▏  | 724/1000 [04:43<01:46,  2.58it/s]
# PTI :step: 723, epoch: 361:  72%|███████▎  | 725/1000 [04:43<01:45,  2.61it/s]
# PTI :step: 724, epoch: 362:  72%|███████▎  | 725/1000 [04:43<01:45,  2.61it/s]
# PTI :step: 724, epoch: 362:  73%|███████▎  | 726/1000 [04:44<01:45,  2.59it/s]
# PTI :step: 725, epoch: 362:  73%|███████▎  | 726/1000 [04:44<01:45,  2.59it/s]
# PTI :step: 725, epoch: 362:  73%|███████▎  | 727/1000 [04:44<01:44,  2.60it/s]
# PTI :step: 726, epoch: 363:  73%|███████▎  | 727/1000 [04:44<01:44,  2.60it/s]
# PTI :step: 726, epoch: 363:  73%|███████▎  | 728/1000 [04:44<01:45,  2.58it/s]
# PTI :step: 727, epoch: 363:  73%|███████▎  | 728/1000 [04:44<01:45,  2.58it/s]
# PTI :step: 727, epoch: 363:  73%|███████▎  | 729/1000 [04:45<01:44,  2.61it/s]
# PTI :step: 728, epoch: 364:  73%|███████▎  | 729/1000 [04:45<01:44,  2.61it/s]
# PTI :step: 728, epoch: 364:  73%|███████▎  | 730/1000 [04:45<01:44,  2.58it/s]
# PTI :step: 729, epoch: 364:  73%|███████▎  | 730/1000 [04:45<01:44,  2.58it/s]
# PTI :step: 729, epoch: 364:  73%|███████▎  | 731/1000 [04:46<01:43,  2.61it/s]
# PTI :step: 730, epoch: 365:  73%|███████▎  | 731/1000 [04:46<01:43,  2.61it/s]
# PTI :step: 730, epoch: 365:  73%|███████▎  | 732/1000 [04:46<01:43,  2.59it/s]
# PTI :step: 731, epoch: 365:  73%|███████▎  | 732/1000 [04:46<01:43,  2.59it/s]
# PTI :step: 731, epoch: 365:  73%|███████▎  | 733/1000 [04:46<01:42,  2.62it/s]
# PTI :step: 732, epoch: 366:  73%|███████▎  | 733/1000 [04:46<01:42,  2.62it/s]
# PTI :step: 732, epoch: 366:  73%|███████▎  | 734/1000 [04:47<01:42,  2.60it/s]
# PTI :step: 733, epoch: 366:  73%|███████▎  | 734/1000 [04:47<01:42,  2.60it/s]
# PTI :step: 733, epoch: 366:  74%|███████▎  | 735/1000 [04:47<01:41,  2.60it/s]
# PTI :step: 734, epoch: 367:  74%|███████▎  | 735/1000 [04:47<01:41,  2.60it/s]
# PTI :step: 734, epoch: 367:  74%|███████▎  | 736/1000 [04:47<01:42,  2.59it/s]
# PTI :step: 735, epoch: 367:  74%|███████▎  | 736/1000 [04:47<01:42,  2.59it/s]
# PTI :step: 735, epoch: 367:  74%|███████▎  | 737/1000 [04:48<01:40,  2.61it/s]
# PTI :step: 736, epoch: 368:  74%|███████▎  | 737/1000 [04:48<01:40,  2.61it/s]
# PTI :step: 736, epoch: 368:  74%|███████▍  | 738/1000 [04:48<01:42,  2.57it/s]
# PTI :step: 737, epoch: 368:  74%|███████▍  | 738/1000 [04:48<01:42,  2.57it/s]
# PTI :step: 737, epoch: 368:  74%|███████▍  | 739/1000 [04:49<01:41,  2.57it/s]
# PTI :step: 738, epoch: 369:  74%|███████▍  | 739/1000 [04:49<01:41,  2.57it/s]
# PTI :step: 738, epoch: 369:  74%|███████▍  | 740/1000 [04:49<01:41,  2.56it/s]
# PTI :step: 739, epoch: 369:  74%|███████▍  | 740/1000 [04:49<01:41,  2.56it/s]
# PTI :step: 739, epoch: 369:  74%|███████▍  | 741/1000 [04:49<01:39,  2.59it/s]
# PTI :step: 740, epoch: 370:  74%|███████▍  | 741/1000 [04:49<01:39,  2.59it/s]
# PTI :step: 740, epoch: 370:  74%|███████▍  | 742/1000 [04:50<01:40,  2.57it/s]
# PTI :step: 741, epoch: 370:  74%|███████▍  | 742/1000 [04:50<01:40,  2.57it/s]
# PTI :step: 741, epoch: 370:  74%|███████▍  | 743/1000 [04:50<01:39,  2.58it/s]
# PTI :step: 742, epoch: 371:  74%|███████▍  | 743/1000 [04:50<01:39,  2.58it/s]
# PTI :step: 742, epoch: 371:  74%|███████▍  | 744/1000 [04:51<01:39,  2.57it/s]
# PTI :step: 743, epoch: 371:  74%|███████▍  | 744/1000 [04:51<01:39,  2.57it/s]
# PTI :step: 743, epoch: 371:  74%|███████▍  | 745/1000 [04:51<01:38,  2.60it/s]
# PTI :step: 744, epoch: 372:  74%|███████▍  | 745/1000 [04:51<01:38,  2.60it/s]
# PTI :step: 744, epoch: 372:  75%|███████▍  | 746/1000 [04:51<01:38,  2.58it/s]
# PTI :step: 745, epoch: 372:  75%|███████▍  | 746/1000 [04:51<01:38,  2.58it/s]
# PTI :step: 745, epoch: 372:  75%|███████▍  | 747/1000 [04:52<01:37,  2.59it/s]
# PTI :step: 746, epoch: 373:  75%|███████▍  | 747/1000 [04:52<01:37,  2.59it/s]
# PTI :step: 746, epoch: 373:  75%|███████▍  | 748/1000 [04:52<01:38,  2.56it/s]
# PTI :step: 747, epoch: 373:  75%|███████▍  | 748/1000 [04:52<01:38,  2.56it/s]
# PTI :step: 747, epoch: 373:  75%|███████▍  | 749/1000 [04:53<01:36,  2.59it/s]
# PTI :step: 748, epoch: 374:  75%|███████▍  | 749/1000 [04:53<01:36,  2.59it/s]
# PTI :step: 748, epoch: 374:  75%|███████▌  | 750/1000 [04:53<01:37,  2.57it/s]
# PTI :step: 749, epoch: 374:  75%|███████▌  | 750/1000 [04:53<01:37,  2.57it/s]
# PTI :step: 749, epoch: 374:  75%|███████▌  | 751/1000 [04:53<01:35,  2.61it/s]
# PTI :step: 750, epoch: 375:  75%|███████▌  | 751/1000 [04:53<01:35,  2.61it/s]
# PTI :step: 750, epoch: 375:  75%|███████▌  | 752/1000 [04:54<01:35,  2.59it/s]
# PTI :step: 751, epoch: 375:  75%|███████▌  | 752/1000 [04:54<01:35,  2.59it/s]
# PTI :step: 751, epoch: 375:  75%|███████▌  | 753/1000 [04:54<01:34,  2.61it/s]
# PTI :step: 752, epoch: 376:  75%|███████▌  | 753/1000 [04:54<01:34,  2.61it/s]
# PTI :step: 752, epoch: 376:  75%|███████▌  | 754/1000 [04:54<01:34,  2.59it/s]
# PTI :step: 753, epoch: 376:  75%|███████▌  | 754/1000 [04:54<01:34,  2.59it/s]
# PTI :step: 753, epoch: 376:  76%|███████▌  | 755/1000 [04:55<01:41,  2.41it/s]
# PTI :step: 754, epoch: 377:  76%|███████▌  | 755/1000 [04:55<01:41,  2.41it/s]
# PTI :step: 754, epoch: 377:  76%|███████▌  | 756/1000 [04:55<01:40,  2.44it/s]
# PTI :step: 755, epoch: 377:  76%|███████▌  | 756/1000 [04:55<01:40,  2.44it/s]
# PTI :step: 755, epoch: 377:  76%|███████▌  | 757/1000 [04:56<01:36,  2.51it/s]
# PTI :step: 756, epoch: 378:  76%|███████▌  | 757/1000 [04:56<01:36,  2.51it/s]
# PTI :step: 756, epoch: 378:  76%|███████▌  | 758/1000 [04:56<01:36,  2.52it/s]
# PTI :step: 757, epoch: 378:  76%|███████▌  | 758/1000 [04:56<01:36,  2.52it/s]
# PTI :step: 757, epoch: 378:  76%|███████▌  | 759/1000 [04:56<01:33,  2.57it/s]
# PTI :step: 758, epoch: 379:  76%|███████▌  | 759/1000 [04:56<01:33,  2.57it/s]
# PTI :step: 758, epoch: 379:  76%|███████▌  | 760/1000 [04:57<01:33,  2.56it/s]
# PTI :step: 759, epoch: 379:  76%|███████▌  | 760/1000 [04:57<01:33,  2.56it/s]
# PTI :step: 759, epoch: 379:  76%|███████▌  | 761/1000 [04:57<01:33,  2.56it/s]
# PTI :step: 760, epoch: 380:  76%|███████▌  | 761/1000 [04:57<01:33,  2.56it/s]
# PTI :step: 760, epoch: 380:  76%|███████▌  | 762/1000 [04:58<01:33,  2.56it/s]
# PTI :step: 761, epoch: 380:  76%|███████▌  | 762/1000 [04:58<01:33,  2.56it/s]
# PTI :step: 761, epoch: 380:  76%|███████▋  | 763/1000 [04:58<01:31,  2.59it/s]
# PTI :step: 762, epoch: 381:  76%|███████▋  | 763/1000 [04:58<01:31,  2.59it/s]
# PTI :step: 762, epoch: 381:  76%|███████▋  | 764/1000 [04:58<01:31,  2.58it/s]
# PTI :step: 763, epoch: 381:  76%|███████▋  | 764/1000 [04:58<01:31,  2.58it/s]
# PTI :step: 763, epoch: 381:  76%|███████▋  | 765/1000 [04:59<01:29,  2.61it/s]
# PTI :step: 764, epoch: 382:  76%|███████▋  | 765/1000 [04:59<01:29,  2.61it/s]
# PTI :step: 764, epoch: 382:  77%|███████▋  | 766/1000 [04:59<01:31,  2.57it/s]
# PTI :step: 765, epoch: 382:  77%|███████▋  | 766/1000 [04:59<01:31,  2.57it/s]
# PTI :step: 765, epoch: 382:  77%|███████▋  | 767/1000 [05:00<01:29,  2.60it/s]
# PTI :step: 766, epoch: 383:  77%|███████▋  | 767/1000 [05:00<01:29,  2.60it/s]
# PTI :step: 766, epoch: 383:  77%|███████▋  | 768/1000 [05:00<01:29,  2.58it/s]
# PTI :step: 767, epoch: 383:  77%|███████▋  | 768/1000 [05:00<01:29,  2.58it/s]
# PTI :step: 767, epoch: 383:  77%|███████▋  | 769/1000 [05:00<01:28,  2.60it/s]
# PTI :step: 768, epoch: 384:  77%|███████▋  | 769/1000 [05:00<01:28,  2.60it/s]
# PTI :step: 768, epoch: 384:  77%|███████▋  | 770/1000 [05:01<01:29,  2.57it/s]
# PTI :step: 769, epoch: 384:  77%|███████▋  | 770/1000 [05:01<01:29,  2.57it/s]
# PTI :step: 769, epoch: 384:  77%|███████▋  | 771/1000 [05:01<01:29,  2.57it/s]
# PTI :step: 770, epoch: 385:  77%|███████▋  | 771/1000 [05:01<01:29,  2.57it/s]
# PTI :step: 770, epoch: 385:  77%|███████▋  | 772/1000 [05:01<01:28,  2.57it/s]
# PTI :step: 771, epoch: 385:  77%|███████▋  | 772/1000 [05:01<01:28,  2.57it/s]
# PTI :step: 771, epoch: 385:  77%|███████▋  | 773/1000 [05:02<01:27,  2.60it/s]
# PTI :step: 772, epoch: 386:  77%|███████▋  | 773/1000 [05:02<01:27,  2.60it/s]
# PTI :step: 772, epoch: 386:  77%|███████▋  | 774/1000 [05:02<01:28,  2.56it/s]
# PTI :step: 773, epoch: 386:  77%|███████▋  | 774/1000 [05:02<01:28,  2.56it/s]
# PTI :step: 773, epoch: 386:  78%|███████▊  | 775/1000 [05:03<01:27,  2.58it/s]
# PTI :step: 774, epoch: 387:  78%|███████▊  | 775/1000 [05:03<01:27,  2.58it/s]
# PTI :step: 774, epoch: 387:  78%|███████▊  | 776/1000 [05:03<01:27,  2.57it/s]
# PTI :step: 775, epoch: 387:  78%|███████▊  | 776/1000 [05:03<01:27,  2.57it/s]
# PTI :step: 775, epoch: 387:  78%|███████▊  | 777/1000 [05:03<01:25,  2.60it/s]
# PTI :step: 776, epoch: 388:  78%|███████▊  | 777/1000 [05:03<01:25,  2.60it/s]
# PTI :step: 776, epoch: 388:  78%|███████▊  | 778/1000 [05:04<01:26,  2.58it/s]
# PTI :step: 777, epoch: 388:  78%|███████▊  | 778/1000 [05:04<01:26,  2.58it/s]
# PTI :step: 777, epoch: 388:  78%|███████▊  | 779/1000 [05:04<01:25,  2.58it/s]
# PTI :step: 778, epoch: 389:  78%|███████▊  | 779/1000 [05:04<01:25,  2.58it/s]
# PTI :step: 778, epoch: 389:  78%|███████▊  | 780/1000 [05:05<01:25,  2.57it/s]
# PTI :step: 779, epoch: 389:  78%|███████▊  | 780/1000 [05:05<01:25,  2.57it/s]
# PTI :step: 779, epoch: 389:  78%|███████▊  | 781/1000 [05:05<01:24,  2.60it/s]
# PTI :step: 780, epoch: 390:  78%|███████▊  | 781/1000 [05:05<01:24,  2.60it/s]
# PTI :step: 780, epoch: 390:  78%|███████▊  | 782/1000 [05:05<01:24,  2.58it/s]
# PTI :step: 781, epoch: 390:  78%|███████▊  | 782/1000 [05:05<01:24,  2.58it/s]
# PTI :step: 781, epoch: 390:  78%|███████▊  | 783/1000 [05:06<01:22,  2.61it/s]
# PTI :step: 782, epoch: 391:  78%|███████▊  | 783/1000 [05:06<01:22,  2.61it/s]
# PTI :step: 782, epoch: 391:  78%|███████▊  | 784/1000 [05:06<01:23,  2.59it/s]
# PTI :step: 783, epoch: 391:  78%|███████▊  | 784/1000 [05:06<01:23,  2.59it/s]
# PTI :step: 783, epoch: 391:  78%|███████▊  | 785/1000 [05:07<01:22,  2.61it/s]
# PTI :step: 784, epoch: 392:  78%|███████▊  | 785/1000 [05:07<01:22,  2.61it/s]
# PTI :step: 784, epoch: 392:  79%|███████▊  | 786/1000 [05:07<01:23,  2.57it/s]
# PTI :step: 785, epoch: 392:  79%|███████▊  | 786/1000 [05:07<01:23,  2.57it/s]
# PTI :step: 785, epoch: 392:  79%|███████▊  | 787/1000 [05:07<01:22,  2.57it/s]
# PTI :step: 786, epoch: 393:  79%|███████▊  | 787/1000 [05:07<01:22,  2.57it/s]
# PTI :step: 786, epoch: 393:  79%|███████▉  | 788/1000 [05:08<01:23,  2.55it/s]
# PTI :step: 787, epoch: 393:  79%|███████▉  | 788/1000 [05:08<01:23,  2.55it/s]
# PTI :step: 787, epoch: 393:  79%|███████▉  | 789/1000 [05:08<01:22,  2.56it/s]
# PTI :step: 788, epoch: 394:  79%|███████▉  | 789/1000 [05:08<01:22,  2.56it/s]
# PTI :step: 788, epoch: 394:  79%|███████▉  | 790/1000 [05:08<01:22,  2.56it/s]
# PTI :step: 789, epoch: 394:  79%|███████▉  | 790/1000 [05:08<01:22,  2.56it/s]
# PTI :step: 789, epoch: 394:  79%|███████▉  | 791/1000 [05:09<01:20,  2.59it/s]
# PTI :step: 790, epoch: 395:  79%|███████▉  | 791/1000 [05:09<01:20,  2.59it/s]
# PTI :step: 790, epoch: 395:  79%|███████▉  | 792/1000 [05:09<01:20,  2.57it/s]
# PTI :step: 791, epoch: 395:  79%|███████▉  | 792/1000 [05:09<01:20,  2.57it/s]
# PTI :step: 791, epoch: 395:  79%|███████▉  | 793/1000 [05:10<01:19,  2.61it/s]
# PTI :step: 792, epoch: 396:  79%|███████▉  | 793/1000 [05:10<01:19,  2.61it/s]
# PTI :step: 792, epoch: 396:  79%|███████▉  | 794/1000 [05:10<01:19,  2.59it/s]
# PTI :step: 793, epoch: 396:  79%|███████▉  | 794/1000 [05:10<01:19,  2.59it/s]
# PTI :step: 793, epoch: 396:  80%|███████▉  | 795/1000 [05:10<01:18,  2.61it/s]
# PTI :step: 794, epoch: 397:  80%|███████▉  | 795/1000 [05:10<01:18,  2.61it/s]
# PTI :step: 794, epoch: 397:  80%|███████▉  | 796/1000 [05:11<01:18,  2.59it/s]
# PTI :step: 795, epoch: 397:  80%|███████▉  | 796/1000 [05:11<01:18,  2.59it/s]
# PTI :step: 795, epoch: 397:  80%|███████▉  | 797/1000 [05:11<01:18,  2.59it/s]
# PTI :step: 796, epoch: 398:  80%|███████▉  | 797/1000 [05:11<01:18,  2.59it/s]
# PTI :step: 796, epoch: 398:  80%|███████▉  | 798/1000 [05:12<01:18,  2.58it/s]
# PTI :step: 797, epoch: 398:  80%|███████▉  | 798/1000 [05:12<01:18,  2.58it/s]
# PTI :step: 797, epoch: 398:  80%|███████▉  | 799/1000 [05:12<01:17,  2.60it/s]
# PTI :step: 798, epoch: 399:  80%|███████▉  | 799/1000 [05:12<01:17,  2.60it/s]
# PTI :step: 798, epoch: 399:  80%|████████  | 800/1000 [05:12<01:17,  2.58it/s]
# PTI :step: 799, epoch: 399:  80%|████████  | 800/1000 [05:12<01:17,  2.58it/s]
# PTI :step: 799, epoch: 399:  80%|████████  | 801/1000 [05:13<01:16,  2.61it/s]
# PTI :step: 800, epoch: 400:  80%|████████  | 801/1000 [05:13<01:16,  2.61it/s]
# PTI :step: 800, epoch: 400:  80%|████████  | 802/1000 [05:13<01:16,  2.59it/s]
# PTI :step: 801, epoch: 400:  80%|████████  | 802/1000 [05:13<01:16,  2.59it/s]
# PTI :step: 801, epoch: 400:  80%|████████  | 803/1000 [05:13<01:15,  2.62it/s]
# PTI :step: 802, epoch: 401:  80%|████████  | 803/1000 [05:13<01:15,  2.62it/s]
# PTI :step: 802, epoch: 401:  80%|████████  | 804/1000 [05:14<01:15,  2.60it/s]
# PTI :step: 803, epoch: 401:  80%|████████  | 804/1000 [05:14<01:15,  2.60it/s]
# PTI :step: 803, epoch: 401:  80%|████████  | 805/1000 [05:14<01:14,  2.62it/s]
# PTI :step: 804, epoch: 402:  80%|████████  | 805/1000 [05:14<01:14,  2.62it/s]
# PTI :step: 804, epoch: 402:  81%|████████  | 806/1000 [05:15<01:14,  2.60it/s]
# PTI :step: 805, epoch: 402:  81%|████████  | 806/1000 [05:15<01:14,  2.60it/s]
# PTI :step: 805, epoch: 402:  81%|████████  | 807/1000 [05:15<01:13,  2.62it/s]
# PTI :step: 806, epoch: 403:  81%|████████  | 807/1000 [05:15<01:13,  2.62it/s]
# PTI :step: 806, epoch: 403:  81%|████████  | 808/1000 [05:15<01:14,  2.59it/s]
# PTI :step: 807, epoch: 403:  81%|████████  | 808/1000 [05:15<01:14,  2.59it/s]
# PTI :step: 807, epoch: 403:  81%|████████  | 809/1000 [05:16<01:13,  2.61it/s]
# PTI :step: 808, epoch: 404:  81%|████████  | 809/1000 [05:16<01:13,  2.61it/s]
# PTI :step: 808, epoch: 404:  81%|████████  | 810/1000 [05:16<01:19,  2.39it/s]
# PTI :step: 809, epoch: 404:  81%|████████  | 810/1000 [05:16<01:19,  2.39it/s]
# PTI :step: 809, epoch: 404:  81%|████████  | 811/1000 [05:17<01:16,  2.47it/s]
# PTI :step: 810, epoch: 405:  81%|████████  | 811/1000 [05:17<01:16,  2.47it/s]
# PTI :step: 810, epoch: 405:  81%|████████  | 812/1000 [05:17<01:15,  2.49it/s]
# PTI :step: 811, epoch: 405:  81%|████████  | 812/1000 [05:17<01:15,  2.49it/s]
# PTI :step: 811, epoch: 405:  81%|████████▏ | 813/1000 [05:17<01:13,  2.54it/s]
# PTI :step: 812, epoch: 406:  81%|████████▏ | 813/1000 [05:17<01:13,  2.54it/s]
# PTI :step: 812, epoch: 406:  81%|████████▏ | 814/1000 [05:18<01:13,  2.54it/s]
# PTI :step: 813, epoch: 406:  81%|████████▏ | 814/1000 [05:18<01:13,  2.54it/s]
# PTI :step: 813, epoch: 406:  82%|████████▏ | 815/1000 [05:18<01:12,  2.55it/s]
# PTI :step: 814, epoch: 407:  82%|████████▏ | 815/1000 [05:18<01:12,  2.55it/s]
# PTI :step: 814, epoch: 407:  82%|████████▏ | 816/1000 [05:19<01:12,  2.52it/s]
# PTI :step: 815, epoch: 407:  82%|████████▏ | 816/1000 [05:19<01:12,  2.52it/s]
# PTI :step: 815, epoch: 407:  82%|████████▏ | 817/1000 [05:19<01:11,  2.56it/s]
# PTI :step: 816, epoch: 408:  82%|████████▏ | 817/1000 [05:19<01:11,  2.56it/s]
# PTI :step: 816, epoch: 408:  82%|████████▏ | 818/1000 [05:19<01:11,  2.56it/s]
# PTI :step: 817, epoch: 408:  82%|████████▏ | 818/1000 [05:19<01:11,  2.56it/s]
# PTI :step: 817, epoch: 408:  82%|████████▏ | 819/1000 [05:20<01:09,  2.59it/s]
# PTI :step: 818, epoch: 409:  82%|████████▏ | 819/1000 [05:20<01:09,  2.59it/s]
# PTI :step: 818, epoch: 409:  82%|████████▏ | 820/1000 [05:20<01:10,  2.57it/s]
# PTI :step: 819, epoch: 409:  82%|████████▏ | 820/1000 [05:20<01:10,  2.57it/s]
# PTI :step: 819, epoch: 409:  82%|████████▏ | 821/1000 [05:21<01:08,  2.60it/s]
# PTI :step: 820, epoch: 410:  82%|████████▏ | 821/1000 [05:21<01:08,  2.60it/s]
# PTI :step: 820, epoch: 410:  82%|████████▏ | 822/1000 [05:21<01:09,  2.57it/s]
# PTI :step: 821, epoch: 410:  82%|████████▏ | 822/1000 [05:21<01:09,  2.57it/s]
# PTI :step: 821, epoch: 410:  82%|████████▏ | 823/1000 [05:21<01:08,  2.60it/s]
# PTI :step: 822, epoch: 411:  82%|████████▏ | 823/1000 [05:21<01:08,  2.60it/s]
# PTI :step: 822, epoch: 411:  82%|████████▏ | 824/1000 [05:22<01:08,  2.58it/s]
# PTI :step: 823, epoch: 411:  82%|████████▏ | 824/1000 [05:22<01:08,  2.58it/s]
# PTI :step: 823, epoch: 411:  82%|████████▎ | 825/1000 [05:22<01:07,  2.61it/s]
# PTI :step: 824, epoch: 412:  82%|████████▎ | 825/1000 [05:22<01:07,  2.61it/s]
# PTI :step: 824, epoch: 412:  83%|████████▎ | 826/1000 [05:22<01:07,  2.59it/s]
# PTI :step: 825, epoch: 412:  83%|████████▎ | 826/1000 [05:22<01:07,  2.59it/s]
# PTI :step: 825, epoch: 412:  83%|████████▎ | 827/1000 [05:23<01:06,  2.62it/s]
# PTI :step: 826, epoch: 413:  83%|████████▎ | 827/1000 [05:23<01:06,  2.62it/s]
# PTI :step: 826, epoch: 413:  83%|████████▎ | 828/1000 [05:23<01:06,  2.59it/s]
# PTI :step: 827, epoch: 413:  83%|████████▎ | 828/1000 [05:23<01:06,  2.59it/s]
# PTI :step: 827, epoch: 413:  83%|████████▎ | 829/1000 [05:24<01:05,  2.62it/s]
# PTI :step: 828, epoch: 414:  83%|████████▎ | 829/1000 [05:24<01:05,  2.62it/s]
# PTI :step: 828, epoch: 414:  83%|████████▎ | 830/1000 [05:24<01:05,  2.60it/s]
# PTI :step: 829, epoch: 414:  83%|████████▎ | 830/1000 [05:24<01:05,  2.60it/s]
# PTI :step: 829, epoch: 414:  83%|████████▎ | 831/1000 [05:24<01:04,  2.62it/s]
# PTI :step: 830, epoch: 415:  83%|████████▎ | 831/1000 [05:24<01:04,  2.62it/s]
# PTI :step: 830, epoch: 415:  83%|████████▎ | 832/1000 [05:25<01:04,  2.60it/s]
# PTI :step: 831, epoch: 415:  83%|████████▎ | 832/1000 [05:25<01:04,  2.60it/s]
# PTI :step: 831, epoch: 415:  83%|████████▎ | 833/1000 [05:25<01:04,  2.60it/s]
# PTI :step: 832, epoch: 416:  83%|████████▎ | 833/1000 [05:25<01:04,  2.60it/s]
# PTI :step: 832, epoch: 416:  83%|████████▎ | 834/1000 [05:26<01:04,  2.59it/s]
# PTI :step: 833, epoch: 416:  83%|████████▎ | 834/1000 [05:26<01:04,  2.59it/s]
# PTI :step: 833, epoch: 416:  84%|████████▎ | 835/1000 [05:26<01:03,  2.61it/s]
# PTI :step: 834, epoch: 417:  84%|████████▎ | 835/1000 [05:26<01:03,  2.61it/s]
# PTI :step: 834, epoch: 417:  84%|████████▎ | 836/1000 [05:26<01:03,  2.59it/s]
# PTI :step: 835, epoch: 417:  84%|████████▎ | 836/1000 [05:26<01:03,  2.59it/s]
# PTI :step: 835, epoch: 417:  84%|████████▎ | 837/1000 [05:27<01:02,  2.62it/s]
# PTI :step: 836, epoch: 418:  84%|████████▎ | 837/1000 [05:27<01:02,  2.62it/s]
# PTI :step: 836, epoch: 418:  84%|████████▍ | 838/1000 [05:27<01:02,  2.59it/s]
# PTI :step: 837, epoch: 418:  84%|████████▍ | 838/1000 [05:27<01:02,  2.59it/s]
# PTI :step: 837, epoch: 418:  84%|████████▍ | 839/1000 [05:27<01:01,  2.62it/s]
# PTI :step: 838, epoch: 419:  84%|████████▍ | 839/1000 [05:27<01:01,  2.62it/s]
# PTI :step: 838, epoch: 419:  84%|████████▍ | 840/1000 [05:28<01:01,  2.60it/s]
# PTI :step: 839, epoch: 419:  84%|████████▍ | 840/1000 [05:28<01:01,  2.60it/s]
# PTI :step: 839, epoch: 419:  84%|████████▍ | 841/1000 [05:28<01:00,  2.61it/s]
# PTI :step: 840, epoch: 420:  84%|████████▍ | 841/1000 [05:28<01:00,  2.61it/s]
# PTI :step: 840, epoch: 420:  84%|████████▍ | 842/1000 [05:29<01:01,  2.59it/s]
# PTI :step: 841, epoch: 420:  84%|████████▍ | 842/1000 [05:29<01:01,  2.59it/s]
# PTI :step: 841, epoch: 420:  84%|████████▍ | 843/1000 [05:29<01:00,  2.60it/s]
# PTI :step: 842, epoch: 421:  84%|████████▍ | 843/1000 [05:29<01:00,  2.60it/s]
# PTI :step: 842, epoch: 421:  84%|████████▍ | 844/1000 [05:29<01:00,  2.58it/s]
# PTI :step: 843, epoch: 421:  84%|████████▍ | 844/1000 [05:29<01:00,  2.58it/s]
# PTI :step: 843, epoch: 421:  84%|████████▍ | 845/1000 [05:30<00:59,  2.60it/s]
# PTI :step: 844, epoch: 422:  84%|████████▍ | 845/1000 [05:30<00:59,  2.60it/s]
# PTI :step: 844, epoch: 422:  85%|████████▍ | 846/1000 [05:30<00:59,  2.58it/s]
# PTI :step: 845, epoch: 422:  85%|████████▍ | 846/1000 [05:30<00:59,  2.58it/s]
# PTI :step: 845, epoch: 422:  85%|████████▍ | 847/1000 [05:31<00:58,  2.61it/s]
# PTI :step: 846, epoch: 423:  85%|████████▍ | 847/1000 [05:31<00:58,  2.61it/s]
# PTI :step: 846, epoch: 423:  85%|████████▍ | 848/1000 [05:31<00:58,  2.59it/s]
# PTI :step: 847, epoch: 423:  85%|████████▍ | 848/1000 [05:31<00:58,  2.59it/s]
# PTI :step: 847, epoch: 423:  85%|████████▍ | 849/1000 [05:31<00:58,  2.58it/s]
# PTI :step: 848, epoch: 424:  85%|████████▍ | 849/1000 [05:31<00:58,  2.58it/s]
# PTI :step: 848, epoch: 424:  85%|████████▌ | 850/1000 [05:32<00:58,  2.55it/s]
# PTI :step: 849, epoch: 424:  85%|████████▌ | 850/1000 [05:32<00:58,  2.55it/s]
# PTI :step: 849, epoch: 424:  85%|████████▌ | 851/1000 [05:32<00:57,  2.58it/s]
# PTI :step: 850, epoch: 425:  85%|████████▌ | 851/1000 [05:32<00:57,  2.58it/s]
# PTI :step: 850, epoch: 425:  85%|████████▌ | 852/1000 [05:32<00:57,  2.57it/s]
# PTI :step: 851, epoch: 425:  85%|████████▌ | 852/1000 [05:32<00:57,  2.57it/s]
# PTI :step: 851, epoch: 425:  85%|████████▌ | 853/1000 [05:33<00:56,  2.60it/s]
# PTI :step: 852, epoch: 426:  85%|████████▌ | 853/1000 [05:33<00:56,  2.60it/s]
# PTI :step: 852, epoch: 426:  85%|████████▌ | 854/1000 [05:33<00:56,  2.56it/s]
# PTI :step: 853, epoch: 426:  85%|████████▌ | 854/1000 [05:33<00:56,  2.56it/s]
# PTI :step: 853, epoch: 426:  86%|████████▌ | 855/1000 [05:34<00:55,  2.59it/s]
# PTI :step: 854, epoch: 427:  86%|████████▌ | 855/1000 [05:34<00:55,  2.59it/s]
# PTI :step: 854, epoch: 427:  86%|████████▌ | 856/1000 [05:34<00:55,  2.57it/s]
# PTI :step: 855, epoch: 427:  86%|████████▌ | 856/1000 [05:34<00:55,  2.57it/s]
# PTI :step: 855, epoch: 427:  86%|████████▌ | 857/1000 [05:34<00:55,  2.60it/s]
# PTI :step: 856, epoch: 428:  86%|████████▌ | 857/1000 [05:34<00:55,  2.60it/s]
# PTI :step: 856, epoch: 428:  86%|████████▌ | 858/1000 [05:35<00:54,  2.58it/s]
# PTI :step: 857, epoch: 428:  86%|████████▌ | 858/1000 [05:35<00:54,  2.58it/s]
# PTI :step: 857, epoch: 428:  86%|████████▌ | 859/1000 [05:35<00:54,  2.57it/s]
# PTI :step: 858, epoch: 429:  86%|████████▌ | 859/1000 [05:35<00:54,  2.57it/s]
# PTI :step: 858, epoch: 429:  86%|████████▌ | 860/1000 [05:36<00:54,  2.56it/s]
# PTI :step: 859, epoch: 429:  86%|████████▌ | 860/1000 [05:36<00:54,  2.56it/s]
# PTI :step: 859, epoch: 429:  86%|████████▌ | 861/1000 [05:36<00:53,  2.59it/s]
# PTI :step: 860, epoch: 430:  86%|████████▌ | 861/1000 [05:36<00:53,  2.59it/s]
# PTI :step: 860, epoch: 430:  86%|████████▌ | 862/1000 [05:36<00:53,  2.58it/s]
# PTI :step: 861, epoch: 430:  86%|████████▌ | 862/1000 [05:36<00:53,  2.58it/s]
# PTI :step: 861, epoch: 430:  86%|████████▋ | 863/1000 [05:37<00:52,  2.60it/s]
# PTI :step: 862, epoch: 431:  86%|████████▋ | 863/1000 [05:37<00:52,  2.60it/s]
# PTI :step: 862, epoch: 431:  86%|████████▋ | 864/1000 [05:37<00:52,  2.58it/s]
# PTI :step: 863, epoch: 431:  86%|████████▋ | 864/1000 [05:37<00:52,  2.58it/s]
# PTI :step: 863, epoch: 431:  86%|████████▋ | 865/1000 [05:37<00:51,  2.61it/s]
# PTI :step: 864, epoch: 432:  86%|████████▋ | 865/1000 [05:37<00:51,  2.61it/s]
# PTI :step: 864, epoch: 432:  87%|████████▋ | 866/1000 [05:38<00:51,  2.60it/s]
# PTI :step: 865, epoch: 432:  87%|████████▋ | 866/1000 [05:38<00:51,  2.60it/s]
# PTI :step: 865, epoch: 432:  87%|████████▋ | 867/1000 [05:38<00:50,  2.61it/s]
# PTI :step: 866, epoch: 433:  87%|████████▋ | 867/1000 [05:38<00:50,  2.61it/s]
# PTI :step: 866, epoch: 433:  87%|████████▋ | 868/1000 [05:39<00:51,  2.59it/s]
# PTI :step: 867, epoch: 433:  87%|████████▋ | 868/1000 [05:39<00:51,  2.59it/s]
# PTI :step: 867, epoch: 433:  87%|████████▋ | 869/1000 [05:39<00:50,  2.58it/s]
# PTI :step: 868, epoch: 434:  87%|████████▋ | 869/1000 [05:39<00:50,  2.58it/s]
# PTI :step: 868, epoch: 434:  87%|████████▋ | 870/1000 [05:39<00:50,  2.57it/s]
# PTI :step: 869, epoch: 434:  87%|████████▋ | 870/1000 [05:39<00:50,  2.57it/s]
# PTI :step: 869, epoch: 434:  87%|████████▋ | 871/1000 [05:40<00:49,  2.60it/s]
# PTI :step: 870, epoch: 435:  87%|████████▋ | 871/1000 [05:40<00:49,  2.60it/s]
# PTI :step: 870, epoch: 435:  87%|████████▋ | 872/1000 [05:40<00:49,  2.58it/s]
# PTI :step: 871, epoch: 435:  87%|████████▋ | 872/1000 [05:40<00:49,  2.58it/s]
# PTI :step: 871, epoch: 435:  87%|████████▋ | 873/1000 [05:41<00:48,  2.61it/s]
# PTI :step: 872, epoch: 436:  87%|████████▋ | 873/1000 [05:41<00:48,  2.61it/s]
# PTI :step: 872, epoch: 436:  87%|████████▋ | 874/1000 [05:41<00:48,  2.58it/s]
# PTI :step: 873, epoch: 436:  87%|████████▋ | 874/1000 [05:41<00:48,  2.58it/s]
# PTI :step: 873, epoch: 436:  88%|████████▊ | 875/1000 [05:41<00:48,  2.58it/s]
# PTI :step: 874, epoch: 437:  88%|████████▊ | 875/1000 [05:41<00:48,  2.58it/s]
# PTI :step: 874, epoch: 437:  88%|████████▊ | 876/1000 [05:42<00:48,  2.56it/s]
# PTI :step: 875, epoch: 437:  88%|████████▊ | 876/1000 [05:42<00:48,  2.56it/s]
# PTI :step: 875, epoch: 437:  88%|████████▊ | 877/1000 [05:42<00:47,  2.58it/s]
# PTI :step: 876, epoch: 438:  88%|████████▊ | 877/1000 [05:42<00:47,  2.58it/s]
# PTI :step: 876, epoch: 438:  88%|████████▊ | 878/1000 [05:43<00:47,  2.57it/s]
# PTI :step: 877, epoch: 438:  88%|████████▊ | 878/1000 [05:43<00:47,  2.57it/s]
# PTI :step: 877, epoch: 438:  88%|████████▊ | 879/1000 [05:43<00:46,  2.60it/s]
# PTI :step: 878, epoch: 439:  88%|████████▊ | 879/1000 [05:43<00:46,  2.60it/s]
# PTI :step: 878, epoch: 439:  88%|████████▊ | 880/1000 [05:43<00:46,  2.58it/s]
# PTI :step: 879, epoch: 439:  88%|████████▊ | 880/1000 [05:43<00:46,  2.58it/s]
# PTI :step: 879, epoch: 439:  88%|████████▊ | 881/1000 [05:44<00:45,  2.60it/s]
# PTI :step: 880, epoch: 440:  88%|████████▊ | 881/1000 [05:44<00:45,  2.60it/s]
# PTI :step: 880, epoch: 440:  88%|████████▊ | 882/1000 [05:44<00:45,  2.58it/s]
# PTI :step: 881, epoch: 440:  88%|████████▊ | 882/1000 [05:44<00:45,  2.58it/s]
# PTI :step: 881, epoch: 440:  88%|████████▊ | 883/1000 [05:44<00:44,  2.60it/s]
# PTI :step: 882, epoch: 441:  88%|████████▊ | 883/1000 [05:44<00:44,  2.60it/s]
# PTI :step: 882, epoch: 441:  88%|████████▊ | 884/1000 [05:45<00:44,  2.58it/s]
# PTI :step: 883, epoch: 441:  88%|████████▊ | 884/1000 [05:45<00:44,  2.58it/s]
# PTI :step: 883, epoch: 441:  88%|████████▊ | 885/1000 [05:45<00:44,  2.59it/s]
# PTI :step: 884, epoch: 442:  88%|████████▊ | 885/1000 [05:45<00:44,  2.59it/s]
# PTI :step: 884, epoch: 442:  89%|████████▊ | 886/1000 [05:46<00:44,  2.58it/s]
# PTI :step: 885, epoch: 442:  89%|████████▊ | 886/1000 [05:46<00:44,  2.58it/s]
# PTI :step: 885, epoch: 442:  89%|████████▊ | 887/1000 [05:46<00:43,  2.59it/s]
# PTI :step: 886, epoch: 443:  89%|████████▊ | 887/1000 [05:46<00:43,  2.59it/s]
# PTI :step: 886, epoch: 443:  89%|████████▉ | 888/1000 [05:46<00:43,  2.58it/s]
# PTI :step: 887, epoch: 443:  89%|████████▉ | 888/1000 [05:46<00:43,  2.58it/s]
# PTI :step: 887, epoch: 443:  89%|████████▉ | 889/1000 [05:47<00:42,  2.60it/s]
# PTI :step: 888, epoch: 444:  89%|████████▉ | 889/1000 [05:47<00:42,  2.60it/s]
# PTI :step: 888, epoch: 444:  89%|████████▉ | 890/1000 [05:47<00:42,  2.58it/s]
# PTI :step: 889, epoch: 444:  89%|████████▉ | 890/1000 [05:47<00:42,  2.58it/s]
# PTI :step: 889, epoch: 444:  89%|████████▉ | 891/1000 [05:48<00:41,  2.61it/s]
# PTI :step: 890, epoch: 445:  89%|████████▉ | 891/1000 [05:48<00:41,  2.61it/s]
# PTI :step: 890, epoch: 445:  89%|████████▉ | 892/1000 [05:48<00:41,  2.58it/s]
# PTI :step: 891, epoch: 445:  89%|████████▉ | 892/1000 [05:48<00:41,  2.58it/s]
# PTI :step: 891, epoch: 445:  89%|████████▉ | 893/1000 [05:48<00:41,  2.61it/s]
# PTI :step: 892, epoch: 446:  89%|████████▉ | 893/1000 [05:48<00:41,  2.61it/s]
# PTI :step: 892, epoch: 446:  89%|████████▉ | 894/1000 [05:49<00:40,  2.59it/s]
# PTI :step: 893, epoch: 446:  89%|████████▉ | 894/1000 [05:49<00:40,  2.59it/s]
# PTI :step: 893, epoch: 446:  90%|████████▉ | 895/1000 [05:49<00:40,  2.58it/s]
# PTI :step: 894, epoch: 447:  90%|████████▉ | 895/1000 [05:49<00:40,  2.58it/s]
# PTI :step: 894, epoch: 447:  90%|████████▉ | 896/1000 [05:49<00:40,  2.57it/s]
# PTI :step: 895, epoch: 447:  90%|████████▉ | 896/1000 [05:49<00:40,  2.57it/s]
# PTI :step: 895, epoch: 447:  90%|████████▉ | 897/1000 [05:50<00:39,  2.60it/s]
# PTI :step: 896, epoch: 448:  90%|████████▉ | 897/1000 [05:50<00:39,  2.60it/s]
# PTI :step: 896, epoch: 448:  90%|████████▉ | 898/1000 [05:50<00:39,  2.56it/s]
# PTI :step: 897, epoch: 448:  90%|████████▉ | 898/1000 [05:50<00:39,  2.56it/s]
# PTI :step: 897, epoch: 448:  90%|████████▉ | 899/1000 [05:51<00:39,  2.56it/s]
# PTI :step: 898, epoch: 449:  90%|████████▉ | 899/1000 [05:51<00:39,  2.56it/s]
# PTI :step: 898, epoch: 449:  90%|█████████ | 900/1000 [05:51<00:39,  2.53it/s]
# PTI :step: 899, epoch: 449:  90%|█████████ | 900/1000 [05:51<00:39,  2.53it/s]
# PTI :step: 899, epoch: 449:  90%|█████████ | 901/1000 [05:51<00:38,  2.56it/s]
# PTI :step: 900, epoch: 450:  90%|█████████ | 901/1000 [05:51<00:38,  2.56it/s]
# PTI :step: 900, epoch: 450:  90%|█████████ | 902/1000 [05:52<00:38,  2.53it/s]
# PTI :step: 901, epoch: 450:  90%|█████████ | 902/1000 [05:52<00:38,  2.53it/s]
# PTI :step: 901, epoch: 450:  90%|█████████ | 903/1000 [05:52<00:37,  2.57it/s]
# PTI :step: 902, epoch: 451:  90%|█████████ | 903/1000 [05:52<00:37,  2.57it/s]
# PTI :step: 902, epoch: 451:  90%|█████████ | 904/1000 [05:53<00:37,  2.56it/s]
# PTI :step: 903, epoch: 451:  90%|█████████ | 904/1000 [05:53<00:37,  2.56it/s]
# PTI :step: 903, epoch: 451:  90%|█████████ | 905/1000 [05:53<00:36,  2.58it/s]
# PTI :step: 904, epoch: 452:  90%|█████████ | 905/1000 [05:53<00:36,  2.58it/s]
# PTI :step: 904, epoch: 452:  91%|█████████ | 906/1000 [05:53<00:36,  2.57it/s]
# PTI :step: 905, epoch: 452:  91%|█████████ | 906/1000 [05:53<00:36,  2.57it/s]
# PTI :step: 905, epoch: 452:  91%|█████████ | 907/1000 [05:54<00:35,  2.59it/s]
# PTI :step: 906, epoch: 453:  91%|█████████ | 907/1000 [05:54<00:35,  2.59it/s]
# PTI :step: 906, epoch: 453:  91%|█████████ | 908/1000 [05:54<00:35,  2.57it/s]
# PTI :step: 907, epoch: 453:  91%|█████████ | 908/1000 [05:54<00:35,  2.57it/s]
# PTI :step: 907, epoch: 453:  91%|█████████ | 909/1000 [05:55<00:35,  2.57it/s]
# PTI :step: 908, epoch: 454:  91%|█████████ | 909/1000 [05:55<00:35,  2.57it/s]
# PTI :step: 908, epoch: 454:  91%|█████████ | 910/1000 [05:55<00:35,  2.56it/s]
# PTI :step: 909, epoch: 454:  91%|█████████ | 910/1000 [05:55<00:35,  2.56it/s]
# PTI :step: 909, epoch: 454:  91%|█████████ | 911/1000 [05:55<00:34,  2.59it/s]
# PTI :step: 910, epoch: 455:  91%|█████████ | 911/1000 [05:55<00:34,  2.59it/s]
# PTI :step: 910, epoch: 455:  91%|█████████ | 912/1000 [05:56<00:34,  2.58it/s]
# PTI :step: 911, epoch: 455:  91%|█████████ | 912/1000 [05:56<00:34,  2.58it/s]
# PTI :step: 911, epoch: 455:  91%|█████████▏| 913/1000 [05:56<00:34,  2.55it/s]
# PTI :step: 912, epoch: 456:  91%|█████████▏| 913/1000 [05:56<00:34,  2.55it/s]
# PTI :step: 912, epoch: 456:  91%|█████████▏| 914/1000 [05:57<00:33,  2.55it/s]
# PTI :step: 913, epoch: 456:  91%|█████████▏| 914/1000 [05:57<00:33,  2.55it/s]
# PTI :step: 913, epoch: 456:  92%|█████████▏| 915/1000 [05:57<00:33,  2.57it/s]
# PTI :step: 914, epoch: 457:  92%|█████████▏| 915/1000 [05:57<00:33,  2.57it/s]
# PTI :step: 914, epoch: 457:  92%|█████████▏| 916/1000 [05:57<00:32,  2.56it/s]
# PTI :step: 915, epoch: 457:  92%|█████████▏| 916/1000 [05:57<00:32,  2.56it/s]
# PTI :step: 915, epoch: 457:  92%|█████████▏| 917/1000 [05:58<00:32,  2.59it/s]
# PTI :step: 916, epoch: 458:  92%|█████████▏| 917/1000 [05:58<00:32,  2.59it/s]
# PTI :step: 916, epoch: 458:  92%|█████████▏| 918/1000 [05:58<00:31,  2.58it/s]
# PTI :step: 917, epoch: 458:  92%|█████████▏| 918/1000 [05:58<00:31,  2.58it/s]
# PTI :step: 917, epoch: 458:  92%|█████████▏| 919/1000 [05:58<00:31,  2.61it/s]
# PTI :step: 918, epoch: 459:  92%|█████████▏| 919/1000 [05:58<00:31,  2.61it/s]
# PTI :step: 918, epoch: 459:  92%|█████████▏| 920/1000 [05:59<00:30,  2.59it/s]
# PTI :step: 919, epoch: 459:  92%|█████████▏| 920/1000 [05:59<00:30,  2.59it/s]
# PTI :step: 919, epoch: 459:  92%|█████████▏| 921/1000 [05:59<00:30,  2.58it/s]
# PTI :step: 920, epoch: 460:  92%|█████████▏| 921/1000 [05:59<00:30,  2.58it/s]
# PTI :step: 920, epoch: 460:  92%|█████████▏| 922/1000 [06:00<00:30,  2.57it/s]
# PTI :step: 921, epoch: 460:  92%|█████████▏| 922/1000 [06:00<00:30,  2.57it/s]
# PTI :step: 921, epoch: 460:  92%|█████████▏| 923/1000 [06:00<00:29,  2.59it/s]
# PTI :step: 922, epoch: 461:  92%|█████████▏| 923/1000 [06:00<00:29,  2.59it/s]
# PTI :step: 922, epoch: 461:  92%|█████████▏| 924/1000 [06:00<00:29,  2.55it/s]
# PTI :step: 923, epoch: 461:  92%|█████████▏| 924/1000 [06:00<00:29,  2.55it/s]
# PTI :step: 923, epoch: 461:  92%|█████████▎| 925/1000 [06:01<00:29,  2.59it/s]
# PTI :step: 924, epoch: 462:  92%|█████████▎| 925/1000 [06:01<00:29,  2.59it/s]
# PTI :step: 924, epoch: 462:  93%|█████████▎| 926/1000 [06:01<00:28,  2.57it/s]
# PTI :step: 925, epoch: 462:  93%|█████████▎| 926/1000 [06:01<00:28,  2.57it/s]
# PTI :step: 925, epoch: 462:  93%|█████████▎| 927/1000 [06:02<00:28,  2.60it/s]
# PTI :step: 926, epoch: 463:  93%|█████████▎| 927/1000 [06:02<00:28,  2.60it/s]
# PTI :step: 926, epoch: 463:  93%|█████████▎| 928/1000 [06:02<00:28,  2.56it/s]
# PTI :step: 927, epoch: 463:  93%|█████████▎| 928/1000 [06:02<00:28,  2.56it/s]
# PTI :step: 927, epoch: 463:  93%|█████████▎| 929/1000 [06:02<00:27,  2.59it/s]
# PTI :step: 928, epoch: 464:  93%|█████████▎| 929/1000 [06:02<00:27,  2.59it/s]
# PTI :step: 928, epoch: 464:  93%|█████████▎| 930/1000 [06:03<00:27,  2.58it/s]
# PTI :step: 929, epoch: 464:  93%|█████████▎| 930/1000 [06:03<00:27,  2.58it/s]
# PTI :step: 929, epoch: 464:  93%|█████████▎| 931/1000 [06:03<00:26,  2.58it/s]
# PTI :step: 930, epoch: 465:  93%|█████████▎| 931/1000 [06:03<00:26,  2.58it/s]
# PTI :step: 930, epoch: 465:  93%|█████████▎| 932/1000 [06:03<00:26,  2.57it/s]
# PTI :step: 931, epoch: 465:  93%|█████████▎| 932/1000 [06:03<00:26,  2.57it/s]
# PTI :step: 931, epoch: 465:  93%|█████████▎| 933/1000 [06:04<00:25,  2.60it/s]
# PTI :step: 932, epoch: 466:  93%|█████████▎| 933/1000 [06:04<00:25,  2.60it/s]
# PTI :step: 932, epoch: 466:  93%|█████████▎| 934/1000 [06:04<00:25,  2.59it/s]
# PTI :step: 933, epoch: 466:  93%|█████████▎| 934/1000 [06:04<00:25,  2.59it/s]
# PTI :step: 933, epoch: 466:  94%|█████████▎| 935/1000 [06:05<00:24,  2.61it/s]
# PTI :step: 934, epoch: 467:  94%|█████████▎| 935/1000 [06:05<00:24,  2.61it/s]
# PTI :step: 934, epoch: 467:  94%|█████████▎| 936/1000 [06:05<00:25,  2.56it/s]
# PTI :step: 935, epoch: 467:  94%|█████████▎| 936/1000 [06:05<00:25,  2.56it/s]
# PTI :step: 935, epoch: 467:  94%|█████████▎| 937/1000 [06:05<00:24,  2.58it/s]
# PTI :step: 936, epoch: 468:  94%|█████████▎| 937/1000 [06:05<00:24,  2.58it/s]
# PTI :step: 936, epoch: 468:  94%|█████████▍| 938/1000 [06:06<00:24,  2.56it/s]
# PTI :step: 937, epoch: 468:  94%|█████████▍| 938/1000 [06:06<00:24,  2.56it/s]
# PTI :step: 937, epoch: 468:  94%|█████████▍| 939/1000 [06:06<00:23,  2.57it/s]
# PTI :step: 938, epoch: 469:  94%|█████████▍| 939/1000 [06:06<00:23,  2.57it/s]
# PTI :step: 938, epoch: 469:  94%|█████████▍| 940/1000 [06:07<00:23,  2.56it/s]
# PTI :step: 939, epoch: 469:  94%|█████████▍| 940/1000 [06:07<00:23,  2.56it/s]
# PTI :step: 939, epoch: 469:  94%|█████████▍| 941/1000 [06:07<00:22,  2.59it/s]
# PTI :step: 940, epoch: 470:  94%|█████████▍| 941/1000 [06:07<00:22,  2.59it/s]
# PTI :step: 940, epoch: 470:  94%|█████████▍| 942/1000 [06:07<00:22,  2.57it/s]
# PTI :step: 941, epoch: 470:  94%|█████████▍| 942/1000 [06:07<00:22,  2.57it/s]
# PTI :step: 941, epoch: 470:  94%|█████████▍| 943/1000 [06:08<00:21,  2.60it/s]
# PTI :step: 942, epoch: 471:  94%|█████████▍| 943/1000 [06:08<00:21,  2.60it/s]
# PTI :step: 942, epoch: 471:  94%|█████████▍| 944/1000 [06:08<00:21,  2.58it/s]
# PTI :step: 943, epoch: 471:  94%|█████████▍| 944/1000 [06:08<00:21,  2.58it/s]
# PTI :step: 943, epoch: 471:  94%|█████████▍| 945/1000 [06:08<00:21,  2.60it/s]
# PTI :step: 944, epoch: 472:  94%|█████████▍| 945/1000 [06:08<00:21,  2.60it/s]
# PTI :step: 944, epoch: 472:  95%|█████████▍| 946/1000 [06:09<00:21,  2.57it/s]
# PTI :step: 945, epoch: 472:  95%|█████████▍| 946/1000 [06:09<00:21,  2.57it/s]
# PTI :step: 945, epoch: 472:  95%|█████████▍| 947/1000 [06:09<00:20,  2.60it/s]
# PTI :step: 946, epoch: 473:  95%|█████████▍| 947/1000 [06:09<00:20,  2.60it/s]
# PTI :step: 946, epoch: 473:  95%|█████████▍| 948/1000 [06:10<00:20,  2.57it/s]
# PTI :step: 947, epoch: 473:  95%|█████████▍| 948/1000 [06:10<00:20,  2.57it/s]
# PTI :step: 947, epoch: 473:  95%|█████████▍| 949/1000 [06:10<00:19,  2.57it/s]
# PTI :step: 948, epoch: 474:  95%|█████████▍| 949/1000 [06:10<00:19,  2.57it/s]
# PTI :step: 948, epoch: 474:  95%|█████████▌| 950/1000 [06:10<00:19,  2.56it/s]
# PTI :step: 949, epoch: 474:  95%|█████████▌| 950/1000 [06:10<00:19,  2.56it/s]
# PTI :step: 949, epoch: 474:  95%|█████████▌| 951/1000 [06:11<00:18,  2.60it/s]
# PTI :step: 950, epoch: 475:  95%|█████████▌| 951/1000 [06:11<00:18,  2.60it/s]
# PTI :step: 950, epoch: 475:  95%|█████████▌| 952/1000 [06:11<00:18,  2.56it/s]
# PTI :step: 951, epoch: 475:  95%|█████████▌| 952/1000 [06:11<00:18,  2.56it/s]
# PTI :step: 951, epoch: 475:  95%|█████████▌| 953/1000 [06:12<00:18,  2.60it/s]
# PTI :step: 952, epoch: 476:  95%|█████████▌| 953/1000 [06:12<00:18,  2.60it/s]
# PTI :step: 952, epoch: 476:  95%|█████████▌| 954/1000 [06:12<00:17,  2.58it/s]
# PTI :step: 953, epoch: 476:  95%|█████████▌| 954/1000 [06:12<00:17,  2.58it/s]
# PTI :step: 953, epoch: 476:  96%|█████████▌| 955/1000 [06:12<00:17,  2.60it/s]
# PTI :step: 954, epoch: 477:  96%|█████████▌| 955/1000 [06:12<00:17,  2.60it/s]
# PTI :step: 954, epoch: 477:  96%|█████████▌| 956/1000 [06:13<00:17,  2.58it/s]
# PTI :step: 955, epoch: 477:  96%|█████████▌| 956/1000 [06:13<00:17,  2.58it/s]
# PTI :step: 955, epoch: 477:  96%|█████████▌| 957/1000 [06:13<00:16,  2.55it/s]
# PTI :step: 956, epoch: 478:  96%|█████████▌| 957/1000 [06:13<00:16,  2.55it/s]
# PTI :step: 956, epoch: 478:  96%|█████████▌| 958/1000 [06:14<00:16,  2.54it/s]
# PTI :step: 957, epoch: 478:  96%|█████████▌| 958/1000 [06:14<00:16,  2.54it/s]
# PTI :step: 957, epoch: 478:  96%|█████████▌| 959/1000 [06:14<00:15,  2.56it/s]
# PTI :step: 958, epoch: 479:  96%|█████████▌| 959/1000 [06:14<00:15,  2.56it/s]
# PTI :step: 958, epoch: 479:  96%|█████████▌| 960/1000 [06:14<00:15,  2.56it/s]
# PTI :step: 959, epoch: 479:  96%|█████████▌| 960/1000 [06:14<00:15,  2.56it/s]
# PTI :step: 959, epoch: 479:  96%|█████████▌| 961/1000 [06:15<00:15,  2.59it/s]
# PTI :step: 960, epoch: 480:  96%|█████████▌| 961/1000 [06:15<00:15,  2.59it/s]
# PTI :step: 960, epoch: 480:  96%|█████████▌| 962/1000 [06:15<00:14,  2.57it/s]
# PTI :step: 961, epoch: 480:  96%|█████████▌| 962/1000 [06:15<00:14,  2.57it/s]
# PTI :step: 961, epoch: 480:  96%|█████████▋| 963/1000 [06:15<00:14,  2.57it/s]
# PTI :step: 962, epoch: 481:  96%|█████████▋| 963/1000 [06:15<00:14,  2.57it/s]
# PTI :step: 962, epoch: 481:  96%|█████████▋| 964/1000 [06:16<00:14,  2.56it/s]
# PTI :step: 963, epoch: 481:  96%|█████████▋| 964/1000 [06:16<00:14,  2.56it/s]
# PTI :step: 963, epoch: 481:  96%|█████████▋| 965/1000 [06:16<00:13,  2.59it/s]
# PTI :step: 964, epoch: 482:  96%|█████████▋| 965/1000 [06:16<00:13,  2.59it/s]
# PTI :step: 964, epoch: 482:  97%|█████████▋| 966/1000 [06:17<00:13,  2.57it/s]
# PTI :step: 965, epoch: 482:  97%|█████████▋| 966/1000 [06:17<00:13,  2.57it/s]
# PTI :step: 965, epoch: 482:  97%|█████████▋| 967/1000 [06:17<00:12,  2.60it/s]
# PTI :step: 966, epoch: 483:  97%|█████████▋| 967/1000 [06:17<00:12,  2.60it/s]
# PTI :step: 966, epoch: 483:  97%|█████████▋| 968/1000 [06:17<00:12,  2.58it/s]
# PTI :step: 967, epoch: 483:  97%|█████████▋| 968/1000 [06:17<00:12,  2.58it/s]
# PTI :step: 967, epoch: 483:  97%|█████████▋| 969/1000 [06:18<00:11,  2.61it/s]
# PTI :step: 968, epoch: 484:  97%|█████████▋| 969/1000 [06:18<00:11,  2.61it/s]
# PTI :step: 968, epoch: 484:  97%|█████████▋| 970/1000 [06:18<00:11,  2.58it/s]
# PTI :step: 969, epoch: 484:  97%|█████████▋| 970/1000 [06:18<00:11,  2.58it/s]
# PTI :step: 969, epoch: 484:  97%|█████████▋| 971/1000 [06:19<00:11,  2.61it/s]
# PTI :step: 970, epoch: 485:  97%|█████████▋| 971/1000 [06:19<00:11,  2.61it/s]
# PTI :step: 970, epoch: 485:  97%|█████████▋| 972/1000 [06:19<00:10,  2.59it/s]
# PTI :step: 971, epoch: 485:  97%|█████████▋| 972/1000 [06:19<00:10,  2.59it/s]
# PTI :step: 971, epoch: 485:  97%|█████████▋| 973/1000 [06:19<00:10,  2.61it/s]
# PTI :step: 972, epoch: 486:  97%|█████████▋| 973/1000 [06:19<00:10,  2.61it/s]
# PTI :step: 972, epoch: 486:  97%|█████████▋| 974/1000 [06:20<00:10,  2.58it/s]
# PTI :step: 973, epoch: 486:  97%|█████████▋| 974/1000 [06:20<00:10,  2.58it/s]
# PTI :step: 973, epoch: 486:  98%|█████████▊| 975/1000 [06:20<00:09,  2.60it/s]
# PTI :step: 974, epoch: 487:  98%|█████████▊| 975/1000 [06:20<00:09,  2.60it/s]
# PTI :step: 974, epoch: 487:  98%|█████████▊| 976/1000 [06:21<00:09,  2.58it/s]
# PTI :step: 975, epoch: 487:  98%|█████████▊| 976/1000 [06:21<00:09,  2.58it/s]
# PTI :step: 975, epoch: 487:  98%|█████████▊| 977/1000 [06:21<00:08,  2.59it/s]
# PTI :step: 976, epoch: 488:  98%|█████████▊| 977/1000 [06:21<00:08,  2.59it/s]
# PTI :step: 976, epoch: 488:  98%|█████████▊| 978/1000 [06:21<00:08,  2.57it/s]
# PTI :step: 977, epoch: 488:  98%|█████████▊| 978/1000 [06:21<00:08,  2.57it/s]
# PTI :step: 977, epoch: 488:  98%|█████████▊| 979/1000 [06:22<00:08,  2.60it/s]
# PTI :step: 978, epoch: 489:  98%|█████████▊| 979/1000 [06:22<00:08,  2.60it/s]
# PTI :step: 978, epoch: 489:  98%|█████████▊| 980/1000 [06:22<00:07,  2.57it/s]
# PTI :step: 979, epoch: 489:  98%|█████████▊| 980/1000 [06:22<00:07,  2.57it/s]
# PTI :step: 979, epoch: 489:  98%|█████████▊| 981/1000 [06:22<00:07,  2.58it/s]
# PTI :step: 980, epoch: 490:  98%|█████████▊| 981/1000 [06:22<00:07,  2.58it/s]
# PTI :step: 980, epoch: 490:  98%|█████████▊| 982/1000 [06:23<00:07,  2.56it/s]
# PTI :step: 981, epoch: 490:  98%|█████████▊| 982/1000 [06:23<00:07,  2.56it/s]
# PTI :step: 981, epoch: 490:  98%|█████████▊| 983/1000 [06:23<00:06,  2.59it/s]
# PTI :step: 982, epoch: 491:  98%|█████████▊| 983/1000 [06:23<00:06,  2.59it/s]
# PTI :step: 982, epoch: 491:  98%|█████████▊| 984/1000 [06:24<00:06,  2.57it/s]
# PTI :step: 983, epoch: 491:  98%|█████████▊| 984/1000 [06:24<00:06,  2.57it/s]
# PTI :step: 983, epoch: 491:  98%|█████████▊| 985/1000 [06:24<00:05,  2.60it/s]
# PTI :step: 984, epoch: 492:  98%|█████████▊| 985/1000 [06:24<00:05,  2.60it/s]
# PTI :step: 984, epoch: 492:  99%|█████████▊| 986/1000 [06:24<00:05,  2.58it/s]
# PTI :step: 985, epoch: 492:  99%|█████████▊| 986/1000 [06:24<00:05,  2.58it/s]
# PTI :step: 985, epoch: 492:  99%|█████████▊| 987/1000 [06:25<00:05,  2.60it/s]
# PTI :step: 986, epoch: 493:  99%|█████████▊| 987/1000 [06:25<00:05,  2.60it/s]
# PTI :step: 986, epoch: 493:  99%|█████████▉| 988/1000 [06:25<00:04,  2.58it/s]
# PTI :step: 987, epoch: 493:  99%|█████████▉| 988/1000 [06:25<00:04,  2.58it/s]
# PTI :step: 987, epoch: 493:  99%|█████████▉| 989/1000 [06:26<00:04,  2.60it/s]
# PTI :step: 988, epoch: 494:  99%|█████████▉| 989/1000 [06:26<00:04,  2.60it/s]
# PTI :step: 988, epoch: 494:  99%|█████████▉| 990/1000 [06:26<00:03,  2.58it/s]
# PTI :step: 989, epoch: 494:  99%|█████████▉| 990/1000 [06:26<00:03,  2.58it/s]
# PTI :step: 989, epoch: 494:  99%|█████████▉| 991/1000 [06:26<00:03,  2.61it/s]
# PTI :step: 990, epoch: 495:  99%|█████████▉| 991/1000 [06:26<00:03,  2.61it/s]
# PTI :step: 990, epoch: 495:  99%|█████████▉| 992/1000 [06:27<00:03,  2.58it/s]
# PTI :step: 991, epoch: 495:  99%|█████████▉| 992/1000 [06:27<00:03,  2.58it/s]
# PTI :step: 991, epoch: 495:  99%|█████████▉| 993/1000 [06:27<00:02,  2.60it/s]
# PTI :step: 992, epoch: 496:  99%|█████████▉| 993/1000 [06:27<00:02,  2.60it/s]
# PTI :step: 992, epoch: 496:  99%|█████████▉| 994/1000 [06:27<00:02,  2.58it/s]
# PTI :step: 993, epoch: 496:  99%|█████████▉| 994/1000 [06:27<00:02,  2.58it/s]
# PTI :step: 993, epoch: 496: 100%|█████████▉| 995/1000 [06:28<00:01,  2.60it/s]
# PTI :step: 994, epoch: 497: 100%|█████████▉| 995/1000 [06:28<00:01,  2.60it/s]
# PTI :step: 994, epoch: 497: 100%|█████████▉| 996/1000 [06:28<00:01,  2.57it/s]
# PTI :step: 995, epoch: 497: 100%|█████████▉| 996/1000 [06:28<00:01,  2.57it/s]
# PTI :step: 995, epoch: 497: 100%|█████████▉| 997/1000 [06:29<00:01,  2.60it/s]
# PTI :step: 996, epoch: 498: 100%|█████████▉| 997/1000 [06:29<00:01,  2.60it/s]
# PTI :step: 996, epoch: 498: 100%|█████████▉| 998/1000 [06:29<00:00,  2.58it/s]
# PTI :step: 997, epoch: 498: 100%|█████████▉| 998/1000 [06:29<00:00,  2.58it/s]
# PTI :step: 997, epoch: 498: 100%|█████████▉| 999/1000 [06:29<00:00,  2.58it/s]
# PTI :step: 998, epoch: 499: 100%|█████████▉| 999/1000 [06:29<00:00,  2.58it/s]
# PTI :step: 998, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00,  2.57it/s]
Saving final model for return
# PTI :step: 999, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00,  2.57it/s]
# PTI :step: 999, epoch: 499: 100%|██████████| 1000/1000 [06:30<00:00,  2.56it/s]
training_out/lora.safetensors
training_out/embeddings.pti
training_out/special_params.json

Want to make some of these yourself?

Run this model