2025-05-01 12:03:37,435-The parameters are as below:
2025-05-01 12:03:37,435-model_name: fcrllm_gru4rec
2025-05-01 12:03:37,435-dataset: fashion
2025-05-01 12:03:37,435-inter_file: inter
2025-05-01 12:03:37,435-demo: False
2025-05-01 12:03:37,435-pretrain_dir: ./saved/fashion/sasrec_seq
2025-05-01 12:03:37,435-output_dir: ./saved/fashion/fcrllm_gru4rec/
2025-05-01 12:03:37,435-check_path: 
2025-05-01 12:03:37,435-do_test: False
2025-05-01 12:03:37,435-do_emb: False
2025-05-01 12:03:37,435-do_group: False
2025-05-01 12:03:37,435-keepon: False
2025-05-01 12:03:37,435-keepon_path: ./saved/fashion/fcrllm_gru4rec/normal
2025-05-01 12:03:37,436-clip_path: 
2025-05-01 12:03:37,436-ts_user: 3
2025-05-01 12:03:37,436-ts_item: 4
2025-05-01 12:03:37,436-hidden_size: 64
2025-05-01 12:03:37,436-trm_num: 2
2025-05-01 12:03:37,436-num_heads: 1
2025-05-01 12:03:37,436-num_layers: 1
2025-05-01 12:03:37,436-cl_scale: 0.1
2025-05-01 12:03:37,436-mask_crop_ratio: 0.3
2025-05-01 12:03:37,436-tau: 1
2025-05-01 12:03:37,436-sse_ratio: 0.4
2025-05-01 12:03:37,436-dropout_rate: 0.5
2025-05-01 12:03:37,436-max_len: 200
2025-05-01 12:03:37,436-mask_prob: 0.4
2025-05-01 12:03:37,436-aug: False
2025-05-01 12:03:37,436-aug_seq: False
2025-05-01 12:03:37,436-aug_seq_len: 0
2025-05-01 12:03:37,436-aug_file: inter
2025-05-01 12:03:37,436-train_neg: 1
2025-05-01 12:03:37,436-test_neg: 100
2025-05-01 12:03:37,436-suffix_num: 5
2025-05-01 12:03:37,436-prompt_num: 2
2025-05-01 12:03:37,436-freeze: True
2025-05-01 12:03:37,436-pg: length
2025-05-01 12:03:37,436-num_hopblock: 1
2025-05-01 12:03:37,436-gamma_fc: 0.5
2025-05-01 12:03:37,436-item_reg: False
2025-05-01 12:03:37,436-beta: 0.1
2025-05-01 12:03:37,436-sim_user_num: 10
2025-05-01 12:03:37,436-split_backbone: False
2025-05-01 12:03:37,436-co_view: False
2025-05-01 12:03:37,436-se_view: False
2025-05-01 12:03:37,436-beta_hopfield: 0.7
2025-05-01 12:03:37,436-alpha_hopfield: 0.3
2025-05-01 12:03:37,436-gamma_update: 0.5
2025-05-01 12:03:37,437-hyb_alpha: 0.5
2025-05-01 12:03:37,437-train_batch_size: 128
2025-05-01 12:03:37,437-lr: 0.001
2025-05-01 12:03:37,437-l2: 0
2025-05-01 12:03:37,437-num_train_epochs: 200.0
2025-05-01 12:03:37,437-lr_dc_step: 1000
2025-05-01 12:03:37,437-lr_dc: 0
2025-05-01 12:03:37,437-patience: 10
2025-05-01 12:03:37,437-watch_metric: NDCG@10
2025-05-01 12:03:37,437-seed: 42
2025-05-01 12:03:37,437-no_cuda: False
2025-05-01 12:03:37,437-gpu_id: 0
2025-05-01 12:03:37,437-num_workers: 8
2025-05-01 12:03:37,437-log: True
2025-05-01 12:03:37,561-Loading dataset ... 
2025-05-01 12:03:37,613-Dataset is loaded: consume 0.051 s
2025-05-01 12:03:37,613-Loading Model: fcrllm_gru4rec
2025-05-01 12:03:41,894-# of model parameters: 18468224
2025-05-01 12:03:42,830-FlipClassEnsemble(
  (st): FlipModelST(
    (enc): DualViewGRU4Rec(
      (item_emb): Embedding(4724, 64, padding_idx=0)
      (backbone): GRU4RecBackbone(
        (gru): GRU(64, 64, bias=False, batch_first=True)
      )
      (loss_func): BCEWithLogitsLoss()
      (llm_item_emb): Embedding(4724, 1536)
      (adapter): Sequential(
        (0): Linear(in_features=1536, out_features=768, bias=True)
        (1): Linear(in_features=768, out_features=64, bias=True)
      )
      (id_item_emb): Embedding(4724, 64)
      (pos_emb): Embedding(300, 64)
      (emb_dropout): Dropout(p=0.5, inplace=False)
    )
    (pos_emb): Embedding(300, 64)
    (do): Dropout(p=0.5, inplace=False)
    (block): FlipBlockST(
      (student_layers): ModuleList(
        (0): _HopBlock(
          (ln): LayerNorm((64,), eps=1e-05, elementwise_affine=True)
          (attn): MultiheadAttention(
            (out_proj): NonDynamicallyQuantizableLinear(in_features=64, out_features=64, bias=True)
          )
          (ffn): PointWiseFeedForward(
            (linear1): Linear(in_features=64, out_features=256, bias=True)
            (dropout): Dropout(p=0.5, inplace=False)
            (linear2): Linear(in_features=256, out_features=64, bias=True)
            (dropout2): Dropout(p=0.5, inplace=False)
            (LayerNorm): LayerNorm((64,), eps=1e-12, elementwise_affine=True)
          )
        )
      )
      (teacher_layers): ModuleList(
        (0): _HopBlock(
          (ln): LayerNorm((64,), eps=1e-05, elementwise_affine=True)
          (attn): MultiheadAttention(
            (out_proj): NonDynamicallyQuantizableLinear(in_features=64, out_features=64, bias=True)
          )
          (ffn): PointWiseFeedForward(
            (linear1): Linear(in_features=64, out_features=256, bias=True)
            (dropout): Dropout(p=0.5, inplace=False)
            (linear2): Linear(in_features=256, out_features=64, bias=True)
            (dropout2): Dropout(p=0.5, inplace=False)
            (LayerNorm): LayerNorm((64,), eps=1e-12, elementwise_affine=True)
          )
        )
      )
    )
    (mse): MSELoss()
  )
  (ct): FlipModelCT(
    (enc): DualViewGRU4Rec(
      (item_emb): Embedding(4724, 64, padding_idx=0)
      (backbone): GRU4RecBackbone(
        (gru): GRU(64, 64, bias=False, batch_first=True)
      )
      (loss_func): BCEWithLogitsLoss()
      (llm_item_emb): Embedding(4724, 1536)
      (adapter): Sequential(
        (0): Linear(in_features=1536, out_features=768, bias=True)
        (1): Linear(in_features=768, out_features=64, bias=True)
      )
      (id_item_emb): Embedding(4724, 64)
      (pos_emb): Embedding(300, 64)
      (emb_dropout): Dropout(p=0.5, inplace=False)
    )
    (pos_emb): Embedding(300, 64)
    (do): Dropout(p=0.5, inplace=False)
    (block): FlipBlockCT(
      (teacher_layers): ModuleList(
        (0): _HopBlock(
          (ln): LayerNorm((64,), eps=1e-05, elementwise_affine=True)
          (attn): MultiheadAttention(
            (out_proj): NonDynamicallyQuantizableLinear(in_features=64, out_features=64, bias=True)
          )
          (ffn): PointWiseFeedForward(
            (linear1): Linear(in_features=64, out_features=256, bias=True)
            (dropout): Dropout(p=0.5, inplace=False)
            (linear2): Linear(in_features=256, out_features=64, bias=True)
            (dropout2): Dropout(p=0.5, inplace=False)
            (LayerNorm): LayerNorm((64,), eps=1e-12, elementwise_affine=True)
          )
        )
      )
      (student_layers): ModuleList(
        (0): _HopBlock(
          (ln): LayerNorm((64,), eps=1e-05, elementwise_affine=True)
          (attn): MultiheadAttention(
            (out_proj): NonDynamicallyQuantizableLinear(in_features=64, out_features=64, bias=True)
          )
          (ffn): PointWiseFeedForward(
            (linear1): Linear(in_features=64, out_features=256, bias=True)
            (dropout): Dropout(p=0.5, inplace=False)
            (linear2): Linear(in_features=256, out_features=64, bias=True)
            (dropout2): Dropout(p=0.5, inplace=False)
            (LayerNorm): LayerNorm((64,), eps=1e-12, elementwise_affine=True)
          )
        )
      )
    )
    (mse): MSELoss()
  )
)
2025-05-01 12:03:42,832-Model Name   : fcrllm_gru4rec
2025-05-01 12:03:42,832-Hidden Size  : 64
2025-05-01 12:03:42,832-Dropout Rate : 0.5
2025-05-01 12:03:42,832-Freeze LLM   : True
2025-05-01 12:03:42,832-Hopfield     : α=0.3, β=0.7, γ=0.5
2025-05-01 12:03:42,832-
----------------------------------------------------------------
2025-05-01 12:03:42,832-********** Running training **********
2025-05-01 12:03:42,832-  Batch size = 128
2025-05-01 12:04:01,749-
----------------------------------
2025-05-01 12:04:01,750-********** Epoch: 0 eval **********
2025-05-01 12:04:03,114-
2025-05-01 12:04:03,206-Overall Performance:
2025-05-01 12:04:03,207-	 NDCG@10: 0.46464
2025-05-01 12:04:03,207-	 HR@10: 0.58291
2025-05-01 12:04:18,371-
----------------------------------
2025-05-01 12:04:18,371-********** Epoch: 1 eval **********
2025-05-01 12:04:19,713-
2025-05-01 12:04:19,808-Overall Performance:
2025-05-01 12:04:19,809-	 NDCG@10: 0.49886
2025-05-01 12:04:19,809-	 HR@10: 0.62085
2025-05-01 12:04:34,902-
----------------------------------
2025-05-01 12:04:34,902-********** Epoch: 2 eval **********
2025-05-01 12:04:36,330-
2025-05-01 12:04:36,425-Overall Performance:
2025-05-01 12:04:36,426-	 NDCG@10: 0.51098
2025-05-01 12:04:36,427-	 HR@10: 0.62987
2025-05-01 12:04:51,355-
----------------------------------
2025-05-01 12:04:51,356-********** Epoch: 3 eval **********
2025-05-01 12:04:52,591-
2025-05-01 12:04:52,686-Overall Performance:
2025-05-01 12:04:52,687-	 NDCG@10: 0.51993
2025-05-01 12:04:52,687-	 HR@10: 0.63580
2025-05-01 12:05:07,785-
----------------------------------
2025-05-01 12:05:07,786-********** Epoch: 4 eval **********
2025-05-01 12:05:09,260-
2025-05-01 12:05:09,397-Overall Performance:
2025-05-01 12:05:09,397-	 NDCG@10: 0.52061
2025-05-01 12:05:09,398-	 HR@10: 0.63580
2025-05-01 12:05:24,506-
----------------------------------
2025-05-01 12:05:24,506-********** Epoch: 5 eval **********
2025-05-01 12:05:25,936-
2025-05-01 12:05:26,033-Overall Performance:
2025-05-01 12:05:26,033-	 NDCG@10: 0.52424
2025-05-01 12:05:26,033-	 HR@10: 0.63965
2025-05-01 12:05:42,614-
----------------------------------
2025-05-01 12:05:42,615-********** Epoch: 6 eval **********
2025-05-01 12:05:44,119-
2025-05-01 12:05:44,215-Overall Performance:
2025-05-01 12:05:44,215-	 NDCG@10: 0.52712
2025-05-01 12:05:44,215-	 HR@10: 0.63635
2025-05-01 12:05:59,489-
----------------------------------
2025-05-01 12:05:59,490-********** Epoch: 7 eval **********
2025-05-01 12:06:00,951-
2025-05-01 12:06:01,048-Overall Performance:
2025-05-01 12:06:01,048-	 NDCG@10: 0.52647
2025-05-01 12:06:01,048-	 HR@10: 0.63196
2025-05-01 12:06:16,006-
----------------------------------
2025-05-01 12:06:16,007-********** Epoch: 8 eval **********
2025-05-01 12:06:17,336-
2025-05-01 12:06:17,433-Overall Performance:
2025-05-01 12:06:17,433-	 NDCG@10: 0.53476
2025-05-01 12:06:17,434-	 HR@10: 0.64119
2025-05-01 12:06:32,596-
----------------------------------
2025-05-01 12:06:32,596-********** Epoch: 9 eval **********
2025-05-01 12:06:34,099-
2025-05-01 12:06:34,194-Overall Performance:
2025-05-01 12:06:34,194-	 NDCG@10: 0.52840
2025-05-01 12:06:34,195-	 HR@10: 0.62701
2025-05-01 12:06:49,145-
----------------------------------
2025-05-01 12:06:49,145-********** Epoch: 10 eval **********
2025-05-01 12:06:50,623-
2025-05-01 12:06:50,719-Overall Performance:
2025-05-01 12:06:50,720-	 NDCG@10: 0.53338
2025-05-01 12:06:50,720-	 HR@10: 0.63756
2025-05-01 12:07:05,725-
----------------------------------
2025-05-01 12:07:05,725-********** Epoch: 11 eval **********
2025-05-01 12:07:07,256-
2025-05-01 12:07:07,353-Overall Performance:
2025-05-01 12:07:07,354-	 NDCG@10: 0.53511
2025-05-01 12:07:07,354-	 HR@10: 0.64130
2025-05-01 12:07:22,456-
----------------------------------
2025-05-01 12:07:22,456-********** Epoch: 12 eval **********
2025-05-01 12:07:24,020-
2025-05-01 12:07:24,119-Overall Performance:
2025-05-01 12:07:24,119-	 NDCG@10: 0.53663
2025-05-01 12:07:24,119-	 HR@10: 0.63844
2025-05-01 12:07:43,629-
----------------------------------
2025-05-01 12:07:43,630-********** Epoch: 13 eval **********
2025-05-01 12:07:44,903-
2025-05-01 12:07:44,999-Overall Performance:
2025-05-01 12:07:44,999-	 NDCG@10: 0.53249
2025-05-01 12:07:45,000-	 HR@10: 0.63294
2025-05-01 12:07:59,942-
----------------------------------
2025-05-01 12:07:59,942-********** Epoch: 14 eval **********
2025-05-01 12:08:01,417-
2025-05-01 12:08:01,513-Overall Performance:
2025-05-01 12:08:01,514-	 NDCG@10: 0.53662
2025-05-01 12:08:01,514-	 HR@10: 0.63987
2025-05-01 12:08:18,465-
----------------------------------
2025-05-01 12:08:18,465-********** Epoch: 15 eval **********
2025-05-01 12:08:19,906-
2025-05-01 12:08:20,002-Overall Performance:
2025-05-01 12:08:20,003-	 NDCG@10: 0.53561
2025-05-01 12:08:20,003-	 HR@10: 0.63690
2025-05-01 12:08:47,195-
----------------------------------
2025-05-01 12:08:47,195-********** Epoch: 16 eval **********
2025-05-01 12:08:48,482-
2025-05-01 12:08:48,578-Overall Performance:
2025-05-01 12:08:48,578-	 NDCG@10: 0.53694
2025-05-01 12:08:48,579-	 HR@10: 0.63954
2025-05-01 12:09:29,440-
----------------------------------
2025-05-01 12:09:29,440-********** Epoch: 17 eval **********
2025-05-01 12:09:31,034-
2025-05-01 12:09:31,130-Overall Performance:
2025-05-01 12:09:31,131-	 NDCG@10: 0.54293
2025-05-01 12:09:31,131-	 HR@10: 0.63910
2025-05-01 12:10:11,871-
----------------------------------
2025-05-01 12:10:11,872-********** Epoch: 18 eval **********
2025-05-01 12:10:13,206-
2025-05-01 12:10:13,305-Overall Performance:
2025-05-01 12:10:13,305-	 NDCG@10: 0.54311
2025-05-01 12:10:13,306-	 HR@10: 0.63734
2025-05-01 12:10:54,133-
----------------------------------
2025-05-01 12:10:54,133-********** Epoch: 19 eval **********
2025-05-01 12:10:55,709-
2025-05-01 12:10:55,805-Overall Performance:
2025-05-01 12:10:55,806-	 NDCG@10: 0.54483
2025-05-01 12:10:55,806-	 HR@10: 0.63602
2025-05-01 12:11:36,693-
----------------------------------
2025-05-01 12:11:36,693-********** Epoch: 20 eval **********
2025-05-01 12:11:38,043-
2025-05-01 12:11:38,139-Overall Performance:
2025-05-01 12:11:38,140-	 NDCG@10: 0.54187
2025-05-01 12:11:38,140-	 HR@10: 0.63382
2025-05-01 12:12:19,049-
----------------------------------
2025-05-01 12:12:19,050-********** Epoch: 21 eval **********
2025-05-01 12:12:20,580-
2025-05-01 12:12:20,676-Overall Performance:
2025-05-01 12:12:20,677-	 NDCG@10: 0.54218
2025-05-01 12:12:20,677-	 HR@10: 0.63382
2025-05-01 12:13:01,621-
----------------------------------
2025-05-01 12:13:01,622-********** Epoch: 22 eval **********
2025-05-01 12:13:03,023-
2025-05-01 12:13:03,120-Overall Performance:
2025-05-01 12:13:03,120-	 NDCG@10: 0.54339
2025-05-01 12:13:03,121-	 HR@10: 0.63767
2025-05-01 12:13:44,050-
----------------------------------
2025-05-01 12:13:44,050-********** Epoch: 23 eval **********
2025-05-01 12:13:45,546-
2025-05-01 12:13:45,643-Overall Performance:
2025-05-01 12:13:45,643-	 NDCG@10: 0.54454
2025-05-01 12:13:45,644-	 HR@10: 0.63800
2025-05-01 12:14:26,657-
----------------------------------
2025-05-01 12:14:26,658-********** Epoch: 24 eval **********
2025-05-01 12:14:28,089-
2025-05-01 12:14:28,185-Overall Performance:
2025-05-01 12:14:28,185-	 NDCG@10: 0.53753
2025-05-01 12:14:28,185-	 HR@10: 0.62745
2025-05-01 12:15:09,159-
----------------------------------
2025-05-01 12:15:09,160-********** Epoch: 25 eval **********
2025-05-01 12:15:10,574-
2025-05-01 12:15:10,671-Overall Performance:
2025-05-01 12:15:10,671-	 NDCG@10: 0.53921
2025-05-01 12:15:10,672-	 HR@10: 0.63382
2025-05-01 12:15:51,526-
----------------------------------
2025-05-01 12:15:51,526-********** Epoch: 26 eval **********
2025-05-01 12:15:52,863-
2025-05-01 12:15:52,960-Overall Performance:
2025-05-01 12:15:52,960-	 NDCG@10: 0.54055
2025-05-01 12:15:52,960-	 HR@10: 0.63470
2025-05-01 12:16:33,710-
----------------------------------
2025-05-01 12:16:33,710-********** Epoch: 27 eval **********
2025-05-01 12:16:35,214-
2025-05-01 12:16:35,310-Overall Performance:
2025-05-01 12:16:35,311-	 NDCG@10: 0.53813
2025-05-01 12:16:35,311-	 HR@10: 0.63064
2025-05-01 12:17:16,133-
----------------------------------
2025-05-01 12:17:16,134-********** Epoch: 28 eval **********
2025-05-01 12:17:17,598-
2025-05-01 12:17:17,693-Overall Performance:
2025-05-01 12:17:17,694-	 NDCG@10: 0.53916
2025-05-01 12:17:17,694-	 HR@10: 0.63086
2025-05-01 12:17:58,429-
----------------------------------
2025-05-01 12:17:58,429-********** Epoch: 29 eval **********
2025-05-01 12:18:00,027-
2025-05-01 12:18:00,122-Overall Performance:
2025-05-01 12:18:00,123-	 NDCG@10: 0.53941
2025-05-01 12:18:00,123-	 HR@10: 0.63393
2025-05-01 12:18:00,123-
2025-05-01 12:18:00,123-The best epoch is 19
2025-05-01 12:18:00,123-The best results are NDCG@10: 0.54483, HR@10: 0.63602
2025-05-01 12:18:00,123-
----------------------------------------------------------------
2025-05-01 12:18:00,123-********** Running test **********
2025-05-01 12:18:01,848-
2025-05-01 12:18:01,982-Overall Performance:
2025-05-01 12:18:01,982-	 NDCG@10: 0.46658
2025-05-01 12:18:01,983-	 HR@10: 0.55872
2025-05-01 12:18:01,983-User Group Performance:
2025-05-01 12:18:01,983-	 Short NDCG@10: 0.36244
2025-05-01 12:18:01,983-	 Short HR@10: 0.47459
2025-05-01 12:18:01,983-	 Long NDCG@10: 0.60166
2025-05-01 12:18:01,983-	 Long HR@10: 0.66785
2025-05-01 12:18:01,983-Item Group Performance:
2025-05-01 12:18:01,983-	 Tail NDCG@10: 0.03968
2025-05-01 12:18:01,983-	 Tail HR@10: 0.09070
2025-05-01 12:18:01,983-	 Popular NDCG@10: 0.63652
2025-05-01 12:18:01,983-	 Popular HR@10: 0.74504
